orcaLog in

Runs · run 4654

load_day 2025-11-26, attempt 1 succeeded

Host
73ccef5e07c2:409362
Started
2026-11-08T14:35:14Z
Ended
2026-11-08T14:36:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
723 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.4 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4654/load_day/2025-11-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:35:14Z [load_day 2025-11-26] attempt 1 started
2026-11-08T14:35:15Z [load_day 2025-11-26] 2025-11-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:35:19Z [load_day 2025-11-26] 2025-11-26 hour 0: 147269 events in 0 files, snapshot none (task 3262 ms: download 2177 ms overlapping gunzip 369 ms, parse 1189 ms, sort 0 ms, write 0 ms, index 566 ms: 9 candidates, 74768 repo-hours, 819 releases; waiting 859 ms; commit 0 ms)
2026-11-08T14:35:19Z [load_day 2025-11-26] 2025-11-26 hour 1: 154633 events in 0 files, snapshot none (task 3010 ms: download 1649 ms overlapping gunzip 343 ms, parse 1123 ms, sort 0 ms, write 0 ms, index 673 ms: 6 candidates, 89989 repo-hours, 637 releases; waiting 478 ms; commit 0 ms)
2026-11-08T14:35:23Z [load_day 2025-11-26] 2025-11-26 hour 2: 146059 events in 0 files, snapshot none (task 3036 ms: download 1926 ms overlapping gunzip 399 ms, parse 1223 ms, sort 0 ms, write 0 ms, index 529 ms: 4 candidates, 71632 repo-hours, 659 releases; waiting 590 ms; commit 0 ms)
2026-11-08T14:35:23Z [load_day 2025-11-26] 2025-11-26 hour 3: 146944 events in 0 files, snapshot none (task 3085 ms: download 1926 ms overlapping gunzip 385 ms, parse 1197 ms, sort 0 ms, write 0 ms, index 561 ms: 8 candidates, 72474 repo-hours, 1522 releases; waiting 656 ms; commit 0 ms)
2026-11-08T14:35:26Z [load_day 2025-11-26] 2025-11-26 hour 4: 147099 events in 0 files, snapshot none (task 3181 ms: download 2107 ms overlapping gunzip 331 ms, parse 1074 ms, sort 0 ms, write 0 ms, index 595 ms: 8 candidates, 68751 repo-hours, 531 releases; waiting 891 ms; commit 0 ms)
2026-11-08T14:35:27Z [load_day 2025-11-26] 2025-11-26 hour 5: 146446 events in 0 files, snapshot none (task 3417 ms: download 2075 ms overlapping gunzip 375 ms, parse 1203 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 67692 repo-hours, 566 releases; waiting 754 ms; commit 0 ms)
2026-11-08T14:35:30Z [load_day 2025-11-26] 2025-11-26 hour 6: 152108 events in 0 files, snapshot none (task 3256 ms: download 2260 ms overlapping gunzip 394 ms, parse 1221 ms, sort 0 ms, write 0 ms, index 611 ms: 6 candidates, 77021 repo-hours, 682 releases; waiting 766 ms; commit 0 ms)
2026-11-08T14:35:30Z [load_day 2025-11-26] 2025-11-26 hour 7: 149911 events in 0 files, snapshot none (task 3184 ms: download 1992 ms overlapping gunzip 379 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 75074 repo-hours, 555 releases; waiting 660 ms; commit 0 ms)
2026-11-08T14:35:34Z [load_day 2025-11-26] 2025-11-26 hour 8: 150046 events in 0 files, snapshot none (task 3747 ms: download 2437 ms overlapping gunzip 465 ms, parse 1322 ms, sort 0 ms, write 0 ms, index 991 ms: 8 candidates, 77977 repo-hours, 600 releases; waiting 755 ms; commit 0 ms)
2026-11-08T14:35:35Z [load_day 2025-11-26] 2025-11-26 hour 9: 149644 events in 0 files, snapshot none (task 4029 ms: download 2403 ms overlapping gunzip 537 ms, parse 1654 ms, sort 0 ms, write 0 ms, index 768 ms: 4 candidates, 77636 repo-hours, 631 releases; waiting 807 ms; commit 0 ms)
2026-11-08T14:35:39Z [load_day 2025-11-26] 2025-11-26 hour 10: 146274 events in 0 files, snapshot none (task 4363 ms: download 3289 ms overlapping gunzip 603 ms, parse 1726 ms, sort 0 ms, write 0 ms, index 645 ms: 6 candidates, 76800 repo-hours, 603 releases; waiting 1157 ms; commit 0 ms)
2026-11-08T14:35:39Z [load_day 2025-11-26] 2025-11-26 hour 11: 148888 events in 0 files, snapshot none (task 3836 ms: download 2431 ms overlapping gunzip 549 ms, parse 1688 ms, sort 0 ms, write 0 ms, index 765 ms: 5 candidates, 75136 repo-hours, 620 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:35:43Z [load_day 2025-11-26] 2025-11-26 hour 12: 155690 events in 0 files, snapshot none (task 3203 ms: download 1553 ms overlapping gunzip 421 ms, parse 1280 ms, sort 0 ms, write 0 ms, index 781 ms: 10 candidates, 94681 repo-hours, 384 releases; waiting 424 ms; commit 0 ms)
2026-11-08T14:35:43Z [load_day 2025-11-26] 2025-11-26 hour 13: 156439 events in 0 files, snapshot none (task 3599 ms: download 1828 ms overlapping gunzip 451 ms, parse 1503 ms, sort 0 ms, write 0 ms, index 728 ms: 6 candidates, 91532 repo-hours, 433 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:35:48Z [load_day 2025-11-26] 2025-11-26 hour 14: 145715 events in 0 files, snapshot none (task 4120 ms: download 2331 ms overlapping gunzip 603 ms, parse 1790 ms, sort 0 ms, write 0 ms, index 817 ms: 8 candidates, 80029 repo-hours, 544 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:35:48Z [load_day 2025-11-26] 2025-11-26 hour 15: 152599 events in 0 files, snapshot none (task 3886 ms: download 2099 ms overlapping gunzip 558 ms, parse 1673 ms, sort 0 ms, write 0 ms, index 1027 ms: 6 candidates, 83229 repo-hours, 518 releases; waiting 289 ms; commit 0 ms)
2026-11-08T14:35:53Z [load_day 2025-11-26] 2025-11-26 hour 16: 152682 events in 0 files, snapshot none (task 4604 ms: download 3091 ms overlapping gunzip 560 ms, parse 1703 ms, sort 0 ms, write 0 ms, index 643 ms: 9 candidates, 82445 repo-hours, 550 releases; waiting 1131 ms; commit 0 ms)
2026-11-08T14:35:53Z [load_day 2025-11-26] 2025-11-26 hour 17: 153049 events in 0 files, snapshot none (task 4101 ms: download 2193 ms overlapping gunzip 554 ms, parse 1765 ms, sort 0 ms, write 0 ms, index 779 ms: 7 candidates, 79538 repo-hours, 521 releases; waiting 734 ms; commit 0 ms)
2026-11-08T14:35:57Z [load_day 2025-11-26] 2025-11-26 hour 18: 155539 events in 0 files, snapshot none (task 3900 ms: download 2257 ms overlapping gunzip 608 ms, parse 1747 ms, sort 0 ms, write 0 ms, index 706 ms: 7 candidates, 83694 repo-hours, 617 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:35:57Z [load_day 2025-11-26] 2025-11-26 hour 19: 147908 events in 0 files, snapshot none (task 3813 ms: download 2570 ms overlapping gunzip 562 ms, parse 1776 ms, sort 0 ms, write 0 ms, index 631 ms: 3 candidates, 71373 repo-hours, 638 releases; waiting 558 ms; commit 0 ms)
2026-11-08T14:36:02Z [load_day 2025-11-26] 2025-11-26 hour 20: 151118 events in 0 files, snapshot none (task 3742 ms: download 2468 ms overlapping gunzip 552 ms, parse 1678 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 71598 repo-hours, 691 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:36:02Z [load_day 2025-11-26] 2025-11-26 hour 21: 150407 events in 0 files, snapshot none (task 3834 ms: download 1765 ms overlapping gunzip 619 ms, parse 1822 ms, sort 0 ms, write 0 ms, index 653 ms: 6 candidates, 70769 repo-hours, 732 releases; waiting 401 ms; commit 0 ms)
2026-11-08T14:36:06Z [load_day 2025-11-26] 2025-11-26 hour 22: 150145 events in 0 files, snapshot none (task 3702 ms: download 2049 ms overlapping gunzip 518 ms, parse 1700 ms, sort 0 ms, write 0 ms, index 564 ms: 4 candidates, 70868 repo-hours, 660 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:36:06Z [load_day 2025-11-26] 2025-11-26 hour 23: 146784 events in 0 files, snapshot none (task 3692 ms: download 2490 ms overlapping gunzip 556 ms, parse 1822 ms, sort 0 ms, write 0 ms, index 537 ms: 9 candidates, 66034 repo-hours, 649 releases; waiting 465 ms; commit 0 ms)
2026-11-08T14:36:14Z [load_day 2025-11-26] 2025-11-26: repo_hour merged from 24 files to 1 (1850740 rows, 8154 ms)
2026-11-08T14:36:17Z [load_day 2025-11-26] 2025-11-26: index committed in 11317 ms (24 + 1 + 24 files)
2026-11-08T14:36:17Z [load_day 2025-11-26] 2025-11-26: 3603396 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:36:17Z [load_day 2025-11-26] attempt 1 succeeded