orcaLog in

Runs · run 4793

load_day 2026-01-06, attempt 1 succeeded

Host
73ccef5e07c2:425766
Started
2026-11-08T14:57:18Z
Ended
2026-11-08T14:58:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
707 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.9 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4793/load_day/2026-01-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:57:18Z [load_day 2026-01-06] attempt 1 started
2026-11-08T14:57:19Z [load_day 2026-01-06] 2026-01-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:57:24Z [load_day 2026-01-06] 2026-01-06 hour 0: 150526 events in 0 files, snapshot none (task 4239 ms: download 2135 ms overlapping gunzip 624 ms, parse 2124 ms, sort 0 ms, write 0 ms, index 729 ms: 9 candidates, 71884 repo-hours, 902 releases; waiting 380 ms; commit 0 ms)
2026-11-08T14:57:24Z [load_day 2026-01-06] 2026-01-06 hour 1: 148080 events in 0 files, snapshot none (task 3885 ms: download 1934 ms overlapping gunzip 566 ms, parse 1750 ms, sort 0 ms, write 0 ms, index 709 ms: 8 candidates, 84957 repo-hours, 661 releases; waiting 521 ms; commit 0 ms)
2026-11-08T14:57:28Z [load_day 2026-01-06] 2026-01-06 hour 2: 148092 events in 0 files, snapshot none (task 3586 ms: download 1684 ms overlapping gunzip 576 ms, parse 1794 ms, sort 0 ms, write 0 ms, index 660 ms: 11 candidates, 74225 repo-hours, 716 releases; waiting 210 ms; commit 0 ms)
2026-11-08T14:57:28Z [load_day 2026-01-06] 2026-01-06 hour 3: 141231 events in 0 files, snapshot none (task 3714 ms: download 2101 ms overlapping gunzip 630 ms, parse 1855 ms, sort 0 ms, write 0 ms, index 589 ms: 9 candidates, 64356 repo-hours, 809 releases; waiting 350 ms; commit 0 ms)
2026-11-08T14:57:32Z [load_day 2026-01-06] 2026-01-06 hour 4: 144742 events in 0 files, snapshot none (task 3567 ms: download 2182 ms overlapping gunzip 475 ms, parse 1527 ms, sort 0 ms, write 0 ms, index 620 ms: 8 candidates, 67378 repo-hours, 1452 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:57:32Z [load_day 2026-01-06] 2026-01-06 hour 5: 140369 events in 0 files, snapshot none (task 3952 ms: download 2537 ms overlapping gunzip 591 ms, parse 1791 ms, sort 0 ms, write 0 ms, index 577 ms: 6 candidates, 64744 repo-hours, 559 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:57:36Z [load_day 2026-01-06] 2026-01-06 hour 6: 146442 events in 0 files, snapshot none (task 4064 ms: download 2516 ms overlapping gunzip 581 ms, parse 1760 ms, sort 0 ms, write 0 ms, index 657 ms: 2 candidates, 73742 repo-hours, 683 releases; waiting 723 ms; commit 0 ms)
2026-11-08T14:57:36Z [load_day 2026-01-06] 2026-01-06 hour 7: 145925 events in 0 files, snapshot none (task 3529 ms: download 1927 ms overlapping gunzip 597 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 696 ms: 7 candidates, 70124 repo-hours, 635 releases; waiting 315 ms; commit 0 ms)
2026-11-08T14:57:41Z [load_day 2026-01-06] 2026-01-06 hour 8: 147063 events in 0 files, snapshot none (task 4401 ms: download 2823 ms overlapping gunzip 672 ms, parse 1890 ms, sort 0 ms, write 0 ms, index 742 ms: 2 candidates, 73599 repo-hours, 699 releases; waiting 800 ms; commit 0 ms)
2026-11-08T14:57:41Z [load_day 2026-01-06] 2026-01-06 hour 9: 147570 events in 0 files, snapshot none (task 4188 ms: download 2719 ms overlapping gunzip 647 ms, parse 1883 ms, sort 0 ms, write 0 ms, index 616 ms: 6 candidates, 75839 repo-hours, 708 releases; waiting 750 ms; commit 0 ms)
2026-11-08T14:57:45Z [load_day 2026-01-06] 2026-01-06 hour 10: 146494 events in 0 files, snapshot none (task 3803 ms: download 2002 ms overlapping gunzip 575 ms, parse 1653 ms, sort 0 ms, write 0 ms, index 952 ms: 6 candidates, 76045 repo-hours, 683 releases; waiting 300 ms; commit 0 ms)
2026-11-08T14:57:46Z [load_day 2026-01-06] 2026-01-06 hour 11: 149995 events in 0 files, snapshot none (task 4098 ms: download 2641 ms overlapping gunzip 660 ms, parse 1954 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 76420 repo-hours, 823 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:57:50Z [load_day 2026-01-06] 2026-01-06 hour 12: 161414 events in 0 files, snapshot none (task 4386 ms: download 2375 ms overlapping gunzip 451 ms, parse 1568 ms, sort 0 ms, write 0 ms, index 1288 ms: 4 candidates, 99953 repo-hours, 532 releases; waiting 739 ms; commit 0 ms)
2026-11-08T14:57:50Z [load_day 2026-01-06] 2026-01-06 hour 13: 157789 events in 0 files, snapshot none (task 4025 ms: download 2181 ms overlapping gunzip 438 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 1111 ms: 6 candidates, 91679 repo-hours, 557 releases; waiting 740 ms; commit 0 ms)
2026-11-08T14:57:55Z [load_day 2026-01-06] 2026-01-06 hour 14: 149567 events in 0 files, snapshot none (task 4613 ms: download 2612 ms overlapping gunzip 674 ms, parse 1931 ms, sort 0 ms, write 0 ms, index 1048 ms: 9 candidates, 81703 repo-hours, 577 releases; waiting 603 ms; commit 0 ms)
2026-11-08T14:57:55Z [load_day 2026-01-06] 2026-01-06 hour 15: 151157 events in 0 files, snapshot none (task 4682 ms: download 2571 ms overlapping gunzip 783 ms, parse 2238 ms, sort 0 ms, write 0 ms, index 799 ms: 6 candidates, 82955 repo-hours, 690 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:58:00Z [load_day 2026-01-06] 2026-01-06 hour 16: 149293 events in 0 files, snapshot none (task 4220 ms: download 2597 ms overlapping gunzip 465 ms, parse 1612 ms, sort 0 ms, write 0 ms, index 903 ms: 3 candidates, 81527 repo-hours, 650 releases; waiting 917 ms; commit 0 ms)
2026-11-08T14:58:00Z [load_day 2026-01-06] 2026-01-06 hour 17: 147881 events in 0 files, snapshot none (task 4086 ms: download 2243 ms overlapping gunzip 614 ms, parse 1616 ms, sort 0 ms, write 0 ms, index 878 ms: 6 candidates, 75586 repo-hours, 698 releases; waiting 692 ms; commit 0 ms)
2026-11-08T14:58:04Z [load_day 2026-01-06] 2026-01-06 hour 18: 150027 events in 0 files, snapshot none (task 3773 ms: download 2585 ms overlapping gunzip 449 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 632 ms: 8 candidates, 82554 repo-hours, 671 releases; waiting 999 ms; commit 0 ms)
2026-11-08T14:58:04Z [load_day 2026-01-06] 2026-01-06 hour 19: 148227 events in 0 files, snapshot none (task 3188 ms: download 2035 ms overlapping gunzip 495 ms, parse 1562 ms, sort 0 ms, write 0 ms, index 605 ms: 9 candidates, 73162 repo-hours, 781 releases; waiting 294 ms; commit 0 ms)
2026-11-08T14:58:08Z [load_day 2026-01-06] 2026-01-06 hour 20: 146127 events in 0 files, snapshot none (task 3018 ms: download 1532 ms overlapping gunzip 414 ms, parse 1223 ms, sort 0 ms, write 0 ms, index 728 ms: 9 candidates, 73345 repo-hours, 844 releases; waiting 330 ms; commit 0 ms)
2026-11-08T14:58:08Z [load_day 2026-01-06] 2026-01-06 hour 21: 147317 events in 0 files, snapshot none (task 3350 ms: download 2117 ms overlapping gunzip 498 ms, parse 1382 ms, sort 0 ms, write 0 ms, index 524 ms: 7 candidates, 69053 repo-hours, 873 releases; waiting 640 ms; commit 0 ms)
2026-11-08T14:58:11Z [load_day 2026-01-06] 2026-01-06 hour 22: 145677 events in 0 files, snapshot none (task 2837 ms: download 1682 ms overlapping gunzip 421 ms, parse 1268 ms, sort 0 ms, write 0 ms, index 558 ms: 10 candidates, 69793 repo-hours, 991 releases; waiting 305 ms; commit 0 ms)
2026-11-08T14:58:12Z [load_day 2026-01-06] 2026-01-06 hour 23: 144501 events in 0 files, snapshot none (task 3307 ms: download 2124 ms overlapping gunzip 413 ms, parse 1328 ms, sort 0 ms, write 0 ms, index 714 ms: 5 candidates, 66891 repo-hours, 878 releases; waiting 567 ms; commit 0 ms)
2026-11-08T14:58:21Z [load_day 2026-01-06] 2026-01-06: repo_hour merged from 24 files to 1 (1821514 rows, 8895 ms)
2026-11-08T14:58:24Z [load_day 2026-01-06] 2026-01-06: index committed in 11783 ms (24 + 1 + 24 files)
2026-11-08T14:58:24Z [load_day 2026-01-06] 2026-01-06: 3555506 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:58:24Z [load_day 2026-01-06] attempt 1 succeeded