orcaLog in

Runs · run 5018

load_day 2026-03-09, attempt 1 succeeded

Host
73ccef5e07c2:453221
Started
2026-11-08T15:32:00Z
Ended
2026-11-08T15:33:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
729 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.4 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5018/load_day/2026-03-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:32:00Z [load_day 2026-03-09] attempt 1 started
2026-11-08T15:32:01Z [load_day 2026-03-09] 2026-03-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:32:05Z [load_day 2026-03-09] 2026-03-09 hour 0: 148849 events in 0 files, snapshot none (task 3404 ms: download 2077 ms overlapping gunzip 513 ms, parse 1564 ms, sort 0 ms, write 0 ms, index 512 ms: 6 candidates, 70548 repo-hours, 1032 releases; waiting 523 ms; commit 0 ms)
2026-11-08T15:32:05Z [load_day 2026-03-09] 2026-03-09 hour 1: 157575 events in 0 files, snapshot none (task 3568 ms: download 2304 ms overlapping gunzip 428 ms, parse 1260 ms, sort 0 ms, write 0 ms, index 679 ms: 5 candidates, 92875 repo-hours, 504 releases; waiting 856 ms; commit 0 ms)
2026-11-08T15:32:09Z [load_day 2026-03-09] 2026-03-09 hour 2: 159279 events in 0 files, snapshot none (task 3233 ms: download 1889 ms overlapping gunzip 382 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 758 ms: 6 candidates, 90492 repo-hours, 573 releases; waiting 549 ms; commit 0 ms)
2026-11-08T15:32:10Z [load_day 2026-03-09] 2026-03-09 hour 3: 153430 events in 0 files, snapshot none (task 3633 ms: download 2421 ms overlapping gunzip 512 ms, parse 1478 ms, sort 0 ms, write 0 ms, index 558 ms: 5 candidates, 71756 repo-hours, 901 releases; waiting 694 ms; commit 0 ms)
2026-11-08T15:32:13Z [load_day 2026-03-09] 2026-03-09 hour 4: 153727 events in 0 files, snapshot none (task 3479 ms: download 2090 ms overlapping gunzip 450 ms, parse 1317 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 77309 repo-hours, 768 releases; waiting 771 ms; commit 0 ms)
2026-11-08T15:32:13Z [load_day 2026-03-09] 2026-03-09 hour 5: 152623 events in 0 files, snapshot none (task 3345 ms: download 2166 ms overlapping gunzip 454 ms, parse 1274 ms, sort 0 ms, write 0 ms, index 581 ms: 11 candidates, 78309 repo-hours, 754 releases; waiting 759 ms; commit 0 ms)
2026-11-08T15:32:17Z [load_day 2026-03-09] 2026-03-09 hour 6: 156613 events in 0 files, snapshot none (task 3842 ms: download 2520 ms overlapping gunzip 425 ms, parse 1330 ms, sort 0 ms, write 0 ms, index 612 ms: 5 candidates, 82960 repo-hours, 582 releases; waiting 937 ms; commit 0 ms)
2026-11-08T15:32:18Z [load_day 2026-03-09] 2026-03-09 hour 7: 153633 events in 0 files, snapshot none (task 3520 ms: download 2026 ms overlapping gunzip 418 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 82965 repo-hours, 653 releases; waiting 736 ms; commit 0 ms)
2026-11-08T15:32:21Z [load_day 2026-03-09] 2026-03-09 hour 8: 157006 events in 0 files, snapshot none (task 3488 ms: download 2009 ms overlapping gunzip 415 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 816 ms: 13 candidates, 87596 repo-hours, 513 releases; waiting 534 ms; commit 0 ms)
2026-11-08T15:32:22Z [load_day 2026-03-09] 2026-03-09 hour 9: 152230 events in 0 files, snapshot none (task 3849 ms: download 2473 ms overlapping gunzip 467 ms, parse 1246 ms, sort 0 ms, write 0 ms, index 701 ms: 7 candidates, 87700 repo-hours, 350 releases; waiting 1114 ms; commit 0 ms)
2026-11-08T15:32:26Z [load_day 2026-03-09] 2026-03-09 hour 10: 156283 events in 0 files, snapshot none (task 3680 ms: download 2043 ms overlapping gunzip 376 ms, parse 1145 ms, sort 0 ms, write 0 ms, index 1100 ms: 9 candidates, 88803 repo-hours, 387 releases; waiting 736 ms; commit 0 ms)
2026-11-08T15:32:26Z [load_day 2026-03-09] 2026-03-09 hour 11: 157794 events in 0 files, snapshot none (task 3978 ms: download 2227 ms overlapping gunzip 469 ms, parse 1331 ms, sort 0 ms, write 0 ms, index 672 ms: 10 candidates, 88315 repo-hours, 367 releases; waiting 696 ms; commit 0 ms)
2026-11-08T15:32:29Z [load_day 2026-03-09] 2026-03-09 hour 12: 157883 events in 0 files, snapshot none (task 3384 ms: download 1974 ms overlapping gunzip 338 ms, parse 979 ms, sort 0 ms, write 0 ms, index 836 ms: 6 candidates, 94995 repo-hours, 275 releases; waiting 905 ms; commit 0 ms)
2026-11-08T15:32:30Z [load_day 2026-03-09] 2026-03-09 hour 13: 165898 events in 0 files, snapshot none (task 3559 ms: download 2015 ms overlapping gunzip 285 ms, parse 1056 ms, sort 0 ms, write 0 ms, index 793 ms: 15 candidates, 102943 repo-hours, 101 releases; waiting 1005 ms; commit 0 ms)
2026-11-08T15:32:33Z [load_day 2026-03-09] 2026-03-09 hour 14: 156925 events in 0 files, snapshot none (task 3299 ms: download 1833 ms overlapping gunzip 268 ms, parse 918 ms, sort 0 ms, write 0 ms, index 855 ms: 8 candidates, 93546 repo-hours, 153 releases; waiting 827 ms; commit 0 ms)
2026-11-08T15:32:35Z [load_day 2026-03-09] 2026-03-09 hour 15: 150443 events in 0 files, snapshot none (task 3756 ms: download 2292 ms overlapping gunzip 344 ms, parse 1021 ms, sort 0 ms, write 0 ms, index 840 ms: 10 candidates, 88845 repo-hours, 243 releases; waiting 985 ms; commit 0 ms)
2026-11-08T15:32:37Z [load_day 2026-03-09] 2026-03-09 hour 16: 156676 events in 0 files, snapshot none (task 3163 ms: download 1567 ms overlapping gunzip 256 ms, parse 838 ms, sort 0 ms, write 0 ms, index 1015 ms: 9 candidates, 90943 repo-hours, 121 releases; waiting 650 ms; commit 0 ms)
2026-11-08T15:32:38Z [load_day 2026-03-09] 2026-03-09 hour 17: 150564 events in 0 files, snapshot none (task 3041 ms: download 1654 ms overlapping gunzip 332 ms, parse 1020 ms, sort 0 ms, write 0 ms, index 779 ms: 10 candidates, 85655 repo-hours, 199 releases; waiting 612 ms; commit 0 ms)
2026-11-08T15:32:41Z [load_day 2026-03-09] 2026-03-09 hour 18: 158004 events in 0 files, snapshot none (task 3075 ms: download 1782 ms overlapping gunzip 314 ms, parse 966 ms, sort 0 ms, write 0 ms, index 706 ms: 11 candidates, 90156 repo-hours, 261 releases; waiting 785 ms; commit 0 ms)
2026-11-08T15:32:41Z [load_day 2026-03-09] 2026-03-09 hour 19: 160604 events in 0 files, snapshot none (task 2529 ms: download 1005 ms overlapping gunzip 307 ms, parse 988 ms, sort 0 ms, write 0 ms, index 701 ms: 8 candidates, 89105 repo-hours, 305 releases; waiting 201 ms; commit 0 ms)
2026-11-08T15:32:45Z [load_day 2026-03-09] 2026-03-09 hour 20: 160054 events in 0 files, snapshot none (task 3505 ms: download 2125 ms overlapping gunzip 354 ms, parse 1043 ms, sort 0 ms, write 0 ms, index 880 ms: 8 candidates, 86190 repo-hours, 415 releases; waiting 889 ms; commit 0 ms)
2026-11-08T15:32:46Z [load_day 2026-03-09] 2026-03-09 hour 21: 156281 events in 0 files, snapshot none (task 3697 ms: download 2071 ms overlapping gunzip 396 ms, parse 1202 ms, sort 0 ms, write 0 ms, index 1014 ms: 7 candidates, 82857 repo-hours, 590 releases; waiting 707 ms; commit 0 ms)
2026-11-08T15:32:50Z [load_day 2026-03-09] 2026-03-09 hour 22: 156378 events in 0 files, snapshot none (task 4205 ms: download 2606 ms overlapping gunzip 567 ms, parse 1599 ms, sort 0 ms, write 0 ms, index 693 ms: 8 candidates, 82446 repo-hours, 642 releases; waiting 999 ms; commit 0 ms)
2026-11-08T15:32:50Z [load_day 2026-03-09] 2026-03-09 hour 23: 152458 events in 0 files, snapshot none (task 4067 ms: download 2385 ms overlapping gunzip 596 ms, parse 1810 ms, sort 0 ms, write 0 ms, index 590 ms: 7 candidates, 74033 repo-hours, 920 releases; waiting 759 ms; commit 0 ms)
2026-11-08T15:33:00Z [load_day 2026-03-09] 2026-03-09: repo_hour merged from 24 files to 1 (2061342 rows, 9605 ms)
2026-11-08T15:33:03Z [load_day 2026-03-09] 2026-03-09: index committed in 12861 ms (24 + 1 + 24 files)
2026-11-08T15:33:03Z [load_day 2026-03-09] 2026-03-09: 3741210 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:33:03Z [load_day 2026-03-09] attempt 1 succeeded