orcaLog in

Runs · run 912

load_day 2023-03-17, attempt 1 succeeded

Host
caf251265124:172690
Started
2026-11-07T17:14:58Z
Ended
2026-11-07T17:18:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/912/load_day/2023-03-17/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:14:58Z [load_day 2023-03-17] attempt 1 started
2026-11-07T17:14:59Z [load_day 2023-03-17] 2023-03-17: 2 hours in flight, about 1200 MB
2026-11-07T17:15:13Z [load_day 2023-03-17] 2023-03-17 hour 0: 157166 events in 4 files, snapshot 3526524534938936994 (task 11667 ms: download 5141 ms overlapping gunzip 678 ms, parse 3012 ms, sort 101 ms, write 6417 ms, index 478 ms: 5 candidates, 74733 repo-hours, 942 releases; waiting 649 ms; commit 1321 ms)
2026-11-07T17:15:15Z [load_day 2023-03-17] 2023-03-17 hour 1: 176870 events in 4 files, snapshot 1519966232191573729 (task 13365 ms: download 7557 ms overlapping gunzip 854 ms, parse 3641 ms, sort 112 ms, write 7461 ms, index 566 ms: 8 candidates, 86643 repo-hours, 835 releases; waiting 313 ms; commit 1554 ms)
2026-11-07T17:15:27Z [load_day 2023-03-17] 2023-03-17 hour 2: 158465 events in 4 files, snapshot 1892029356110315288 (task 12334 ms: download 5176 ms overlapping gunzip 745 ms, parse 3085 ms, sort 96 ms, write 6695 ms, index 504 ms: 5 candidates, 69432 repo-hours, 784 releases; waiting 650 ms; commit 1742 ms)
2026-11-07T17:15:28Z [load_day 2023-03-17] 2023-03-17 hour 3: 140341 events in 3 files, snapshot 3790365013146978352 (task 10836 ms: download 4710 ms overlapping gunzip 664 ms, parse 2697 ms, sort 76 ms, write 5911 ms, index 420 ms: 4 candidates, 60091 repo-hours, 862 releases; waiting 775 ms; commit 1429 ms)
2026-11-07T17:15:37Z [load_day 2023-03-17] 2023-03-17 hour 4: 127487 events in 3 files, snapshot 5222478315453538996 (task 9831 ms: download 2886 ms overlapping gunzip 587 ms, parse 2476 ms, sort 91 ms, write 5067 ms, index 343 ms: 6 candidates, 52548 repo-hours, 584 releases; waiting 858 ms; commit 1586 ms)
2026-11-07T17:15:42Z [load_day 2023-03-17] 2023-03-17 hour 5: 143248 events in 3 files, snapshot 8724694966545512946 (task 13014 ms: download 6470 ms overlapping gunzip 761 ms, parse 3181 ms, sort 102 ms, write 6359 ms, index 377 ms: 2 candidates, 60309 repo-hours, 739 releases; waiting 1982 ms; commit 1528 ms)
2026-11-07T17:15:50Z [load_day 2023-03-17] 2023-03-17 hour 6: 156382 events in 4 files, snapshot 7212612127973348953 (task 12163 ms: download 5228 ms overlapping gunzip 693 ms, parse 2976 ms, sort 105 ms, write 6649 ms, index 456 ms: 5 candidates, 71115 repo-hours, 945 releases; waiting 883 ms; commit 1719 ms)
2026-11-07T17:15:55Z [load_day 2023-03-17] 2023-03-17 hour 7: 159633 events in 4 files, snapshot 7742529824254577973 (task 12001 ms: download 4818 ms overlapping gunzip 712 ms, parse 3075 ms, sort 83 ms, write 6758 ms, index 483 ms: 8 candidates, 70423 repo-hours, 1190 releases; waiting 541 ms; commit 1415 ms)
2026-11-07T17:16:06Z [load_day 2023-03-17] 2023-03-17 hour 8: 182922 events in 4 files, snapshot 3424113601338490282 (task 14907 ms: download 8732 ms overlapping gunzip 886 ms, parse 3812 ms, sort 110 ms, write 8027 ms, index 564 ms: 7 candidates, 91509 repo-hours, 1286 releases; waiting 999 ms; commit 1716 ms)
2026-11-07T17:16:11Z [load_day 2023-03-17] 2023-03-17 hour 9: 182606 events in 4 files, snapshot 9194371936416884335 (task 15254 ms: download 8743 ms overlapping gunzip 925 ms, parse 4030 ms, sort 105 ms, write 8906 ms, index 529 ms: 5 candidates, 81444 repo-hours, 1515 releases; waiting 476 ms; commit 1469 ms)
2026-11-07T17:16:22Z [load_day 2023-03-17] 2023-03-17 hour 10: 186376 events in 4 files, snapshot 5747572237734008584 (task 15253 ms: download 8589 ms overlapping gunzip 876 ms, parse 3874 ms, sort 120 ms, write 8736 ms, index 598 ms: 5 candidates, 83797 repo-hours, 1348 releases; waiting 741 ms; commit 1887 ms)
2026-11-07T17:16:26Z [load_day 2023-03-17] 2023-03-17 hour 11: 181962 events in 4 files, snapshot 8044550855593395954 (task 14477 ms: download 7975 ms overlapping gunzip 839 ms, parse 3661 ms, sort 126 ms, write 8292 ms, index 599 ms: 2 candidates, 83692 repo-hours, 1359 releases; waiting 609 ms; commit 1651 ms)
2026-11-07T17:16:38Z [load_day 2023-03-17] 2023-03-17 hour 12: 209498 events in 5 files, snapshot 578259973370458838 (task 15084 ms: download 8090 ms overlapping gunzip 882 ms, parse 3880 ms, sort 121 ms, write 8643 ms, index 695 ms: 4 candidates, 106393 repo-hours, 1351 releases; waiting 568 ms; commit 1516 ms)
2026-11-07T17:16:42Z [load_day 2023-03-17] 2023-03-17 hour 13: 189673 events in 4 files, snapshot 3621364853342299211 (task 14563 ms: download 7747 ms overlapping gunzip 856 ms, parse 3754 ms, sort 96 ms, write 8397 ms, index 645 ms: 10 candidates, 94842 repo-hours, 1266 releases; waiting 510 ms; commit 1560 ms)
2026-11-07T17:16:54Z [load_day 2023-03-17] 2023-03-17 hour 14: 186062 events in 4 files, snapshot 4292085677451868845 (task 15348 ms: download 8796 ms overlapping gunzip 893 ms, parse 3910 ms, sort 118 ms, write 9042 ms, index 571 ms: 8 candidates, 89364 repo-hours, 1331 releases; waiting 496 ms; commit 1637 ms)
2026-11-07T17:16:57Z [load_day 2023-03-17] 2023-03-17 hour 15: 181448 events in 4 files, snapshot 8940136562644100833 (task 14555 ms: download 8222 ms overlapping gunzip 809 ms, parse 3533 ms, sort 114 ms, write 8435 ms, index 537 ms: 3 candidates, 90287 repo-hours, 1366 releases; waiting 759 ms; commit 1414 ms)
2026-11-07T17:17:10Z [load_day 2023-03-17] 2023-03-17 hour 16: 183255 events in 4 files, snapshot 8066172325082806872 (task 15971 ms: download 9378 ms overlapping gunzip 900 ms, parse 3958 ms, sort 124 ms, write 8824 ms, index 564 ms: 6 candidates, 84534 repo-hours, 1105 releases; waiting 1250 ms; commit 1440 ms)
2026-11-07T17:17:12Z [load_day 2023-03-17] 2023-03-17 hour 17: 184396 events in 4 files, snapshot 472183395673147266 (task 14722 ms: download 8337 ms overlapping gunzip 861 ms, parse 3789 ms, sort 116 ms, write 8659 ms, index 512 ms: 8 candidates, 78507 repo-hours, 1110 releases; waiting 543 ms; commit 1378 ms)
2026-11-07T17:17:26Z [load_day 2023-03-17] 2023-03-17 hour 18: 179722 events in 4 files, snapshot 3433120752491238093 (task 14072 ms: download 8012 ms overlapping gunzip 843 ms, parse 3708 ms, sort 110 ms, write 7955 ms, index 513 ms: 5 candidates, 78768 repo-hours, 1308 releases; waiting 615 ms; commit 1696 ms)
2026-11-07T17:17:27Z [load_day 2023-03-17] 2023-03-17 hour 19: 165583 events in 4 files, snapshot 6228628876699694843 (task 13423 ms: download 5614 ms overlapping gunzip 769 ms, parse 3409 ms, sort 106 ms, write 7351 ms, index 488 ms: 3 candidates, 68486 repo-hours, 1326 releases; waiting 798 ms; commit 1593 ms)
2026-11-07T17:17:43Z [load_day 2023-03-17] 2023-03-17 hour 20: 166328 events in 4 files, snapshot 4375625186998874629 (task 16987 ms: download 11558 ms overlapping gunzip 840 ms, parse 3653 ms, sort 102 ms, write 7142 ms, index 467 ms: 6 candidates, 69961 repo-hours, 1341 releases; waiting 4387 ms; commit 1508 ms)
2026-11-07T17:17:45Z [load_day 2023-03-17] 2023-03-17 hour 21: 153085 events in 4 files, snapshot 1551669921484664559 (task 13811 ms: download 7139 ms overlapping gunzip 715 ms, parse 3202 ms, sort 100 ms, write 6244 ms, index 432 ms: 8 candidates, 64248 repo-hours, 1307 releases; waiting 2787 ms; commit 1834 ms)
2026-11-07T17:17:55Z [load_day 2023-03-17] 2023-03-17 hour 22: 141400 events in 3 files, snapshot 4081248225779274537 (task 10454 ms: download 4512 ms overlapping gunzip 622 ms, parse 2717 ms, sort 99 ms, write 5796 ms, index 389 ms: 3 candidates, 56038 repo-hours, 1202 releases; waiting 522 ms; commit 1410 ms)
2026-11-07T17:17:56Z [load_day 2023-03-17] 2023-03-17 hour 23: 131870 events in 3 files, snapshot 3708177930038844224 (task 9717 ms: download 4228 ms overlapping gunzip 561 ms, parse 2511 ms, sort 76 ms, write 5214 ms, index 374 ms: 1 candidates, 53298 repo-hours, 1144 releases; waiting 640 ms; commit 1444 ms)
2026-11-07T17:18:04Z [load_day 2023-03-17] 2023-03-17: repo_hour merged from 24 files to 1 (1820462 rows, 7551 ms)
2026-11-07T17:18:06Z [load_day 2023-03-17] 2023-03-17: index committed in 9688 ms (24 + 1 + 24 files)
2026-11-07T17:18:06Z [load_day 2023-03-17] 2023-03-17: 4025778 events in 24 hours
2026-11-07T17:18:06Z [load_day 2023-03-17] attempt 1 succeeded