orcaLog in

Runs · run 1263

load_day 2023-07-04, attempt 1 succeeded

Host
3c2b29713ce8:88715
Started
2026-11-07T22:38:52Z
Ended
2026-11-07T22:42:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1263/load_day/2023-07-04/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:38:52Z [load_day 2023-07-04] attempt 1 started
2026-11-07T22:38:53Z [load_day 2023-07-04] 2023-07-04: 2 hours in flight, about 1200 MB
2026-11-07T22:39:12Z [load_day 2023-07-04] 2023-07-04 hour 0: 130137 events in 3 files, snapshot 7366017516867569036 (task 13430 ms: download 6451 ms overlapping gunzip 909 ms, parse 4256 ms, sort 115 ms, write 6899 ms, index 432 ms: 3 candidates, 64061 repo-hours, 740 releases; waiting 502 ms; commit 2061 ms)
2026-11-07T22:39:14Z [load_day 2023-07-04] 2023-07-04 hour 1: 143897 events in 3 files, snapshot 228567379346469056 (task 13763 ms: download 5866 ms overlapping gunzip 735 ms, parse 3530 ms, sort 127 ms, write 8047 ms, index 539 ms: 7 candidates, 81796 repo-hours, 727 releases; waiting 473 ms; commit 2535 ms)
2026-11-07T22:39:26Z [load_day 2023-07-04] 2023-07-04 hour 2: 136553 events in 3 files, snapshot 4018508234017557006 (task 12485 ms: download 5562 ms overlapping gunzip 751 ms, parse 3354 ms, sort 81 ms, write 6954 ms, index 497 ms: 6 candidates, 69046 repo-hours, 635 releases; waiting 491 ms; commit 3439 ms)
2026-11-07T22:39:29Z [load_day 2023-07-04] 2023-07-04 hour 3: 121693 events in 3 files, snapshot 6267533072503870733 (task 11646 ms: download 2374 ms overlapping gunzip 709 ms, parse 3076 ms, sort 64 ms, write 6474 ms, index 497 ms: 6 candidates, 55908 repo-hours, 875 releases; waiting 498 ms; commit 2440 ms)
2026-11-07T22:39:37Z [load_day 2023-07-04] 2023-07-04 hour 4: 117967 events in 3 files, snapshot 2907734039850942893 (task 11081 ms: download 2622 ms overlapping gunzip 721 ms, parse 3127 ms, sort 71 ms, write 5971 ms, index 373 ms: 3 candidates, 51368 repo-hours, 580 releases; waiting 517 ms; commit 2188 ms)
2026-11-07T22:39:43Z [load_day 2023-07-04] 2023-07-04 hour 5: 135191 events in 3 files, snapshot 3130493107239026081 (task 12949 ms: download 5309 ms overlapping gunzip 717 ms, parse 3252 ms, sort 78 ms, write 7484 ms, index 602 ms: 6 candidates, 59889 repo-hours, 710 releases; waiting 493 ms; commit 2978 ms)
2026-11-07T22:39:57Z [load_day 2023-07-04] 2023-07-04 hour 6: 162646 events in 4 files, snapshot 652405607701954732 (task 15468 ms: download 5852 ms overlapping gunzip 851 ms, parse 3740 ms, sort 121 ms, write 9660 ms, index 555 ms: 4 candidates, 77300 repo-hours, 917 releases; waiting 263 ms; commit 5432 ms)
2026-11-07T22:40:00Z [load_day 2023-07-04] 2023-07-04 hour 7: 173319 events in 4 files, snapshot 5898529835232586139 (task 16316 ms: download 9880 ms overlapping gunzip 983 ms, parse 4546 ms, sort 121 ms, write 9252 ms, index 529 ms: 9 candidates, 78701 repo-hours, 907 releases; waiting 513 ms; commit 2217 ms)
2026-11-07T22:40:11Z [load_day 2023-07-04] 2023-07-04 hour 8: 172830 events in 4 files, snapshot 8100521146975246899 (task 15832 ms: download 9401 ms overlapping gunzip 935 ms, parse 4128 ms, sort 102 ms, write 9347 ms, index 548 ms: 7 candidates, 81093 repo-hours, 1093 releases; waiting 508 ms; commit 2708 ms)
2026-11-07T22:40:21Z [load_day 2023-07-04] 2023-07-04 hour 9: 184883 events in 4 files, snapshot 8393932239010681529 (task 18855 ms: download 9320 ms overlapping gunzip 1002 ms, parse 4476 ms, sort 166 ms, write 11667 ms, index 740 ms: 11 candidates, 83555 repo-hours, 1227 releases; waiting 486 ms; commit 2742 ms)
2026-11-07T22:40:31Z [load_day 2023-07-04] 2023-07-04 hour 10: 182679 events in 4 files, snapshot 8702145916794959411 (task 19529 ms: download 10817 ms overlapping gunzip 1310 ms, parse 5442 ms, sort 120 ms, write 11058 ms, index 845 ms: 7 candidates, 80426 repo-hours, 1070 releases; waiting 479 ms; commit 2293 ms)
2026-11-07T22:40:42Z [load_day 2023-07-04] 2023-07-04 hour 11: 186381 events in 4 files, snapshot 5542358993840895122 (task 19869 ms: download 11011 ms overlapping gunzip 1018 ms, parse 4796 ms, sort 188 ms, write 12235 ms, index 823 ms: 8 candidates, 78632 repo-hours, 978 releases; waiting 479 ms; commit 2542 ms)
2026-11-07T22:40:54Z [load_day 2023-07-04] 2023-07-04 hour 12: 219887 events in 5 files, snapshot 5156034992977134697 (task 21188 ms: download 14010 ms overlapping gunzip 1260 ms, parse 5576 ms, sort 188 ms, write 12426 ms, index 913 ms: 11 candidates, 108992 repo-hours, 1140 releases; waiting 494 ms; commit 2779 ms)
2026-11-07T22:41:03Z [load_day 2023-07-04] 2023-07-04 hour 13: 206551 events in 5 files, snapshot 3424541128459367975 (task 20862 ms: download 10750 ms overlapping gunzip 1178 ms, parse 5313 ms, sort 124 ms, write 12749 ms, index 735 ms: 6 candidates, 104718 repo-hours, 1078 releases; waiting 497 ms; commit 2266 ms)
2026-11-07T22:41:16Z [load_day 2023-07-04] 2023-07-04 hour 14: 197620 events in 4 files, snapshot 3262170080100891170 (task 21585 ms: download 11488 ms overlapping gunzip 1144 ms, parse 5447 ms, sort 220 ms, write 13210 ms, index 647 ms: 10 candidates, 90683 repo-hours, 1199 releases; waiting 533 ms; commit 2467 ms)
2026-11-07T22:41:24Z [load_day 2023-07-04] 2023-07-04 hour 15: 194899 events in 4 files, snapshot 5195002914071446996 (task 19688 ms: download 11105 ms overlapping gunzip 1041 ms, parse 4589 ms, sort 164 ms, write 12375 ms, index 738 ms: 6 candidates, 90356 repo-hours, 1192 releases; waiting 476 ms; commit 2428 ms)
2026-11-07T22:41:36Z [load_day 2023-07-04] 2023-07-04 hour 16: 182173 events in 4 files, snapshot 3494788656290238026 (task 18525 ms: download 9916 ms overlapping gunzip 1112 ms, parse 4738 ms, sort 147 ms, write 10950 ms, index 780 ms: 5 candidates, 81747 repo-hours, 1043 releases; waiting 499 ms; commit 2283 ms)
2026-11-07T22:41:43Z [load_day 2023-07-04] 2023-07-04 hour 17: 169186 events in 4 files, snapshot 2210601181744471285 (task 16843 ms: download 6790 ms overlapping gunzip 872 ms, parse 3701 ms, sort 114 ms, write 10845 ms, index 559 ms: 6 candidates, 73162 repo-hours, 907 releases; waiting 506 ms; commit 2397 ms)
2026-11-07T22:41:54Z [load_day 2023-07-04] 2023-07-04 hour 18: 170617 events in 4 files, snapshot 8439408264129120022 (task 15358 ms: download 5740 ms overlapping gunzip 913 ms, parse 4242 ms, sort 143 ms, write 8997 ms, index 575 ms: 7 candidates, 75966 repo-hours, 1047 releases; waiting 207 ms; commit 4511 ms)
2026-11-07T22:41:58Z [load_day 2023-07-04] 2023-07-04 hour 19: 153628 events in 4 files, snapshot 3742076053874555825 (task 14760 ms: download 5370 ms overlapping gunzip 712 ms, parse 3320 ms, sort 146 ms, write 9149 ms, index 601 ms: 7 candidates, 65660 repo-hours, 842 releases; waiting 520 ms; commit 2372 ms)
2026-11-07T22:42:07Z [load_day 2023-07-04] 2023-07-04 hour 20: 142278 events in 3 files, snapshot 6102932621491948017 (task 14344 ms: download 5977 ms overlapping gunzip 839 ms, parse 3774 ms, sort 149 ms, write 8335 ms, index 474 ms: 8 candidates, 62551 repo-hours, 814 releases; waiting 505 ms; commit 2701 ms)
2026-11-07T22:42:11Z [load_day 2023-07-04] 2023-07-04 hour 21: 131395 events in 3 files, snapshot 6633196417086766191 (task 12341 ms: download 5216 ms overlapping gunzip 739 ms, parse 3302 ms, sort 78 ms, write 6861 ms, index 581 ms: 4 candidates, 54727 repo-hours, 911 releases; waiting 465 ms; commit 2622 ms)
2026-11-07T22:42:19Z [load_day 2023-07-04] 2023-07-04 hour 22: 119735 events in 3 files, snapshot 2354913944084328975 (task 10707 ms: download 2150 ms overlapping gunzip 678 ms, parse 2699 ms, sort 76 ms, write 6064 ms, index 424 ms: 4 candidates, 48571 repo-hours, 749 releases; waiting 484 ms; commit 2506 ms)
2026-11-07T22:42:22Z [load_day 2023-07-04] 2023-07-04 hour 23: 108878 events in 3 files, snapshot 4948389872496390065 (task 9518 ms: download 2246 ms overlapping gunzip 565 ms, parse 2449 ms, sort 73 ms, write 5169 ms, index 433 ms: 3 candidates, 45731 repo-hours, 583 releases; waiting 531 ms; commit 2104 ms)
2026-11-07T22:42:29Z [load_day 2023-07-04] 2023-07-04: repo_hour merged from 24 files to 1 (1764639 rows, 7644 ms)
2026-11-07T22:42:32Z [load_day 2023-07-04] 2023-07-04: index committed in 9871 ms (24 + 1 + 24 files)
2026-11-07T22:42:32Z [load_day 2023-07-04] 2023-07-04: 3845023 events in 24 hours
2026-11-07T22:42:32Z [load_day 2023-07-04] attempt 1 succeeded