orcaLog in

Runs · run 1449

load_day 2023-08-31, attempt 1 succeeded

Host
3c2b29713ce8:281565
Started
2026-11-08T00:23:31Z
Ended
2026-11-08T00:27:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1449/load_day/2023-08-31/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:23:31Z [load_day 2023-08-31] attempt 1 started
2026-11-08T00:23:32Z [load_day 2023-08-31] 2023-08-31: 2 hours in flight, about 1200 MB
2026-11-08T00:23:52Z [load_day 2023-08-31] 2023-08-31 hour 0: 166504 events in 4 files, snapshot 812683107683640746 (task 16600 ms: download 7131 ms overlapping gunzip 940 ms, parse 4711 ms, sort 222 ms, write 9412 ms, index 639 ms: 12 candidates, 87081 repo-hours, 1006 releases; waiting 465 ms; commit 2322 ms)
2026-11-08T00:23:57Z [load_day 2023-08-31] 2023-08-31 hour 1: 162033 events in 4 files, snapshot 7488796051327859617 (task 16608 ms: download 6631 ms overlapping gunzip 958 ms, parse 4202 ms, sort 161 ms, write 10030 ms, index 585 ms: 6 candidates, 87220 repo-hours, 757 releases; waiting 350 ms; commit 4561 ms)
2026-11-08T00:24:08Z [load_day 2023-08-31] 2023-08-31 hour 2: 141859 events in 3 files, snapshot 8685234713999395305 (task 14551 ms: download 6433 ms overlapping gunzip 966 ms, parse 4132 ms, sort 82 ms, write 8091 ms, index 448 ms: 5 candidates, 60833 repo-hours, 760 releases; waiting 533 ms; commit 2442 ms)
2026-11-08T00:24:11Z [load_day 2023-08-31] 2023-08-31 hour 3: 135201 events in 3 files, snapshot 2897964170639042865 (task 12540 ms: download 5193 ms overlapping gunzip 781 ms, parse 3401 ms, sort 106 ms, write 6883 ms, index 538 ms: 3 candidates, 57029 repo-hours, 901 releases; waiting 502 ms; commit 2361 ms)
2026-11-08T00:24:21Z [load_day 2023-08-31] 2023-08-31 hour 4: 127485 events in 3 files, snapshot 24061184902721542 (task 11782 ms: download 4710 ms overlapping gunzip 608 ms, parse 2709 ms, sort 79 ms, write 7163 ms, index 393 ms: 3 candidates, 52070 repo-hours, 655 releases; waiting 505 ms; commit 2821 ms)
2026-11-08T00:24:27Z [load_day 2023-08-31] 2023-08-31 hour 5: 138367 events in 3 files, snapshot 1997897935809100547 (task 14572 ms: download 5635 ms overlapping gunzip 726 ms, parse 3158 ms, sort 84 ms, write 9187 ms, index 536 ms: 3 candidates, 58090 repo-hours, 764 releases; waiting 495 ms; commit 2645 ms)
2026-11-08T00:24:40Z [load_day 2023-08-31] 2023-08-31 hour 6: 163009 events in 4 files, snapshot 1027019070467353041 (task 17949 ms: download 7503 ms overlapping gunzip 1124 ms, parse 5126 ms, sort 106 ms, write 10207 ms, index 581 ms: 5 candidates, 75131 repo-hours, 1050 releases; waiting 478 ms; commit 2898 ms)
2026-11-08T00:24:46Z [load_day 2023-08-31] 2023-08-31 hour 7: 161132 events in 4 files, snapshot 7186883077071119276 (task 18104 ms: download 7564 ms overlapping gunzip 1052 ms, parse 4775 ms, sort 154 ms, write 10553 ms, index 770 ms: 5 candidates, 72618 repo-hours, 983 releases; waiting 470 ms; commit 2848 ms)
2026-11-08T00:25:03Z [load_day 2023-08-31] 2023-08-31 hour 8: 175983 events in 4 files, snapshot 1508116347705476664 (task 20032 ms: download 11772 ms overlapping gunzip 1165 ms, parse 5098 ms, sort 114 ms, write 12102 ms, index 815 ms: 5 candidates, 79262 repo-hours, 1098 releases; waiting 516 ms; commit 3949 ms)
2026-11-08T00:25:08Z [load_day 2023-08-31] 2023-08-31 hour 9: 184596 events in 4 files, snapshot 7647394021224134104 (task 20526 ms: download 11674 ms overlapping gunzip 1226 ms, parse 5362 ms, sort 135 ms, write 12421 ms, index 590 ms: 7 candidates, 80824 repo-hours, 1214 releases; waiting 519 ms; commit 2862 ms)
2026-11-08T00:25:20Z [load_day 2023-08-31] 2023-08-31 hour 10: 176334 events in 4 files, snapshot 6380509857611799319 (task 18130 ms: download 11591 ms overlapping gunzip 1224 ms, parse 5358 ms, sort 165 ms, write 10071 ms, index 526 ms: 6 candidates, 76802 repo-hours, 977 releases; waiting 451 ms; commit 2482 ms)
2026-11-08T00:25:25Z [load_day 2023-08-31] 2023-08-31 hour 11: 180963 events in 4 files, snapshot 8908352709888073336 (task 16366 ms: download 9636 ms overlapping gunzip 968 ms, parse 4412 ms, sort 120 ms, write 9637 ms, index 506 ms: 3 candidates, 77016 repo-hours, 1199 releases; waiting 505 ms; commit 2297 ms)
2026-11-08T00:25:39Z [load_day 2023-08-31] 2023-08-31 hour 12: 214525 events in 5 files, snapshot 9190083889980479866 (task 17763 ms: download 8007 ms overlapping gunzip 949 ms, parse 4262 ms, sort 139 ms, write 10959 ms, index 830 ms: 8 candidates, 105212 repo-hours, 982 releases; waiting 348 ms; commit 2908 ms)
2026-11-08T00:25:46Z [load_day 2023-08-31] 2023-08-31 hour 13: 202208 events in 5 files, snapshot 4516640281562396308 (task 20434 ms: download 9834 ms overlapping gunzip 1245 ms, parse 5457 ms, sort 252 ms, write 11828 ms, index 848 ms: 6 candidates, 100743 repo-hours, 1119 releases; waiting 506 ms; commit 2518 ms)
2026-11-08T00:26:01Z [load_day 2023-08-31] 2023-08-31 hour 14: 189228 events in 4 files, snapshot 1033060405464828208 (task 21061 ms: download 11335 ms overlapping gunzip 1175 ms, parse 5125 ms, sort 125 ms, write 13215 ms, index 723 ms: 4 candidates, 86570 repo-hours, 1162 releases; waiting 484 ms; commit 2689 ms)
2026-11-08T00:26:08Z [load_day 2023-08-31] 2023-08-31 hour 15: 177376 events in 4 files, snapshot 599368429406921293 (task 18549 ms: download 10661 ms overlapping gunzip 1014 ms, parse 4496 ms, sort 109 ms, write 11461 ms, index 630 ms: 5 candidates, 82578 repo-hours, 1073 releases; waiting 517 ms; commit 4836 ms)
2026-11-08T00:26:22Z [load_day 2023-08-31] 2023-08-31 hour 16: 170912 events in 4 files, snapshot 2601413432757918571 (task 19547 ms: download 11952 ms overlapping gunzip 1209 ms, parse 5420 ms, sort 167 ms, write 11279 ms, index 657 ms: 10 candidates, 78836 repo-hours, 950 releases; waiting 493 ms; commit 2984 ms)
2026-11-08T00:26:27Z [load_day 2023-08-31] 2023-08-31 hour 17: 177368 events in 4 files, snapshot 2171124101644860182 (task 19847 ms: download 11715 ms overlapping gunzip 1023 ms, parse 4601 ms, sort 133 ms, write 12319 ms, index 981 ms: 6 candidates, 76940 repo-hours, 925 releases; waiting 507 ms; commit 2795 ms)
2026-11-08T00:26:42Z [load_day 2023-08-31] 2023-08-31 hour 18: 181214 events in 4 files, snapshot 3905610819053900758 (task 18803 ms: download 11107 ms overlapping gunzip 1050 ms, parse 4702 ms, sort 114 ms, write 11408 ms, index 842 ms: 7 candidates, 83330 repo-hours, 1038 releases; waiting 487 ms; commit 2522 ms)
2026-11-08T00:26:47Z [load_day 2023-08-31] 2023-08-31 hour 19: 167941 events in 4 files, snapshot 220423923937877616 (task 18421 ms: download 10657 ms overlapping gunzip 965 ms, parse 4367 ms, sort 192 ms, write 10843 ms, index 1250 ms: 9 candidates, 70116 repo-hours, 1007 releases; waiting 474 ms; commit 2666 ms)
2026-11-08T00:27:01Z [load_day 2023-08-31] 2023-08-31 hour 20: 167646 events in 4 files, snapshot 9004588516213940622 (task 17483 ms: download 7341 ms overlapping gunzip 964 ms, parse 4318 ms, sort 110 ms, write 10808 ms, index 488 ms: 7 candidates, 70233 repo-hours, 972 releases; waiting 526 ms; commit 2880 ms)
2026-11-08T00:27:03Z [load_day 2023-08-31] 2023-08-31 hour 21: 156015 events in 4 files, snapshot 211302170528605331 (task 15420 ms: download 6396 ms overlapping gunzip 825 ms, parse 3677 ms, sort 115 ms, write 9287 ms, index 694 ms: 6 candidates, 61745 repo-hours, 984 releases; waiting 545 ms; commit 2298 ms)
2026-11-08T00:27:16Z [load_day 2023-08-31] 2023-08-31 hour 22: 141105 events in 3 files, snapshot 8885869717535881749 (task 14364 ms: download 6099 ms overlapping gunzip 999 ms, parse 4237 ms, sort 111 ms, write 8197 ms, index 379 ms: 4 candidates, 55558 repo-hours, 846 releases; waiting 205 ms; commit 2254 ms)
2026-11-08T00:27:18Z [load_day 2023-08-31] 2023-08-31 hour 23: 130420 events in 3 files, snapshot 7733603636870893954 (task 13633 ms: download 6477 ms overlapping gunzip 714 ms, parse 3243 ms, sort 112 ms, write 8449 ms, index 352 ms: 5 candidates, 52528 repo-hours, 748 releases; waiting 464 ms; commit 1993 ms)
2026-11-08T00:27:26Z [load_day 2023-08-31] 2023-08-31: repo_hour merged from 24 files to 1 (1788365 rows, 8309 ms)
2026-11-08T00:27:28Z [load_day 2023-08-31] 2023-08-31: index committed in 10332 ms (24 + 1 + 24 files)
2026-11-08T00:27:28Z [load_day 2023-08-31] 2023-08-31: 3989424 events in 24 hours
2026-11-08T00:27:28Z [load_day 2023-08-31] attempt 1 succeeded