orcaLog in

Runs · run 1026

load_day 2023-04-24, attempt 1 succeeded

Host
caf251265124:300108
Started
2026-11-07T19:07:32Z
Ended
2026-11-07T19:10:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1026/load_day/2023-04-24/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:07:32Z [load_day 2023-04-24] attempt 1 started
2026-11-07T19:07:34Z [load_day 2023-04-24] 2023-04-24: 2 hours in flight, about 1200 MB
2026-11-07T19:07:46Z [load_day 2023-04-24] 2023-04-24 hour 0: 132833 events in 3 files, snapshot 3490117030469717298 (task 9292 ms: download 2429 ms overlapping gunzip 515 ms, parse 2346 ms, sort 71 ms, write 5076 ms, index 453 ms: 5 candidates, 69313 repo-hours, 905 releases; waiting 526 ms; commit 1611 ms)
2026-11-07T19:07:49Z [load_day 2023-04-24] 2023-04-24 hour 1: 161369 events in 4 files, snapshot 6314833210902286846 (task 12186 ms: download 5300 ms overlapping gunzip 761 ms, parse 3297 ms, sort 209 ms, write 6606 ms, index 533 ms: 4 candidates, 85635 repo-hours, 701 releases; waiting 507 ms; commit 1562 ms)
2026-11-07T19:07:57Z [load_day 2023-04-24] 2023-04-24 hour 2: 138433 events in 3 files, snapshot 3001889323819875306 (task 10793 ms: download 4978 ms overlapping gunzip 688 ms, parse 2811 ms, sort 84 ms, write 5963 ms, index 394 ms: 3 candidates, 63056 repo-hours, 689 releases; waiting 536 ms; commit 1638 ms)
2026-11-07T19:08:00Z [load_day 2023-04-24] 2023-04-24 hour 3: 133121 events in 3 files, snapshot 5267851741250775793 (task 10694 ms: download 5168 ms overlapping gunzip 693 ms, parse 2863 ms, sort 80 ms, write 5664 ms, index 369 ms: 4 candidates, 57378 repo-hours, 778 releases; waiting 680 ms; commit 1720 ms)
2026-11-07T19:08:09Z [load_day 2023-04-24] 2023-04-24 hour 4: 129446 events in 3 files, snapshot 7959604576990462917 (task 10930 ms: download 5351 ms overlapping gunzip 677 ms, parse 2799 ms, sort 83 ms, write 5716 ms, index 339 ms: 1 candidates, 53431 repo-hours, 654 releases; waiting 877 ms; commit 1741 ms)
2026-11-07T19:08:14Z [load_day 2023-04-24] 2023-04-24 hour 5: 145597 events in 3 files, snapshot 2935639011534896926 (task 12752 ms: download 6091 ms overlapping gunzip 820 ms, parse 3360 ms, sort 94 ms, write 6752 ms, index 409 ms: 0 candidates, 61692 repo-hours, 730 releases; waiting 987 ms; commit 1492 ms)
2026-11-07T19:08:24Z [load_day 2023-04-24] 2023-04-24 hour 6: 164021 events in 4 files, snapshot 1126890802136100736 (task 14353 ms: download 8963 ms overlapping gunzip 873 ms, parse 3559 ms, sort 109 ms, write 7803 ms, index 516 ms: 7 candidates, 76245 repo-hours, 895 releases; waiting 1179 ms; commit 1522 ms)
2026-11-07T19:08:28Z [load_day 2023-04-24] 2023-04-24 hour 7: 150131 events in 4 files, snapshot 5210197418713379779 (task 13317 ms: download 5926 ms overlapping gunzip 825 ms, parse 3432 ms, sort 109 ms, write 7535 ms, index 528 ms: 3 candidates, 70515 repo-hours, 781 releases; waiting 519 ms; commit 1672 ms)
2026-11-07T19:08:40Z [load_day 2023-04-24] 2023-04-24 hour 8: 164360 events in 4 files, snapshot 5773077780072793540 (task 15216 ms: download 9609 ms overlapping gunzip 916 ms, parse 3895 ms, sort 95 ms, write 8554 ms, index 516 ms: 5 candidates, 79729 repo-hours, 933 releases; waiting 893 ms; commit 1600 ms)
2026-11-07T19:08:45Z [load_day 2023-04-24] 2023-04-24 hour 9: 176059 events in 4 files, snapshot 5348616352703893076 (task 16397 ms: download 9580 ms overlapping gunzip 1011 ms, parse 4259 ms, sort 116 ms, write 9074 ms, index 526 ms: 2 candidates, 81149 repo-hours, 1072 releases; waiting 627 ms; commit 1786 ms)
2026-11-07T19:09:00Z [load_day 2023-04-24] 2023-04-24 hour 10: 180003 events in 4 files, snapshot 6000837537951244699 (task 16022 ms: download 9560 ms overlapping gunzip 982 ms, parse 4198 ms, sort 112 ms, write 9350 ms, index 530 ms: 2 candidates, 79548 repo-hours, 954 releases; waiting 547 ms; commit 4996 ms)
2026-11-07T19:09:02Z [load_day 2023-04-24] 2023-04-24 hour 11: 175652 events in 4 files, snapshot 5367506066719822511 (task 15711 ms: download 9465 ms overlapping gunzip 985 ms, parse 4065 ms, sort 107 ms, write 9174 ms, index 576 ms: 5 candidates, 78137 repo-hours, 1023 releases; waiting 525 ms; commit 1617 ms)
2026-11-07T19:09:15Z [load_day 2023-04-24] 2023-04-24 hour 12: 210771 events in 5 files, snapshot 140355023831916097 (task 17138 ms: download 9631 ms overlapping gunzip 1038 ms, parse 4432 ms, sort 115 ms, write 9603 ms, index 698 ms: 7 candidates, 105020 repo-hours, 1029 releases; waiting 969 ms; commit 1503 ms)
2026-11-07T19:09:23Z [load_day 2023-04-24] 2023-04-24 hour 13: 187558 events in 4 files, snapshot 147852903419025451 (task 20616 ms: download 12844 ms overlapping gunzip 1006 ms, parse 4421 ms, sort 137 ms, write 9796 ms, index 664 ms: 5 candidates, 96910 repo-hours, 997 releases; waiting 4296 ms; commit 1522 ms)
2026-11-07T19:09:33Z [load_day 2023-04-24] 2023-04-24 hour 14: 195913 events in 4 files, snapshot 3252663170262335754 (task 17704 ms: download 10159 ms overlapping gunzip 1054 ms, parse 4589 ms, sort 129 ms, write 10415 ms, index 663 ms: 3 candidates, 96234 repo-hours, 1122 releases; waiting 586 ms; commit 1535 ms)
2026-11-07T19:09:40Z [load_day 2023-04-24] 2023-04-24 hour 15: 172476 events in 4 files, snapshot 3310747258620464596 (task 15707 ms: download 9236 ms overlapping gunzip 926 ms, parse 3927 ms, sort 105 ms, write 9312 ms, index 569 ms: 3 candidates, 87310 repo-hours, 1093 releases; waiting 613 ms; commit 1824 ms)
2026-11-07T19:09:50Z [load_day 2023-04-24] 2023-04-24 hour 16: 179500 events in 4 files, snapshot 7686609782530990310 (task 15974 ms: download 9089 ms overlapping gunzip 957 ms, parse 4158 ms, sort 108 ms, write 9246 ms, index 855 ms: 6 candidates, 85210 repo-hours, 956 releases; waiting 400 ms; commit 1629 ms)
2026-11-07T19:09:57Z [load_day 2023-04-24] 2023-04-24 hour 17: 189046 events in 4 files, snapshot 8033496211151515749 (task 17101 ms: download 10051 ms overlapping gunzip 1005 ms, parse 4329 ms, sort 112 ms, write 9553 ms, index 571 ms: 5 candidates, 85051 repo-hours, 830 releases; waiting 1192 ms; commit 1570 ms)
2026-11-07T19:10:08Z [load_day 2023-04-24] 2023-04-24 hour 18: 189222 events in 4 files, snapshot 4344082750238298748 (task 17276 ms: download 10037 ms overlapping gunzip 1072 ms, parse 4525 ms, sort 127 ms, write 9888 ms, index 629 ms: 5 candidates, 86787 repo-hours, 1022 releases; waiting 701 ms; commit 1764 ms)
2026-11-07T19:10:14Z [load_day 2023-04-24] 2023-04-24 hour 19: 179338 events in 4 files, snapshot 7306792900547887412 (task 15919 ms: download 9483 ms overlapping gunzip 971 ms, parse 4151 ms, sort 109 ms, write 9350 ms, index 504 ms: 9 candidates, 77433 repo-hours, 1027 releases; waiting 517 ms; commit 1425 ms)
2026-11-07T19:10:24Z [load_day 2023-04-24] 2023-04-24 hour 20: 176873 events in 4 files, snapshot 5714972619367913280 (task 15502 ms: download 9286 ms overlapping gunzip 991 ms, parse 4200 ms, sort 109 ms, write 8822 ms, index 535 ms: 5 candidates, 76846 repo-hours, 920 releases; waiting 512 ms; commit 1528 ms)
2026-11-07T19:10:30Z [load_day 2023-04-24] 2023-04-24 hour 21: 168985 events in 4 files, snapshot 4607429287896803865 (task 14934 ms: download 9088 ms overlapping gunzip 940 ms, parse 3999 ms, sort 111 ms, write 8384 ms, index 597 ms: 6 candidates, 68304 repo-hours, 942 releases; waiting 583 ms; commit 1609 ms)
2026-11-07T19:10:38Z [load_day 2023-04-24] 2023-04-24 hour 22: 146477 events in 3 files, snapshot 1050858748254909762 (task 12774 ms: download 5871 ms overlapping gunzip 765 ms, parse 3268 ms, sort 97 ms, write 6959 ms, index 392 ms: 4 candidates, 61857 repo-hours, 807 releases; waiting 911 ms; commit 1610 ms)
2026-11-07T19:10:43Z [load_day 2023-04-24] 2023-04-24 hour 23: 140596 events in 3 files, snapshot 3913504930122924616 (task 12268 ms: download 5747 ms overlapping gunzip 793 ms, parse 3383 ms, sort 99 ms, write 6704 ms, index 376 ms: 0 candidates, 59392 repo-hours, 690 releases; waiting 610 ms; commit 1488 ms)
2026-11-07T19:10:51Z [load_day 2023-04-24] 2023-04-24: repo_hour merged from 24 files to 1 (1842182 rows, 7899 ms)
2026-11-07T19:10:54Z [load_day 2023-04-24] 2023-04-24: index committed in 10519 ms (22 + 1 + 24 files)
2026-11-07T19:10:54Z [load_day 2023-04-24] 2023-04-24: 3987780 events in 24 hours
2026-11-07T19:10:54Z [load_day 2023-04-24] attempt 1 succeeded