orcaLog in

Runs · run 1008

load_day 2023-04-18, attempt 1 succeeded

Host
caf251265124:280098
Started
2026-11-07T18:49:49Z
Ended
2026-11-07T18:53:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1008/load_day/2023-04-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:49:49Z [load_day 2023-04-18] attempt 1 started
2026-11-07T18:49:51Z [load_day 2023-04-18] 2023-04-18: 2 hours in flight, about 1200 MB
2026-11-07T18:50:05Z [load_day 2023-04-18] 2023-04-18 hour 0: 163261 events in 4 files, snapshot 6265752333167430204 (task 12000 ms: download 5312 ms overlapping gunzip 717 ms, parse 3235 ms, sort 105 ms, write 6623 ms, index 518 ms: 7 candidates, 81449 repo-hours, 896 releases; waiting 528 ms; commit 1571 ms)
2026-11-07T18:50:07Z [load_day 2023-04-18] 2023-04-18 hour 1: 173479 events in 4 files, snapshot 2595954976593157407 (task 12004 ms: download 4677 ms overlapping gunzip 696 ms, parse 3099 ms, sort 103 ms, write 6705 ms, index 585 ms: 6 candidates, 93461 repo-hours, 790 releases; waiting 524 ms; commit 1463 ms)
2026-11-07T18:50:18Z [load_day 2023-04-18] 2023-04-18 hour 2: 154143 events in 4 files, snapshot 3395597869433862860 (task 12110 ms: download 5573 ms overlapping gunzip 708 ms, parse 2983 ms, sort 110 ms, write 6374 ms, index 453 ms: 3 candidates, 69251 repo-hours, 696 releases; waiting 1201 ms; commit 1567 ms)
2026-11-07T18:50:20Z [load_day 2023-04-18] 2023-04-18 hour 3: 147514 events in 3 files, snapshot 8445609872925974768 (task 10838 ms: download 4412 ms overlapping gunzip 671 ms, parse 2958 ms, sort 100 ms, write 5825 ms, index 481 ms: 6 candidates, 65659 repo-hours, 816 releases; waiting 506 ms; commit 1600 ms)
2026-11-07T18:50:30Z [load_day 2023-04-18] 2023-04-18 hour 4: 136514 events in 3 files, snapshot 8196057567149345873 (task 10603 ms: download 4768 ms overlapping gunzip 596 ms, parse 2578 ms, sort 74 ms, write 5768 ms, index 384 ms: 0 candidates, 59747 repo-hours, 621 releases; waiting 892 ms; commit 1667 ms)
2026-11-07T18:50:32Z [load_day 2023-04-18] 2023-04-18 hour 5: 149109 events in 3 files, snapshot 1744921447989758586 (task 11364 ms: download 4844 ms overlapping gunzip 676 ms, parse 2916 ms, sort 86 ms, write 6049 ms, index 450 ms: 5 candidates, 65252 repo-hours, 787 releases; waiting 806 ms; commit 1549 ms)
2026-11-07T18:50:44Z [load_day 2023-04-18] 2023-04-18 hour 6: 175256 events in 4 files, snapshot 3445061659409358079 (task 13535 ms: download 7806 ms overlapping gunzip 800 ms, parse 3444 ms, sort 100 ms, write 7751 ms, index 515 ms: 6 candidates, 80530 repo-hours, 967 releases; waiting 599 ms; commit 1506 ms)
2026-11-07T18:50:47Z [load_day 2023-04-18] 2023-04-18 hour 7: 170506 events in 4 files, snapshot 245854100814149954 (task 14728 ms: download 8842 ms overlapping gunzip 867 ms, parse 3864 ms, sort 107 ms, write 8259 ms, index 555 ms: 7 candidates, 79421 repo-hours, 907 releases; waiting 749 ms; commit 1654 ms)
2026-11-07T18:51:02Z [load_day 2023-04-18] 2023-04-18 hour 8: 198074 events in 4 files, snapshot 3699034180110791370 (task 16732 ms: download 9330 ms overlapping gunzip 993 ms, parse 4354 ms, sort 137 ms, write 9610 ms, index 619 ms: 7 candidates, 88979 repo-hours, 1075 releases; waiting 695 ms; commit 1835 ms)
2026-11-07T18:51:06Z [load_day 2023-04-18] 2023-04-18 hour 9: 187931 events in 4 files, snapshot 1257650561758918660 (task 17739 ms: download 10489 ms overlapping gunzip 994 ms, parse 4273 ms, sort 126 ms, write 9335 ms, index 571 ms: 10 candidates, 86162 repo-hours, 1123 releases; waiting 2153 ms; commit 1673 ms)
2026-11-07T18:51:19Z [load_day 2023-04-18] 2023-04-18 hour 10: 191553 events in 4 files, snapshot 2669682899844688415 (task 16212 ms: download 9161 ms overlapping gunzip 966 ms, parse 4185 ms, sort 125 ms, write 9146 ms, index 550 ms: 7 candidates, 85702 repo-hours, 1076 releases; waiting 842 ms; commit 1970 ms)
2026-11-07T18:51:24Z [load_day 2023-04-18] 2023-04-18 hour 11: 195461 events in 4 files, snapshot 8279968443493006418 (task 16875 ms: download 9571 ms overlapping gunzip 995 ms, parse 4305 ms, sort 132 ms, write 9391 ms, index 589 ms: 5 candidates, 86073 repo-hours, 1135 releases; waiting 1182 ms; commit 1791 ms)
2026-11-07T18:51:37Z [load_day 2023-04-18] 2023-04-18 hour 12: 239237 events in 5 files, snapshot 9197726938585836538 (task 18150 ms: download 11418 ms overlapping gunzip 1073 ms, parse 4734 ms, sort 131 ms, write 10578 ms, index 782 ms: 10 candidates, 116184 repo-hours, 1190 releases; waiting 608 ms; commit 1789 ms)
2026-11-07T18:51:43Z [load_day 2023-04-18] 2023-04-18 hour 13: 223309 events in 5 files, snapshot 4287497484491318508 (task 18390 ms: download 11950 ms overlapping gunzip 1092 ms, parse 4805 ms, sort 129 ms, write 10593 ms, index 750 ms: 5 candidates, 111090 repo-hours, 1118 releases; waiting 749 ms; commit 1570 ms)
2026-11-07T18:51:52Z [load_day 2023-04-18] 2023-04-18 hour 14: 153404 events in 4 files, snapshot 6506856412034616824 (task 13924 ms: download 5716 ms overlapping gunzip 841 ms, parse 3607 ms, sort 87 ms, write 8354 ms, index 507 ms: 7 candidates, 77562 repo-hours, 846 releases; waiting 235 ms; commit 1458 ms)
2026-11-07T18:52:00Z [load_day 2023-04-18] 2023-04-18 hour 15: 198814 events in 4 files, snapshot 2836018888066509326 (task 16604 ms: download 9150 ms overlapping gunzip 984 ms, parse 4268 ms, sort 124 ms, write 9682 ms, index 655 ms: 6 candidates, 95270 repo-hours, 1206 releases; waiting 548 ms; commit 1631 ms)
2026-11-07T18:52:10Z [load_day 2023-04-18] 2023-04-18 hour 16: 203268 events in 5 files, snapshot 1143697093236885620 (task 17152 ms: download 9380 ms overlapping gunzip 1052 ms, parse 4512 ms, sort 131 ms, write 9912 ms, index 603 ms: 11 candidates, 91798 repo-hours, 1137 releases; waiting 606 ms; commit 1865 ms)
2026-11-07T18:52:18Z [load_day 2023-04-18] 2023-04-18 hour 17: 192994 events in 4 files, snapshot 2590636571695770540 (task 16815 ms: download 9509 ms overlapping gunzip 964 ms, parse 4221 ms, sort 123 ms, write 9524 ms, index 580 ms: 7 candidates, 84599 repo-hours, 974 releases; waiting 1100 ms; commit 1457 ms)
2026-11-07T18:52:27Z [load_day 2023-04-18] 2023-04-18 hour 18: 199055 events in 4 files, snapshot 3786220610929285324 (task 16103 ms: download 8482 ms overlapping gunzip 943 ms, parse 4216 ms, sort 125 ms, write 9359 ms, index 656 ms: 8 candidates, 87930 repo-hours, 1022 releases; waiting 457 ms; commit 1699 ms)
2026-11-07T18:52:34Z [load_day 2023-04-18] 2023-04-18 hour 19: 185450 events in 4 files, snapshot 8604876339526011163 (task 15066 ms: download 8364 ms overlapping gunzip 905 ms, parse 3999 ms, sort 121 ms, write 8641 ms, index 523 ms: 3 candidates, 78387 repo-hours, 1018 releases; waiting 531 ms; commit 1391 ms)
2026-11-07T18:52:43Z [load_day 2023-04-18] 2023-04-18 hour 20: 185340 events in 4 files, snapshot 3195562598875358798 (task 14982 ms: download 8436 ms overlapping gunzip 906 ms, parse 3976 ms, sort 122 ms, write 8559 ms, index 538 ms: 6 candidates, 77250 repo-hours, 1065 releases; waiting 517 ms; commit 1626 ms)
2026-11-07T18:52:46Z [load_day 2023-04-18] 2023-04-18 hour 21: 141582 events in 3 files, snapshot 7742541640403928132 (task 11273 ms: download 4599 ms overlapping gunzip 643 ms, parse 2872 ms, sort 94 ms, write 6354 ms, index 462 ms: 5 candidates, 61966 repo-hours, 812 releases; waiting 507 ms; commit 1602 ms)
2026-11-07T18:52:53Z [load_day 2023-04-18] 2023-04-18 hour 22: 107083 events in 3 files, snapshot 1383816390156680011 (task 9617 ms: download 4572 ms overlapping gunzip 600 ms, parse 2469 ms, sort 74 ms, write 5160 ms, index 331 ms: 11 candidates, 48935 repo-hours, 501 releases; waiting 721 ms; commit 1835 ms)
2026-11-07T18:52:55Z [load_day 2023-04-18] 2023-04-18 hour 23: 96000 events in 2 files, snapshot 8159708248353570002 (task 7628 ms: download 3018 ms overlapping gunzip 414 ms, parse 1858 ms, sort 67 ms, write 4081 ms, index 342 ms: 4 candidates, 41430 repo-hours, 499 releases; waiting 529 ms; commit 1588 ms)
2026-11-07T18:53:03Z [load_day 2023-04-18] 2023-04-18: repo_hour merged from 24 files to 1 (1914087 rows, 8201 ms)
2026-11-07T18:53:05Z [load_day 2023-04-18] 2023-04-18: index committed in 10385 ms (23 + 1 + 24 files)
2026-11-07T18:53:05Z [load_day 2023-04-18] 2023-04-18: 4168337 events in 24 hours
2026-11-07T18:53:05Z [load_day 2023-04-18] attempt 1 succeeded