orcaLog in

Runs · run 1421

load_day 2023-08-23, attempt 1 succeeded

Host
3c2b29713ce8:255035
Started
2026-11-08T00:09:04Z
Ended
2026-11-08T00:13:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1421/load_day/2023-08-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:09:04Z [load_day 2023-08-23] attempt 1 started
2026-11-08T00:09:06Z [load_day 2023-08-23] 2023-08-23: 2 hours in flight, about 1200 MB
2026-11-08T00:09:26Z [load_day 2023-08-23] 2023-08-23 hour 0: 160895 events in 4 files, snapshot 3945525805845012737 (task 15758 ms: download 6568 ms overlapping gunzip 927 ms, parse 4379 ms, sort 202 ms, write 8808 ms, index 580 ms: 6 candidates, 89161 repo-hours, 934 releases; waiting 523 ms; commit 2356 ms)
2026-11-08T00:09:29Z [load_day 2023-08-23] 2023-08-23 hour 1: 152509 events in 4 files, snapshot 4711541515889211546 (task 15100 ms: download 6047 ms overlapping gunzip 782 ms, parse 3818 ms, sort 133 ms, write 8836 ms, index 795 ms: 4 candidates, 84276 repo-hours, 753 releases; waiting 456 ms; commit 2860 ms)
2026-11-08T00:09:40Z [load_day 2023-08-23] 2023-08-23 hour 2: 134318 events in 3 files, snapshot 2582979425015240446 (task 12412 ms: download 5198 ms overlapping gunzip 640 ms, parse 2865 ms, sort 86 ms, write 7488 ms, index 528 ms: 1 candidates, 60393 repo-hours, 651 releases; waiting 506 ms; commit 3701 ms)
2026-11-08T00:09:43Z [load_day 2023-08-23] 2023-08-23 hour 3: 132718 events in 3 files, snapshot 2164243430912780852 (task 11627 ms: download 4606 ms overlapping gunzip 639 ms, parse 2791 ms, sort 104 ms, write 6434 ms, index 869 ms: 1 candidates, 56212 repo-hours, 781 releases; waiting 511 ms; commit 2193 ms)
2026-11-08T00:09:53Z [load_day 2023-08-23] 2023-08-23 hour 4: 129262 events in 3 files, snapshot 8912305377744064516 (task 12055 ms: download 5098 ms overlapping gunzip 690 ms, parse 3101 ms, sort 93 ms, write 7019 ms, index 370 ms: 0 candidates, 53026 repo-hours, 552 releases; waiting 458 ms; commit 2780 ms)
2026-11-08T00:10:00Z [load_day 2023-08-23] 2023-08-23 hour 5: 139218 events in 3 files, snapshot 9110872581789416240 (task 13070 ms: download 5250 ms overlapping gunzip 645 ms, parse 2895 ms, sort 141 ms, write 7954 ms, index 569 ms: 4 candidates, 59985 repo-hours, 842 releases; waiting 522 ms; commit 4774 ms)
2026-11-08T00:10:10Z [load_day 2023-08-23] 2023-08-23 hour 6: 166933 events in 4 files, snapshot 5139397629127462075 (task 17084 ms: download 7001 ms overlapping gunzip 994 ms, parse 4616 ms, sort 147 ms, write 9906 ms, index 565 ms: 5 candidates, 76294 repo-hours, 957 releases; waiting 508 ms; commit 2203 ms)
2026-11-08T00:10:14Z [load_day 2023-08-23] 2023-08-23 hour 7: 162074 events in 4 files, snapshot 7828030703237770268 (task 16212 ms: download 7755 ms overlapping gunzip 995 ms, parse 4651 ms, sort 145 ms, write 9090 ms, index 532 ms: 2 candidates, 72771 repo-hours, 865 releases; waiting 476 ms; commit 2194 ms)
2026-11-08T00:10:28Z [load_day 2023-08-23] 2023-08-23 hour 8: 178881 events in 4 files, snapshot 6005939600846148545 (task 16367 ms: download 8697 ms overlapping gunzip 887 ms, parse 3937 ms, sort 101 ms, write 10349 ms, index 511 ms: 7 candidates, 81379 repo-hours, 1139 releases; waiting 370 ms; commit 2165 ms)
2026-11-08T00:10:32Z [load_day 2023-08-23] 2023-08-23 hour 9: 176262 events in 4 files, snapshot 7426510261917060489 (task 15199 ms: download 9002 ms overlapping gunzip 919 ms, parse 3888 ms, sort 105 ms, write 8705 ms, index 676 ms: 5 candidates, 83078 repo-hours, 1023 releases; waiting 564 ms; commit 3221 ms)
2026-11-08T00:10:49Z [load_day 2023-08-23] 2023-08-23 hour 10: 170395 events in 4 files, snapshot 8479366736886274323 (task 18149 ms: download 10817 ms overlapping gunzip 957 ms, parse 4386 ms, sort 96 ms, write 11375 ms, index 535 ms: 5 candidates, 76334 repo-hours, 1013 releases; waiting 509 ms; commit 4721 ms)
2026-11-08T00:10:52Z [load_day 2023-08-23] 2023-08-23 hour 11: 178654 events in 4 files, snapshot 2757323204443237607 (task 19577 ms: download 11848 ms overlapping gunzip 1115 ms, parse 5102 ms, sort 165 ms, write 11415 ms, index 1020 ms: 3 candidates, 78282 repo-hours, 994 releases; waiting 470 ms; commit 3115 ms)
2026-11-08T00:11:08Z [load_day 2023-08-23] 2023-08-23 hour 12: 206100 events in 5 files, snapshot 5072605701496619085 (task 19793 ms: download 11157 ms overlapping gunzip 1055 ms, parse 5188 ms, sort 158 ms, write 11871 ms, index 738 ms: 4 candidates, 103552 repo-hours, 985 releases; waiting 498 ms; commit 2680 ms)
2026-11-08T00:11:14Z [load_day 2023-08-23] 2023-08-23 hour 13: 193234 events in 4 files, snapshot 2027444971348952222 (task 21092 ms: download 11146 ms overlapping gunzip 1050 ms, parse 4968 ms, sort 128 ms, write 13291 ms, index 824 ms: 3 candidates, 97826 repo-hours, 1135 releases; waiting 489 ms; commit 2789 ms)
2026-11-08T00:11:31Z [load_day 2023-08-23] 2023-08-23 hour 14: 195555 events in 4 files, snapshot 3824366059884336827 (task 22131 ms: download 13117 ms overlapping gunzip 1175 ms, parse 5408 ms, sort 163 ms, write 13741 ms, index 820 ms: 3 candidates, 89720 repo-hours, 1128 releases; waiting 511 ms; commit 2447 ms)
2026-11-08T00:11:38Z [load_day 2023-08-23] 2023-08-23 hour 15: 169800 events in 4 files, snapshot 8942705178551294872 (task 20464 ms: download 12626 ms overlapping gunzip 1023 ms, parse 4456 ms, sort 138 ms, write 13157 ms, index 822 ms: 4 candidates, 81827 repo-hours, 1023 releases; waiting 516 ms; commit 4640 ms)
2026-11-08T00:11:52Z [load_day 2023-08-23] 2023-08-23 hour 16: 171598 events in 4 files, snapshot 7965759523045429586 (task 19387 ms: download 11311 ms overlapping gunzip 1297 ms, parse 5550 ms, sort 143 ms, write 11056 ms, index 555 ms: 6 candidates, 80817 repo-hours, 1067 releases; waiting 508 ms; commit 2782 ms)
2026-11-08T00:11:59Z [load_day 2023-08-23] 2023-08-23 hour 17: 182377 events in 4 files, snapshot 6838293040675660611 (task 19561 ms: download 11110 ms overlapping gunzip 918 ms, parse 4367 ms, sort 130 ms, write 12902 ms, index 662 ms: 6 candidates, 78851 repo-hours, 899 releases; waiting 211 ms; commit 5279 ms)
2026-11-08T00:12:15Z [load_day 2023-08-23] 2023-08-23 hour 18: 181510 events in 4 files, snapshot 3372558010664786597 (task 20571 ms: download 11243 ms overlapping gunzip 1133 ms, parse 5167 ms, sort 221 ms, write 11926 ms, index 1300 ms: 5 candidates, 81878 repo-hours, 1009 releases; waiting 517 ms; commit 3835 ms)
2026-11-08T00:12:19Z [load_day 2023-08-23] 2023-08-23 hour 19: 168872 events in 4 files, snapshot 6368592045640140439 (task 18351 ms: download 11567 ms overlapping gunzip 1016 ms, parse 4458 ms, sort 106 ms, write 11327 ms, index 600 ms: 9 candidates, 72078 repo-hours, 1018 releases; waiting 553 ms; commit 3907 ms)
2026-11-08T00:12:34Z [load_day 2023-08-23] 2023-08-23 hour 20: 163118 events in 4 files, snapshot 6921462336719100927 (task 17288 ms: download 10400 ms overlapping gunzip 996 ms, parse 4445 ms, sort 106 ms, write 10437 ms, index 509 ms: 4 candidates, 71448 repo-hours, 1170 releases; waiting 489 ms; commit 2871 ms)
2026-11-08T00:12:37Z [load_day 2023-08-23] 2023-08-23 hour 21: 159344 events in 4 files, snapshot 4300326446221461350 (task 19086 ms: download 12283 ms overlapping gunzip 1353 ms, parse 5789 ms, sort 114 ms, write 10571 ms, index 488 ms: 6 candidates, 65590 repo-hours, 919 releases; waiting 475 ms; commit 2514 ms)
2026-11-08T00:12:50Z [load_day 2023-08-23] 2023-08-23 hour 22: 141728 events in 3 files, snapshot 8763216084909232497 (task 15152 ms: download 6307 ms overlapping gunzip 813 ms, parse 3499 ms, sort 114 ms, write 9249 ms, index 644 ms: 3 candidates, 58407 repo-hours, 806 releases; waiting 534 ms; commit 2649 ms)
2026-11-08T00:12:52Z [load_day 2023-08-23] 2023-08-23 hour 23: 132835 events in 3 files, snapshot 4098686462216799639 (task 13205 ms: download 5994 ms overlapping gunzip 744 ms, parse 3092 ms, sort 100 ms, write 8013 ms, index 454 ms: 3 candidates, 56002 repo-hours, 623 releases; waiting 485 ms; commit 1950 ms)
2026-11-08T00:13:00Z [load_day 2023-08-23] 2023-08-23: repo_hour merged from 24 files to 1 (1809187 rows, 7922 ms)
2026-11-08T00:13:02Z [load_day 2023-08-23] 2023-08-23: index committed in 9982 ms (23 + 1 + 24 files)
2026-11-08T00:13:02Z [load_day 2023-08-23] 2023-08-23: 3948190 events in 24 hours
2026-11-08T00:13:02Z [load_day 2023-08-23] attempt 1 succeeded