orcaLog in

Runs · run 1269

load_day 2023-07-06, attempt 1 succeeded

Host
3c2b29713ce8:95726
Started
2026-11-07T22:42:32Z
Ended
2026-11-07T22:46:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1269/load_day/2023-07-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:42:32Z [load_day 2023-07-06] attempt 1 started
2026-11-07T22:42:33Z [load_day 2023-07-06] 2023-07-06: 2 hours in flight, about 1200 MB
2026-11-07T22:42:54Z [load_day 2023-07-06] 2023-07-06 hour 0: 159623 events in 4 files, snapshot 1623322057201367183 (task 16306 ms: download 7817 ms overlapping gunzip 1050 ms, parse 4943 ms, sort 139 ms, write 8922 ms, index 546 ms: 7 candidates, 74077 repo-hours, 809 releases; waiting 488 ms; commit 3148 ms)
2026-11-07T22:43:06Z [load_day 2023-07-06] 2023-07-06 hour 1: 163859 events in 4 files, snapshot 6840876015107077000 (task 16050 ms: download 7417 ms overlapping gunzip 1025 ms, parse 4843 ms, sort 146 ms, write 8898 ms, index 668 ms: 6 candidates, 90819 repo-hours, 822 releases; waiting 186 ms; commit 12334 ms)
2026-11-07T22:43:10Z [load_day 2023-07-06] 2023-07-06 hour 2: 143971 events in 3 files, snapshot 91321164184444711 (task 15518 ms: download 6041 ms overlapping gunzip 719 ms, parse 3185 ms, sort 90 ms, write 10265 ms, index 544 ms: 5 candidates, 70232 repo-hours, 716 releases; waiting 379 ms; commit 2070 ms)
2026-11-07T22:43:20Z [load_day 2023-07-06] 2023-07-06 hour 3: 130540 events in 3 files, snapshot 1402429154666308611 (task 12698 ms: download 4873 ms overlapping gunzip 754 ms, parse 3387 ms, sort 97 ms, write 7140 ms, index 470 ms: 9 candidates, 59815 repo-hours, 912 releases; waiting 517 ms; commit 2403 ms)
2026-11-07T22:43:23Z [load_day 2023-07-06] 2023-07-06 hour 4: 125219 events in 3 files, snapshot 7516669458102415863 (task 12098 ms: download 4680 ms overlapping gunzip 623 ms, parse 2724 ms, sort 78 ms, write 7250 ms, index 558 ms: 2 candidates, 54141 repo-hours, 546 releases; waiting 499 ms; commit 2655 ms)
2026-11-07T22:43:35Z [load_day 2023-07-06] 2023-07-06 hour 5: 141538 events in 3 files, snapshot 3008574747545023895 (task 14029 ms: download 5798 ms overlapping gunzip 865 ms, parse 3745 ms, sort 101 ms, write 8105 ms, index 682 ms: 9 candidates, 61795 repo-hours, 729 releases; waiting 201 ms; commit 2554 ms)
2026-11-07T22:43:42Z [load_day 2023-07-06] 2023-07-06 hour 6: 165438 events in 4 files, snapshot 8425120288351238790 (task 17371 ms: download 6458 ms overlapping gunzip 973 ms, parse 4338 ms, sort 129 ms, write 10363 ms, index 780 ms: 6 candidates, 78553 repo-hours, 891 releases; waiting 458 ms; commit 2469 ms)
2026-11-07T22:43:55Z [load_day 2023-07-06] 2023-07-06 hour 7: 183355 events in 4 files, snapshot 7484640313471054156 (task 19374 ms: download 12137 ms overlapping gunzip 1064 ms, parse 4716 ms, sort 257 ms, write 12020 ms, index 529 ms: 5 candidates, 84091 repo-hours, 1043 releases; waiting 482 ms; commit 1991 ms)
2026-11-07T22:44:00Z [load_day 2023-07-06] 2023-07-06 hour 8: 186694 events in 4 files, snapshot 854637098290759439 (task 17921 ms: download 10755 ms overlapping gunzip 1076 ms, parse 4921 ms, sort 111 ms, write 10361 ms, index 649 ms: 7 candidates, 85492 repo-hours, 1125 releases; waiting 503 ms; commit 1837 ms)
2026-11-07T22:44:15Z [load_day 2023-07-06] 2023-07-06 hour 9: 190856 events in 4 files, snapshot 7935919168403053054 (task 18400 ms: download 9295 ms overlapping gunzip 1087 ms, parse 4606 ms, sort 113 ms, write 11105 ms, index 687 ms: 9 candidates, 85715 repo-hours, 1168 releases; waiting 514 ms; commit 2514 ms)
2026-11-07T22:44:20Z [load_day 2023-07-06] 2023-07-06 hour 10: 184903 events in 4 files, snapshot 4459965324981757374 (task 18907 ms: download 10524 ms overlapping gunzip 979 ms, parse 4440 ms, sort 130 ms, write 11997 ms, index 540 ms: 9 candidates, 80876 repo-hours, 1209 releases; waiting 539 ms; commit 2155 ms)
2026-11-07T22:44:35Z [load_day 2023-07-06] 2023-07-06 hour 11: 183392 events in 4 files, snapshot 4893425576408174510 (task 19313 ms: download 10597 ms overlapping gunzip 1034 ms, parse 4426 ms, sort 120 ms, write 12282 ms, index 645 ms: 3 candidates, 80237 repo-hours, 1066 releases; waiting 517 ms; commit 2350 ms)
2026-11-07T22:44:44Z [load_day 2023-07-06] 2023-07-06 hour 12: 221511 events in 5 files, snapshot 4287920224599753407 (task 22155 ms: download 14232 ms overlapping gunzip 1226 ms, parse 5544 ms, sort 215 ms, write 13501 ms, index 932 ms: 6 candidates, 111111 repo-hours, 1200 releases; waiting 393 ms; commit 2571 ms)
2026-11-07T22:44:59Z [load_day 2023-07-06] 2023-07-06 hour 13: 211519 events in 5 files, snapshot 8237801747423890253 (task 22686 ms: download 14622 ms overlapping gunzip 1338 ms, parse 5959 ms, sort 203 ms, write 13747 ms, index 929 ms: 11 candidates, 107728 repo-hours, 1143 releases; waiting 191 ms; commit 2656 ms)
2026-11-07T22:45:07Z [load_day 2023-07-06] 2023-07-06 hour 14: 195034 events in 4 files, snapshot 3540790518977482062 (task 22653 ms: download 12878 ms overlapping gunzip 1346 ms, parse 5977 ms, sort 221 ms, write 13801 ms, index 834 ms: 6 candidates, 90790 repo-hours, 1228 releases; waiting 179 ms; commit 2301 ms)
2026-11-07T22:45:21Z [load_day 2023-07-06] 2023-07-06 hour 15: 177131 events in 4 files, snapshot 1374566987514367571 (task 20767 ms: download 12322 ms overlapping gunzip 1188 ms, parse 5271 ms, sort 207 ms, write 12476 ms, index 598 ms: 9 candidates, 84599 repo-hours, 1025 releases; waiting 682 ms; commit 2627 ms)
2026-11-07T22:45:29Z [load_day 2023-07-06] 2023-07-06 hour 16: 178845 events in 4 files, snapshot 4685553855066708916 (task 19936 ms: download 11906 ms overlapping gunzip 1168 ms, parse 5212 ms, sort 119 ms, write 11905 ms, index 703 ms: 6 candidates, 82359 repo-hours, 924 releases; waiting 483 ms; commit 2547 ms)
2026-11-07T22:45:42Z [load_day 2023-07-06] 2023-07-06 hour 17: 183375 events in 4 files, snapshot 6341740902275424287 (task 20294 ms: download 11576 ms overlapping gunzip 1401 ms, parse 5963 ms, sort 161 ms, write 11312 ms, index 534 ms: 6 candidates, 79303 repo-hours, 950 releases; waiting 617 ms; commit 2059 ms)
2026-11-07T22:45:52Z [load_day 2023-07-06] 2023-07-06 hour 18: 188316 events in 4 files, snapshot 4639155292120964329 (task 21484 ms: download 12668 ms overlapping gunzip 1183 ms, parse 5413 ms, sort 193 ms, write 13187 ms, index 727 ms: 9 candidates, 83093 repo-hours, 999 releases; waiting 484 ms; commit 3276 ms)
2026-11-07T22:46:01Z [load_day 2023-07-06] 2023-07-06 hour 19: 176157 events in 4 files, snapshot 2215996154981839423 (task 18464 ms: download 10602 ms overlapping gunzip 1307 ms, parse 5493 ms, sort 111 ms, write 10279 ms, index 524 ms: 5 candidates, 72505 repo-hours, 895 releases; waiting 504 ms; commit 2235 ms)
2026-11-07T22:46:10Z [load_day 2023-07-06] 2023-07-06 hour 20: 177606 events in 4 files, snapshot 6778478330556064930 (task 18881 ms: download 10603 ms overlapping gunzip 1178 ms, parse 5430 ms, sort 122 ms, write 10776 ms, index 602 ms: 3 candidates, 71946 repo-hours, 878 releases; waiting 481 ms; commit 2135 ms)
2026-11-07T22:46:24Z [load_day 2023-07-06] 2023-07-06 hour 21: 173580 events in 4 files, snapshot 8922166428201842627 (task 21027 ms: download 11865 ms overlapping gunzip 1478 ms, parse 5958 ms, sort 102 ms, write 12225 ms, index 566 ms: 4 candidates, 70879 repo-hours, 950 releases; waiting 341 ms; commit 2655 ms)
2026-11-07T22:46:28Z [load_day 2023-07-06] 2023-07-06 hour 22: 145536 events in 3 files, snapshot 806996341840866747 (task 16668 ms: download 7603 ms overlapping gunzip 1151 ms, parse 4850 ms, sort 115 ms, write 9422 ms, index 471 ms: 1 candidates, 59070 repo-hours, 884 releases; waiting 354 ms; commit 1994 ms)
2026-11-07T22:46:37Z [load_day 2023-07-06] 2023-07-06 hour 23: 133471 events in 3 files, snapshot 4214991031971267674 (task 12757 ms: download 6121 ms overlapping gunzip 886 ms, parse 3530 ms, sort 82 ms, write 7131 ms, index 344 ms: 2 candidates, 54730 repo-hours, 686 releases; waiting 492 ms; commit 2154 ms)
2026-11-07T22:46:45Z [load_day 2023-07-06] 2023-07-06: repo_hour merged from 24 files to 1 (1873956 rows, 8202 ms)
2026-11-07T22:46:47Z [load_day 2023-07-06] 2023-07-06: index committed in 10151 ms (24 + 1 + 24 files)
2026-11-07T22:46:47Z [load_day 2023-07-06] 2023-07-06: 4121469 events in 24 hours
2026-11-07T22:46:47Z [load_day 2023-07-06] attempt 1 succeeded