orcaLog in

Runs · run 765

load_day 2023-01-27, attempt 1 succeeded

Host
d3d1748bf284:51278
Started
2026-11-07T14:25:38Z
Ended
2026-11-07T14:28:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/765/load_day/2023-01-27/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:25:38Z [load_day 2023-01-27] attempt 1 started
2026-11-07T14:25:39Z [load_day 2023-01-27] 2023-01-27: 2 hours in flight, about 1200 MB
2026-11-07T14:25:55Z [load_day 2023-01-27] 2023-01-27 hour 0: 155762 events in 4 files, snapshot 3376262492574576519 (task 13697 ms: download 6580 ms overlapping gunzip 946 ms, parse 3963 ms, sort 96 ms, write 7396 ms, index 452 ms: 6 candidates, 71332 repo-hours, 978 releases; waiting 536 ms; commit 1262 ms)
2026-11-07T14:25:56Z [load_day 2023-01-27] 2023-01-27 hour 1: 164532 events in 4 files, snapshot 4329012843853150610 (task 13855 ms: download 8623 ms overlapping gunzip 941 ms, parse 3808 ms, sort 104 ms, write 7394 ms, index 445 ms: 7 candidates, 72348 repo-hours, 857 releases; waiting 688 ms; commit 1316 ms)
2026-11-07T14:26:06Z [load_day 2023-01-27] 2023-01-27 hour 2: 122647 events in 3 files, snapshot 3452532211318267773 (task 10310 ms: download 4824 ms overlapping gunzip 725 ms, parse 2830 ms, sort 91 ms, write 5751 ms, index 351 ms: 4 candidates, 57012 repo-hours, 684 releases; waiting 274 ms; commit 1204 ms)
2026-11-07T14:26:07Z [load_day 2023-01-27] 2023-01-27 hour 3: 117836 events in 3 files, snapshot 1292015985809726211 (task 9549 ms: download 4632 ms overlapping gunzip 652 ms, parse 2690 ms, sort 70 ms, write 5122 ms, index 311 ms: 3 candidates, 47670 repo-hours, 772 releases; waiting 481 ms; commit 1288 ms)
2026-11-07T14:26:20Z [load_day 2023-01-27] 2023-01-27 hour 4: 134212 events in 3 files, snapshot 774513238270553382 (task 12807 ms: download 5801 ms overlapping gunzip 789 ms, parse 3334 ms, sort 76 ms, write 7243 ms, index 339 ms: 4 candidates, 53790 repo-hours, 539 releases; waiting 673 ms; commit 1511 ms)
2026-11-07T14:26:21Z [load_day 2023-01-27] 2023-01-27 hour 5: 118585 events in 3 files, snapshot 4927546958280365001 (task 8768 ms: download 2144 ms overlapping gunzip 541 ms, parse 2339 ms, sort 63 ms, write 4695 ms, index 320 ms: 1 candidates, 49902 repo-hours, 686 releases; waiting 513 ms; commit 1276 ms)
2026-11-07T14:26:31Z [load_day 2023-01-27] 2023-01-27 hour 6: 131989 events in 3 files, snapshot 6399565304724873322 (task 10116 ms: download 4550 ms overlapping gunzip 623 ms, parse 2660 ms, sort 77 ms, write 5427 ms, index 344 ms: 4 candidates, 57071 repo-hours, 739 releases; waiting 629 ms; commit 1351 ms)
2026-11-07T14:26:34Z [load_day 2023-01-27] 2023-01-27 hour 7: 139093 events in 3 files, snapshot 5570079098654404495 (task 11564 ms: download 5181 ms overlapping gunzip 711 ms, parse 3063 ms, sort 86 ms, write 6188 ms, index 375 ms: 6 candidates, 58603 repo-hours, 702 releases; waiting 847 ms; commit 1932 ms)
2026-11-07T14:26:45Z [load_day 2023-01-27] 2023-01-27 hour 8: 160464 events in 4 files, snapshot 7013302122987520892 (task 13329 ms: download 5553 ms overlapping gunzip 849 ms, parse 3571 ms, sort 84 ms, write 7541 ms, index 466 ms: 8 candidates, 68600 repo-hours, 802 releases; waiting 518 ms; commit 1364 ms)
2026-11-07T14:26:48Z [load_day 2023-01-27] 2023-01-27 hour 9: 168931 events in 4 files, snapshot 3111828907649849467 (task 13755 ms: download 8345 ms overlapping gunzip 914 ms, parse 3953 ms, sort 78 ms, write 7687 ms, index 463 ms: 5 candidates, 71167 repo-hours, 1032 releases; waiting 374 ms; commit 1212 ms)
2026-11-07T14:27:01Z [load_day 2023-01-27] 2023-01-27 hour 10: 181606 events in 4 files, snapshot 30755186139171256 (task 15519 ms: download 9259 ms overlapping gunzip 1036 ms, parse 4432 ms, sort 114 ms, write 8688 ms, index 499 ms: 3 candidates, 76843 repo-hours, 996 releases; waiting 443 ms; commit 1362 ms)
2026-11-07T14:27:04Z [load_day 2023-01-27] 2023-01-27 hour 11: 177323 events in 4 files, snapshot 1094777580167257432 (task 14798 ms: download 8925 ms overlapping gunzip 932 ms, parse 4022 ms, sort 91 ms, write 8088 ms, index 481 ms: 5 candidates, 71948 repo-hours, 936 releases; waiting 831 ms; commit 1459 ms)
2026-11-07T14:27:17Z [load_day 2023-01-27] 2023-01-27 hour 12: 213269 events in 5 files, snapshot 4070206363751856182 (task 15431 ms: download 8496 ms overlapping gunzip 995 ms, parse 4373 ms, sort 129 ms, write 8482 ms, index 596 ms: 3 candidates, 98528 repo-hours, 1158 releases; waiting 526 ms; commit 1222 ms)
2026-11-07T14:27:21Z [load_day 2023-01-27] 2023-01-27 hour 13: 207836 events in 5 files, snapshot 5912758325888859409 (task 16220 ms: download 8683 ms overlapping gunzip 1032 ms, parse 4476 ms, sort 123 ms, write 8955 ms, index 767 ms: 7 candidates, 97348 repo-hours, 996 releases; waiting 499 ms; commit 1307 ms)
2026-11-07T14:27:34Z [load_day 2023-01-27] 2023-01-27 hour 14: 200251 events in 5 files, snapshot 1943561790496954606 (task 16277 ms: download 9173 ms overlapping gunzip 1013 ms, parse 4403 ms, sort 128 ms, write 8985 ms, index 587 ms: 6 candidates, 86856 repo-hours, 1170 releases; waiting 713 ms; commit 1379 ms)
2026-11-07T14:27:38Z [load_day 2023-01-27] 2023-01-27 hour 15: 202461 events in 5 files, snapshot 2027787916979862120 (task 16420 ms: download 9180 ms overlapping gunzip 1018 ms, parse 4417 ms, sort 106 ms, write 9258 ms, index 563 ms: 4 candidates, 89396 repo-hours, 1206 releases; waiting 700 ms; commit 1368 ms)
2026-11-07T14:27:50Z [load_day 2023-01-27] 2023-01-27 hour 16: 193178 events in 4 files, snapshot 7106865276774896982 (task 15527 ms: download 8966 ms overlapping gunzip 978 ms, parse 4306 ms, sort 103 ms, write 8734 ms, index 530 ms: 4 candidates, 84448 repo-hours, 990 releases; waiting 510 ms; commit 1466 ms)
2026-11-07T14:27:53Z [load_day 2023-01-27] 2023-01-27 hour 17: 187920 events in 4 files, snapshot 4227257827662411054 (task 14857 ms: download 8345 ms overlapping gunzip 940 ms, parse 4043 ms, sort 102 ms, write 8631 ms, index 537 ms: 3 candidates, 81435 repo-hours, 1043 releases; waiting 184 ms; commit 1473 ms)
2026-11-07T14:28:05Z [load_day 2023-01-27] 2023-01-27 hour 18: 187746 events in 4 files, snapshot 6848392676782454632 (task 14963 ms: download 8569 ms overlapping gunzip 909 ms, parse 3913 ms, sort 86 ms, write 8682 ms, index 547 ms: 2 candidates, 83338 repo-hours, 1016 releases; waiting 512 ms; commit 1186 ms)
2026-11-07T14:28:13Z [load_day 2023-01-27] 2023-01-27 hour 19: 175369 events in 4 files, snapshot 4553033604933697017 (task 15807 ms: download 8736 ms overlapping gunzip 825 ms, parse 3603 ms, sort 91 ms, write 7791 ms, index 1876 ms: 2 candidates, 69881 repo-hours, 943 releases; waiting 1301 ms; commit 5071 ms)
2026-11-07T14:28:20Z [load_day 2023-01-27] 2023-01-27 hour 20: 165780 events in 4 files, snapshot 6338814506621163164 (task 13636 ms: download 5808 ms overlapping gunzip 816 ms, parse 3585 ms, sort 92 ms, write 7645 ms, index 453 ms: 2 candidates, 68011 repo-hours, 1208 releases; waiting 743 ms; commit 1185 ms)
2026-11-07T14:28:23Z [load_day 2023-01-27] 2023-01-27 hour 21: 151072 events in 4 files, snapshot 5843059812836651351 (task 12648 ms: download 5708 ms overlapping gunzip 763 ms, parse 3309 ms, sort 90 ms, write 7105 ms, index 394 ms: 5 candidates, 61080 repo-hours, 1051 releases; waiting 646 ms; commit 1236 ms)
2026-11-07T14:28:34Z [load_day 2023-01-27] 2023-01-27 hour 22: 140892 events in 3 files, snapshot 8865864477050730314 (task 11121 ms: download 5019 ms overlapping gunzip 698 ms, parse 3056 ms, sort 76 ms, write 6181 ms, index 345 ms: 4 candidates, 56115 repo-hours, 919 releases; waiting 457 ms; commit 3360 ms)
2026-11-07T14:28:35Z [load_day 2023-01-27] 2023-01-27 hour 23: 123324 events in 3 files, snapshot 7229730695560497192 (task 9611 ms: download 4421 ms overlapping gunzip 588 ms, parse 2571 ms, sort 54 ms, write 5217 ms, index 338 ms: 4 candidates, 50684 repo-hours, 746 releases; waiting 535 ms; commit 1166 ms)
2026-11-07T14:28:42Z [load_day 2023-01-27] 2023-01-27: repo_hour merged from 24 files to 1 (1683406 rows, 6916 ms)
2026-11-07T14:28:44Z [load_day 2023-01-27] 2023-01-27: index committed in 8606 ms (24 + 1 + 24 files)
2026-11-07T14:28:44Z [load_day 2023-01-27] 2023-01-27: 3922078 events in 24 hours
2026-11-07T14:28:44Z [load_day 2023-01-27] attempt 1 succeeded