orcaLog in

Runs · run 738

load_day 2023-01-18, attempt 1 succeeded

Host
d3d1748bf284:17009
Started
2026-11-07T13:52:22Z
Ended
2026-11-07T13:55:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/738/load_day/2023-01-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:52:22Z [load_day 2023-01-18] attempt 1 started
2026-11-07T13:52:23Z [load_day 2023-01-18] 2023-01-18: 2 hours in flight, about 1200 MB
2026-11-07T13:52:38Z [load_day 2023-01-18] 2023-01-18 hour 0: 151302 events in 4 files, snapshot 4894176377962521667 (task 12398 ms: download 5697 ms overlapping gunzip 756 ms, parse 3335 ms, sort 92 ms, write 6594 ms, index 459 ms: 3 candidates, 70120 repo-hours, 911 releases; waiting 800 ms; commit 1520 ms)
2026-11-07T13:52:39Z [load_day 2023-01-18] 2023-01-18 hour 1: 145934 events in 3 files, snapshot 1500365978228567219 (task 10788 ms: download 4689 ms overlapping gunzip 656 ms, parse 2961 ms, sort 81 ms, write 5836 ms, index 469 ms: 2 candidates, 74003 repo-hours, 820 releases; waiting 504 ms; commit 1365 ms)
2026-11-07T13:52:48Z [load_day 2023-01-18] 2023-01-18 hour 2: 126440 events in 3 files, snapshot 524488872339053806 (task 9191 ms: download 3589 ms overlapping gunzip 566 ms, parse 2357 ms, sort 55 ms, write 5189 ms, index 427 ms: 4 candidates, 59105 repo-hours, 549 releases; waiting 24 ms; commit 1365 ms)
2026-11-07T13:52:49Z [load_day 2023-01-18] 2023-01-18 hour 3: 136077 events in 3 files, snapshot 3098182110035966790 (task 9557 ms: download 4152 ms overlapping gunzip 581 ms, parse 2536 ms, sort 78 ms, write 5046 ms, index 324 ms: 1 candidates, 50669 repo-hours, 797 releases; waiting 616 ms; commit 1368 ms)
2026-11-07T13:52:58Z [load_day 2023-01-18] 2023-01-18 hour 4: 135105 events in 3 files, snapshot 4082902875329345030 (task 9664 ms: download 4487 ms overlapping gunzip 636 ms, parse 2635 ms, sort 85 ms, write 5357 ms, index 324 ms: 1 candidates, 50016 repo-hours, 527 releases; waiting 305 ms; commit 1321 ms)
2026-11-07T13:52:59Z [load_day 2023-01-18] 2023-01-18 hour 5: 140531 events in 3 files, snapshot 1875292582724099565 (task 9192 ms: download 3865 ms overlapping gunzip 581 ms, parse 2525 ms, sort 75 ms, write 5098 ms, index 342 ms: 3 candidates, 52673 repo-hours, 768 releases; waiting 349 ms; commit 1243 ms)
2026-11-07T13:53:10Z [load_day 2023-01-18] 2023-01-18 hour 6: 154236 events in 4 files, snapshot 9038035031234306166 (task 11534 ms: download 5095 ms overlapping gunzip 700 ms, parse 3001 ms, sort 107 ms, write 6350 ms, index 411 ms: 2 candidates, 62883 repo-hours, 797 releases; waiting 740 ms; commit 1261 ms)
2026-11-07T13:53:12Z [load_day 2023-01-18] 2023-01-18 hour 7: 164444 events in 4 files, snapshot 1613397551793281768 (task 12153 ms: download 5264 ms overlapping gunzip 738 ms, parse 3199 ms, sort 97 ms, write 6701 ms, index 416 ms: 2 candidates, 63687 repo-hours, 722 releases; waiting 671 ms; commit 1287 ms)
2026-11-07T13:53:25Z [load_day 2023-01-18] 2023-01-18 hour 8: 181909 events in 4 files, snapshot 8596799126932167980 (task 13794 ms: download 7746 ms overlapping gunzip 878 ms, parse 3804 ms, sort 100 ms, write 7768 ms, index 476 ms: 5 candidates, 73507 repo-hours, 878 releases; waiting 271 ms; commit 1222 ms)
2026-11-07T13:53:28Z [load_day 2023-01-18] 2023-01-18 hour 9: 192770 events in 4 files, snapshot 8605794372843378920 (task 15225 ms: download 8611 ms overlapping gunzip 931 ms, parse 4054 ms, sort 106 ms, write 8742 ms, index 541 ms: 4 candidates, 78339 repo-hours, 1118 releases; waiting 531 ms; commit 1317 ms)
2026-11-07T13:53:40Z [load_day 2023-01-18] 2023-01-18 hour 10: 191801 events in 4 files, snapshot 7276236742440588687 (task 14942 ms: download 8603 ms overlapping gunzip 937 ms, parse 4063 ms, sort 102 ms, write 8435 ms, index 494 ms: 4 candidates, 77101 repo-hours, 1036 releases; waiting 631 ms; commit 1348 ms)
2026-11-07T13:53:43Z [load_day 2023-01-18] 2023-01-18 hour 11: 184656 events in 4 files, snapshot 6578229142257136222 (task 14021 ms: download 7837 ms overlapping gunzip 873 ms, parse 3797 ms, sort 115 ms, write 8071 ms, index 508 ms: 3 candidates, 73631 repo-hours, 906 releases; waiting 192 ms; commit 1221 ms)
2026-11-07T13:53:57Z [load_day 2023-01-18] 2023-01-18 hour 12: 215062 events in 5 files, snapshot 2501048803228040017 (task 16133 ms: download 8746 ms overlapping gunzip 955 ms, parse 4190 ms, sort 137 ms, write 9218 ms, index 651 ms: 4 candidates, 100595 repo-hours, 1014 releases; waiting 676 ms; commit 1195 ms)
2026-11-07T13:53:59Z [load_day 2023-01-18] 2023-01-18 hour 13: 214628 events in 5 files, snapshot 8506946022173598184 (task 15755 ms: download 8297 ms overlapping gunzip 958 ms, parse 4126 ms, sort 124 ms, write 9111 ms, index 625 ms: 2 candidates, 97583 repo-hours, 1019 releases; waiting 505 ms; commit 1235 ms)
2026-11-07T13:54:15Z [load_day 2023-01-18] 2023-01-18 hour 14: 209710 events in 5 files, snapshot 3784946332975412770 (task 17310 ms: download 9522 ms overlapping gunzip 1024 ms, parse 4540 ms, sort 115 ms, write 9882 ms, index 590 ms: 3 candidates, 89041 repo-hours, 1212 releases; waiting 801 ms; commit 1342 ms)
2026-11-07T13:54:17Z [load_day 2023-01-18] 2023-01-18 hour 15: 210288 events in 5 files, snapshot 765919366246816544 (task 16948 ms: download 9209 ms overlapping gunzip 1058 ms, parse 4672 ms, sort 131 ms, write 10046 ms, index 587 ms: 0 candidates, 92105 repo-hours, 1314 releases; waiting 201 ms; commit 1168 ms)
2026-11-07T13:54:32Z [load_day 2023-01-18] 2023-01-18 hour 16: 196101 events in 4 files, snapshot 3850953673889526038 (task 16319 ms: download 9299 ms overlapping gunzip 977 ms, parse 4279 ms, sort 116 ms, write 9502 ms, index 541 ms: 1 candidates, 87080 repo-hours, 1126 releases; waiting 523 ms; commit 1268 ms)
2026-11-07T13:54:34Z [load_day 2023-01-18] 2023-01-18 hour 17: 200326 events in 5 files, snapshot 6999144294023934357 (task 16166 ms: download 9067 ms overlapping gunzip 999 ms, parse 4266 ms, sort 143 ms, write 9403 ms, index 551 ms: 5 candidates, 82669 repo-hours, 957 releases; waiting 516 ms; commit 1508 ms)
2026-11-07T13:54:58Z [load_day 2023-01-18] 2023-01-18 hour 18: 243286 events in 5 files, snapshot 1486263772467101786 (task 25539 ms: download 20553 ms overlapping gunzip 1794 ms, parse 7718 ms, sort 135 ms, write 14636 ms, index 609 ms: 5 candidates, 99313 repo-hours, 888 releases; waiting 299 ms; commit 1198 ms)
2026-11-07T13:55:00Z [load_day 2023-01-18] 2023-01-18 hour 19: 247551 events in 5 files, snapshot 4339486835512615886 (task 24372 ms: download 19201 ms overlapping gunzip 1662 ms, parse 7556 ms, sort 139 ms, write 13406 ms, index 566 ms: 7 candidates, 92479 repo-hours, 851 releases; waiting 715 ms; commit 1429 ms)
2026-11-07T13:55:20Z [load_day 2023-01-18] 2023-01-18 hour 20: 219864 events in 5 files, snapshot 4776701270833429383 (task 20611 ms: download 14865 ms overlapping gunzip 1403 ms, parse 5927 ms, sort 112 ms, write 11541 ms, index 543 ms: 8 candidates, 83606 repo-hours, 777 releases; waiting 735 ms; commit 1423 ms)
2026-11-07T13:55:21Z [load_day 2023-01-18] 2023-01-18 hour 21: 207171 events in 5 files, snapshot 3561766754671227420 (task 19624 ms: download 13575 ms overlapping gunzip 1325 ms, parse 5863 ms, sort 115 ms, write 10916 ms, index 555 ms: 12 candidates, 85130 repo-hours, 972 releases; waiting 532 ms; commit 1317 ms)
2026-11-07T13:55:35Z [load_day 2023-01-18] 2023-01-18 hour 22: 172791 events in 4 files, snapshot 5957914462711323187 (task 14951 ms: download 9432 ms overlapping gunzip 999 ms, parse 4197 ms, sort 111 ms, write 8361 ms, index 438 ms: 5 candidates, 67283 repo-hours, 989 releases; waiting 555 ms; commit 1237 ms)
2026-11-07T13:55:36Z [load_day 2023-01-18] 2023-01-18 hour 23: 154345 events in 4 files, snapshot 6127279697551081378 (task 12685 ms: download 5702 ms overlapping gunzip 817 ms, parse 3427 ms, sort 88 ms, write 7116 ms, index 396 ms: 9 candidates, 60092 repo-hours, 762 releases; waiting 516 ms; commit 1089 ms)
2026-11-07T13:55:44Z [load_day 2023-01-18] 2023-01-18: repo_hour merged from 24 files to 1 (1822710 rows, 7527 ms)
2026-11-07T13:55:46Z [load_day 2023-01-18] 2023-01-18: index committed in 9578 ms (23 + 1 + 24 files)
2026-11-07T13:55:46Z [load_day 2023-01-18] 2023-01-18: 4396328 events in 24 hours
2026-11-07T13:55:46Z [load_day 2023-01-18] attempt 1 succeeded