orcaLog in

Runs · run 756

load_day 2023-01-24, attempt 1 succeeded

Host
d3d1748bf284:38151
Started
2026-11-07T14:09:33Z
Ended
2026-11-07T14:13:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/756/load_day/2023-01-24/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:09:33Z [load_day 2023-01-24] attempt 1 started
2026-11-07T14:09:34Z [load_day 2023-01-24] 2023-01-24: 2 hours in flight, about 1200 MB
2026-11-07T14:09:52Z [load_day 2023-01-24] 2023-01-24 hour 0: 178452 events in 4 files, snapshot 4184264948092861068 (task 15298 ms: download 8592 ms overlapping gunzip 938 ms, parse 4451 ms, sort 97 ms, write 8483 ms, index 518 ms: 7 candidates, 80470 repo-hours, 893 releases; waiting 511 ms; commit 1381 ms)
2026-11-07T14:09:54Z [load_day 2023-01-24] 2023-01-24 hour 1: 206402 events in 5 files, snapshot 1898569917387948214 (task 18006 ms: download 10200 ms overlapping gunzip 1149 ms, parse 5402 ms, sort 137 ms, write 9938 ms, index 577 ms: 5 candidates, 91756 repo-hours, 784 releases; waiting 513 ms; commit 1212 ms)
2026-11-07T14:10:11Z [load_day 2023-01-24] 2023-01-24 hour 2: 161182 events in 4 files, snapshot 8329089173747026866 (task 18226 ms: download 9781 ms overlapping gunzip 840 ms, parse 4162 ms, sort 89 ms, write 8326 ms, index 461 ms: 1 candidates, 73186 repo-hours, 639 releases; waiting 2599 ms; commit 1395 ms)
2026-11-07T14:10:12Z [load_day 2023-01-24] 2023-01-24 hour 3: 163600 events in 4 files, snapshot 5321425993008447366 (task 14365 ms: download 6281 ms overlapping gunzip 825 ms, parse 4068 ms, sort 90 ms, write 7866 ms, index 402 ms: 7 candidates, 63209 repo-hours, 672 releases; waiting 720 ms; commit 1371 ms)
2026-11-07T14:10:23Z [load_day 2023-01-24] 2023-01-24 hour 4: 145308 events in 3 files, snapshot 977383469327542271 (task 12117 ms: download 5649 ms overlapping gunzip 731 ms, parse 3320 ms, sort 93 ms, write 6702 ms, index 347 ms: 6 candidates, 54925 repo-hours, 602 releases; waiting 638 ms; commit 1330 ms)
2026-11-07T14:10:25Z [load_day 2023-01-24] 2023-01-24 hour 5: 133955 events in 3 files, snapshot 8308987371029446906 (task 9500 ms: download 4058 ms overlapping gunzip 599 ms, parse 2676 ms, sort 65 ms, write 5146 ms, index 347 ms: 7 candidates, 51215 repo-hours, 641 releases; waiting 344 ms; commit 1365 ms)
2026-11-07T14:10:35Z [load_day 2023-01-24] 2023-01-24 hour 6: 147984 events in 3 files, snapshot 6219338750457216768 (task 10581 ms: download 4459 ms overlapping gunzip 684 ms, parse 2965 ms, sort 83 ms, write 5950 ms, index 361 ms: 4 candidates, 58394 repo-hours, 677 releases; waiting 254 ms; commit 1674 ms)
2026-11-07T14:10:38Z [load_day 2023-01-24] 2023-01-24 hour 7: 158134 events in 4 files, snapshot 6797710580741253980 (task 12359 ms: download 5289 ms overlapping gunzip 774 ms, parse 3475 ms, sort 87 ms, write 6702 ms, index 401 ms: 4 candidates, 58891 repo-hours, 714 releases; waiting 377 ms; commit 1293 ms)
2026-11-07T14:10:49Z [load_day 2023-01-24] 2023-01-24 hour 8: 169692 events in 4 files, snapshot 8714300527838265090 (task 13683 ms: download 8006 ms overlapping gunzip 860 ms, parse 3727 ms, sort 99 ms, write 7648 ms, index 454 ms: 7 candidates, 67766 repo-hours, 762 releases; waiting 535 ms; commit 1281 ms)
2026-11-07T14:10:53Z [load_day 2023-01-24] 2023-01-24 hour 9: 185018 events in 4 files, snapshot 44375166516589401 (task 15273 ms: download 9002 ms overlapping gunzip 993 ms, parse 4228 ms, sort 104 ms, write 8653 ms, index 471 ms: 2 candidates, 73374 repo-hours, 971 releases; waiting 517 ms; commit 1262 ms)
2026-11-07T14:11:07Z [load_day 2023-01-24] 2023-01-24 hour 10: 192725 events in 4 files, snapshot 2569609905507042589 (task 17306 ms: download 9102 ms overlapping gunzip 1006 ms, parse 4349 ms, sort 97 ms, write 10200 ms, index 618 ms: 5 candidates, 77971 repo-hours, 982 releases; waiting 636 ms; commit 1156 ms)
2026-11-07T14:11:11Z [load_day 2023-01-24] 2023-01-24 hour 11: 192558 events in 4 files, snapshot 2002860776996491966 (task 17196 ms: download 10640 ms overlapping gunzip 979 ms, parse 4208 ms, sort 116 ms, write 8864 ms, index 557 ms: 1 candidates, 75073 repo-hours, 997 releases; waiting 2160 ms; commit 1258 ms)
2026-11-07T14:11:24Z [load_day 2023-01-24] 2023-01-24 hour 12: 223760 events in 5 files, snapshot 4244436178534854523 (task 16275 ms: download 10673 ms overlapping gunzip 1000 ms, parse 4328 ms, sort 106 ms, write 9267 ms, index 644 ms: 5 candidates, 104316 repo-hours, 1094 releases; waiting 578 ms; commit 1198 ms)
2026-11-07T14:11:29Z [load_day 2023-01-24] 2023-01-24 hour 13: 218394 events in 5 files, snapshot 822558410291790819 (task 16801 ms: download 11057 ms overlapping gunzip 1062 ms, parse 4550 ms, sort 108 ms, write 9588 ms, index 695 ms: 8 candidates, 101881 repo-hours, 1206 releases; waiting 493 ms; commit 1462 ms)
2026-11-07T14:11:43Z [load_day 2023-01-24] 2023-01-24 hour 14: 213672 events in 5 files, snapshot 6773098536804507662 (task 18247 ms: download 10274 ms overlapping gunzip 1121 ms, parse 4874 ms, sort 116 ms, write 10421 ms, index 575 ms: 7 candidates, 91479 repo-hours, 1289 releases; waiting 663 ms; commit 1431 ms)
2026-11-07T14:11:48Z [load_day 2023-01-24] 2023-01-24 hour 15: 212679 events in 5 files, snapshot 1625780757305570146 (task 17653 ms: download 12115 ms overlapping gunzip 1102 ms, parse 4788 ms, sort 127 ms, write 10261 ms, index 611 ms: 5 candidates, 91330 repo-hours, 1480 releases; waiting 531 ms; commit 1830 ms)
2026-11-07T14:12:00Z [load_day 2023-01-24] 2023-01-24 hour 16: 198144 events in 4 files, snapshot 4966264922803274301 (task 16635 ms: download 9447 ms overlapping gunzip 1041 ms, parse 4475 ms, sort 138 ms, write 9640 ms, index 585 ms: 3 candidates, 88704 repo-hours, 1116 releases; waiting 514 ms; commit 1428 ms)
2026-11-07T14:12:04Z [load_day 2023-01-24] 2023-01-24 hour 17: 203725 events in 5 files, snapshot 8383701646152272761 (task 16881 ms: download 9529 ms overlapping gunzip 1056 ms, parse 4454 ms, sort 119 ms, write 9859 ms, index 560 ms: 5 candidates, 85042 repo-hours, 1045 releases; waiting 531 ms; commit 1178 ms)
2026-11-07T14:12:17Z [load_day 2023-01-24] 2023-01-24 hour 18: 201895 events in 5 files, snapshot 8389771222895288161 (task 16270 ms: download 8979 ms overlapping gunzip 997 ms, parse 4198 ms, sort 114 ms, write 9485 ms, index 591 ms: 7 candidates, 86570 repo-hours, 1078 releases; waiting 584 ms; commit 1306 ms)
2026-11-07T14:12:21Z [load_day 2023-01-24] 2023-01-24 hour 19: 190718 events in 4 files, snapshot 68953017395474790 (task 15291 ms: download 8670 ms overlapping gunzip 961 ms, parse 4110 ms, sort 130 ms, write 8927 ms, index 624 ms: 3 candidates, 77652 repo-hours, 1014 releases; waiting 216 ms; commit 1704 ms)
2026-11-07T14:12:33Z [load_day 2023-01-24] 2023-01-24 hour 20: 190223 events in 4 files, snapshot 8046257354794300980 (task 15536 ms: download 8824 ms overlapping gunzip 994 ms, parse 4232 ms, sort 103 ms, write 8731 ms, index 507 ms: 5 candidates, 75479 repo-hours, 865 releases; waiting 629 ms; commit 1394 ms)
2026-11-07T14:12:37Z [load_day 2023-01-24] 2023-01-24 hour 21: 185891 events in 4 files, snapshot 4923796652564139878 (task 15787 ms: download 9145 ms overlapping gunzip 1071 ms, parse 4363 ms, sort 100 ms, write 9001 ms, index 539 ms: 3 candidates, 71332 repo-hours, 1094 releases; waiting 351 ms; commit 1433 ms)
2026-11-07T14:12:48Z [load_day 2023-01-24] 2023-01-24 hour 22: 180639 events in 4 files, snapshot 4958552160583177014 (task 14023 ms: download 8440 ms overlapping gunzip 878 ms, parse 3716 ms, sort 76 ms, write 8035 ms, index 415 ms: 5 candidates, 63776 repo-hours, 974 releases; waiting 587 ms; commit 1227 ms)
2026-11-07T14:12:51Z [load_day 2023-01-24] 2023-01-24 hour 23: 162381 events in 4 files, snapshot 6187339905176763253 (task 13184 ms: download 5839 ms overlapping gunzip 823 ms, parse 3510 ms, sort 85 ms, write 7228 ms, index 405 ms: 5 candidates, 60146 repo-hours, 852 releases; waiting 606 ms; commit 1251 ms)
2026-11-07T14:12:58Z [load_day 2023-01-24] 2023-01-24: repo_hour merged from 24 files to 1 (1823937 rows, 7536 ms)
2026-11-07T14:13:00Z [load_day 2023-01-24] 2023-01-24: index committed in 9063 ms (24 + 1 + 24 files)
2026-11-07T14:13:00Z [load_day 2023-01-24] 2023-01-24: 4417131 events in 24 hours
2026-11-07T14:13:00Z [load_day 2023-01-24] attempt 1 succeeded