orcaLog in

Runs · run 774

load_day 2023-01-30, attempt 1 succeeded

Host
a5fae32f1699:2200
Started
2026-11-07T14:42:37Z
Ended
2026-11-07T14:46:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/774/load_day/2023-01-30/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:42:37Z [load_day 2023-01-30] attempt 1 started
2026-11-07T14:42:38Z [load_day 2023-01-30] 2023-01-30: 2 hours in flight, about 1200 MB
2026-11-07T14:42:52Z [load_day 2023-01-30] 2023-01-30 hour 0: 137605 events in 3 files, snapshot 6665110823970334386 (task 11158 ms: download 5311 ms overlapping gunzip 695 ms, parse 2922 ms, sort 76 ms, write 6117 ms, index 429 ms: 4 candidates, 66773 repo-hours, 902 releases; waiting 616 ms; commit 1462 ms)
2026-11-07T14:42:55Z [load_day 2023-01-30] 2023-01-30 hour 1: 159817 events in 4 files, snapshot 8979810609669122954 (task 14596 ms: download 9107 ms overlapping gunzip 1013 ms, parse 3982 ms, sort 90 ms, write 7750 ms, index 503 ms: 6 candidates, 75200 repo-hours, 789 releases; waiting 885 ms; commit 1242 ms)
2026-11-07T14:43:05Z [load_day 2023-01-30] 2023-01-30 hour 2: 142827 events in 3 files, snapshot 4658177777472923619 (task 12448 ms: download 5705 ms overlapping gunzip 905 ms, parse 3383 ms, sort 95 ms, write 6841 ms, index 412 ms: 6 candidates, 62019 repo-hours, 691 releases; waiting 517 ms; commit 1315 ms)
2026-11-07T14:43:09Z [load_day 2023-01-30] 2023-01-30 hour 3: 149412 events in 3 files, snapshot 5812689095123818542 (task 13195 ms: download 6413 ms overlapping gunzip 921 ms, parse 3581 ms, sort 112 ms, write 7003 ms, index 453 ms: 3 candidates, 55313 repo-hours, 822 releases; waiting 771 ms; commit 1612 ms)
2026-11-07T14:43:19Z [load_day 2023-01-30] 2023-01-30 hour 4: 146081 events in 3 files, snapshot 3443112086183056080 (task 13487 ms: download 6524 ms overlapping gunzip 1013 ms, parse 3835 ms, sort 92 ms, write 7192 ms, index 430 ms: 5 candidates, 53161 repo-hours, 601 releases; waiting 611 ms; commit 1449 ms)
2026-11-07T14:43:22Z [load_day 2023-01-30] 2023-01-30 hour 5: 143000 events in 3 files, snapshot 8523643546944540714 (task 12143 ms: download 5896 ms overlapping gunzip 824 ms, parse 3269 ms, sort 92 ms, write 6668 ms, index 358 ms: 7 candidates, 55694 repo-hours, 706 releases; waiting 613 ms; commit 1186 ms)
2026-11-07T14:43:33Z [load_day 2023-01-30] 2023-01-30 hour 6: 160675 events in 4 files, snapshot 7750274438185216083 (task 13632 ms: download 6305 ms overlapping gunzip 935 ms, parse 3737 ms, sort 108 ms, write 7498 ms, index 488 ms: 5 candidates, 67918 repo-hours, 848 releases; waiting 511 ms; commit 1336 ms)
2026-11-07T14:43:37Z [load_day 2023-01-30] 2023-01-30 hour 7: 170156 events in 4 files, snapshot 6013201734000631500 (task 14400 ms: download 8973 ms overlapping gunzip 1010 ms, parse 4057 ms, sort 110 ms, write 8206 ms, index 494 ms: 4 candidates, 71505 repo-hours, 847 releases; waiting 218 ms; commit 1397 ms)
2026-11-07T14:43:51Z [load_day 2023-01-30] 2023-01-30 hour 8: 189227 events in 4 files, snapshot 1288425851834398536 (task 17108 ms: download 10296 ms overlapping gunzip 1152 ms, parse 4565 ms, sort 123 ms, write 9842 ms, index 563 ms: 4 candidates, 81096 repo-hours, 887 releases; waiting 533 ms; commit 1522 ms)
2026-11-07T14:43:56Z [load_day 2023-01-30] 2023-01-30 hour 9: 198701 events in 4 files, snapshot 4158512428658272591 (task 18042 ms: download 10728 ms overlapping gunzip 1211 ms, parse 4947 ms, sort 125 ms, write 10308 ms, index 540 ms: 6 candidates, 85133 repo-hours, 1102 releases; waiting 533 ms; commit 1144 ms)
2026-11-07T14:44:11Z [load_day 2023-01-30] 2023-01-30 hour 10: 204154 events in 5 files, snapshot 1211849311588187464 (task 18659 ms: download 10989 ms overlapping gunzip 1281 ms, parse 5214 ms, sort 144 ms, write 10570 ms, index 661 ms: 3 candidates, 86792 repo-hours, 1020 releases; waiting 468 ms; commit 1248 ms)
2026-11-07T14:44:15Z [load_day 2023-01-30] 2023-01-30 hour 11: 204233 events in 5 files, snapshot 9146373047349387948 (task 18661 ms: download 10947 ms overlapping gunzip 1285 ms, parse 5103 ms, sort 140 ms, write 10744 ms, index 566 ms: 7 candidates, 86325 repo-hours, 1117 releases; waiting 495 ms; commit 1370 ms)
2026-11-07T14:44:31Z [load_day 2023-01-30] 2023-01-30 hour 12: 229958 events in 5 files, snapshot 5571841323213308299 (task 19176 ms: download 13124 ms overlapping gunzip 1253 ms, parse 5194 ms, sort 139 ms, write 11017 ms, index 696 ms: 10 candidates, 108135 repo-hours, 1082 releases; waiting 524 ms; commit 1340 ms)
2026-11-07T14:44:35Z [load_day 2023-01-30] 2023-01-30 hour 13: 230644 events in 5 files, snapshot 6589914887382231769 (task 19511 ms: download 12721 ms overlapping gunzip 1299 ms, parse 5246 ms, sort 144 ms, write 11630 ms, index 676 ms: 7 candidates, 108452 repo-hours, 1167 releases; waiting 208 ms; commit 1348 ms)
2026-11-07T14:44:52Z [load_day 2023-01-30] 2023-01-30 hour 14: 221910 events in 5 files, snapshot 7232916897482646692 (task 20159 ms: download 14043 ms overlapping gunzip 1312 ms, parse 5323 ms, sort 137 ms, write 11791 ms, index 630 ms: 5 candidates, 96190 repo-hours, 1021 releases; waiting 615 ms; commit 1366 ms)
2026-11-07T14:44:56Z [load_day 2023-01-30] 2023-01-30 hour 15: 220884 events in 5 files, snapshot 3798712055214165308 (task 20085 ms: download 14040 ms overlapping gunzip 1333 ms, parse 5498 ms, sort 135 ms, write 11623 ms, index 642 ms: 3 candidates, 97177 repo-hours, 1301 releases; waiting 539 ms; commit 1245 ms)
2026-11-07T14:45:12Z [load_day 2023-01-30] 2023-01-30 hour 16: 205445 events in 5 files, snapshot 8316323630610222936 (task 20080 ms: download 12227 ms overlapping gunzip 1255 ms, parse 5219 ms, sort 137 ms, write 10968 ms, index 644 ms: 6 candidates, 91314 repo-hours, 955 releases; waiting 1501 ms; commit 1383 ms)
2026-11-07T14:45:17Z [load_day 2023-01-30] 2023-01-30 hour 17: 210153 events in 5 files, snapshot 2054142156323299936 (task 19703 ms: download 11410 ms overlapping gunzip 1268 ms, parse 5290 ms, sort 133 ms, write 11470 ms, index 616 ms: 12 candidates, 88817 repo-hours, 965 releases; waiting 594 ms; commit 1924 ms)
2026-11-07T14:45:32Z [load_day 2023-01-30] 2023-01-30 hour 18: 208351 events in 5 files, snapshot 650495358330195428 (task 18474 ms: download 10715 ms overlapping gunzip 1222 ms, parse 5008 ms, sort 116 ms, write 10892 ms, index 611 ms: 9 candidates, 87706 repo-hours, 1143 releases; waiting 315 ms; commit 1402 ms)
2026-11-07T14:45:36Z [load_day 2023-01-30] 2023-01-30 hour 19: 197182 events in 4 files, snapshot 5290431836331319666 (task 17917 ms: download 10958 ms overlapping gunzip 1207 ms, parse 4927 ms, sort 124 ms, write 9895 ms, index 533 ms: 4 candidates, 80551 repo-hours, 997 releases; waiting 909 ms; commit 1366 ms)
2026-11-07T14:45:50Z [load_day 2023-01-30] 2023-01-30 hour 20: 196348 events in 4 files, snapshot 955793120723668011 (task 17350 ms: download 10330 ms overlapping gunzip 1211 ms, parse 4908 ms, sort 123 ms, write 10040 ms, index 539 ms: 6 candidates, 80072 repo-hours, 945 releases; waiting 216 ms; commit 1312 ms)
2026-11-07T14:45:55Z [load_day 2023-01-30] 2023-01-30 hour 21: 193771 events in 4 files, snapshot 5551980261197299079 (task 18718 ms: download 11393 ms overlapping gunzip 1367 ms, parse 5306 ms, sort 116 ms, write 10549 ms, index 515 ms: 8 candidates, 75799 repo-hours, 1094 releases; waiting 526 ms; commit 1366 ms)
2026-11-07T14:46:07Z [load_day 2023-01-30] 2023-01-30 hour 22: 175230 events in 4 files, snapshot 1452765598446990513 (task 16279 ms: download 10294 ms overlapping gunzip 1119 ms, parse 4515 ms, sort 107 ms, write 9469 ms, index 454 ms: 3 candidates, 69051 repo-hours, 906 releases; waiting 319 ms; commit 1477 ms)
2026-11-07T14:46:12Z [load_day 2023-01-30] 2023-01-30 hour 23: 170622 events in 4 files, snapshot 1204701024369715459 (task 15928 ms: download 10574 ms overlapping gunzip 1158 ms, parse 4532 ms, sort 105 ms, write 8952 ms, index 435 ms: 8 candidates, 67626 repo-hours, 709 releases; waiting 522 ms; commit 1254 ms)
2026-11-07T14:46:19Z [load_day 2023-01-30] 2023-01-30: repo_hour merged from 24 files to 1 (1897819 rows, 7686 ms)
2026-11-07T14:46:21Z [load_day 2023-01-30] 2023-01-30: index committed in 9416 ms (24 + 1 + 24 files)
2026-11-07T14:46:21Z [load_day 2023-01-30] 2023-01-30: 4466386 events in 24 hours
2026-11-07T14:46:21Z [load_day 2023-01-30] attempt 1 succeeded