orcaLog in

Runs · run 876

load_day 2023-03-05, attempt 1 succeeded

Host
caf251265124:125214
Started
2026-11-07T16:33:53Z
Ended
2026-11-07T16:36:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/876/load_day/2023-03-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:33:53Z [load_day 2023-03-05] attempt 1 started
2026-11-07T16:33:55Z [load_day 2023-03-05] 2023-03-05: 2 hours in flight, about 1200 MB
2026-11-07T16:34:06Z [load_day 2023-03-05] 2023-03-05 hour 0: 148465 events in 3 files, snapshot 1532763279036942621 (task 8724 ms: download 2249 ms overlapping gunzip 490 ms, parse 2192 ms, sort 81 ms, write 4381 ms, index 577 ms: 7 candidates, 88121 repo-hours, 1261 releases; waiting 670 ms; commit 1524 ms)
2026-11-07T16:34:07Z [load_day 2023-03-05] 2023-03-05 hour 1: 169833 events in 4 files, snapshot 6454397866462660170 (task 8860 ms: download 3023 ms overlapping gunzip 484 ms, parse 2178 ms, sort 94 ms, write 4597 ms, index 675 ms: 4 candidates, 115461 repo-hours, 1035 releases; waiting 496 ms; commit 1316 ms)
2026-11-07T16:34:14Z [load_day 2023-03-05] 2023-03-05 hour 2: 144322 events in 3 files, snapshot 1024278280006901651 (task 7858 ms: download 1617 ms overlapping gunzip 482 ms, parse 2045 ms, sort 81 ms, write 4093 ms, index 526 ms: 39 candidates, 86125 repo-hours, 861 releases; waiting 250 ms; commit 1399 ms)
2026-11-07T16:34:16Z [load_day 2023-03-05] 2023-03-05 hour 3: 138085 events in 3 files, snapshot 8077357898662026404 (task 7755 ms: download 2071 ms overlapping gunzip 464 ms, parse 1919 ms, sort 73 ms, write 3934 ms, index 471 ms: 5 candidates, 74933 repo-hours, 1031 releases; waiting 538 ms; commit 1500 ms)
2026-11-07T16:34:23Z [load_day 2023-03-05] 2023-03-05 hour 4: 135605 events in 3 files, snapshot 2291215255793193480 (task 7698 ms: download 2512 ms overlapping gunzip 438 ms, parse 1887 ms, sort 62 ms, write 3750 ms, index 497 ms: 4 candidates, 75247 repo-hours, 860 releases; waiting 725 ms; commit 1377 ms)
2026-11-07T16:34:25Z [load_day 2023-03-05] 2023-03-05 hour 5: 135912 events in 3 files, snapshot 8037535012440970276 (task 7791 ms: download 2654 ms overlapping gunzip 453 ms, parse 1941 ms, sort 77 ms, write 3809 ms, index 489 ms: 7 candidates, 73038 repo-hours, 981 releases; waiting 693 ms; commit 1574 ms)
2026-11-07T16:34:32Z [load_day 2023-03-05] 2023-03-05 hour 6: 140641 events in 3 files, snapshot 1874063096786698466 (task 8261 ms: download 2862 ms overlapping gunzip 476 ms, parse 2040 ms, sort 67 ms, write 4241 ms, index 497 ms: 2 candidates, 75375 repo-hours, 904 releases; waiting 620 ms; commit 1421 ms)
2026-11-07T16:34:33Z [load_day 2023-03-05] 2023-03-05 hour 7: 139932 events in 3 files, snapshot 7420889456461942250 (task 8048 ms: download 2175 ms overlapping gunzip 477 ms, parse 2051 ms, sort 83 ms, write 4141 ms, index 459 ms: 2 candidates, 72238 repo-hours, 812 releases; waiting 534 ms; commit 1475 ms)
2026-11-07T16:34:42Z [load_day 2023-03-05] 2023-03-05 hour 8: 146669 events in 3 files, snapshot 4405235701090708681 (task 8933 ms: download 3498 ms overlapping gunzip 535 ms, parse 2313 ms, sort 87 ms, write 4633 ms, index 525 ms: 5 candidates, 75117 repo-hours, 912 releases; waiting 550 ms; commit 1407 ms)
2026-11-07T16:34:43Z [load_day 2023-03-05] 2023-03-05 hour 9: 131280 events in 3 files, snapshot 8481208536952010814 (task 8611 ms: download 3407 ms overlapping gunzip 533 ms, parse 2269 ms, sort 66 ms, write 4475 ms, index 390 ms: 3 candidates, 59233 repo-hours, 1013 releases; waiting 575 ms; commit 1446 ms)
2026-11-07T16:34:52Z [load_day 2023-03-05] 2023-03-05 hour 10: 134798 events in 3 files, snapshot 9196129514838674951 (task 9335 ms: download 3944 ms overlapping gunzip 579 ms, parse 2443 ms, sort 85 ms, write 4980 ms, index 430 ms: 2 candidates, 56535 repo-hours, 1044 releases; waiting 529 ms; commit 1440 ms)
2026-11-07T16:34:54Z [load_day 2023-03-05] 2023-03-05 hour 11: 135033 events in 3 files, snapshot 1300441878722971547 (task 9281 ms: download 3780 ms overlapping gunzip 561 ms, parse 2372 ms, sort 95 ms, write 4984 ms, index 376 ms: 3 candidates, 56647 repo-hours, 987 releases; waiting 610 ms; commit 1569 ms)
2026-11-07T16:35:04Z [load_day 2023-03-05] 2023-03-05 hour 12: 187669 events in 4 files, snapshot 5727729802447814727 (task 10992 ms: download 4066 ms overlapping gunzip 617 ms, parse 2758 ms, sort 129 ms, write 6014 ms, index 612 ms: 4 candidates, 90115 repo-hours, 1091 releases; waiting 578 ms; commit 1554 ms)
2026-11-07T16:35:05Z [load_day 2023-03-05] 2023-03-05 hour 13: 174219 events in 4 files, snapshot 2047873189514692451 (task 10993 ms: download 4079 ms overlapping gunzip 658 ms, parse 2802 ms, sort 110 ms, write 6021 ms, index 591 ms: 3 candidates, 88344 repo-hours, 1044 releases; waiting 519 ms; commit 1536 ms)
2026-11-07T16:35:18Z [load_day 2023-03-05] 2023-03-05 hour 14: 168784 events in 4 files, snapshot 7499560489804824613 (task 13218 ms: download 6698 ms overlapping gunzip 674 ms, parse 2859 ms, sort 112 ms, write 5880 ms, index 492 ms: 5 candidates, 79336 repo-hours, 1091 releases; waiting 2900 ms; commit 1415 ms)
2026-11-07T16:35:19Z [load_day 2023-03-05] 2023-03-05 hour 15: 163616 events in 4 files, snapshot 7086368001484062725 (task 10906 ms: download 4204 ms overlapping gunzip 620 ms, parse 2705 ms, sort 99 ms, write 6173 ms, index 472 ms: 2 candidates, 73465 repo-hours, 1314 releases; waiting 533 ms; commit 1535 ms)
2026-11-07T16:35:33Z [load_day 2023-03-05] 2023-03-05 hour 16: 158988 events in 4 files, snapshot 3232934850090442718 (task 14406 ms: download 7984 ms overlapping gunzip 681 ms, parse 2996 ms, sort 107 ms, write 5724 ms, index 456 ms: 4 candidates, 67812 repo-hours, 1111 releases; waiting 3990 ms; commit 1673 ms)
2026-11-07T16:35:35Z [load_day 2023-03-05] 2023-03-05 hour 17: 166608 events in 4 files, snapshot 6190669307809783016 (task 11440 ms: download 4519 ms overlapping gunzip 610 ms, parse 2703 ms, sort 97 ms, write 6331 ms, index 501 ms: 1 candidates, 76719 repo-hours, 1060 releases; waiting 865 ms; commit 1418 ms)
2026-11-07T16:35:46Z [load_day 2023-03-05] 2023-03-05 hour 18: 167602 events in 4 files, snapshot 2830885850249265305 (task 11795 ms: download 4836 ms overlapping gunzip 759 ms, parse 3101 ms, sort 112 ms, write 6464 ms, index 529 ms: 2 candidates, 74392 repo-hours, 1123 releases; waiting 532 ms; commit 1609 ms)
2026-11-07T16:35:47Z [load_day 2023-03-05] 2023-03-05 hour 19: 146807 events in 3 files, snapshot 6480161091426205812 (task 10301 ms: download 4264 ms overlapping gunzip 636 ms, parse 2769 ms, sort 101 ms, write 5537 ms, index 448 ms: 2 candidates, 58878 repo-hours, 1047 releases; waiting 533 ms; commit 1506 ms)
2026-11-07T16:35:57Z [load_day 2023-03-05] 2023-03-05 hour 20: 161300 events in 4 files, snapshot 2002905172132557304 (task 10122 ms: download 3596 ms overlapping gunzip 576 ms, parse 2502 ms, sort 100 ms, write 5698 ms, index 514 ms: 4 candidates, 83809 repo-hours, 1065 releases; waiting 399 ms; commit 1670 ms)
2026-11-07T16:35:58Z [load_day 2023-03-05] 2023-03-05 hour 21: 133802 events in 3 files, snapshot 1585376870857194455 (task 9408 ms: download 3795 ms overlapping gunzip 553 ms, parse 2518 ms, sort 94 ms, write 5056 ms, index 363 ms: 4 candidates, 54115 repo-hours, 1131 releases; waiting 495 ms; commit 1548 ms)
2026-11-07T16:36:10Z [load_day 2023-03-05] 2023-03-05 hour 22: 129620 events in 3 files, snapshot 8376359685291162516 (task 9610 ms: download 4050 ms overlapping gunzip 553 ms, parse 2364 ms, sort 81 ms, write 5165 ms, index 332 ms: 1 candidates, 50886 repo-hours, 1110 releases; waiting 591 ms; commit 4492 ms)
2026-11-07T16:36:12Z [load_day 2023-03-05] 2023-03-05 hour 23: 118528 events in 3 files, snapshot 5636461427628283376 (task 8598 ms: download 2347 ms overlapping gunzip 523 ms, parse 2265 ms, sort 73 ms, write 4546 ms, index 328 ms: 0 candidates, 49402 repo-hours, 969 releases; waiting 553 ms; commit 1522 ms)
2026-11-07T16:36:19Z [load_day 2023-03-05] 2023-03-05: repo_hour merged from 24 files to 1 (1755343 rows, 6982 ms)
2026-11-07T16:36:21Z [load_day 2023-03-05] 2023-03-05: index committed in 9091 ms (23 + 1 + 24 files)
2026-11-07T16:36:21Z [load_day 2023-03-05] 2023-03-05: 3578118 events in 24 hours
2026-11-07T16:36:21Z [load_day 2023-03-05] attempt 1 succeeded