orcaLog in

Runs · run 828

load_day 2023-02-17, attempt 1 succeeded

Host
caf251265124:66342
Started
2026-11-07T15:43:35Z
Ended
2026-11-07T15:46:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/828/load_day/2023-02-17/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:43:35Z [load_day 2023-02-17] attempt 1 started
2026-11-07T15:43:36Z [load_day 2023-02-17] 2023-02-17: 2 hours in flight, about 1200 MB
2026-11-07T15:43:52Z [load_day 2023-02-17] 2023-02-17 hour 0: 160841 events in 4 files, snapshot 8484898374722602990 (task 12832 ms: download 5846 ms overlapping gunzip 778 ms, parse 3379 ms, sort 105 ms, write 7254 ms, index 487 ms: 7 candidates, 74816 repo-hours, 953 releases; waiting 519 ms; commit 1396 ms)
2026-11-07T15:43:53Z [load_day 2023-02-17] 2023-02-17 hour 1: 167968 events in 4 files, snapshot 8574011318841954212 (task 13282 ms: download 5460 ms overlapping gunzip 807 ms, parse 3431 ms, sort 108 ms, write 7565 ms, index 547 ms: 5 candidates, 83274 repo-hours, 905 releases; waiting 506 ms; commit 1308 ms)
2026-11-07T15:44:04Z [load_day 2023-02-17] 2023-02-17 hour 2: 146678 events in 3 files, snapshot 528141838843607471 (task 11266 ms: download 4827 ms overlapping gunzip 662 ms, parse 2802 ms, sort 103 ms, write 6387 ms, index 484 ms: 6 candidates, 71301 repo-hours, 700 releases; waiting 515 ms; commit 1651 ms)
2026-11-07T15:44:05Z [load_day 2023-02-17] 2023-02-17 hour 3: 139160 events in 3 files, snapshot 1887422115768979822 (task 10016 ms: download 3922 ms overlapping gunzip 598 ms, parse 2567 ms, sort 91 ms, write 5761 ms, index 404 ms: 4 candidates, 59778 repo-hours, 918 releases; waiting 194 ms; commit 1423 ms)
2026-11-07T15:44:14Z [load_day 2023-02-17] 2023-02-17 hour 4: 126485 events in 3 files, snapshot 6709457404436103755 (task 9772 ms: download 4348 ms overlapping gunzip 586 ms, parse 2477 ms, sort 79 ms, write 5313 ms, index 358 ms: 4 candidates, 53550 repo-hours, 624 releases; waiting 646 ms; commit 1371 ms)
2026-11-07T15:44:17Z [load_day 2023-02-17] 2023-02-17 hour 5: 135671 events in 3 files, snapshot 9087344032369256753 (task 10617 ms: download 4673 ms overlapping gunzip 662 ms, parse 2827 ms, sort 82 ms, write 5785 ms, index 387 ms: 4 candidates, 58228 repo-hours, 721 releases; waiting 586 ms; commit 1505 ms)
2026-11-07T15:44:26Z [load_day 2023-02-17] 2023-02-17 hour 6: 148616 events in 3 files, snapshot 4170710350972712758 (task 10993 ms: download 4108 ms overlapping gunzip 625 ms, parse 2768 ms, sort 97 ms, write 6324 ms, index 457 ms: 7 candidates, 68460 repo-hours, 864 releases; waiting 403 ms; commit 1296 ms)
2026-11-07T15:44:30Z [load_day 2023-02-17] 2023-02-17 hour 7: 155184 events in 4 files, snapshot 908877761146774657 (task 12658 ms: download 5307 ms overlapping gunzip 729 ms, parse 3181 ms, sort 90 ms, write 7213 ms, index 510 ms: 3 candidates, 69481 repo-hours, 817 releases; waiting 608 ms; commit 1477 ms)
2026-11-07T15:44:42Z [load_day 2023-02-17] 2023-02-17 hour 8: 175183 events in 4 files, snapshot 5863057183918010010 (task 14890 ms: download 8661 ms overlapping gunzip 872 ms, parse 3756 ms, sort 104 ms, write 8587 ms, index 533 ms: 4 candidates, 78669 repo-hours, 921 releases; waiting 731 ms; commit 1494 ms)
2026-11-07T15:44:47Z [load_day 2023-02-17] 2023-02-17 hour 9: 185740 events in 4 files, snapshot 2652689497107455446 (task 15810 ms: download 9158 ms overlapping gunzip 931 ms, parse 4038 ms, sort 121 ms, write 8990 ms, index 597 ms: 5 candidates, 82174 repo-hours, 1221 releases; waiting 822 ms; commit 1446 ms)
2026-11-07T15:45:01Z [load_day 2023-02-17] 2023-02-17 hour 10: 184020 events in 4 files, snapshot 1542508959063012154 (task 15600 ms: download 8886 ms overlapping gunzip 924 ms, parse 3997 ms, sort 110 ms, write 8686 ms, index 548 ms: 4 candidates, 81351 repo-hours, 1028 releases; waiting 855 ms; commit 4461 ms)
2026-11-07T15:45:03Z [load_day 2023-02-17] 2023-02-17 hour 11: 178887 events in 4 files, snapshot 1072763227788351484 (task 15183 ms: download 8859 ms overlapping gunzip 917 ms, parse 3976 ms, sort 101 ms, write 8550 ms, index 523 ms: 6 candidates, 75494 repo-hours, 960 releases; waiting 822 ms; commit 1627 ms)
2026-11-07T15:45:19Z [load_day 2023-02-17] 2023-02-17 hour 12: 215980 events in 5 files, snapshot 1027405061318511634 (task 20081 ms: download 12555 ms overlapping gunzip 1018 ms, parse 4454 ms, sort 128 ms, write 9555 ms, index 700 ms: 3 candidates, 103047 repo-hours, 1093 releases; waiting 3879 ms; commit 1398 ms)
2026-11-07T15:45:20Z [load_day 2023-02-17] 2023-02-17 hour 13: 214902 events in 5 files, snapshot 1798828412891037682 (task 16719 ms: download 8865 ms overlapping gunzip 994 ms, parse 4440 ms, sort 138 ms, write 9421 ms, index 663 ms: 6 candidates, 108085 repo-hours, 1076 releases; waiting 634 ms; commit 1308 ms)
2026-11-07T15:45:38Z [load_day 2023-02-17] 2023-02-17 hour 14: 209339 events in 5 files, snapshot 6044900306663839105 (task 18147 ms: download 10255 ms overlapping gunzip 1066 ms, parse 4609 ms, sort 127 ms, write 10343 ms, index 607 ms: 6 candidates, 93284 repo-hours, 1123 releases; waiting 977 ms; commit 1430 ms)
2026-11-07T15:45:39Z [load_day 2023-02-17] 2023-02-17 hour 15: 211719 events in 5 files, snapshot 2762887595942752658 (task 17617 ms: download 9740 ms overlapping gunzip 1063 ms, parse 4599 ms, sort 132 ms, write 10217 ms, index 591 ms: 5 candidates, 92006 repo-hours, 1354 releases; waiting 708 ms; commit 1449 ms)
2026-11-07T15:45:55Z [load_day 2023-02-17] 2023-02-17 hour 16: 204808 events in 5 files, snapshot 4796955105792113813 (task 16605 ms: download 8997 ms overlapping gunzip 986 ms, parse 4255 ms, sort 107 ms, write 9736 ms, index 657 ms: 5 candidates, 90378 repo-hours, 1045 releases; waiting 518 ms; commit 1532 ms)
2026-11-07T15:45:57Z [load_day 2023-02-17] 2023-02-17 hour 17: 193034 events in 4 files, snapshot 1987850770271148029 (task 15469 ms: download 8699 ms overlapping gunzip 922 ms, parse 4106 ms, sort 123 ms, write 8910 ms, index 568 ms: 5 candidates, 82225 repo-hours, 938 releases; waiting 548 ms; commit 1428 ms)
2026-11-07T15:46:11Z [load_day 2023-02-17] 2023-02-17 hour 18: 188861 events in 4 files, snapshot 891943077276772070 (task 15442 ms: download 8778 ms overlapping gunzip 918 ms, parse 4011 ms, sort 129 ms, write 8744 ms, index 516 ms: 3 candidates, 82293 repo-hours, 1113 releases; waiting 632 ms; commit 1524 ms)
2026-11-07T15:46:13Z [load_day 2023-02-17] 2023-02-17 hour 19: 173466 events in 4 files, snapshot 6580112189328324689 (task 13737 ms: download 8076 ms overlapping gunzip 859 ms, parse 3724 ms, sort 105 ms, write 7749 ms, index 477 ms: 7 candidates, 72930 repo-hours, 971 releases; waiting 525 ms; commit 1438 ms)
2026-11-07T15:46:29Z [load_day 2023-02-17] 2023-02-17 hour 20: 173659 events in 4 files, snapshot 2013415855876357091 (task 15936 ms: download 10040 ms overlapping gunzip 875 ms, parse 3774 ms, sort 120 ms, write 7705 ms, index 486 ms: 5 candidates, 76056 repo-hours, 1026 releases; waiting 2463 ms; commit 1600 ms)
2026-11-07T15:46:30Z [load_day 2023-02-17] 2023-02-17 hour 21: 161270 events in 4 files, snapshot 5332182887937570111 (task 13462 ms: download 6053 ms overlapping gunzip 791 ms, parse 3480 ms, sort 92 ms, write 7518 ms, index 417 ms: 3 candidates, 64596 repo-hours, 965 releases; waiting 714 ms; commit 1451 ms)
2026-11-07T15:46:43Z [load_day 2023-02-17] 2023-02-17 hour 22: 161657 events in 4 files, snapshot 4702739146548704529 (task 13476 ms: download 8304 ms overlapping gunzip 884 ms, parse 3690 ms, sort 108 ms, write 7457 ms, index 459 ms: 7 candidates, 68592 repo-hours, 870 releases; waiting 574 ms; commit 1483 ms)
2026-11-07T15:46:44Z [load_day 2023-02-17] 2023-02-17 hour 23: 141986 events in 3 files, snapshot 1380700474259102340 (task 10693 ms: download 4915 ms overlapping gunzip 660 ms, parse 2819 ms, sort 77 ms, write 5823 ms, index 426 ms: 8 candidates, 65045 repo-hours, 759 releases; waiting 564 ms; commit 1471 ms)
2026-11-07T15:46:52Z [load_day 2023-02-17] 2023-02-17: repo_hour merged from 24 files to 1 (1855113 rows, 7463 ms)
2026-11-07T15:46:53Z [load_day 2023-02-17] 2023-02-17: index committed in 9038 ms (24 + 1 + 24 files)
2026-11-07T15:46:53Z [load_day 2023-02-17] 2023-02-17: 4155114 events in 24 hours
2026-11-07T15:46:53Z [load_day 2023-02-17] attempt 1 succeeded