orcaLog in

Runs · run 924

load_day 2023-03-21, attempt 1 succeeded

Host
caf251265124:184532
Started
2026-11-07T17:25:50Z
Ended
2026-11-07T17:29:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/924/load_day/2023-03-21/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:25:50Z [load_day 2023-03-21] attempt 1 started
2026-11-07T17:25:51Z [load_day 2023-03-21] 2023-03-21: 2 hours in flight, about 1200 MB
2026-11-07T17:26:07Z [load_day 2023-03-21] 2023-03-21 hour 0: 173253 events in 4 files, snapshot 3102391093630800378 (task 13176 ms: download 5954 ms overlapping gunzip 785 ms, parse 3481 ms, sort 146 ms, write 7351 ms, index 543 ms: 8 candidates, 85041 repo-hours, 938 releases; waiting 561 ms; commit 1457 ms)
2026-11-07T17:26:09Z [load_day 2023-03-21] 2023-03-21 hour 1: 172411 events in 4 files, snapshot 1873964697143396805 (task 12715 ms: download 5165 ms overlapping gunzip 743 ms, parse 3340 ms, sort 124 ms, write 7048 ms, index 588 ms: 9 candidates, 91847 repo-hours, 911 releases; waiting 532 ms; commit 1465 ms)
2026-11-07T17:26:19Z [load_day 2023-03-21] 2023-03-21 hour 2: 152109 events in 4 files, snapshot 1030293863314132962 (task 11463 ms: download 4868 ms overlapping gunzip 724 ms, parse 3059 ms, sort 106 ms, write 6170 ms, index 460 ms: 3 candidates, 67801 repo-hours, 840 releases; waiting 580 ms; commit 1353 ms)
2026-11-07T17:26:21Z [load_day 2023-03-21] 2023-03-21 hour 3: 142241 events in 3 files, snapshot 2908523256383186285 (task 11154 ms: download 4875 ms overlapping gunzip 664 ms, parse 2858 ms, sort 87 ms, write 5971 ms, index 428 ms: 6 candidates, 61407 repo-hours, 870 releases; waiting 768 ms; commit 1664 ms)
2026-11-07T17:26:30Z [load_day 2023-03-21] 2023-03-21 hour 4: 132623 events in 3 files, snapshot 2000063081434798676 (task 10466 ms: download 4966 ms overlapping gunzip 624 ms, parse 2668 ms, sort 97 ms, write 5830 ms, index 370 ms: 2 candidates, 55915 repo-hours, 688 releases; waiting 589 ms; commit 1405 ms)
2026-11-07T17:26:33Z [load_day 2023-03-21] 2023-03-21 hour 5: 143939 events in 3 files, snapshot 8172736996086798490 (task 11384 ms: download 5000 ms overlapping gunzip 704 ms, parse 2971 ms, sort 85 ms, write 6607 ms, index 392 ms: 3 candidates, 60271 repo-hours, 696 releases; waiting 288 ms; commit 1429 ms)
2026-11-07T17:26:43Z [load_day 2023-03-21] 2023-03-21 hour 6: 161423 events in 4 files, snapshot 2719524000869011356 (task 12115 ms: download 5001 ms overlapping gunzip 748 ms, parse 3209 ms, sort 106 ms, write 6745 ms, index 500 ms: 5 candidates, 72637 repo-hours, 809 releases; waiting 524 ms; commit 1505 ms)
2026-11-07T17:26:47Z [load_day 2023-03-21] 2023-03-21 hour 7: 169677 events in 4 files, snapshot 4765224321419200830 (task 13539 ms: download 7750 ms overlapping gunzip 812 ms, parse 3531 ms, sort 113 ms, write 7723 ms, index 521 ms: 6 candidates, 73917 repo-hours, 820 releases; waiting 530 ms; commit 1390 ms)
2026-11-07T17:26:58Z [load_day 2023-03-21] 2023-03-21 hour 8: 178495 events in 4 files, snapshot 8528863780751279336 (task 13730 ms: download 7293 ms overlapping gunzip 783 ms, parse 3357 ms, sort 120 ms, write 7833 ms, index 599 ms: 6 candidates, 98263 repo-hours, 855 releases; waiting 630 ms; commit 1466 ms)
2026-11-07T17:27:04Z [load_day 2023-03-21] 2023-03-21 hour 9: 184027 events in 4 files, snapshot 3924757800726192058 (task 16106 ms: download 9056 ms overlapping gunzip 974 ms, parse 4191 ms, sort 119 ms, write 9325 ms, index 613 ms: 9 candidates, 83438 repo-hours, 1149 releases; waiting 547 ms; commit 1443 ms)
2026-11-07T17:27:18Z [load_day 2023-03-21] 2023-03-21 hour 10: 176076 events in 4 files, snapshot 4287548036222057055 (task 14907 ms: download 8672 ms overlapping gunzip 908 ms, parse 3989 ms, sort 112 ms, write 8649 ms, index 559 ms: 11 candidates, 81305 repo-hours, 934 releases; waiting 354 ms; commit 5845 ms)
2026-11-07T17:27:20Z [load_day 2023-03-21] 2023-03-21 hour 11: 183096 events in 4 files, snapshot 3593369781246049458 (task 15384 ms: download 8837 ms overlapping gunzip 919 ms, parse 3943 ms, sort 115 ms, write 8838 ms, index 556 ms: 4 candidates, 81473 repo-hours, 927 releases; waiting 691 ms; commit 1532 ms)
2026-11-07T17:27:34Z [load_day 2023-03-21] 2023-03-21 hour 12: 214610 events in 5 files, snapshot 6277274118661666046 (task 15445 ms: download 8334 ms overlapping gunzip 896 ms, parse 4118 ms, sort 133 ms, write 8796 ms, index 668 ms: 7 candidates, 109280 repo-hours, 873 releases; waiting 530 ms; commit 1483 ms)
2026-11-07T17:27:37Z [load_day 2023-03-21] 2023-03-21 hour 13: 203134 events in 5 files, snapshot 8590326323451681598 (task 16445 ms: download 8713 ms overlapping gunzip 956 ms, parse 4065 ms, sort 135 ms, write 9656 ms, index 723 ms: 10 candidates, 110864 repo-hours, 981 releases; waiting 577 ms; commit 1597 ms)
2026-11-07T17:27:51Z [load_day 2023-03-21] 2023-03-21 hour 14: 196958 events in 4 files, snapshot 3040308973401389726 (task 16606 ms: download 9236 ms overlapping gunzip 980 ms, parse 4265 ms, sort 142 ms, write 9848 ms, index 655 ms: 7 candidates, 99768 repo-hours, 1090 releases; waiting 410 ms; commit 1392 ms)
2026-11-07T17:27:54Z [load_day 2023-03-21] 2023-03-21 hour 15: 189284 events in 4 files, snapshot 3112544364113850782 (task 15694 ms: download 8375 ms overlapping gunzip 868 ms, parse 3765 ms, sort 138 ms, write 9126 ms, index 753 ms: 6 candidates, 109798 repo-hours, 1054 releases; waiting 675 ms; commit 1448 ms)
2026-11-07T17:28:07Z [load_day 2023-03-21] 2023-03-21 hour 16: 190759 events in 4 files, snapshot 8538664901485494815 (task 15628 ms: download 8351 ms overlapping gunzip 918 ms, parse 4026 ms, sort 124 ms, write 9119 ms, index 618 ms: 6 candidates, 100723 repo-hours, 909 releases; waiting 516 ms; commit 1326 ms)
2026-11-07T17:28:10Z [load_day 2023-03-21] 2023-03-21 hour 17: 191243 events in 4 files, snapshot 5801222686606128638 (task 15906 ms: download 8999 ms overlapping gunzip 941 ms, parse 4170 ms, sort 132 ms, write 9230 ms, index 619 ms: 3 candidates, 87813 repo-hours, 1055 releases; waiting 524 ms; commit 1587 ms)
2026-11-07T17:28:24Z [load_day 2023-03-21] 2023-03-21 hour 18: 193552 events in 4 files, snapshot 6147077845994843711 (task 15236 ms: download 8337 ms overlapping gunzip 891 ms, parse 3830 ms, sort 134 ms, write 8885 ms, index 583 ms: 7 candidates, 94229 repo-hours, 943 releases; waiting 552 ms; commit 1696 ms)
2026-11-07T17:28:26Z [load_day 2023-03-21] 2023-03-21 hour 19: 180810 events in 4 files, snapshot 6288587144697611194 (task 14828 ms: download 8410 ms overlapping gunzip 881 ms, parse 3843 ms, sort 106 ms, write 8570 ms, index 524 ms: 5 candidates, 78338 repo-hours, 942 releases; waiting 537 ms; commit 1528 ms)
2026-11-07T17:28:40Z [load_day 2023-03-21] 2023-03-21 hour 20: 176798 events in 4 files, snapshot 3432452314564214566 (task 14871 ms: download 8901 ms overlapping gunzip 859 ms, parse 3737 ms, sort 111 ms, write 8413 ms, index 525 ms: 12 candidates, 76782 repo-hours, 938 releases; waiting 837 ms; commit 1680 ms)
2026-11-07T17:28:41Z [load_day 2023-03-21] 2023-03-21 hour 21: 183460 events in 4 files, snapshot 5786117304196532825 (task 13855 ms: download 7585 ms overlapping gunzip 808 ms, parse 3553 ms, sort 139 ms, write 7964 ms, index 531 ms: 8 candidates, 91066 repo-hours, 914 releases; waiting 558 ms; commit 1490 ms)
2026-11-07T17:28:54Z [load_day 2023-03-21] 2023-03-21 hour 22: 160297 events in 4 files, snapshot 5070703893730221129 (task 13624 ms: download 8188 ms overlapping gunzip 842 ms, parse 3604 ms, sort 104 ms, write 7596 ms, index 462 ms: 5 candidates, 66976 repo-hours, 808 releases; waiting 639 ms; commit 1539 ms)
2026-11-07T17:28:55Z [load_day 2023-03-21] 2023-03-21 hour 23: 155738 events in 4 files, snapshot 2437002464489570280 (task 11788 ms: download 5254 ms overlapping gunzip 715 ms, parse 2953 ms, sort 110 ms, write 6614 ms, index 461 ms: 11 candidates, 75736 repo-hours, 656 releases; waiting 600 ms; commit 1474 ms)
2026-11-07T17:29:03Z [load_day 2023-03-21] 2023-03-21: repo_hour merged from 24 files to 1 (2014688 rows, 7844 ms)
2026-11-07T17:29:05Z [load_day 2023-03-21] 2023-03-21: index committed in 10055 ms (24 + 1 + 24 files)
2026-11-07T17:29:05Z [load_day 2023-03-21] 2023-03-21: 4206013 events in 24 hours
2026-11-07T17:29:05Z [load_day 2023-03-21] attempt 1 succeeded