orcaLog in

Runs · run 1182

load_day 2023-06-15, attempt 1 succeeded

Host
3c2b29713ce8:7901
Started
2026-11-07T21:31:32Z
Ended
2026-11-07T21:33:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1182/load_day/2023-06-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:31:32Z [load_day 2023-06-15] attempt 1 started
2026-11-07T21:31:33Z [load_day 2023-06-15] 2023-06-15: 4 hours in flight, about 2100 MB
2026-11-07T21:31:50Z [load_day 2023-06-15] 2023-06-15 hour 0: 145538 events in 3 files, snapshot 9048356562341520187 (task 13878 ms: download 6453 ms overlapping gunzip 790 ms, parse 3624 ms, sort 143 ms, write 8090 ms, index 468 ms: 9 candidates, 71604 repo-hours, 821 releases; waiting 463 ms; commit 1665 ms)
2026-11-07T21:31:52Z [load_day 2023-06-15] 2023-06-15 hour 1: 151166 events in 4 files, snapshot 5001469894970102841 (task 14015 ms: download 6105 ms overlapping gunzip 757 ms, parse 3597 ms, sort 92 ms, write 8240 ms, index 532 ms: 6 candidates, 83296 repo-hours, 836 releases; waiting 492 ms; commit 1681 ms)
2026-11-07T21:31:54Z [load_day 2023-06-15] 2023-06-15 hour 2: 151981 events in 4 files, snapshot 6972921678123564238 (task 13858 ms: download 6257 ms overlapping gunzip 807 ms, parse 3753 ms, sort 131 ms, write 7930 ms, index 455 ms: 5 candidates, 69341 repo-hours, 1270 releases; waiting 443 ms; commit 2015 ms)
2026-11-07T21:31:56Z [load_day 2023-06-15] 2023-06-15 hour 3: 130478 events in 3 files, snapshot 6178758489915017763 (task 13084 ms: download 5638 ms overlapping gunzip 668 ms, parse 3081 ms, sort 144 ms, write 8223 ms, index 455 ms: 6 candidates, 58413 repo-hours, 784 releases; waiting 217 ms; commit 2287 ms)
2026-11-07T21:32:04Z [load_day 2023-06-15] 2023-06-15 hour 4: 128635 events in 3 files, snapshot 8780206786936657547 (task 11946 ms: download 4808 ms overlapping gunzip 567 ms, parse 2639 ms, sort 78 ms, write 7228 ms, index 545 ms: 1 candidates, 58126 repo-hours, 569 releases; waiting 553 ms; commit 2070 ms)
2026-11-07T21:32:07Z [load_day 2023-06-15] 2023-06-15 hour 5: 140308 events in 3 files, snapshot 8389143984777241890 (task 13781 ms: download 5690 ms overlapping gunzip 743 ms, parse 3283 ms, sort 102 ms, write 8389 ms, index 420 ms: 5 candidates, 62757 repo-hours, 928 releases; waiting 501 ms; commit 1769 ms)
2026-11-07T21:32:11Z [load_day 2023-06-15] 2023-06-15 hour 6: 165833 events in 4 files, snapshot 7428373522833699145 (task 16040 ms: download 5981 ms overlapping gunzip 718 ms, parse 3391 ms, sort 105 ms, write 10301 ms, index 650 ms: 5 candidates, 79488 repo-hours, 953 releases; waiting 510 ms; commit 1934 ms)
2026-11-07T21:32:15Z [load_day 2023-06-15] 2023-06-15 hour 7: 165951 events in 4 files, snapshot 5572704684113221875 (task 17619 ms: download 10199 ms overlapping gunzip 889 ms, parse 4066 ms, sort 126 ms, write 11179 ms, index 587 ms: 7 candidates, 77607 repo-hours, 934 releases; waiting 495 ms; commit 2314 ms)
2026-11-07T21:32:28Z [load_day 2023-06-15] 2023-06-15 hour 8: 185913 events in 4 files, snapshot 2298890552164332887 (task 23190 ms: download 14962 ms overlapping gunzip 1046 ms, parse 4607 ms, sort 114 ms, write 13479 ms, index 556 ms: 6 candidates, 86043 repo-hours, 1096 releases; waiting 3068 ms; commit 2020 ms)
2026-11-07T21:32:30Z [load_day 2023-06-15] 2023-06-15 hour 9: 177913 events in 4 files, snapshot 402092333029169640 (task 19839 ms: download 11724 ms overlapping gunzip 1036 ms, parse 4639 ms, sort 117 ms, write 12261 ms, index 551 ms: 4 candidates, 82593 repo-hours, 1197 releases; waiting 598 ms; commit 1965 ms)
2026-11-07T21:32:32Z [load_day 2023-06-15] 2023-06-15 hour 10: 166903 events in 4 files, snapshot 7947140548772792623 (task 16944 ms: download 10109 ms overlapping gunzip 915 ms, parse 4040 ms, sort 121 ms, write 11103 ms, index 558 ms: 4 candidates, 77423 repo-hours, 950 releases; waiting 15 ms; commit 2226 ms)
2026-11-07T21:32:34Z [load_day 2023-06-15] 2023-06-15 hour 11: 168635 events in 4 files, snapshot 2128150839494374077 (task 16954 ms: download 9624 ms overlapping gunzip 913 ms, parse 4069 ms, sort 103 ms, write 11030 ms, index 617 ms: 3 candidates, 77001 repo-hours, 973 releases; waiting 16 ms; commit 2211 ms)
2026-11-07T21:32:48Z [load_day 2023-06-15] 2023-06-15 hour 12: 198897 events in 4 files, snapshot 5603743079386994510 (task 19604 ms: download 10662 ms overlapping gunzip 958 ms, parse 4775 ms, sort 129 ms, write 12824 ms, index 662 ms: 6 candidates, 102614 repo-hours, 1016 releases; waiting 38 ms; commit 2197 ms)
2026-11-07T21:32:50Z [load_day 2023-06-15] 2023-06-15 hour 13: 183298 events in 4 files, snapshot 5378034610469171795 (task 19479 ms: download 10818 ms overlapping gunzip 1030 ms, parse 4847 ms, sort 114 ms, write 12565 ms, index 728 ms: 6 candidates, 96225 repo-hours, 903 releases; waiting 7 ms; commit 2031 ms)
2026-11-07T21:32:53Z [load_day 2023-06-15] 2023-06-15 hour 14: 175949 events in 4 files, snapshot 111472617923114339 (task 19698 ms: download 11622 ms overlapping gunzip 920 ms, parse 4426 ms, sort 158 ms, write 13016 ms, index 945 ms: 6 candidates, 86183 repo-hours, 928 releases; waiting 18 ms; commit 2288 ms)
2026-11-07T21:32:55Z [load_day 2023-06-15] 2023-06-15 hour 15: 171644 events in 4 files, snapshot 15328534229968163 (task 19866 ms: download 11525 ms overlapping gunzip 1107 ms, parse 4964 ms, sort 113 ms, write 12097 ms, index 804 ms: 5 candidates, 83586 repo-hours, 1158 releases; waiting 462 ms; commit 2173 ms)
2026-11-07T21:33:07Z [load_day 2023-06-15] 2023-06-15 hour 16: 171237 events in 4 files, snapshot 8378369690296333395 (task 18733 ms: download 11343 ms overlapping gunzip 904 ms, parse 4291 ms, sort 144 ms, write 11959 ms, index 581 ms: 7 candidates, 82089 repo-hours, 932 releases; waiting 533 ms; commit 2036 ms)
2026-11-07T21:33:10Z [load_day 2023-06-15] 2023-06-15 hour 17: 161236 events in 4 files, snapshot 5063400094500120038 (task 17251 ms: download 6899 ms overlapping gunzip 952 ms, parse 4370 ms, sort 101 ms, write 10972 ms, index 630 ms: 4 candidates, 75297 repo-hours, 990 releases; waiting 17 ms; commit 2085 ms)
2026-11-07T21:33:11Z [load_day 2023-06-15] 2023-06-15 hour 18: 165772 events in 4 files, snapshot 4816452485459416788 (task 16497 ms: download 6707 ms overlapping gunzip 835 ms, parse 3657 ms, sort 110 ms, write 11147 ms, index 522 ms: 9 candidates, 78094 repo-hours, 985 releases; waiting 22 ms; commit 1894 ms)
2026-11-07T21:33:14Z [load_day 2023-06-15] 2023-06-15 hour 19: 159425 events in 4 files, snapshot 5370766515436927602 (task 16135 ms: download 6534 ms overlapping gunzip 886 ms, parse 3896 ms, sort 100 ms, write 10330 ms, index 703 ms: 7 candidates, 69714 repo-hours, 919 releases; waiting 15 ms; commit 2265 ms)
2026-11-07T21:33:24Z [load_day 2023-06-15] 2023-06-15 hour 20: 156768 events in 4 files, snapshot 5029415726114539219 (task 15978 ms: download 6132 ms overlapping gunzip 880 ms, parse 3872 ms, sort 105 ms, write 10402 ms, index 517 ms: 5 candidates, 69176 repo-hours, 918 releases; waiting 18 ms; commit 1799 ms)
2026-11-07T21:33:26Z [load_day 2023-06-15] 2023-06-15 hour 21: 146879 events in 3 files, snapshot 2599050136856041389 (task 14651 ms: download 6350 ms overlapping gunzip 790 ms, parse 3793 ms, sort 108 ms, write 9346 ms, index 401 ms: 4 candidates, 62892 repo-hours, 900 releases; waiting 19 ms; commit 1765 ms)
2026-11-07T21:33:28Z [load_day 2023-06-15] 2023-06-15 hour 22: 132472 events in 3 files, snapshot 3906118858514895330 (task 12644 ms: download 5524 ms overlapping gunzip 676 ms, parse 3013 ms, sort 84 ms, write 8301 ms, index 353 ms: 1 candidates, 55976 repo-hours, 794 releases; waiting 16 ms; commit 1684 ms)
2026-11-07T21:33:29Z [load_day 2023-06-15] 2023-06-15 hour 23: 125325 events in 3 files, snapshot 6004850610019693279 (task 11874 ms: download 5170 ms overlapping gunzip 689 ms, parse 3073 ms, sort 91 ms, write 7336 ms, index 363 ms: 2 candidates, 53223 repo-hours, 728 releases; waiting 20 ms; commit 1814 ms)
2026-11-07T21:33:37Z [load_day 2023-06-15] 2023-06-15: repo_hour merged from 24 files to 1 (1798761 rows, 7399 ms)
2026-11-07T21:33:39Z [load_day 2023-06-15] 2023-06-15: index committed in 9397 ms (24 + 1 + 24 files)
2026-11-07T21:33:39Z [load_day 2023-06-15] 2023-06-15: 3828156 events in 24 hours
2026-11-07T21:33:39Z [load_day 2023-06-15] attempt 1 succeeded