orcaLog in

Runs · run 825

load_day 2023-02-16, attempt 1 succeeded

Host
caf251265124:62134
Started
2026-11-07T15:39:37Z
Ended
2026-11-07T15:43:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/825/load_day/2023-02-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:39:37Z [load_day 2023-02-16] attempt 1 started
2026-11-07T15:39:39Z [load_day 2023-02-16] 2023-02-16: 2 hours in flight, about 1200 MB
2026-11-07T15:39:55Z [load_day 2023-02-16] 2023-02-16 hour 0: 163507 events in 4 files, snapshot 8897877234626850170 (task 13876 ms: download 6650 ms overlapping gunzip 838 ms, parse 3598 ms, sort 112 ms, write 7428 ms, index 511 ms: 4 candidates, 77336 repo-hours, 942 releases; waiting 1101 ms; commit 1305 ms)
2026-11-07T15:39:57Z [load_day 2023-02-16] 2023-02-16 hour 1: 167678 events in 4 files, snapshot 6315099875966106222 (task 14719 ms: download 8922 ms overlapping gunzip 939 ms, parse 3866 ms, sort 100 ms, write 8008 ms, index 601 ms: 4 candidates, 85186 repo-hours, 834 releases; waiting 737 ms; commit 1288 ms)
2026-11-07T15:40:09Z [load_day 2023-02-16] 2023-02-16 hour 2: 154136 events in 4 files, snapshot 8842934342281348148 (task 12528 ms: download 5515 ms overlapping gunzip 765 ms, parse 3141 ms, sort 98 ms, write 7086 ms, index 534 ms: 3 candidates, 74071 repo-hours, 737 releases; waiting 600 ms; commit 1351 ms)
2026-11-07T15:40:10Z [load_day 2023-02-16] 2023-02-16 hour 3: 141759 events in 3 files, snapshot 257884703994005590 (task 11357 ms: download 5206 ms overlapping gunzip 714 ms, parse 2960 ms, sort 89 ms, write 6179 ms, index 385 ms: 6 candidates, 60840 repo-hours, 844 releases; waiting 698 ms; commit 1532 ms)
2026-11-07T15:40:22Z [load_day 2023-02-16] 2023-02-16 hour 4: 132384 events in 3 files, snapshot 4250167355522106782 (task 12734 ms: download 7099 ms overlapping gunzip 734 ms, parse 3019 ms, sort 83 ms, write 5668 ms, index 373 ms: 2 candidates, 56038 repo-hours, 650 releases; waiting 2481 ms; commit 1538 ms)
2026-11-07T15:40:24Z [load_day 2023-02-16] 2023-02-16 hour 5: 140792 events in 3 files, snapshot 8182110409828425933 (task 11325 ms: download 4811 ms overlapping gunzip 721 ms, parse 3041 ms, sort 78 ms, write 6360 ms, index 526 ms: 5 candidates, 60725 repo-hours, 804 releases; waiting 310 ms; commit 1374 ms)
2026-11-07T15:40:36Z [load_day 2023-02-16] 2023-02-16 hour 6: 155789 events in 4 files, snapshot 6332673810016440614 (task 12805 ms: download 5626 ms overlapping gunzip 773 ms, parse 3247 ms, sort 92 ms, write 7149 ms, index 453 ms: 3 candidates, 71429 repo-hours, 960 releases; waiting 786 ms; commit 1395 ms)
2026-11-07T15:40:39Z [load_day 2023-02-16] 2023-02-16 hour 7: 165570 events in 4 files, snapshot 4589538118013959414 (task 14589 ms: download 8722 ms overlapping gunzip 879 ms, parse 3744 ms, sort 100 ms, write 7900 ms, index 514 ms: 9 candidates, 72600 repo-hours, 881 releases; waiting 1110 ms; commit 1360 ms)
2026-11-07T15:40:51Z [load_day 2023-02-16] 2023-02-16 hour 8: 190321 events in 4 files, snapshot 5038679378079363091 (task 14714 ms: download 8425 ms overlapping gunzip 922 ms, parse 4006 ms, sort 133 ms, write 8407 ms, index 549 ms: 10 candidates, 94115 repo-hours, 928 releases; waiting 390 ms; commit 1458 ms)
2026-11-07T15:40:56Z [load_day 2023-02-16] 2023-02-16 hour 9: 194270 events in 4 files, snapshot 542969617271019320 (task 16472 ms: download 9373 ms overlapping gunzip 1025 ms, parse 4462 ms, sort 117 ms, write 9272 ms, index 570 ms: 4 candidates, 84342 repo-hours, 1276 releases; waiting 673 ms; commit 1412 ms)
2026-11-07T15:41:08Z [load_day 2023-02-16] 2023-02-16 hour 10: 193273 events in 4 files, snapshot 903421756693927446 (task 16363 ms: download 9266 ms overlapping gunzip 990 ms, parse 4225 ms, sort 117 ms, write 9594 ms, index 561 ms: 6 candidates, 87614 repo-hours, 1148 releases; waiting 552 ms; commit 1574 ms)
2026-11-07T15:41:12Z [load_day 2023-02-16] 2023-02-16 hour 11: 186210 events in 4 files, snapshot 6233985661466576697 (task 15528 ms: download 9016 ms overlapping gunzip 941 ms, parse 4048 ms, sort 107 ms, write 8699 ms, index 568 ms: 6 candidates, 81100 repo-hours, 1106 releases; waiting 851 ms; commit 1323 ms)
2026-11-07T15:41:27Z [load_day 2023-02-16] 2023-02-16 hour 12: 223730 events in 5 files, snapshot 3890526151621485890 (task 17382 ms: download 9168 ms overlapping gunzip 979 ms, parse 4436 ms, sort 124 ms, write 9911 ms, index 706 ms: 5 candidates, 110252 repo-hours, 1207 releases; waiting 844 ms; commit 1579 ms)
2026-11-07T15:41:31Z [load_day 2023-02-16] 2023-02-16 hour 13: 221649 events in 5 files, snapshot 500322361472455701 (task 17830 ms: download 11640 ms overlapping gunzip 1035 ms, parse 4535 ms, sort 138 ms, write 10105 ms, index 690 ms: 6 candidates, 107297 repo-hours, 1205 releases; waiting 880 ms; commit 1524 ms)
2026-11-07T15:41:47Z [load_day 2023-02-16] 2023-02-16 hour 14: 218290 events in 5 files, snapshot 4591832659821914224 (task 18977 ms: download 12881 ms overlapping gunzip 1202 ms, parse 5110 ms, sort 131 ms, write 10867 ms, index 627 ms: 5 candidates, 97269 repo-hours, 1184 releases; waiting 710 ms; commit 1699 ms)
2026-11-07T15:41:54Z [load_day 2023-02-16] 2023-02-16 hour 15: 215614 events in 5 files, snapshot 8767504989540606920 (task 21884 ms: download 16004 ms overlapping gunzip 1129 ms, parse 4924 ms, sort 128 ms, write 10532 ms, index 627 ms: 2 candidates, 96979 repo-hours, 1326 releases; waiting 4221 ms; commit 1385 ms)
2026-11-07T15:42:35Z [load_day 2023-02-16] 2023-02-16 hour 16: 209438 events in 5 files, snapshot 3141597348731236179 (task 48251 ms: download 46200 ms overlapping gunzip 1724 ms, parse 7914 ms, sort 156 ms, write 10363 ms, index 626 ms: 1 candidates, 93567 repo-hours, 1195 releases; waiting 27107 ms; commit 1413 ms)
2026-11-07T15:42:37Z [load_day 2023-02-16] 2023-02-16 hour 17: 204199 events in 5 files, snapshot 1439327299095916546 (task 16327 ms: download 8961 ms overlapping gunzip 1026 ms, parse 4478 ms, sort 114 ms, write 9554 ms, index 597 ms: 7 candidates, 88157 repo-hours, 1137 releases; waiting 226 ms; commit 1470 ms)
2026-11-07T15:42:52Z [load_day 2023-02-16] 2023-02-16 hour 18: 197116 events in 4 files, snapshot 7991814334221281829 (task 15908 ms: download 8941 ms overlapping gunzip 953 ms, parse 4200 ms, sort 111 ms, write 9130 ms, index 576 ms: 5 candidates, 86937 repo-hours, 1107 releases; waiting 591 ms; commit 1413 ms)
2026-11-07T15:42:54Z [load_day 2023-02-16] 2023-02-16 hour 19: 202250 events in 5 files, snapshot 9538972326468614 (task 13906 ms: download 7386 ms overlapping gunzip 794 ms, parse 3677 ms, sort 129 ms, write 8070 ms, index 645 ms: 4 candidates, 100323 repo-hours, 971 releases; waiting 189 ms; commit 1321 ms)
2026-11-07T15:43:07Z [load_day 2023-02-16] 2023-02-16 hour 20: 203463 events in 5 files, snapshot 1317130638803721658 (task 14060 ms: download 6685 ms overlapping gunzip 821 ms, parse 3672 ms, sort 129 ms, write 8213 ms, index 615 ms: 9 candidates, 106256 repo-hours, 932 releases; waiting 261 ms; commit 1429 ms)
2026-11-07T15:43:09Z [load_day 2023-02-16] 2023-02-16 hour 21: 174576 events in 4 files, snapshot 6971441897401333368 (task 14934 ms: download 8637 ms overlapping gunzip 913 ms, parse 3977 ms, sort 107 ms, write 8525 ms, index 501 ms: 4 candidates, 73173 repo-hours, 1003 releases; waiting 538 ms; commit 1502 ms)
2026-11-07T15:43:21Z [load_day 2023-02-16] 2023-02-16 hour 22: 163483 events in 4 files, snapshot 3567821965480642244 (task 13392 ms: download 7826 ms overlapping gunzip 837 ms, parse 3504 ms, sort 103 ms, write 7815 ms, index 557 ms: 10 candidates, 67704 repo-hours, 925 releases; waiting 232 ms; commit 1327 ms)
2026-11-07T15:43:23Z [load_day 2023-02-16] 2023-02-16 hour 23: 154405 events in 4 files, snapshot 2543315848752437121 (task 13328 ms: download 5853 ms overlapping gunzip 848 ms, parse 3557 ms, sort 94 ms, write 7555 ms, index 430 ms: 3 candidates, 63602 repo-hours, 780 releases; waiting 519 ms; commit 1461 ms)
2026-11-07T15:43:32Z [load_day 2023-02-16] 2023-02-16: repo_hour merged from 24 files to 1 (1996912 rows, 8116 ms)
2026-11-07T15:43:33Z [load_day 2023-02-16] 2023-02-16: index committed in 10033 ms (24 + 1 + 24 files)
2026-11-07T15:43:33Z [load_day 2023-02-16] 2023-02-16: 4373902 events in 24 hours
2026-11-07T15:43:33Z [load_day 2023-02-16] attempt 1 succeeded