orcaLog in

Runs · run 1438

load_day 2023-08-28, attempt 1 succeeded

Host
3c2b29713ce8:269540
Started
2026-11-08T00:17:08Z
Ended
2026-11-08T00:21:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1438/load_day/2023-08-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:17:08Z [load_day 2023-08-28] attempt 1 started
2026-11-08T00:17:10Z [load_day 2023-08-28] 2023-08-28: 2 hours in flight, about 1200 MB
2026-11-08T00:17:28Z [load_day 2023-08-28] 2023-08-28 hour 0: 150197 events in 4 files, snapshot 2340765244154859402 (task 14762 ms: download 6096 ms overlapping gunzip 842 ms, parse 3891 ms, sort 162 ms, write 8110 ms, index 657 ms: 7 candidates, 82861 repo-hours, 825 releases; waiting 536 ms; commit 2345 ms)
2026-11-08T00:17:31Z [load_day 2023-08-28] 2023-08-28 hour 1: 165312 events in 4 files, snapshot 1069453160715481385 (task 16669 ms: download 7337 ms overlapping gunzip 1012 ms, parse 4494 ms, sort 105 ms, write 9560 ms, index 764 ms: 6 candidates, 88768 repo-hours, 720 releases; waiting 508 ms; commit 2655 ms)
2026-11-08T00:17:44Z [load_day 2023-08-28] 2023-08-28 hour 2: 139447 events in 3 files, snapshot 970735826821281212 (task 15351 ms: download 6775 ms overlapping gunzip 901 ms, parse 3666 ms, sort 100 ms, write 9005 ms, index 944 ms: 7 candidates, 59709 repo-hours, 766 releases; waiting 384 ms; commit 2388 ms)
2026-11-08T00:17:49Z [load_day 2023-08-28] 2023-08-28 hour 3: 137649 events in 3 files, snapshot 8652872974521218840 (task 14146 ms: download 5941 ms overlapping gunzip 966 ms, parse 3969 ms, sort 125 ms, write 7547 ms, index 652 ms: 2 candidates, 57133 repo-hours, 777 releases; waiting 498 ms; commit 4962 ms)
2026-11-08T00:18:01Z [load_day 2023-08-28] 2023-08-28 hour 4: 137572 events in 3 files, snapshot 8920177948951788771 (task 15597 ms: download 7379 ms overlapping gunzip 986 ms, parse 4181 ms, sort 93 ms, write 9019 ms, index 618 ms: 4 candidates, 54211 repo-hours, 590 releases; waiting 480 ms; commit 2486 ms)
2026-11-08T00:18:04Z [load_day 2023-08-28] 2023-08-28 hour 5: 145155 events in 3 files, snapshot 7229666225288832931 (task 15413 ms: download 6451 ms overlapping gunzip 1058 ms, parse 4400 ms, sort 141 ms, write 8343 ms, index 689 ms: 1 candidates, 60334 repo-hours, 751 releases; waiting 535 ms; commit 2327 ms)
2026-11-08T00:18:22Z [load_day 2023-08-28] 2023-08-28 hour 6: 172161 events in 4 files, snapshot 3691850872393939856 (task 17901 ms: download 10654 ms overlapping gunzip 1143 ms, parse 4819 ms, sort 152 ms, write 10387 ms, index 632 ms: 3 candidates, 75809 repo-hours, 868 releases; waiting 506 ms; commit 4033 ms)
2026-11-08T00:18:26Z [load_day 2023-08-28] 2023-08-28 hour 7: 177384 events in 4 files, snapshot 4169551390234789087 (task 20090 ms: download 11683 ms overlapping gunzip 1118 ms, parse 4833 ms, sort 187 ms, write 12212 ms, index 931 ms: 3 candidates, 75704 repo-hours, 848 releases; waiting 495 ms; commit 3898 ms)
2026-11-08T00:18:42Z [load_day 2023-08-28] 2023-08-28 hour 8: 175252 events in 4 files, snapshot 9000651178176586537 (task 21393 ms: download 13070 ms overlapping gunzip 1376 ms, parse 5962 ms, sort 119 ms, write 12600 ms, index 517 ms: 6 candidates, 77167 repo-hours, 1146 releases; waiting 520 ms; commit 2452 ms)
2026-11-08T00:18:48Z [load_day 2023-08-28] 2023-08-28 hour 9: 177702 events in 4 files, snapshot 8905741254686058870 (task 19823 ms: download 11731 ms overlapping gunzip 1186 ms, parse 4938 ms, sort 162 ms, write 12117 ms, index 709 ms: 8 candidates, 78154 repo-hours, 1065 releases; waiting 471 ms; commit 3877 ms)
2026-11-08T00:19:04Z [load_day 2023-08-28] 2023-08-28 hour 10: 181507 events in 4 files, snapshot 6550493764710517686 (task 20155 ms: download 12061 ms overlapping gunzip 1174 ms, parse 5182 ms, sort 177 ms, write 11893 ms, index 746 ms: 6 candidates, 78313 repo-hours, 974 releases; waiting 691 ms; commit 2802 ms)
2026-11-08T00:19:08Z [load_day 2023-08-28] 2023-08-28 hour 11: 185112 events in 4 files, snapshot 4994144733559949994 (task 21271 ms: download 12141 ms overlapping gunzip 1261 ms, parse 5533 ms, sort 255 ms, write 12740 ms, index 713 ms: 6 candidates, 77934 repo-hours, 935 releases; waiting 508 ms; commit 2044 ms)
2026-11-08T00:19:25Z [load_day 2023-08-28] 2023-08-28 hour 12: 230512 events in 5 files, snapshot 7569226550179411652 (task 21249 ms: download 14526 ms overlapping gunzip 1264 ms, parse 5635 ms, sort 213 ms, write 12671 ms, index 704 ms: 5 candidates, 109818 repo-hours, 1073 releases; waiting 469 ms; commit 2308 ms)
2026-11-08T00:19:30Z [load_day 2023-08-28] 2023-08-28 hour 13: 208098 events in 5 files, snapshot 2990543736234023934 (task 20288 ms: download 14003 ms overlapping gunzip 1329 ms, parse 5559 ms, sort 157 ms, write 11747 ms, index 782 ms: 7 candidates, 102244 repo-hours, 1010 releases; waiting 495 ms; commit 2342 ms)
2026-11-08T00:19:47Z [load_day 2023-08-28] 2023-08-28 hour 14: 192761 events in 4 files, snapshot 4957064198082893961 (task 20583 ms: download 10188 ms overlapping gunzip 1123 ms, parse 4773 ms, sort 154 ms, write 13147 ms, index 585 ms: 4 candidates, 87441 repo-hours, 1126 releases; waiting 513 ms; commit 2432 ms)
2026-11-08T00:19:50Z [load_day 2023-08-28] 2023-08-28 hour 15: 175488 events in 4 files, snapshot 7832682455481386862 (task 19629 ms: download 11067 ms overlapping gunzip 1002 ms, parse 4395 ms, sort 112 ms, write 12682 ms, index 700 ms: 11 candidates, 81528 repo-hours, 1013 releases; waiting 519 ms; commit 2199 ms)
2026-11-08T00:20:09Z [load_day 2023-08-28] 2023-08-28 hour 16: 170564 events in 4 files, snapshot 7879780256149090943 (task 18640 ms: download 10519 ms overlapping gunzip 1121 ms, parse 4770 ms, sort 175 ms, write 11253 ms, index 527 ms: 3 candidates, 78145 repo-hours, 912 releases; waiting 491 ms; commit 4793 ms)
2026-11-08T00:20:13Z [load_day 2023-08-28] 2023-08-28 hour 17: 184318 events in 4 files, snapshot 9159303558957644125 (task 20031 ms: download 11176 ms overlapping gunzip 1063 ms, parse 4470 ms, sort 153 ms, write 12881 ms, index 823 ms: 6 candidates, 79630 repo-hours, 939 releases; waiting 344 ms; commit 4011 ms)
2026-11-08T00:20:29Z [load_day 2023-08-28] 2023-08-28 hour 18: 184606 events in 4 files, snapshot 1332790144254110131 (task 21494 ms: download 12255 ms overlapping gunzip 1427 ms, parse 5824 ms, sort 168 ms, write 12287 ms, index 962 ms: 4 candidates, 84240 repo-hours, 886 releases; waiting 493 ms; commit 2828 ms)
2026-11-08T00:20:36Z [load_day 2023-08-28] 2023-08-28 hour 19: 179974 events in 4 files, snapshot 7821771696209516840 (task 22113 ms: download 12667 ms overlapping gunzip 1259 ms, parse 5075 ms, sort 161 ms, write 14146 ms, index 683 ms: 10 candidates, 76841 repo-hours, 950 releases; waiting 529 ms; commit 3409 ms)
2026-11-08T00:20:51Z [load_day 2023-08-28] 2023-08-28 hour 20: 180355 events in 4 files, snapshot 5968645407171233642 (task 20951 ms: download 11736 ms overlapping gunzip 1178 ms, parse 5134 ms, sort 173 ms, write 12878 ms, index 732 ms: 6 candidates, 76135 repo-hours, 908 releases; waiting 526 ms; commit 2272 ms)
2026-11-08T00:20:54Z [load_day 2023-08-28] 2023-08-28 hour 21: 158944 events in 4 files, snapshot 130175911811575037 (task 17337 ms: download 10724 ms overlapping gunzip 1111 ms, parse 4790 ms, sort 116 ms, write 10005 ms, index 578 ms: 9 candidates, 64311 repo-hours, 866 releases; waiting 521 ms; commit 2724 ms)
2026-11-08T00:21:08Z [load_day 2023-08-28] 2023-08-28 hour 22: 145853 events in 3 files, snapshot 277916503206294951 (task 15644 ms: download 7222 ms overlapping gunzip 1035 ms, parse 4362 ms, sort 104 ms, write 8840 ms, index 427 ms: 6 candidates, 58362 repo-hours, 817 releases; waiting 541 ms; commit 2776 ms)
2026-11-08T00:21:10Z [load_day 2023-08-28] 2023-08-28 hour 23: 123909 events in 3 files, snapshot 241104185298731115 (task 12796 ms: download 5832 ms overlapping gunzip 708 ms, parse 3145 ms, sort 99 ms, write 7597 ms, index 470 ms: 2 candidates, 52278 repo-hours, 665 releases; waiting 491 ms; commit 2270 ms)
2026-11-08T00:21:18Z [load_day 2023-08-28] 2023-08-28: repo_hour merged from 24 files to 1 (1817070 rows, 7680 ms)
2026-11-08T00:21:20Z [load_day 2023-08-28] 2023-08-28: index committed in 9461 ms (24 + 1 + 24 files)
2026-11-08T00:21:20Z [load_day 2023-08-28] 2023-08-28: 4079832 events in 24 hours
2026-11-08T00:21:20Z [load_day 2023-08-28] attempt 1 succeeded