orcaLog in

Runs · run 4482

load_day 2025-10-07, attempt 1 succeeded

Host
73ccef5e07c2:391577
Started
2026-11-08T14:10:00Z
Ended
2026-11-08T14:11:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
734 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.0 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4482/load_day/2025-10-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:10:00Z [load_day 2025-10-07] attempt 1 started
2026-11-08T14:10:00Z [load_day 2025-10-07] 2025-10-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:10:07Z [load_day 2025-10-07] 2025-10-07 hour 0: 155197 events in 0 files, snapshot none (task 6393 ms: download 3873 ms overlapping gunzip 958 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 559 ms: 12 candidates, 78053 repo-hours, 974 releases; waiting 698 ms; commit 0 ms)
2026-11-08T14:10:09Z [load_day 2025-10-07] 2025-10-07 hour 1: 162663 events in 0 files, snapshot none (task 8158 ms: download 5399 ms overlapping gunzip 765 ms, parse 3354 ms, sort 0 ms, write 0 ms, index 814 ms: 7 candidates, 94596 repo-hours, 807 releases; waiting 2882 ms; commit 0 ms)
2026-11-08T14:10:15Z [load_day 2025-10-07] 2025-10-07 hour 2: 149301 events in 0 files, snapshot none (task 7443 ms: download 4704 ms overlapping gunzip 1043 ms, parse 4327 ms, sort 0 ms, write 0 ms, index 524 ms: 15 candidates, 71691 repo-hours, 684 releases; waiting 1256 ms; commit 0 ms)
2026-11-08T14:10:15Z [load_day 2025-10-07] 2025-10-07 hour 3: 148836 events in 0 files, snapshot none (task 5601 ms: download 3192 ms overlapping gunzip 830 ms, parse 3452 ms, sort 0 ms, write 0 ms, index 523 ms: 9 candidates, 67014 repo-hours, 1938 releases; waiting 486 ms; commit 0 ms)
2026-11-08T14:10:23Z [load_day 2025-10-07] 2025-10-07 hour 4: 154233 events in 0 files, snapshot none (task 7058 ms: download 3882 ms overlapping gunzip 1126 ms, parse 4452 ms, sort 0 ms, write 0 ms, index 555 ms: 12 candidates, 67250 repo-hours, 659 releases; waiting 647 ms; commit 0 ms)
2026-11-08T14:10:23Z [load_day 2025-10-07] 2025-10-07 hour 5: 154558 events in 0 files, snapshot none (task 7133 ms: download 4651 ms overlapping gunzip 1073 ms, parse 4215 ms, sort 0 ms, write 0 ms, index 524 ms: 15 candidates, 68299 repo-hours, 632 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:10:33Z [load_day 2025-10-07] 2025-10-07 hour 6: 164512 events in 0 files, snapshot none (task 9582 ms: download 6433 ms overlapping gunzip 1481 ms, parse 6124 ms, sort 0 ms, write 0 ms, index 616 ms: 14 candidates, 81286 repo-hours, 741 releases; waiting 1062 ms; commit 0 ms)
2026-11-08T14:10:33Z [load_day 2025-10-07] 2025-10-07 hour 7: 162565 events in 0 files, snapshot none (task 8440 ms: download 5017 ms overlapping gunzip 1296 ms, parse 5312 ms, sort 0 ms, write 0 ms, index 821 ms: 20 candidates, 74167 repo-hours, 762 releases; waiting 779 ms; commit 0 ms)
2026-11-08T14:10:42Z [load_day 2025-10-07] 2025-10-07 hour 8: 165785 events in 0 files, snapshot none (task 8500 ms: download 4922 ms overlapping gunzip 1279 ms, parse 5225 ms, sort 0 ms, write 0 ms, index 803 ms: 14 candidates, 80794 repo-hours, 730 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:10:42Z [load_day 2025-10-07] 2025-10-07 hour 9: 166723 events in 0 files, snapshot none (task 9021 ms: download 6096 ms overlapping gunzip 1247 ms, parse 5068 ms, sort 0 ms, write 0 ms, index 602 ms: 9 candidates, 81957 repo-hours, 913 releases; waiting 1747 ms; commit 0 ms)
2026-11-08T14:10:51Z [load_day 2025-10-07] 2025-10-07 hour 10: 163861 events in 0 files, snapshot none (task 8682 ms: download 4376 ms overlapping gunzip 1209 ms, parse 4967 ms, sort 0 ms, write 0 ms, index 1670 ms: 9 candidates, 80519 repo-hours, 749 releases; waiting 470 ms; commit 0 ms)
2026-11-08T14:10:51Z [load_day 2025-10-07] 2025-10-07 hour 11: 161703 events in 0 files, snapshot none (task 8456 ms: download 4948 ms overlapping gunzip 1243 ms, parse 4954 ms, sort 0 ms, write 0 ms, index 1203 ms: 12 candidates, 76583 repo-hours, 757 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:11:01Z [load_day 2025-10-07] 2025-10-07 hour 12: 169526 events in 0 files, snapshot none (task 8055 ms: download 4584 ms overlapping gunzip 1245 ms, parse 5267 ms, sort 0 ms, write 0 ms, index 911 ms: 9 candidates, 100674 repo-hours, 911 releases; waiting 369 ms; commit 0 ms)
2026-11-08T14:11:02Z [load_day 2025-10-07] 2025-10-07 hour 13: 168138 events in 0 files, snapshot none (task 9028 ms: download 6040 ms overlapping gunzip 1391 ms, parse 5927 ms, sort 0 ms, write 0 ms, index 800 ms: 13 candidates, 94665 repo-hours, 817 releases; waiting 555 ms; commit 0 ms)
2026-11-08T14:11:09Z [load_day 2025-10-07] 2025-10-07 hour 14: 167735 events in 0 files, snapshot none (task 7949 ms: download 4371 ms overlapping gunzip 1295 ms, parse 5229 ms, sort 0 ms, write 0 ms, index 879 ms: 13 candidates, 88646 repo-hours, 904 releases; waiting 175 ms; commit 0 ms)
2026-11-08T14:11:10Z [load_day 2025-10-07] 2025-10-07 hour 15: 167925 events in 0 files, snapshot none (task 8324 ms: download 5613 ms overlapping gunzip 1357 ms, parse 5425 ms, sort 0 ms, write 0 ms, index 662 ms: 7 candidates, 88237 repo-hours, 954 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:11:16Z [load_day 2025-10-07] 2025-10-07 hour 16: 167926 events in 0 files, snapshot none (task 6550 ms: download 4468 ms overlapping gunzip 980 ms, parse 3866 ms, sort 0 ms, write 0 ms, index 709 ms: 20 candidates, 86352 repo-hours, 875 releases; waiting 672 ms; commit 0 ms)
2026-11-08T14:11:17Z [load_day 2025-10-07] 2025-10-07 hour 17: 166865 events in 0 files, snapshot none (task 6539 ms: download 4748 ms overlapping gunzip 1001 ms, parse 3841 ms, sort 0 ms, write 0 ms, index 646 ms: 16 candidates, 83407 repo-hours, 769 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:11:23Z [load_day 2025-10-07] 2025-10-07 hour 18: 164229 events in 0 files, snapshot none (task 6075 ms: download 3923 ms overlapping gunzip 906 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 674 ms: 13 candidates, 89502 repo-hours, 911 releases; waiting 603 ms; commit 0 ms)
2026-11-08T14:11:26Z [load_day 2025-10-07] 2025-10-07 hour 19: 163331 events in 0 files, snapshot none (task 8241 ms: download 5263 ms overlapping gunzip 940 ms, parse 3783 ms, sort 0 ms, write 0 ms, index 1104 ms: 13 candidates, 78588 repo-hours, 736 releases; waiting 2041 ms; commit 0 ms)
2026-11-08T14:11:31Z [load_day 2025-10-07] 2025-10-07 hour 20: 165301 events in 0 files, snapshot none (task 7838 ms: download 5088 ms overlapping gunzip 1228 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 590 ms: 13 candidates, 78103 repo-hours, 781 releases; waiting 683 ms; commit 0 ms)
2026-11-08T14:11:35Z [load_day 2025-10-07] 2025-10-07 hour 21: 157441 events in 0 files, snapshot none (task 8865 ms: download 7615 ms overlapping gunzip 1088 ms, parse 4202 ms, sort 0 ms, write 0 ms, index 577 ms: 11 candidates, 70865 repo-hours, 816 releases; waiting 2693 ms; commit 0 ms)
2026-11-08T14:11:40Z [load_day 2025-10-07] 2025-10-07 hour 22: 156466 events in 0 files, snapshot none (task 7993 ms: download 4999 ms overlapping gunzip 944 ms, parse 3773 ms, sort 0 ms, write 0 ms, index 900 ms: 13 candidates, 66584 repo-hours, 821 releases; waiting 1989 ms; commit 0 ms)
2026-11-08T14:11:42Z [load_day 2025-10-07] 2025-10-07 hour 23: 150441 events in 0 files, snapshot none (task 6160 ms: download 3689 ms overlapping gunzip 937 ms, parse 3790 ms, sort 0 ms, write 0 ms, index 567 ms: 5 candidates, 63474 repo-hours, 785 releases; waiting 493 ms; commit 0 ms)
2026-11-08T14:11:52Z [load_day 2025-10-07] 2025-10-07: repo_hour merged from 24 files to 1 (1911306 rows, 9712 ms)
2026-11-08T14:11:55Z [load_day 2025-10-07] 2025-10-07: index committed in 12678 ms (24 + 1 + 24 files)
2026-11-08T14:11:55Z [load_day 2025-10-07] 2025-10-07: 3875261 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:11:55Z [load_day 2025-10-07] attempt 1 succeeded