orcaLog in

Runs · run 4438

load_day 2025-09-25, attempt 1 succeeded

Host
73ccef5e07c2:384646
Started
2026-11-08T13:59:10Z
Ended
2026-11-08T14:00:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
691 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
147.6 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4438/load_day/2025-09-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:59:10Z [load_day 2025-09-25] attempt 1 started
2026-11-08T13:59:11Z [load_day 2025-09-25] 2025-09-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:59:18Z [load_day 2025-09-25] 2025-09-25 hour 0: 149070 events in 0 files, snapshot none (task 6396 ms: download 3413 ms overlapping gunzip 1022 ms, parse 3765 ms, sort 0 ms, write 0 ms, index 783 ms: 7 candidates, 68630 repo-hours, 933 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:59:18Z [load_day 2025-09-25] 2025-09-25 hour 1: 163290 events in 0 files, snapshot none (task 5424 ms: download 2564 ms overlapping gunzip 800 ms, parse 3341 ms, sort 0 ms, write 0 ms, index 796 ms: 9 candidates, 95883 repo-hours, 720 releases; waiting 212 ms; commit 0 ms)
2026-11-08T13:59:25Z [load_day 2025-09-25] 2025-09-25 hour 2: 152415 events in 0 files, snapshot none (task 6176 ms: download 3515 ms overlapping gunzip 978 ms, parse 3843 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 73932 repo-hours, 701 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:59:25Z [load_day 2025-09-25] 2025-09-25 hour 3: 153208 events in 0 files, snapshot none (task 5369 ms: download 2639 ms overlapping gunzip 786 ms, parse 3413 ms, sort 0 ms, write 0 ms, index 701 ms: 9 candidates, 69034 repo-hours, 1919 releases; waiting 184 ms; commit 0 ms)
2026-11-08T13:59:31Z [load_day 2025-09-25] 2025-09-25 hour 4: 154851 events in 0 files, snapshot none (task 5823 ms: download 3770 ms overlapping gunzip 848 ms, parse 3530 ms, sort 0 ms, write 0 ms, index 612 ms: 8 candidates, 68570 repo-hours, 561 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:59:32Z [load_day 2025-09-25] 2025-09-25 hour 5: 153456 events in 0 files, snapshot none (task 6293 ms: download 3589 ms overlapping gunzip 974 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 67882 repo-hours, 678 releases; waiting 601 ms; commit 0 ms)
2026-11-08T13:59:38Z [load_day 2025-09-25] 2025-09-25 hour 6: 163259 events in 0 files, snapshot none (task 6394 ms: download 3857 ms overlapping gunzip 973 ms, parse 4015 ms, sort 0 ms, write 0 ms, index 609 ms: 3 candidates, 81437 repo-hours, 743 releases; waiting 495 ms; commit 0 ms)
2026-11-08T13:59:39Z [load_day 2025-09-25] 2025-09-25 hour 7: 159989 events in 0 files, snapshot none (task 6909 ms: download 4498 ms overlapping gunzip 1089 ms, parse 4404 ms, sort 0 ms, write 0 ms, index 541 ms: 7 candidates, 75824 repo-hours, 685 releases; waiting 563 ms; commit 0 ms)
2026-11-08T13:59:48Z [load_day 2025-09-25] 2025-09-25 hour 8: 167719 events in 0 files, snapshot none (task 8958 ms: download 6408 ms overlapping gunzip 1107 ms, parse 4542 ms, sort 0 ms, write 0 ms, index 647 ms: 9 candidates, 82250 repo-hours, 784 releases; waiting 2329 ms; commit 0 ms)
2026-11-08T13:59:48Z [load_day 2025-09-25] 2025-09-25 hour 9: 165068 events in 0 files, snapshot none (task 6778 ms: download 3964 ms overlapping gunzip 1047 ms, parse 4284 ms, sort 0 ms, write 0 ms, index 590 ms: 14 candidates, 81365 repo-hours, 824 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:59:55Z [load_day 2025-09-25] 2025-09-25 hour 10: 162444 events in 0 files, snapshot none (task 6845 ms: download 4263 ms overlapping gunzip 1019 ms, parse 4320 ms, sort 0 ms, write 0 ms, index 649 ms: 12 candidates, 79803 repo-hours, 718 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:59:56Z [load_day 2025-09-25] 2025-09-25 hour 11: 164347 events in 0 files, snapshot none (task 6941 ms: download 4194 ms overlapping gunzip 1044 ms, parse 4668 ms, sort 0 ms, write 0 ms, index 692 ms: 10 candidates, 76249 repo-hours, 823 releases; waiting 211 ms; commit 0 ms)
2026-11-08T14:00:04Z [load_day 2025-09-25] 2025-09-25 hour 12: 168542 events in 0 files, snapshot none (task 7683 ms: download 4516 ms overlapping gunzip 1066 ms, parse 4733 ms, sort 0 ms, write 0 ms, index 880 ms: 4 candidates, 98917 repo-hours, 774 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:00:05Z [load_day 2025-09-25] 2025-09-25 hour 13: 169578 events in 0 files, snapshot none (task 8836 ms: download 4845 ms overlapping gunzip 1257 ms, parse 5171 ms, sort 0 ms, write 0 ms, index 1787 ms: 14 candidates, 94169 repo-hours, 723 releases; waiting 242 ms; commit 0 ms)
2026-11-08T14:00:15Z [load_day 2025-09-25] 2025-09-25 hour 14: 165769 events in 0 files, snapshot none (task 8413 ms: download 5781 ms overlapping gunzip 1328 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 677 ms: 12 candidates, 86038 repo-hours, 759 releases; waiting 772 ms; commit 0 ms)
2026-11-08T14:00:15Z [load_day 2025-09-25] 2025-09-25 hour 15: 170362 events in 0 files, snapshot none (task 8516 ms: download 5649 ms overlapping gunzip 1395 ms, parse 5565 ms, sort 0 ms, write 0 ms, index 745 ms: 12 candidates, 87428 repo-hours, 849 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:00:20Z [load_day 2025-09-25] 2025-09-25 hour 16: 71213 events in 0 files, snapshot none (task 5226 ms: download 2766 ms overlapping gunzip 716 ms, parse 2882 ms, sort 0 ms, write 0 ms, index 723 ms: 8 candidates, 41683 repo-hours, 353 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:00:24Z [load_day 2025-09-25] 2025-09-25 hour 17: 164689 events in 0 files, snapshot none (task 8619 ms: download 5524 ms overlapping gunzip 1406 ms, parse 5569 ms, sort 0 ms, write 0 ms, index 801 ms: 14 candidates, 78795 repo-hours, 777 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:00:28Z [load_day 2025-09-25] 2025-09-25 hour 18: 166096 events in 0 files, snapshot none (task 7412 ms: download 4126 ms overlapping gunzip 1046 ms, parse 4247 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 83586 repo-hours, 891 releases; waiting 849 ms; commit 0 ms)
2026-11-08T14:00:29Z [load_day 2025-09-25] 2025-09-25 hour 19: 86370 events in 0 files, snapshot none (task 4393 ms: download 2077 ms overlapping gunzip 691 ms, parse 2674 ms, sort 0 ms, write 0 ms, index 478 ms: 11 candidates, 45677 repo-hours, 412 releases; waiting 272 ms; commit 0 ms)
2026-11-08T14:00:37Z [load_day 2025-09-25] 2025-09-25 hour 20: 163276 events in 0 files, snapshot none (task 8038 ms: download 5158 ms overlapping gunzip 1113 ms, parse 4473 ms, sort 0 ms, write 0 ms, index 765 ms: 9 candidates, 75020 repo-hours, 783 releases; waiting 1342 ms; commit 0 ms)
2026-11-08T14:00:37Z [load_day 2025-09-25] 2025-09-25 hour 21: 161420 events in 0 files, snapshot none (task 7611 ms: download 4778 ms overlapping gunzip 1139 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 680 ms: 6 candidates, 68621 repo-hours, 784 releases; waiting 1013 ms; commit 0 ms)
2026-11-08T14:00:44Z [load_day 2025-09-25] 2025-09-25 hour 22: 154909 events in 0 files, snapshot none (task 6097 ms: download 4545 ms overlapping gunzip 914 ms, parse 3494 ms, sort 0 ms, write 0 ms, index 480 ms: 10 candidates, 63699 repo-hours, 874 releases; waiting 902 ms; commit 0 ms)
2026-11-08T14:00:44Z [load_day 2025-09-25] 2025-09-25 hour 23: 148767 events in 0 files, snapshot none (task 5160 ms: download 2874 ms overlapping gunzip 765 ms, parse 3061 ms, sort 0 ms, write 0 ms, index 485 ms: 5 candidates, 59922 repo-hours, 781 releases; waiting 515 ms; commit 0 ms)
2026-11-08T14:00:52Z [load_day 2025-09-25] 2025-09-25: repo_hour merged from 24 files to 1 (1804414 rows, 7853 ms)
2026-11-08T14:00:55Z [load_day 2025-09-25] 2025-09-25: index committed in 11279 ms (24 + 1 + 24 files)
2026-11-08T14:00:55Z [load_day 2025-09-25] 2025-09-25: 3700107 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:00:55Z [load_day 2025-09-25] attempt 1 succeeded