orcaLog in

Runs · run 4362

load_day 2025-09-07, attempt 1 succeeded

Host
73ccef5e07c2:374655
Started
2026-11-08T13:43:54Z
Ended
2026-11-08T13:45:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
641 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
119.7 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4362/load_day/2025-09-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:43:54Z [load_day 2025-09-07] attempt 1 started
2026-11-08T13:43:55Z [load_day 2025-09-07] 2025-09-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:44:00Z [load_day 2025-09-07] 2025-09-07 hour 0: 140408 events in 0 files, snapshot none (task 5031 ms: download 2859 ms overlapping gunzip 753 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 479 ms: 12 candidates, 65215 repo-hours, 1032 releases; waiting 550 ms; commit 0 ms)
2026-11-08T13:44:01Z [load_day 2025-09-07] 2025-09-07 hour 1: 149218 events in 0 files, snapshot none (task 5399 ms: download 2803 ms overlapping gunzip 753 ms, parse 3203 ms, sort 0 ms, write 0 ms, index 646 ms: 9 candidates, 86321 repo-hours, 931 releases; waiting 481 ms; commit 0 ms)
2026-11-08T13:44:06Z [load_day 2025-09-07] 2025-09-07 hour 2: 135052 events in 0 files, snapshot none (task 5264 ms: download 3123 ms overlapping gunzip 813 ms, parse 3199 ms, sort 0 ms, write 0 ms, index 502 ms: 10 candidates, 62937 repo-hours, 904 releases; waiting 495 ms; commit 0 ms)
2026-11-08T13:44:06Z [load_day 2025-09-07] 2025-09-07 hour 3: 140166 events in 0 files, snapshot none (task 4897 ms: download 2872 ms overlapping gunzip 701 ms, parse 2944 ms, sort 0 ms, write 0 ms, index 407 ms: 3 candidates, 55807 repo-hours, 2305 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:44:13Z [load_day 2025-09-07] 2025-09-07 hour 4: 140168 events in 0 files, snapshot none (task 5991 ms: download 3020 ms overlapping gunzip 937 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 441 ms: 6 candidates, 54094 repo-hours, 758 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:44:13Z [load_day 2025-09-07] 2025-09-07 hour 5: 141619 events in 0 files, snapshot none (task 6180 ms: download 3067 ms overlapping gunzip 926 ms, parse 4007 ms, sort 0 ms, write 0 ms, index 463 ms: 8 candidates, 55136 repo-hours, 906 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:44:18Z [load_day 2025-09-07] 2025-09-07 hour 6: 142551 events in 0 files, snapshot none (task 4869 ms: download 2559 ms overlapping gunzip 765 ms, parse 3021 ms, sort 0 ms, write 0 ms, index 548 ms: 10 candidates, 65373 repo-hours, 849 releases; waiting 252 ms; commit 0 ms)
2026-11-08T13:44:19Z [load_day 2025-09-07] 2025-09-07 hour 7: 146348 events in 0 files, snapshot none (task 5436 ms: download 2999 ms overlapping gunzip 777 ms, parse 3123 ms, sort 0 ms, write 0 ms, index 634 ms: 5 candidates, 58402 repo-hours, 863 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:44:23Z [load_day 2025-09-07] 2025-09-07 hour 8: 147539 events in 0 files, snapshot none (task 4794 ms: download 2492 ms overlapping gunzip 703 ms, parse 2839 ms, sort 0 ms, write 0 ms, index 430 ms: 4 candidates, 60370 repo-hours, 832 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:44:24Z [load_day 2025-09-07] 2025-09-07 hour 9: 152770 events in 0 files, snapshot none (task 4533 ms: download 2716 ms overlapping gunzip 634 ms, parse 2531 ms, sort 0 ms, write 0 ms, index 503 ms: 9 candidates, 64917 repo-hours, 680 releases; waiting 580 ms; commit 0 ms)
2026-11-08T13:44:29Z [load_day 2025-09-07] 2025-09-07 hour 10: 150184 events in 0 files, snapshot none (task 4981 ms: download 2680 ms overlapping gunzip 720 ms, parse 2807 ms, sort 0 ms, write 0 ms, index 663 ms: 6 candidates, 61957 repo-hours, 730 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:44:31Z [load_day 2025-09-07] 2025-09-07 hour 11: 151326 events in 0 files, snapshot none (task 6717 ms: download 3882 ms overlapping gunzip 914 ms, parse 3642 ms, sort 0 ms, write 0 ms, index 713 ms: 9 candidates, 61189 repo-hours, 683 releases; waiting 1183 ms; commit 0 ms)
2026-11-08T13:44:36Z [load_day 2025-09-07] 2025-09-07 hour 12: 167132 events in 0 files, snapshot none (task 6266 ms: download 3629 ms overlapping gunzip 771 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 1058 ms: 6 candidates, 91178 repo-hours, 713 releases; waiting 1089 ms; commit 0 ms)
2026-11-08T13:44:36Z [load_day 2025-09-07] 2025-09-07 hour 13: 158077 events in 0 files, snapshot none (task 5113 ms: download 2873 ms overlapping gunzip 709 ms, parse 2925 ms, sort 0 ms, write 0 ms, index 662 ms: 7 candidates, 76929 repo-hours, 723 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:44:42Z [load_day 2025-09-07] 2025-09-07 hour 14: 157267 events in 0 files, snapshot none (task 6167 ms: download 3477 ms overlapping gunzip 907 ms, parse 3629 ms, sort 0 ms, write 0 ms, index 542 ms: 8 candidates, 69585 repo-hours, 776 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:44:42Z [load_day 2025-09-07] 2025-09-07 hour 15: 157877 events in 0 files, snapshot none (task 5675 ms: download 3151 ms overlapping gunzip 836 ms, parse 3334 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 71251 repo-hours, 910 releases; waiting 597 ms; commit 0 ms)
2026-11-08T13:44:49Z [load_day 2025-09-07] 2025-09-07 hour 16: 156959 events in 0 files, snapshot none (task 6561 ms: download 3738 ms overlapping gunzip 952 ms, parse 3937 ms, sort 0 ms, write 0 ms, index 645 ms: 9 candidates, 70001 repo-hours, 739 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:44:49Z [load_day 2025-09-07] 2025-09-07 hour 17: 153785 events in 0 files, snapshot none (task 6358 ms: download 3885 ms overlapping gunzip 993 ms, parse 4025 ms, sort 0 ms, write 0 ms, index 495 ms: 7 candidates, 64084 repo-hours, 699 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:44:56Z [load_day 2025-09-07] 2025-09-07 hour 18: 159964 events in 0 files, snapshot none (task 6352 ms: download 3199 ms overlapping gunzip 935 ms, parse 3783 ms, sort 0 ms, write 0 ms, index 810 ms: 12 candidates, 74703 repo-hours, 790 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:44:57Z [load_day 2025-09-07] 2025-09-07 hour 19: 153220 events in 0 files, snapshot none (task 6545 ms: download 3841 ms overlapping gunzip 1038 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 493 ms: 6 candidates, 61068 repo-hours, 748 releases; waiting 638 ms; commit 0 ms)
2026-11-08T13:45:01Z [load_day 2025-09-07] 2025-09-07 hour 20: 151115 events in 0 files, snapshot none (task 4701 ms: download 2791 ms overlapping gunzip 671 ms, parse 2734 ms, sort 0 ms, write 0 ms, index 498 ms: 9 candidates, 60953 repo-hours, 775 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:45:03Z [load_day 2025-09-07] 2025-09-07 hour 21: 144172 events in 0 files, snapshot none (task 5891 ms: download 3770 ms overlapping gunzip 708 ms, parse 2735 ms, sort 0 ms, write 0 ms, index 428 ms: 11 candidates, 58486 repo-hours, 771 releases; waiting 1703 ms; commit 0 ms)
2026-11-08T13:45:08Z [load_day 2025-09-07] 2025-09-07 hour 22: 141190 events in 0 files, snapshot none (task 5896 ms: download 2712 ms overlapping gunzip 906 ms, parse 3577 ms, sort 0 ms, write 0 ms, index 463 ms: 5 candidates, 53814 repo-hours, 798 releases; waiting 599 ms; commit 0 ms)
2026-11-08T13:45:09Z [load_day 2025-09-07] 2025-09-07 hour 23: 141744 events in 0 files, snapshot none (task 5950 ms: download 3314 ms overlapping gunzip 948 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 406 ms: 7 candidates, 55216 repo-hours, 650 releases; waiting 532 ms; commit 0 ms)
2026-11-08T13:45:17Z [load_day 2025-09-07] 2025-09-07: repo_hour merged from 24 files to 1 (1558986 rows, 7257 ms)
2026-11-08T13:45:19Z [load_day 2025-09-07] 2025-09-07: index committed in 10020 ms (24 + 1 + 24 files)
2026-11-08T13:45:19Z [load_day 2025-09-07] 2025-09-07: 3579851 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:45:19Z [load_day 2025-09-07] attempt 1 succeeded