orcaLog in

Runs · run 4048

load_day 2025-06-21, attempt 1 succeeded

Host
73ccef5e07c2:327105
Started
2026-11-08T12:33:16Z
Ended
2026-11-08T12:34:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
635 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
114.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4048/load_day/2025-06-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:33:16Z [load_day 2025-06-21] attempt 1 started
2026-11-08T12:33:17Z [load_day 2025-06-21] 2025-06-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:33:24Z [load_day 2025-06-21] 2025-06-21 hour 0: 135653 events in 0 files, snapshot none (task 5968 ms: download 3151 ms overlapping gunzip 931 ms, parse 3826 ms, sort 0 ms, write 0 ms, index 501 ms: 6 candidates, 66438 repo-hours, 1015 releases; waiting 264 ms; commit 0 ms)
2026-11-08T12:33:24Z [load_day 2025-06-21] 2025-06-21 hour 1: 143777 events in 0 files, snapshot none (task 5649 ms: download 3313 ms overlapping gunzip 786 ms, parse 3507 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 82360 repo-hours, 693 releases; waiting 462 ms; commit 0 ms)
2026-11-08T12:33:30Z [load_day 2025-06-21] 2025-06-21 hour 2: 133020 events in 0 files, snapshot none (task 6282 ms: download 3069 ms overlapping gunzip 1041 ms, parse 4228 ms, sort 0 ms, write 0 ms, index 494 ms: 6 candidates, 60438 repo-hours, 830 releases; waiting 231 ms; commit 0 ms)
2026-11-08T12:33:30Z [load_day 2025-06-21] 2025-06-21 hour 3: 134573 events in 0 files, snapshot none (task 6149 ms: download 3750 ms overlapping gunzip 923 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 514 ms: 1 candidates, 59220 repo-hours, 1982 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:33:37Z [load_day 2025-06-21] 2025-06-21 hour 4: 134815 events in 0 files, snapshot none (task 5872 ms: download 2980 ms overlapping gunzip 926 ms, parse 3922 ms, sort 0 ms, write 0 ms, index 422 ms: 5 candidates, 55146 repo-hours, 794 releases; waiting 310 ms; commit 0 ms)
2026-11-08T12:33:37Z [load_day 2025-06-21] 2025-06-21 hour 5: 139491 events in 0 files, snapshot none (task 5987 ms: download 3217 ms overlapping gunzip 915 ms, parse 3852 ms, sort 0 ms, write 0 ms, index 460 ms: 6 candidates, 58154 repo-hours, 700 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:33:42Z [load_day 2025-06-21] 2025-06-21 hour 6: 144731 events in 0 files, snapshot none (task 5038 ms: download 2419 ms overlapping gunzip 720 ms, parse 3044 ms, sort 0 ms, write 0 ms, index 650 ms: 8 candidates, 67278 repo-hours, 955 releases; waiting 338 ms; commit 0 ms)
2026-11-08T12:33:43Z [load_day 2025-06-21] 2025-06-21 hour 7: 141649 events in 0 files, snapshot none (task 5458 ms: download 2992 ms overlapping gunzip 744 ms, parse 3290 ms, sort 0 ms, write 0 ms, index 487 ms: 4 candidates, 60180 repo-hours, 817 releases; waiting 646 ms; commit 0 ms)
2026-11-08T12:33:48Z [load_day 2025-06-21] 2025-06-21 hour 8: 142751 events in 0 files, snapshot none (task 4885 ms: download 2785 ms overlapping gunzip 710 ms, parse 2930 ms, sort 0 ms, write 0 ms, index 594 ms: 2 candidates, 64307 repo-hours, 783 releases; waiting 295 ms; commit 0 ms)
2026-11-08T12:33:49Z [load_day 2025-06-21] 2025-06-21 hour 9: 143340 events in 0 files, snapshot none (task 5148 ms: download 2779 ms overlapping gunzip 694 ms, parse 2941 ms, sort 0 ms, write 0 ms, index 732 ms: 12 candidates, 63420 repo-hours, 914 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:33:54Z [load_day 2025-06-21] 2025-06-21 hour 10: 146124 events in 0 files, snapshot none (task 5292 ms: download 3029 ms overlapping gunzip 758 ms, parse 3220 ms, sort 0 ms, write 0 ms, index 499 ms: 10 candidates, 65731 repo-hours, 714 releases; waiting 460 ms; commit 0 ms)
2026-11-08T12:33:54Z [load_day 2025-06-21] 2025-06-21 hour 11: 143296 events in 0 files, snapshot none (task 4684 ms: download 2652 ms overlapping gunzip 707 ms, parse 3010 ms, sort 0 ms, write 0 ms, index 445 ms: 15 candidates, 61072 repo-hours, 619 releases; waiting 210 ms; commit 0 ms)
2026-11-08T12:34:00Z [load_day 2025-06-21] 2025-06-21 hour 12: 159254 events in 0 files, snapshot none (task 5892 ms: download 3137 ms overlapping gunzip 875 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 702 ms: 16 candidates, 89468 repo-hours, 666 releases; waiting 439 ms; commit 0 ms)
2026-11-08T12:34:01Z [load_day 2025-06-21] 2025-06-21 hour 13: 157500 events in 0 files, snapshot none (task 6230 ms: download 3327 ms overlapping gunzip 868 ms, parse 3886 ms, sort 0 ms, write 0 ms, index 705 ms: 22 candidates, 81061 repo-hours, 588 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:34:08Z [load_day 2025-06-21] 2025-06-21 hour 14: 150276 events in 0 files, snapshot none (task 6815 ms: download 3777 ms overlapping gunzip 1040 ms, parse 4226 ms, sort 0 ms, write 0 ms, index 714 ms: 15 candidates, 67311 repo-hours, 694 releases; waiting 618 ms; commit 0 ms)
2026-11-08T12:34:08Z [load_day 2025-06-21] 2025-06-21 hour 15: 148967 events in 0 files, snapshot none (task 6608 ms: download 2940 ms overlapping gunzip 937 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 856 ms: 9 candidates, 69222 repo-hours, 735 releases; waiting 150 ms; commit 0 ms)
2026-11-08T12:34:15Z [load_day 2025-06-21] 2025-06-21 hour 16: 149624 events in 0 files, snapshot none (task 7135 ms: download 3452 ms overlapping gunzip 1122 ms, parse 4673 ms, sort 0 ms, write 0 ms, index 607 ms: 11 candidates, 68892 repo-hours, 713 releases; waiting 470 ms; commit 0 ms)
2026-11-08T12:34:15Z [load_day 2025-06-21] 2025-06-21 hour 17: 148638 events in 0 files, snapshot none (task 6189 ms: download 2989 ms overlapping gunzip 928 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 664 ms: 10 candidates, 65149 repo-hours, 656 releases; waiting 229 ms; commit 0 ms)
2026-11-08T12:34:22Z [load_day 2025-06-21] 2025-06-21 hour 18: 145606 events in 0 files, snapshot none (task 6051 ms: download 2886 ms overlapping gunzip 785 ms, parse 3428 ms, sort 0 ms, write 0 ms, index 771 ms: 11 candidates, 70795 repo-hours, 715 releases; waiting 721 ms; commit 0 ms)
2026-11-08T12:34:22Z [load_day 2025-06-21] 2025-06-21 hour 19: 143441 events in 0 files, snapshot none (task 5666 ms: download 3279 ms overlapping gunzip 805 ms, parse 3338 ms, sort 0 ms, write 0 ms, index 642 ms: 11 candidates, 59237 repo-hours, 856 releases; waiting 612 ms; commit 0 ms)
2026-11-08T12:34:28Z [load_day 2025-06-21] 2025-06-21 hour 20: 141023 events in 0 files, snapshot none (task 5457 ms: download 2722 ms overlapping gunzip 755 ms, parse 3338 ms, sort 0 ms, write 0 ms, index 624 ms: 7 candidates, 58177 repo-hours, 666 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:34:28Z [load_day 2025-06-21] 2025-06-21 hour 21: 135030 events in 0 files, snapshot none (task 5389 ms: download 2731 ms overlapping gunzip 762 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 511 ms: 4 candidates, 55625 repo-hours, 729 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:34:32Z [load_day 2025-06-21] 2025-06-21 hour 22: 129754 events in 0 files, snapshot none (task 4371 ms: download 2648 ms overlapping gunzip 606 ms, parse 2580 ms, sort 0 ms, write 0 ms, index 386 ms: 6 candidates, 52340 repo-hours, 864 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:34:32Z [load_day 2025-06-21] 2025-06-21 hour 23: 125771 events in 0 files, snapshot none (task 4074 ms: download 2649 ms overlapping gunzip 549 ms, parse 2454 ms, sort 0 ms, write 0 ms, index 424 ms: 2 candidates, 49091 repo-hours, 772 releases; waiting 424 ms; commit 0 ms)
2026-11-08T12:34:39Z [load_day 2025-06-21] 2025-06-21: repo_hour merged from 24 files to 1 (1550112 rows, 6719 ms)
2026-11-08T12:34:42Z [load_day 2025-06-21] 2025-06-21: index committed in 9372 ms (24 + 1 + 24 files)
2026-11-08T12:34:42Z [load_day 2025-06-21] 2025-06-21: 3418104 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:34:42Z [load_day 2025-06-21] attempt 1 succeeded