orcaLog in

Runs · run 3753

load_day 2025-04-05, attempt 1 succeeded

Host
73ccef5e07c2:282794
Started
2026-11-08T11:14:08Z
Ended
2026-11-08T11:15:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.1 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3753/load_day/2025-04-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:14:08Z [load_day 2025-04-05] attempt 1 started
2026-11-08T11:14:09Z [load_day 2025-04-05] 2025-04-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:14:16Z [load_day 2025-04-05] 2025-04-05 hour 0: 187638 events in 0 files, snapshot none (task 5600 ms: download 3074 ms overlapping gunzip 779 ms, parse 3424 ms, sort 0 ms, write 0 ms, index 621 ms: 5 candidates, 85962 repo-hours, 1095 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:14:16Z [load_day 2025-04-05] 2025-04-05 hour 1: 210600 events in 0 files, snapshot none (task 5638 ms: download 2994 ms overlapping gunzip 777 ms, parse 3320 ms, sort 0 ms, write 0 ms, index 749 ms: 6 candidates, 110988 repo-hours, 802 releases; waiting 526 ms; commit 0 ms)
2026-11-08T11:14:21Z [load_day 2025-04-05] 2025-04-05 hour 2: 175054 events in 0 files, snapshot none (task 5100 ms: download 2711 ms overlapping gunzip 751 ms, parse 3193 ms, sort 0 ms, write 0 ms, index 527 ms: 9 candidates, 74828 repo-hours, 717 releases; waiting 348 ms; commit 0 ms)
2026-11-08T11:14:21Z [load_day 2025-04-05] 2025-04-05 hour 3: 181351 events in 0 files, snapshot none (task 4896 ms: download 2793 ms overlapping gunzip 636 ms, parse 2829 ms, sort 0 ms, write 0 ms, index 523 ms: 4 candidates, 71296 repo-hours, 2911 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:14:26Z [load_day 2025-04-05] 2025-04-05 hour 4: 172757 events in 0 files, snapshot none (task 4478 ms: download 2811 ms overlapping gunzip 609 ms, parse 2590 ms, sort 0 ms, write 0 ms, index 454 ms: 5 candidates, 62140 repo-hours, 746 releases; waiting 552 ms; commit 0 ms)
2026-11-08T11:14:26Z [load_day 2025-04-05] 2025-04-05 hour 5: 185665 events in 0 files, snapshot none (task 4505 ms: download 2176 ms overlapping gunzip 659 ms, parse 2871 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 66500 repo-hours, 746 releases; waiting 200 ms; commit 0 ms)
2026-11-08T11:14:32Z [load_day 2025-04-05] 2025-04-05 hour 6: 200837 events in 0 files, snapshot none (task 4980 ms: download 2416 ms overlapping gunzip 733 ms, parse 3061 ms, sort 0 ms, write 0 ms, index 684 ms: 7 candidates, 85129 repo-hours, 1053 releases; waiting 221 ms; commit 0 ms)
2026-11-08T11:14:32Z [load_day 2025-04-05] 2025-04-05 hour 7: 185647 events in 0 files, snapshot none (task 5213 ms: download 2714 ms overlapping gunzip 711 ms, parse 2965 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 68717 repo-hours, 906 releases; waiting 654 ms; commit 0 ms)
2026-11-08T11:14:37Z [load_day 2025-04-05] 2025-04-05 hour 8: 190718 events in 0 files, snapshot none (task 5176 ms: download 2387 ms overlapping gunzip 691 ms, parse 3041 ms, sort 0 ms, write 0 ms, index 939 ms: 8 candidates, 74236 repo-hours, 983 releases; waiting 223 ms; commit 0 ms)
2026-11-08T11:14:37Z [load_day 2025-04-05] 2025-04-05 hour 9: 202938 events in 0 files, snapshot none (task 5060 ms: download 2476 ms overlapping gunzip 716 ms, parse 3114 ms, sort 0 ms, write 0 ms, index 687 ms: 11 candidates, 79284 repo-hours, 1169 releases; waiting 279 ms; commit 0 ms)
2026-11-08T11:14:43Z [load_day 2025-04-05] 2025-04-05 hour 10: 199799 events in 0 files, snapshot none (task 5351 ms: download 3238 ms overlapping gunzip 707 ms, parse 3136 ms, sort 0 ms, write 0 ms, index 646 ms: 9 candidates, 76976 repo-hours, 892 releases; waiting 594 ms; commit 0 ms)
2026-11-08T11:14:43Z [load_day 2025-04-05] 2025-04-05 hour 11: 197902 events in 0 files, snapshot none (task 5152 ms: download 2833 ms overlapping gunzip 673 ms, parse 3092 ms, sort 0 ms, write 0 ms, index 642 ms: 10 candidates, 72596 repo-hours, 726 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:14:50Z [load_day 2025-04-05] 2025-04-05 hour 12: 252196 events in 0 files, snapshot none (task 5962 ms: download 3286 ms overlapping gunzip 782 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 840 ms: 15 candidates, 123579 repo-hours, 1016 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:14:50Z [load_day 2025-04-05] 2025-04-05 hour 13: 226606 events in 0 files, snapshot none (task 5931 ms: download 3282 ms overlapping gunzip 823 ms, parse 3572 ms, sort 0 ms, write 0 ms, index 706 ms: 14 candidates, 101391 repo-hours, 942 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:14:56Z [load_day 2025-04-05] 2025-04-05 hour 14: 220709 events in 0 files, snapshot none (task 5869 ms: download 3289 ms overlapping gunzip 818 ms, parse 3541 ms, sort 0 ms, write 0 ms, index 712 ms: 8 candidates, 85999 repo-hours, 922 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:14:56Z [load_day 2025-04-05] 2025-04-05 hour 15: 228587 events in 0 files, snapshot none (task 5456 ms: download 2850 ms overlapping gunzip 784 ms, parse 3419 ms, sort 0 ms, write 0 ms, index 730 ms: 10 candidates, 93742 repo-hours, 1067 releases; waiting 224 ms; commit 0 ms)
2026-11-08T11:15:03Z [load_day 2025-04-05] 2025-04-05 hour 16: 219885 events in 0 files, snapshot none (task 6052 ms: download 3416 ms overlapping gunzip 853 ms, parse 3773 ms, sort 0 ms, write 0 ms, index 674 ms: 7 candidates, 86540 repo-hours, 890 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:15:03Z [load_day 2025-04-05] 2025-04-05 hour 17: 219480 events in 0 files, snapshot none (task 5694 ms: download 3821 ms overlapping gunzip 773 ms, parse 3345 ms, sort 0 ms, write 0 ms, index 694 ms: 6 candidates, 82207 repo-hours, 914 releases; waiting 613 ms; commit 0 ms)
2026-11-08T11:15:09Z [load_day 2025-04-05] 2025-04-05 hour 18: 224549 events in 0 files, snapshot none (task 6072 ms: download 3345 ms overlapping gunzip 833 ms, parse 3461 ms, sort 0 ms, write 0 ms, index 718 ms: 9 candidates, 95284 repo-hours, 1028 releases; waiting 651 ms; commit 0 ms)
2026-11-08T11:15:09Z [load_day 2025-04-05] 2025-04-05 hour 19: 201874 events in 0 files, snapshot none (task 5608 ms: download 3229 ms overlapping gunzip 782 ms, parse 3438 ms, sort 0 ms, write 0 ms, index 564 ms: 3 candidates, 73587 repo-hours, 924 releases; waiting 556 ms; commit 0 ms)
2026-11-08T11:15:15Z [load_day 2025-04-05] 2025-04-05 hour 20: 196179 events in 0 files, snapshot none (task 5299 ms: download 3055 ms overlapping gunzip 730 ms, parse 3146 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 73122 repo-hours, 831 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:15:16Z [load_day 2025-04-05] 2025-04-05 hour 21: 188583 events in 0 files, snapshot none (task 5876 ms: download 3362 ms overlapping gunzip 704 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 559 ms: 6 candidates, 70300 repo-hours, 1088 releases; waiting 1328 ms; commit 0 ms)
2026-11-08T11:15:20Z [load_day 2025-04-05] 2025-04-05 hour 22: 171832 events in 0 files, snapshot none (task 4752 ms: download 2582 ms overlapping gunzip 637 ms, parse 2863 ms, sort 0 ms, write 0 ms, index 504 ms: 8 candidates, 60434 repo-hours, 902 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:15:20Z [load_day 2025-04-05] 2025-04-05 hour 23: 154149 events in 0 files, snapshot none (task 4084 ms: download 2425 ms overlapping gunzip 565 ms, parse 2501 ms, sort 0 ms, write 0 ms, index 426 ms: 5 candidates, 54292 repo-hours, 884 releases; waiting 278 ms; commit 0 ms)
2026-11-08T11:15:29Z [load_day 2025-04-05] 2025-04-05: repo_hour merged from 24 files to 1 (1929129 rows, 8315 ms)
2026-11-08T11:15:31Z [load_day 2025-04-05] 2025-04-05: index committed in 10905 ms (24 + 1 + 24 files)
2026-11-08T11:15:31Z [load_day 2025-04-05] 2025-04-05: 4795535 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:15:31Z [load_day 2025-04-05] attempt 1 succeeded