orcaLog in

Runs · run 4332

load_day 2025-08-30, attempt 1 succeeded

Host
73ccef5e07c2:370122
Started
2026-11-08T13:37:10Z
Ended
2026-11-08T13:38:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
618 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
115.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4332/load_day/2025-08-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:37:10Z [load_day 2025-08-30] attempt 1 started
2026-11-08T13:37:11Z [load_day 2025-08-30] 2025-08-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:37:18Z [load_day 2025-08-30] 2025-08-30 hour 0: 141152 events in 0 files, snapshot none (task 6652 ms: download 3053 ms overlapping gunzip 1062 ms, parse 4391 ms, sort 0 ms, write 0 ms, index 607 ms: 7 candidates, 69841 repo-hours, 1033 releases; waiting 279 ms; commit 0 ms)
2026-11-08T13:37:18Z [load_day 2025-08-30] 2025-08-30 hour 1: 147485 events in 0 files, snapshot none (task 7062 ms: download 3598 ms overlapping gunzip 1045 ms, parse 4538 ms, sort 0 ms, write 0 ms, index 650 ms: 3 candidates, 83987 repo-hours, 831 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:37:24Z [load_day 2025-08-30] 2025-08-30 hour 2: 132001 events in 0 files, snapshot none (task 4993 ms: download 2975 ms overlapping gunzip 668 ms, parse 2826 ms, sort 0 ms, write 0 ms, index 534 ms: 9 candidates, 60859 repo-hours, 743 releases; waiting 692 ms; commit 0 ms)
2026-11-08T13:37:24Z [load_day 2025-08-30] 2025-08-30 hour 3: 144434 events in 0 files, snapshot none (task 5249 ms: download 2528 ms overlapping gunzip 738 ms, parse 3175 ms, sort 0 ms, write 0 ms, index 453 ms: 5 candidates, 56611 repo-hours, 2250 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:37:29Z [load_day 2025-08-30] 2025-08-30 hour 4: 138901 events in 0 files, snapshot none (task 4926 ms: download 2701 ms overlapping gunzip 759 ms, parse 2955 ms, sort 0 ms, write 0 ms, index 449 ms: 2 candidates, 54840 repo-hours, 609 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:37:30Z [load_day 2025-08-30] 2025-08-30 hour 5: 141434 events in 0 files, snapshot none (task 5124 ms: download 2982 ms overlapping gunzip 761 ms, parse 3290 ms, sort 0 ms, write 0 ms, index 480 ms: 9 candidates, 55118 repo-hours, 673 releases; waiting 288 ms; commit 0 ms)
2026-11-08T13:37:35Z [load_day 2025-08-30] 2025-08-30 hour 6: 150729 events in 0 files, snapshot none (task 5489 ms: download 3313 ms overlapping gunzip 799 ms, parse 3083 ms, sort 0 ms, write 0 ms, index 515 ms: 10 candidates, 67883 repo-hours, 876 releases; waiting 663 ms; commit 0 ms)
2026-11-08T13:37:36Z [load_day 2025-08-30] 2025-08-30 hour 7: 148196 events in 0 files, snapshot none (task 5445 ms: download 3180 ms overlapping gunzip 871 ms, parse 3531 ms, sort 0 ms, write 0 ms, index 426 ms: 4 candidates, 58065 repo-hours, 785 releases; waiting 301 ms; commit 0 ms)
2026-11-08T13:37:40Z [load_day 2025-08-30] 2025-08-30 hour 8: 145645 events in 0 files, snapshot none (task 4961 ms: download 2884 ms overlapping gunzip 651 ms, parse 2707 ms, sort 0 ms, write 0 ms, index 479 ms: 4 candidates, 61501 repo-hours, 725 releases; waiting 569 ms; commit 0 ms)
2026-11-08T13:37:40Z [load_day 2025-08-30] 2025-08-30 hour 9: 143441 events in 0 files, snapshot none (task 4314 ms: download 2465 ms overlapping gunzip 636 ms, parse 2439 ms, sort 0 ms, write 0 ms, index 514 ms: 5 candidates, 61112 repo-hours, 694 releases; waiting 495 ms; commit 0 ms)
2026-11-08T13:37:46Z [load_day 2025-08-30] 2025-08-30 hour 10: 145160 events in 0 files, snapshot none (task 5356 ms: download 2932 ms overlapping gunzip 777 ms, parse 3304 ms, sort 0 ms, write 0 ms, index 433 ms: 4 candidates, 61943 repo-hours, 636 releases; waiting 228 ms; commit 0 ms)
2026-11-08T13:37:46Z [load_day 2025-08-30] 2025-08-30 hour 11: 148421 events in 0 files, snapshot none (task 5353 ms: download 2941 ms overlapping gunzip 808 ms, parse 3269 ms, sort 0 ms, write 0 ms, index 480 ms: 6 candidates, 59177 repo-hours, 654 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:37:52Z [load_day 2025-08-30] 2025-08-30 hour 12: 163712 events in 0 files, snapshot none (task 5289 ms: download 2966 ms overlapping gunzip 750 ms, parse 2983 ms, sort 0 ms, write 0 ms, index 729 ms: 3 candidates, 91176 repo-hours, 739 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:37:53Z [load_day 2025-08-30] 2025-08-30 hour 13: 152965 events in 0 files, snapshot none (task 5815 ms: download 3452 ms overlapping gunzip 909 ms, parse 3456 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 74145 repo-hours, 581 releases; waiting 585 ms; commit 0 ms)
2026-11-08T13:37:59Z [load_day 2025-08-30] 2025-08-30 hour 14: 151997 events in 0 files, snapshot none (task 6052 ms: download 3556 ms overlapping gunzip 973 ms, parse 3452 ms, sort 0 ms, write 0 ms, index 727 ms: 8 candidates, 65534 repo-hours, 736 releases; waiting 556 ms; commit 0 ms)
2026-11-08T13:37:59Z [load_day 2025-08-30] 2025-08-30 hour 15: 154420 events in 0 files, snapshot none (task 5697 ms: download 2879 ms overlapping gunzip 865 ms, parse 3378 ms, sort 0 ms, write 0 ms, index 632 ms: 13 candidates, 67308 repo-hours, 781 releases; waiting 549 ms; commit 0 ms)
2026-11-08T13:38:05Z [load_day 2025-08-30] 2025-08-30 hour 16: 156594 events in 0 files, snapshot none (task 6078 ms: download 3379 ms overlapping gunzip 878 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 940 ms: 6 candidates, 67055 repo-hours, 928 releases; waiting 597 ms; commit 0 ms)
2026-11-08T13:38:05Z [load_day 2025-08-30] 2025-08-30 hour 17: 151142 events in 0 files, snapshot none (task 5410 ms: download 2979 ms overlapping gunzip 750 ms, parse 3221 ms, sort 0 ms, write 0 ms, index 626 ms: 12 candidates, 62612 repo-hours, 735 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:38:11Z [load_day 2025-08-30] 2025-08-30 hour 18: 150153 events in 0 files, snapshot none (task 5475 ms: download 2975 ms overlapping gunzip 733 ms, parse 3023 ms, sort 0 ms, write 0 ms, index 942 ms: 16 candidates, 70314 repo-hours, 858 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:38:11Z [load_day 2025-08-30] 2025-08-30 hour 19: 148693 events in 0 files, snapshot none (task 5564 ms: download 2797 ms overlapping gunzip 713 ms, parse 3069 ms, sort 0 ms, write 0 ms, index 890 ms: 6 candidates, 57496 repo-hours, 712 releases; waiting 536 ms; commit 0 ms)
2026-11-08T13:38:18Z [load_day 2025-08-30] 2025-08-30 hour 20: 144299 events in 0 files, snapshot none (task 5518 ms: download 2718 ms overlapping gunzip 755 ms, parse 3260 ms, sort 0 ms, write 0 ms, index 621 ms: 7 candidates, 56799 repo-hours, 669 releases; waiting 610 ms; commit 0 ms)
2026-11-08T13:38:18Z [load_day 2025-08-30] 2025-08-30 hour 21: 138945 events in 0 files, snapshot none (task 5039 ms: download 2912 ms overlapping gunzip 661 ms, parse 2871 ms, sort 0 ms, write 0 ms, index 592 ms: 12 candidates, 52405 repo-hours, 798 releases; waiting 633 ms; commit 0 ms)
2026-11-08T13:38:23Z [load_day 2025-08-30] 2025-08-30 hour 22: 135190 events in 0 files, snapshot none (task 5051 ms: download 2529 ms overlapping gunzip 746 ms, parse 2935 ms, sort 0 ms, write 0 ms, index 403 ms: 11 candidates, 49499 repo-hours, 985 releases; waiting 575 ms; commit 0 ms)
2026-11-08T13:38:23Z [load_day 2025-08-30] 2025-08-30 hour 23: 133490 events in 0 files, snapshot none (task 4087 ms: download 2327 ms overlapping gunzip 639 ms, parse 2603 ms, sort 0 ms, write 0 ms, index 372 ms: 6 candidates, 48386 repo-hours, 804 releases; waiting 188 ms; commit 0 ms)
2026-11-08T13:38:30Z [load_day 2025-08-30] 2025-08-30: repo_hour merged from 24 files to 1 (1513666 rows, 6820 ms)
2026-11-08T13:38:33Z [load_day 2025-08-30] 2025-08-30: index committed in 9684 ms (24 + 1 + 24 files)
2026-11-08T13:38:33Z [load_day 2025-08-30] 2025-08-30: 3508599 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:38:33Z [load_day 2025-08-30] attempt 1 succeeded