orcaLog in

Runs · run 4474

load_day 2025-10-05, attempt 1 succeeded

Host
73ccef5e07c2:390371
Started
2026-11-08T14:08:21Z
Ended
2026-11-08T14:09:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
669 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
121.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4474/load_day/2025-10-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:08:21Z [load_day 2025-10-05] attempt 1 started
2026-11-08T14:08:22Z [load_day 2025-10-05] 2025-10-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:08:30Z [load_day 2025-10-05] 2025-10-05 hour 0: 143162 events in 0 files, snapshot none (task 7049 ms: download 4747 ms overlapping gunzip 1047 ms, parse 4554 ms, sort 0 ms, write 0 ms, index 602 ms: 6 candidates, 68592 repo-hours, 1107 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:08:30Z [load_day 2025-10-05] 2025-10-05 hour 1: 153734 events in 0 files, snapshot none (task 6867 ms: download 3397 ms overlapping gunzip 954 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 828 ms: 4 candidates, 85837 repo-hours, 869 releases; waiting 501 ms; commit 0 ms)
2026-11-08T14:08:37Z [load_day 2025-10-05] 2025-10-05 hour 2: 140270 events in 0 files, snapshot none (task 6933 ms: download 4227 ms overlapping gunzip 1043 ms, parse 4168 ms, sort 0 ms, write 0 ms, index 730 ms: 7 candidates, 61993 repo-hours, 884 releases; waiting 695 ms; commit 0 ms)
2026-11-08T14:08:37Z [load_day 2025-10-05] 2025-10-05 hour 3: 147011 events in 0 files, snapshot none (task 6668 ms: download 3779 ms overlapping gunzip 930 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 802 ms: 8 candidates, 59551 repo-hours, 2104 releases; waiting 559 ms; commit 0 ms)
2026-11-08T14:08:45Z [load_day 2025-10-05] 2025-10-05 hour 4: 144313 events in 0 files, snapshot none (task 7080 ms: download 3833 ms overlapping gunzip 1091 ms, parse 4572 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 56875 repo-hours, 570 releases; waiting 496 ms; commit 0 ms)
2026-11-08T14:08:45Z [load_day 2025-10-05] 2025-10-05 hour 5: 147942 events in 0 files, snapshot none (task 6982 ms: download 3136 ms overlapping gunzip 1025 ms, parse 4497 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 59478 repo-hours, 585 releases; waiting 479 ms; commit 0 ms)
2026-11-08T14:08:51Z [load_day 2025-10-05] 2025-10-05 hour 6: 154509 events in 0 files, snapshot none (task 6051 ms: download 3742 ms overlapping gunzip 748 ms, parse 3290 ms, sort 0 ms, write 0 ms, index 1031 ms: 9 candidates, 70030 repo-hours, 662 releases; waiting 653 ms; commit 0 ms)
2026-11-08T14:08:51Z [load_day 2025-10-05] 2025-10-05 hour 7: 150794 events in 0 files, snapshot none (task 6014 ms: download 3380 ms overlapping gunzip 843 ms, parse 3711 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 60213 repo-hours, 539 releases; waiting 492 ms; commit 0 ms)
2026-11-08T14:08:59Z [load_day 2025-10-05] 2025-10-05 hour 8: 153376 events in 0 files, snapshot none (task 7419 ms: download 4451 ms overlapping gunzip 947 ms, parse 3942 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 64972 repo-hours, 622 releases; waiting 1708 ms; commit 0 ms)
2026-11-08T14:08:59Z [load_day 2025-10-05] 2025-10-05 hour 9: 153313 events in 0 files, snapshot none (task 6390 ms: download 3683 ms overlapping gunzip 885 ms, parse 3824 ms, sort 0 ms, write 0 ms, index 590 ms: 7 candidates, 65395 repo-hours, 765 releases; waiting 728 ms; commit 0 ms)
2026-11-08T14:09:07Z [load_day 2025-10-05] 2025-10-05 hour 10: 153493 events in 0 files, snapshot none (task 6825 ms: download 4500 ms overlapping gunzip 891 ms, parse 3745 ms, sort 0 ms, write 0 ms, index 526 ms: 7 candidates, 65722 repo-hours, 610 releases; waiting 1249 ms; commit 0 ms)
2026-11-08T14:09:07Z [load_day 2025-10-05] 2025-10-05 hour 11: 158497 events in 0 files, snapshot none (task 5626 ms: download 3228 ms overlapping gunzip 849 ms, parse 3619 ms, sort 0 ms, write 0 ms, index 531 ms: 16 candidates, 65015 repo-hours, 654 releases; waiting 242 ms; commit 0 ms)
2026-11-08T14:09:14Z [load_day 2025-10-05] 2025-10-05 hour 12: 167955 events in 0 files, snapshot none (task 6433 ms: download 3329 ms overlapping gunzip 880 ms, parse 3865 ms, sort 0 ms, write 0 ms, index 670 ms: 3 candidates, 92454 repo-hours, 651 releases; waiting 443 ms; commit 0 ms)
2026-11-08T14:09:14Z [load_day 2025-10-05] 2025-10-05 hour 13: 170122 events in 0 files, snapshot none (task 6412 ms: download 3728 ms overlapping gunzip 941 ms, parse 4088 ms, sort 0 ms, write 0 ms, index 579 ms: 9 candidates, 80129 repo-hours, 656 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:09:22Z [load_day 2025-10-05] 2025-10-05 hour 14: 168580 events in 0 files, snapshot none (task 7515 ms: download 5885 ms overlapping gunzip 708 ms, parse 2925 ms, sort 0 ms, write 0 ms, index 626 ms: 11 candidates, 73428 repo-hours, 779 releases; waiting 2555 ms; commit 0 ms)
2026-11-08T14:09:22Z [load_day 2025-10-05] 2025-10-05 hour 15: 167158 events in 0 files, snapshot none (task 6146 ms: download 3932 ms overlapping gunzip 681 ms, parse 2866 ms, sort 0 ms, write 0 ms, index 587 ms: 8 candidates, 74374 repo-hours, 787 releases; waiting 1749 ms; commit 0 ms)
2026-11-08T14:09:28Z [load_day 2025-10-05] 2025-10-05 hour 16: 164471 events in 0 files, snapshot none (task 6020 ms: download 3558 ms overlapping gunzip 824 ms, parse 3277 ms, sort 0 ms, write 0 ms, index 774 ms: 5 candidates, 76035 repo-hours, 675 releases; waiting 765 ms; commit 0 ms)
2026-11-08T14:09:28Z [load_day 2025-10-05] 2025-10-05 hour 17: 162101 events in 0 files, snapshot none (task 6242 ms: download 3313 ms overlapping gunzip 829 ms, parse 3452 ms, sort 0 ms, write 0 ms, index 645 ms: 10 candidates, 72383 repo-hours, 697 releases; waiting 991 ms; commit 0 ms)
2026-11-08T14:09:35Z [load_day 2025-10-05] 2025-10-05 hour 18: 163567 events in 0 files, snapshot none (task 5676 ms: download 3055 ms overlapping gunzip 763 ms, parse 3278 ms, sort 0 ms, write 0 ms, index 808 ms: 21 candidates, 78065 repo-hours, 819 releases; waiting 503 ms; commit 0 ms)
2026-11-08T14:09:35Z [load_day 2025-10-05] 2025-10-05 hour 19: 155259 events in 0 files, snapshot none (task 5366 ms: download 3433 ms overlapping gunzip 753 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 551 ms: 16 candidates, 64704 repo-hours, 678 releases; waiting 361 ms; commit 0 ms)
2026-11-08T14:09:41Z [load_day 2025-10-05] 2025-10-05 hour 20: 154097 events in 0 files, snapshot none (task 5832 ms: download 3583 ms overlapping gunzip 881 ms, parse 3497 ms, sort 0 ms, write 0 ms, index 601 ms: 13 candidates, 66600 repo-hours, 721 releases; waiting 527 ms; commit 0 ms)
2026-11-08T14:09:41Z [load_day 2025-10-05] 2025-10-05 hour 21: 155571 events in 0 files, snapshot none (task 5575 ms: download 3693 ms overlapping gunzip 823 ms, parse 3486 ms, sort 0 ms, write 0 ms, index 462 ms: 35 candidates, 63873 repo-hours, 828 releases; waiting 470 ms; commit 0 ms)
2026-11-08T14:09:48Z [load_day 2025-10-05] 2025-10-05 hour 22: 143798 events in 0 files, snapshot none (task 6272 ms: download 3336 ms overlapping gunzip 844 ms, parse 3600 ms, sort 0 ms, write 0 ms, index 523 ms: 28 candidates, 57569 repo-hours, 790 releases; waiting 634 ms; commit 0 ms)
2026-11-08T14:09:48Z [load_day 2025-10-05] 2025-10-05 hour 23: 139158 events in 0 files, snapshot none (task 5944 ms: download 3245 ms overlapping gunzip 903 ms, parse 3826 ms, sort 0 ms, write 0 ms, index 402 ms: 15 candidates, 54775 repo-hours, 594 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:09:56Z [load_day 2025-10-05] 2025-10-05: repo_hour merged from 24 files to 1 (1638062 rows, 7774 ms)
2026-11-08T14:09:58Z [load_day 2025-10-05] 2025-10-05: index committed in 10365 ms (24 + 1 + 24 files)
2026-11-08T14:09:58Z [load_day 2025-10-05] 2025-10-05: 3712251 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:09:58Z [load_day 2025-10-05] attempt 1 succeeded