orcaLog in

Runs · run 4349

load_day 2025-09-04, attempt 1 succeeded

Host
73ccef5e07c2:372567
Started
2026-11-08T13:41:00Z
Ended
2026-11-08T13:42:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
158.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4349/load_day/2025-09-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:41:00Z [load_day 2025-09-04] attempt 1 started
2026-11-08T13:41:01Z [load_day 2025-09-04] 2025-09-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:41:12Z [load_day 2025-09-04] 2025-09-04 hour 0: 151395 events in 0 files, snapshot none (task 8023 ms: download 4872 ms overlapping gunzip 1242 ms, parse 5107 ms, sort 0 ms, write 0 ms, index 968 ms: 11 candidates, 78946 repo-hours, 985 releases; waiting 472 ms; commit 0 ms)
2026-11-08T13:41:12Z [load_day 2025-09-04] 2025-09-04 hour 1: 158148 events in 0 files, snapshot none (task 7661 ms: download 4573 ms overlapping gunzip 1202 ms, parse 4972 ms, sort 0 ms, write 0 ms, index 730 ms: 9 candidates, 94535 repo-hours, 838 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:41:20Z [load_day 2025-09-04] 2025-09-04 hour 2: 148348 events in 0 files, snapshot none (task 7644 ms: download 4783 ms overlapping gunzip 1210 ms, parse 4954 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 74707 repo-hours, 890 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:41:20Z [load_day 2025-09-04] 2025-09-04 hour 3: 156534 events in 0 files, snapshot none (task 7381 ms: download 4636 ms overlapping gunzip 1200 ms, parse 4683 ms, sort 0 ms, write 0 ms, index 596 ms: 9 candidates, 71119 repo-hours, 2344 releases; waiting 654 ms; commit 0 ms)
2026-11-08T13:41:28Z [load_day 2025-09-04] 2025-09-04 hour 4: 154409 events in 0 files, snapshot none (task 7509 ms: download 3950 ms overlapping gunzip 1215 ms, parse 4818 ms, sort 0 ms, write 0 ms, index 717 ms: 3 candidates, 68201 repo-hours, 952 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:41:28Z [load_day 2025-09-04] 2025-09-04 hour 5: 154287 events in 0 files, snapshot none (task 7627 ms: download 4879 ms overlapping gunzip 1305 ms, parse 5025 ms, sort 0 ms, write 0 ms, index 536 ms: 4 candidates, 70719 repo-hours, 887 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:41:35Z [load_day 2025-09-04] 2025-09-04 hour 6: 162918 events in 0 files, snapshot none (task 7006 ms: download 3908 ms overlapping gunzip 1134 ms, parse 4449 ms, sort 0 ms, write 0 ms, index 937 ms: 7 candidates, 82254 repo-hours, 817 releases; waiting 222 ms; commit 0 ms)
2026-11-08T13:41:36Z [load_day 2025-09-04] 2025-09-04 hour 7: 163190 events in 0 files, snapshot none (task 7504 ms: download 4088 ms overlapping gunzip 1233 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 815 ms: 12 candidates, 76919 repo-hours, 800 releases; waiting 220 ms; commit 0 ms)
2026-11-08T13:41:45Z [load_day 2025-09-04] 2025-09-04 hour 8: 161301 events in 0 files, snapshot none (task 8545 ms: download 5269 ms overlapping gunzip 1342 ms, parse 5233 ms, sort 0 ms, write 0 ms, index 780 ms: 14 candidates, 80586 repo-hours, 931 releases; waiting 875 ms; commit 0 ms)
2026-11-08T13:41:45Z [load_day 2025-09-04] 2025-09-04 hour 9: 168840 events in 0 files, snapshot none (task 8400 ms: download 5587 ms overlapping gunzip 1430 ms, parse 5621 ms, sort 0 ms, write 0 ms, index 601 ms: 9 candidates, 82204 repo-hours, 1044 releases; waiting 543 ms; commit 0 ms)
2026-11-08T13:41:53Z [load_day 2025-09-04] 2025-09-04 hour 10: 160534 events in 0 files, snapshot none (task 8363 ms: download 5710 ms overlapping gunzip 1335 ms, parse 5352 ms, sort 0 ms, write 0 ms, index 670 ms: 7 candidates, 79543 repo-hours, 843 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:41:53Z [load_day 2025-09-04] 2025-09-04 hour 11: 166493 events in 0 files, snapshot none (task 7904 ms: download 5464 ms overlapping gunzip 1318 ms, parse 5078 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 76765 repo-hours, 839 releases; waiting 690 ms; commit 0 ms)
2026-11-08T13:42:02Z [load_day 2025-09-04] 2025-09-04 hour 12: 167793 events in 0 files, snapshot none (task 7823 ms: download 5215 ms overlapping gunzip 1242 ms, parse 5009 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 94807 repo-hours, 849 releases; waiting 570 ms; commit 0 ms)
2026-11-08T13:42:02Z [load_day 2025-09-04] 2025-09-04 hour 13: 162632 events in 0 files, snapshot none (task 8142 ms: download 5728 ms overlapping gunzip 1289 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 86106 repo-hours, 804 releases; waiting 710 ms; commit 0 ms)
2026-11-08T13:42:09Z [load_day 2025-09-04] 2025-09-04 hour 14: 169397 events in 0 files, snapshot none (task 7016 ms: download 4592 ms overlapping gunzip 1080 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 654 ms: 6 candidates, 83492 repo-hours, 815 releases; waiting 553 ms; commit 0 ms)
2026-11-08T13:42:09Z [load_day 2025-09-04] 2025-09-04 hour 15: 165968 events in 0 files, snapshot none (task 6774 ms: download 4417 ms overlapping gunzip 1158 ms, parse 4444 ms, sort 0 ms, write 0 ms, index 632 ms: 5 candidates, 82169 repo-hours, 863 releases; waiting 326 ms; commit 0 ms)
2026-11-08T13:42:16Z [load_day 2025-09-04] 2025-09-04 hour 16: 165874 events in 0 files, snapshot none (task 6294 ms: download 3744 ms overlapping gunzip 948 ms, parse 3738 ms, sort 0 ms, write 0 ms, index 774 ms: 11 candidates, 77764 repo-hours, 819 releases; waiting 565 ms; commit 0 ms)
2026-11-08T13:42:16Z [load_day 2025-09-04] 2025-09-04 hour 17: 166771 events in 0 files, snapshot none (task 6425 ms: download 3753 ms overlapping gunzip 922 ms, parse 3721 ms, sort 0 ms, write 0 ms, index 930 ms: 4 candidates, 74317 repo-hours, 681 releases; waiting 554 ms; commit 0 ms)
2026-11-08T13:42:24Z [load_day 2025-09-04] 2025-09-04 hour 18: 166589 events in 0 files, snapshot none (task 7329 ms: download 4144 ms overlapping gunzip 1005 ms, parse 4225 ms, sort 0 ms, write 0 ms, index 1117 ms: 3 candidates, 76100 repo-hours, 810 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:42:24Z [load_day 2025-09-04] 2025-09-04 hour 19: 166289 events in 0 files, snapshot none (task 6919 ms: download 4167 ms overlapping gunzip 1104 ms, parse 4427 ms, sort 0 ms, write 0 ms, index 748 ms: 12 candidates, 66697 repo-hours, 786 releases; waiting 363 ms; commit 0 ms)
2026-11-08T13:42:34Z [load_day 2025-09-04] 2025-09-04 hour 20: 164648 events in 0 files, snapshot none (task 9518 ms: download 7239 ms overlapping gunzip 1191 ms, parse 4839 ms, sort 0 ms, write 0 ms, index 503 ms: 16 candidates, 66794 repo-hours, 779 releases; waiting 2699 ms; commit 0 ms)
2026-11-08T13:42:34Z [load_day 2025-09-04] 2025-09-04 hour 21: 158948 events in 0 files, snapshot none (task 7419 ms: download 4814 ms overlapping gunzip 1174 ms, parse 4343 ms, sort 0 ms, write 0 ms, index 785 ms: 11 candidates, 61232 repo-hours, 811 releases; waiting 756 ms; commit 0 ms)
2026-11-08T13:42:41Z [load_day 2025-09-04] 2025-09-04 hour 22: 152061 events in 0 files, snapshot none (task 6335 ms: download 4088 ms overlapping gunzip 1071 ms, parse 4131 ms, sort 0 ms, write 0 ms, index 407 ms: 4 candidates, 56413 repo-hours, 817 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:42:41Z [load_day 2025-09-04] 2025-09-04 hour 23: 156011 events in 0 files, snapshot none (task 6399 ms: download 4149 ms overlapping gunzip 1076 ms, parse 4168 ms, sort 0 ms, write 0 ms, index 424 ms: 5 candidates, 53995 repo-hours, 752 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:42:49Z [load_day 2025-09-04] 2025-09-04: repo_hour merged from 24 files to 1 (1816384 rows, 8334 ms)
2026-11-08T13:42:52Z [load_day 2025-09-04] 2025-09-04: index committed in 11273 ms (24 + 1 + 24 files)
2026-11-08T13:42:52Z [load_day 2025-09-04] 2025-09-04: 3869378 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:42:52Z [load_day 2025-09-04] attempt 1 succeeded