orcaLog in

Runs · run 4435

load_day 2025-09-24, attempt 1 succeeded

Host
73ccef5e07c2:384520
Started
2026-11-08T13:59:00Z
Ended
2026-11-08T14:00:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
688 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
154.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4435/load_day/2025-09-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:59:00Z [load_day 2025-09-24] attempt 1 started
2026-11-08T13:59:01Z [load_day 2025-09-24] 2025-09-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:59:07Z [load_day 2025-09-24] 2025-09-24 hour 0: 156267 events in 0 files, snapshot none (task 5689 ms: download 3184 ms overlapping gunzip 901 ms, parse 3415 ms, sort 0 ms, write 0 ms, index 566 ms: 12 candidates, 78640 repo-hours, 985 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:59:08Z [load_day 2025-09-24] 2025-09-24 hour 1: 164078 events in 0 files, snapshot none (task 6021 ms: download 3988 ms overlapping gunzip 749 ms, parse 2971 ms, sort 0 ms, write 0 ms, index 654 ms: 12 candidates, 95796 repo-hours, 747 releases; waiting 1332 ms; commit 0 ms)
2026-11-08T13:59:14Z [load_day 2025-09-24] 2025-09-24 hour 2: 153463 events in 0 files, snapshot none (task 6216 ms: download 3193 ms overlapping gunzip 812 ms, parse 3364 ms, sort 0 ms, write 0 ms, index 1137 ms: 10 candidates, 75900 repo-hours, 710 releases; waiting 612 ms; commit 0 ms)
2026-11-08T13:59:14Z [load_day 2025-09-24] 2025-09-24 hour 3: 155624 events in 0 files, snapshot none (task 5288 ms: download 2783 ms overlapping gunzip 757 ms, parse 3060 ms, sort 0 ms, write 0 ms, index 716 ms: 5 candidates, 70088 repo-hours, 1929 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:59:21Z [load_day 2025-09-24] 2025-09-24 hour 4: 152318 events in 0 files, snapshot none (task 6902 ms: download 3913 ms overlapping gunzip 995 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 789 ms: 14 candidates, 68094 repo-hours, 612 releases; waiting 823 ms; commit 0 ms)
2026-11-08T13:59:21Z [load_day 2025-09-24] 2025-09-24 hour 5: 151368 events in 0 files, snapshot none (task 6567 ms: download 3904 ms overlapping gunzip 943 ms, parse 3524 ms, sort 0 ms, write 0 ms, index 1073 ms: 5 candidates, 66845 repo-hours, 729 releases; waiting 717 ms; commit 0 ms)
2026-11-08T13:59:28Z [load_day 2025-09-24] 2025-09-24 hour 6: 167229 events in 0 files, snapshot none (task 6398 ms: download 3386 ms overlapping gunzip 930 ms, parse 3781 ms, sort 0 ms, write 0 ms, index 884 ms: 10 candidates, 85313 repo-hours, 779 releases; waiting 481 ms; commit 0 ms)
2026-11-08T13:59:30Z [load_day 2025-09-24] 2025-09-24 hour 7: 165819 events in 0 files, snapshot none (task 8580 ms: download 5005 ms overlapping gunzip 1211 ms, parse 4877 ms, sort 0 ms, write 0 ms, index 774 ms: 13 candidates, 79326 repo-hours, 681 releases; waiting 1415 ms; commit 0 ms)
2026-11-08T13:59:36Z [load_day 2025-09-24] 2025-09-24 hour 8: 167162 events in 0 files, snapshot none (task 7587 ms: download 3755 ms overlapping gunzip 1253 ms, parse 4687 ms, sort 0 ms, write 0 ms, index 1067 ms: 9 candidates, 83146 repo-hours, 857 releases; waiting 285 ms; commit 0 ms)
2026-11-08T13:59:39Z [load_day 2025-09-24] 2025-09-24 hour 9: 167812 events in 0 files, snapshot none (task 7771 ms: download 4929 ms overlapping gunzip 1247 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 711 ms: 10 candidates, 82576 repo-hours, 865 releases; waiting 667 ms; commit 0 ms)
2026-11-08T13:59:45Z [load_day 2025-09-24] 2025-09-24 hour 10: 168113 events in 0 files, snapshot none (task 8272 ms: download 4734 ms overlapping gunzip 1125 ms, parse 4691 ms, sort 0 ms, write 0 ms, index 1128 ms: 9 candidates, 80462 repo-hours, 758 releases; waiting 803 ms; commit 0 ms)
2026-11-08T13:59:47Z [load_day 2025-09-24] 2025-09-24 hour 11: 168189 events in 0 files, snapshot none (task 7516 ms: download 4766 ms overlapping gunzip 1188 ms, parse 4838 ms, sort 0 ms, write 0 ms, index 620 ms: 3 candidates, 76775 repo-hours, 825 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:59:53Z [load_day 2025-09-24] 2025-09-24 hour 12: 169526 events in 0 files, snapshot none (task 6877 ms: download 3684 ms overlapping gunzip 927 ms, parse 3959 ms, sort 0 ms, write 0 ms, index 1141 ms: 10 candidates, 97941 repo-hours, 731 releases; waiting 617 ms; commit 0 ms)
2026-11-08T13:59:55Z [load_day 2025-09-24] 2025-09-24 hour 13: 170587 events in 0 files, snapshot none (task 7583 ms: download 4790 ms overlapping gunzip 1159 ms, parse 4742 ms, sort 0 ms, write 0 ms, index 767 ms: 8 candidates, 93120 repo-hours, 771 releases; waiting 658 ms; commit 0 ms)
2026-11-08T14:00:01Z [load_day 2025-09-24] 2025-09-24 hour 14: 166644 events in 0 files, snapshot none (task 7685 ms: download 4432 ms overlapping gunzip 1137 ms, parse 4514 ms, sort 0 ms, write 0 ms, index 1272 ms: 8 candidates, 84186 repo-hours, 855 releases; waiting 434 ms; commit 0 ms)
2026-11-08T14:00:03Z [load_day 2025-09-24] 2025-09-24 hour 15: 164694 events in 0 files, snapshot none (task 7910 ms: download 5297 ms overlapping gunzip 1261 ms, parse 5202 ms, sort 0 ms, write 0 ms, index 666 ms: 12 candidates, 82270 repo-hours, 841 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:00:08Z [load_day 2025-09-24] 2025-09-24 hour 16: 112718 events in 0 files, snapshot none (task 5951 ms: download 3727 ms overlapping gunzip 626 ms, parse 2440 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 59764 repo-hours, 518 releases; waiting 2069 ms; commit 0 ms)
2026-11-08T14:00:15Z [load_day 2025-09-24] 2025-09-24 hour 17: 171019 events in 0 files, snapshot none (task 8336 ms: download 5698 ms overlapping gunzip 1306 ms, parse 5225 ms, sort 0 ms, write 0 ms, index 708 ms: 10 candidates, 79082 repo-hours, 670 releases; waiting 871 ms; commit 0 ms)
2026-11-08T14:00:15Z [load_day 2025-09-24] 2025-09-24 hour 18: 122204 events in 0 files, snapshot none (task 6262 ms: download 3390 ms overlapping gunzip 1018 ms, parse 3826 ms, sort 0 ms, write 0 ms, index 564 ms: 15 candidates, 64542 repo-hours, 551 releases; waiting 477 ms; commit 0 ms)
2026-11-08T14:00:24Z [load_day 2025-09-24] 2025-09-24 hour 19: 169563 events in 0 files, snapshot none (task 9264 ms: download 6431 ms overlapping gunzip 1519 ms, parse 5964 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 72675 repo-hours, 700 releases; waiting 852 ms; commit 0 ms)
2026-11-08T14:00:24Z [load_day 2025-09-24] 2025-09-24 hour 20: 165069 events in 0 files, snapshot none (task 8305 ms: download 5347 ms overlapping gunzip 1339 ms, parse 5286 ms, sort 0 ms, write 0 ms, index 848 ms: 7 candidates, 72229 repo-hours, 707 releases; waiting 589 ms; commit 0 ms)
2026-11-08T14:00:33Z [load_day 2025-09-24] 2025-09-24 hour 21: 165801 events in 0 files, snapshot none (task 8099 ms: download 4986 ms overlapping gunzip 1267 ms, parse 4862 ms, sort 0 ms, write 0 ms, index 587 ms: 16 candidates, 71585 repo-hours, 763 releases; waiting 1131 ms; commit 0 ms)
2026-11-08T14:00:33Z [load_day 2025-09-24] 2025-09-24 hour 22: 151618 events in 0 files, snapshot none (task 7129 ms: download 4437 ms overlapping gunzip 1161 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 63157 repo-hours, 780 releases; waiting 234 ms; commit 0 ms)
2026-11-08T14:00:39Z [load_day 2025-09-24] 2025-09-24 hour 23: 148882 events in 0 files, snapshot none (task 5395 ms: download 3076 ms overlapping gunzip 887 ms, parse 3485 ms, sort 0 ms, write 0 ms, index 449 ms: 10 candidates, 60048 repo-hours, 752 releases; waiting 219 ms; commit 0 ms)
2026-11-08T14:00:47Z [load_day 2025-09-24] 2025-09-24: repo_hour merged from 24 files to 1 (1843560 rows, 8510 ms)
2026-11-08T14:00:50Z [load_day 2025-09-24] 2025-09-24: index committed in 11150 ms (24 + 1 + 24 files)
2026-11-08T14:00:50Z [load_day 2025-09-24] 2025-09-24: 3815767 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:00:50Z [load_day 2025-09-24] attempt 1 succeeded