orcaLog in

Runs · run 4403

load_day 2025-09-18, attempt 1 succeeded

Host
73ccef5e07c2:380901
Started
2026-11-08T13:53:43Z
Ended
2026-11-08T13:55:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
729 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
149.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4403/load_day/2025-09-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:53:43Z [load_day 2025-09-18] attempt 1 started
2026-11-08T13:53:44Z [load_day 2025-09-18] 2025-09-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:53:50Z [load_day 2025-09-18] 2025-09-18 hour 0: 150214 events in 0 files, snapshot none (task 6120 ms: download 3608 ms overlapping gunzip 984 ms, parse 3874 ms, sort 0 ms, write 0 ms, index 558 ms: 9 candidates, 77304 repo-hours, 1177 releases; waiting 455 ms; commit 0 ms)
2026-11-08T13:53:50Z [load_day 2025-09-18] 2025-09-18 hour 1: 158628 events in 0 files, snapshot none (task 6115 ms: download 3343 ms overlapping gunzip 844 ms, parse 3703 ms, sort 0 ms, write 0 ms, index 729 ms: 7 candidates, 91711 repo-hours, 786 releases; waiting 558 ms; commit 0 ms)
2026-11-08T13:53:57Z [load_day 2025-09-18] 2025-09-18 hour 2: 149157 events in 0 files, snapshot none (task 5677 ms: download 3086 ms overlapping gunzip 805 ms, parse 3276 ms, sort 0 ms, write 0 ms, index 585 ms: 11 candidates, 74132 repo-hours, 770 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:53:57Z [load_day 2025-09-18] 2025-09-18 hour 3: 154092 events in 0 files, snapshot none (task 5547 ms: download 3085 ms overlapping gunzip 816 ms, parse 3365 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 69598 repo-hours, 1956 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:54:04Z [load_day 2025-09-18] 2025-09-18 hour 4: 151554 events in 0 files, snapshot none (task 6565 ms: download 3707 ms overlapping gunzip 1070 ms, parse 4395 ms, sort 0 ms, write 0 ms, index 595 ms: 6 candidates, 66367 repo-hours, 600 releases; waiting 263 ms; commit 0 ms)
2026-11-08T13:54:04Z [load_day 2025-09-18] 2025-09-18 hour 5: 150515 events in 0 files, snapshot none (task 6865 ms: download 4226 ms overlapping gunzip 1106 ms, parse 4357 ms, sort 0 ms, write 0 ms, index 516 ms: 9 candidates, 68369 repo-hours, 741 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:54:12Z [load_day 2025-09-18] 2025-09-18 hour 6: 159436 events in 0 files, snapshot none (task 7664 ms: download 4845 ms overlapping gunzip 1281 ms, parse 4971 ms, sort 0 ms, write 0 ms, index 680 ms: 8 candidates, 80204 repo-hours, 860 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:54:12Z [load_day 2025-09-18] 2025-09-18 hour 7: 161871 events in 0 files, snapshot none (task 7723 ms: download 5047 ms overlapping gunzip 1225 ms, parse 4978 ms, sort 0 ms, write 0 ms, index 555 ms: 8 candidates, 77582 repo-hours, 810 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:54:20Z [load_day 2025-09-18] 2025-09-18 hour 8: 159022 events in 0 files, snapshot none (task 8292 ms: download 5603 ms overlapping gunzip 1407 ms, parse 5450 ms, sort 0 ms, write 0 ms, index 653 ms: 7 candidates, 79652 repo-hours, 815 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:54:21Z [load_day 2025-09-18] 2025-09-18 hour 9: 162828 events in 0 files, snapshot none (task 8231 ms: download 5352 ms overlapping gunzip 1284 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 614 ms: 4 candidates, 82014 repo-hours, 963 releases; waiting 545 ms; commit 0 ms)
2026-11-08T13:54:28Z [load_day 2025-09-18] 2025-09-18 hour 10: 161704 events in 0 files, snapshot none (task 7651 ms: download 5166 ms overlapping gunzip 1289 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 581 ms: 7 candidates, 80521 repo-hours, 784 releases; waiting 602 ms; commit 0 ms)
2026-11-08T13:54:29Z [load_day 2025-09-18] 2025-09-18 hour 11: 165336 events in 0 files, snapshot none (task 6976 ms: download 4559 ms overlapping gunzip 1146 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 557 ms: 4 candidates, 76741 repo-hours, 800 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:54:36Z [load_day 2025-09-18] 2025-09-18 hour 12: 167846 events in 0 files, snapshot none (task 7043 ms: download 4332 ms overlapping gunzip 1139 ms, parse 4647 ms, sort 0 ms, write 0 ms, index 697 ms: 12 candidates, 99699 repo-hours, 821 releases; waiting 338 ms; commit 0 ms)
2026-11-08T13:54:37Z [load_day 2025-09-18] 2025-09-18 hour 13: 169319 events in 0 files, snapshot none (task 7597 ms: download 5122 ms overlapping gunzip 1197 ms, parse 4908 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 93520 repo-hours, 771 releases; waiting 591 ms; commit 0 ms)
2026-11-08T13:54:44Z [load_day 2025-09-18] 2025-09-18 hour 14: 167820 events in 0 files, snapshot none (task 7675 ms: download 4212 ms overlapping gunzip 1270 ms, parse 4887 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 86555 repo-hours, 857 releases; waiting 540 ms; commit 0 ms)
2026-11-08T13:54:45Z [load_day 2025-09-18] 2025-09-18 hour 15: 165181 events in 0 files, snapshot none (task 8039 ms: download 5505 ms overlapping gunzip 1111 ms, parse 4502 ms, sort 0 ms, write 0 ms, index 700 ms: 8 candidates, 84910 repo-hours, 907 releases; waiting 1391 ms; commit 0 ms)
2026-11-08T13:54:50Z [load_day 2025-09-18] 2025-09-18 hour 16: 110055 events in 0 files, snapshot none (task 5458 ms: download 3484 ms overlapping gunzip 728 ms, parse 3013 ms, sort 0 ms, write 0 ms, index 676 ms: 7 candidates, 58239 repo-hours, 536 releases; waiting 762 ms; commit 0 ms)
2026-11-08T13:54:54Z [load_day 2025-09-18] 2025-09-18 hour 17: 161881 events in 0 files, snapshot none (task 7882 ms: download 4798 ms overlapping gunzip 1274 ms, parse 5147 ms, sort 0 ms, write 0 ms, index 817 ms: 9 candidates, 78540 repo-hours, 775 releases; waiting 321 ms; commit 0 ms)
2026-11-08T13:54:58Z [load_day 2025-09-18] 2025-09-18 hour 18: 162784 events in 0 files, snapshot none (task 7333 ms: download 3597 ms overlapping gunzip 1030 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 1266 ms: 6 candidates, 84103 repo-hours, 897 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:55:01Z [load_day 2025-09-18] 2025-09-18 hour 19: 158704 events in 0 files, snapshot none (task 7245 ms: download 4422 ms overlapping gunzip 1146 ms, parse 4518 ms, sort 0 ms, write 0 ms, index 708 ms: 5 candidates, 70845 repo-hours, 820 releases; waiting 564 ms; commit 0 ms)
2026-11-08T13:55:06Z [load_day 2025-09-18] 2025-09-18 hour 20: 157199 events in 0 files, snapshot none (task 7508 ms: download 4366 ms overlapping gunzip 1009 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 1141 ms: 8 candidates, 72497 repo-hours, 769 releases; waiting 1141 ms; commit 0 ms)
2026-11-08T13:55:10Z [load_day 2025-09-18] 2025-09-18 hour 21: 152028 events in 0 files, snapshot none (task 8213 ms: download 4802 ms overlapping gunzip 1212 ms, parse 4738 ms, sort 0 ms, write 0 ms, index 931 ms: 11 candidates, 65759 repo-hours, 847 releases; waiting 1103 ms; commit 0 ms)
2026-11-08T13:55:12Z [load_day 2025-09-18] 2025-09-18 hour 22: 145984 events in 0 files, snapshot none (task 5656 ms: download 3191 ms overlapping gunzip 853 ms, parse 3413 ms, sort 0 ms, write 0 ms, index 461 ms: 6 candidates, 61822 repo-hours, 873 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:55:16Z [load_day 2025-09-18] 2025-09-18 hour 23: 147319 events in 0 files, snapshot none (task 5214 ms: download 2850 ms overlapping gunzip 802 ms, parse 3324 ms, sort 0 ms, write 0 ms, index 479 ms: 9 candidates, 60017 repo-hours, 936 releases; waiting 303 ms; commit 0 ms)
2026-11-08T13:55:25Z [load_day 2025-09-18] 2025-09-18: repo_hour merged from 24 files to 1 (1840701 rows, 8811 ms)
2026-11-08T13:55:28Z [load_day 2025-09-18] 2025-09-18: index committed in 11653 ms (24 + 1 + 24 files)
2026-11-08T13:55:28Z [load_day 2025-09-18] 2025-09-18: 3750477 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:55:28Z [load_day 2025-09-18] attempt 1 succeeded