orcaLog in

Runs · run 4242

load_day 2025-08-06, attempt 1 succeeded

Host
73ccef5e07c2:356690
Started
2026-11-08T13:15:43Z
Ended
2026-11-08T13:17:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
687 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4242/load_day/2025-08-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:15:43Z [load_day 2025-08-06] attempt 1 started
2026-11-08T13:15:44Z [load_day 2025-08-06] 2025-08-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:15:51Z [load_day 2025-08-06] 2025-08-06 hour 0: 145127 events in 0 files, snapshot none (task 5952 ms: download 2759 ms overlapping gunzip 938 ms, parse 3781 ms, sort 0 ms, write 0 ms, index 629 ms: 4 candidates, 66760 repo-hours, 1166 releases; waiting 300 ms; commit 0 ms)
2026-11-08T13:15:51Z [load_day 2025-08-06] 2025-08-06 hour 1: 154869 events in 0 files, snapshot none (task 6429 ms: download 3462 ms overlapping gunzip 940 ms, parse 3688 ms, sort 0 ms, write 0 ms, index 864 ms: 5 candidates, 84725 repo-hours, 703 releases; waiting 610 ms; commit 0 ms)
2026-11-08T13:15:58Z [load_day 2025-08-06] 2025-08-06 hour 2: 150349 events in 0 files, snapshot none (task 6683 ms: download 4242 ms overlapping gunzip 1098 ms, parse 4128 ms, sort 0 ms, write 0 ms, index 700 ms: 5 candidates, 76148 repo-hours, 810 releases; waiting 463 ms; commit 0 ms)
2026-11-08T13:15:58Z [load_day 2025-08-06] 2025-08-06 hour 3: 146458 events in 0 files, snapshot none (task 6336 ms: download 3854 ms overlapping gunzip 1060 ms, parse 4094 ms, sort 0 ms, write 0 ms, index 688 ms: 5 candidates, 64685 repo-hours, 902 releases; waiting 205 ms; commit 0 ms)
2026-11-08T13:16:05Z [load_day 2025-08-06] 2025-08-06 hour 4: 147926 events in 0 files, snapshot none (task 6322 ms: download 3693 ms overlapping gunzip 1083 ms, parse 4036 ms, sort 0 ms, write 0 ms, index 500 ms: 9 candidates, 67782 repo-hours, 1795 releases; waiting 388 ms; commit 0 ms)
2026-11-08T13:16:05Z [load_day 2025-08-06] 2025-08-06 hour 5: 151569 events in 0 files, snapshot none (task 6374 ms: download 3873 ms overlapping gunzip 1095 ms, parse 4161 ms, sort 0 ms, write 0 ms, index 550 ms: 9 candidates, 67692 repo-hours, 763 releases; waiting 263 ms; commit 0 ms)
2026-11-08T13:16:12Z [load_day 2025-08-06] 2025-08-06 hour 6: 155053 events in 0 files, snapshot none (task 6998 ms: download 4161 ms overlapping gunzip 1006 ms, parse 4257 ms, sort 0 ms, write 0 ms, index 595 ms: 1 candidates, 79487 repo-hours, 925 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:16:12Z [load_day 2025-08-06] 2025-08-06 hour 7: 153302 events in 0 files, snapshot none (task 6689 ms: download 3919 ms overlapping gunzip 1039 ms, parse 4281 ms, sort 0 ms, write 0 ms, index 620 ms: 9 candidates, 74408 repo-hours, 872 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:16:21Z [load_day 2025-08-06] 2025-08-06 hour 8: 158968 events in 0 files, snapshot none (task 7710 ms: download 5304 ms overlapping gunzip 955 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 79918 repo-hours, 930 releases; waiting 2085 ms; commit 0 ms)
2026-11-08T13:16:21Z [load_day 2025-08-06] 2025-08-06 hour 9: 159414 events in 0 files, snapshot none (task 6361 ms: download 4195 ms overlapping gunzip 958 ms, parse 3744 ms, sort 0 ms, write 0 ms, index 619 ms: 7 candidates, 80167 repo-hours, 1055 releases; waiting 705 ms; commit 0 ms)
2026-11-08T13:16:27Z [load_day 2025-08-06] 2025-08-06 hour 10: 155991 events in 0 files, snapshot none (task 5595 ms: download 3563 ms overlapping gunzip 848 ms, parse 3345 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 77012 repo-hours, 848 releases; waiting 584 ms; commit 0 ms)
2026-11-08T13:16:27Z [load_day 2025-08-06] 2025-08-06 hour 11: 157298 events in 0 files, snapshot none (task 6282 ms: download 4240 ms overlapping gunzip 869 ms, parse 3729 ms, sort 0 ms, write 0 ms, index 563 ms: 7 candidates, 75014 repo-hours, 798 releases; waiting 823 ms; commit 0 ms)
2026-11-08T13:16:32Z [load_day 2025-08-06] 2025-08-06 hour 12: 166655 events in 0 files, snapshot none (task 5249 ms: download 3099 ms overlapping gunzip 805 ms, parse 3302 ms, sort 0 ms, write 0 ms, index 675 ms: 10 candidates, 97810 repo-hours, 851 releases; waiting 193 ms; commit 0 ms)
2026-11-08T13:16:35Z [load_day 2025-08-06] 2025-08-06 hour 13: 166349 events in 0 files, snapshot none (task 6962 ms: download 4192 ms overlapping gunzip 852 ms, parse 3577 ms, sort 0 ms, write 0 ms, index 944 ms: 1 candidates, 93933 repo-hours, 960 releases; waiting 1327 ms; commit 0 ms)
2026-11-08T13:16:41Z [load_day 2025-08-06] 2025-08-06 hour 14: 166284 events in 0 files, snapshot none (task 8081 ms: download 5195 ms overlapping gunzip 1288 ms, parse 5269 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 85743 repo-hours, 973 releases; waiting 558 ms; commit 0 ms)
2026-11-08T13:16:43Z [load_day 2025-08-06] 2025-08-06 hour 15: 166403 events in 0 files, snapshot none (task 7106 ms: download 4559 ms overlapping gunzip 1075 ms, parse 4469 ms, sort 0 ms, write 0 ms, index 781 ms: 5 candidates, 85017 repo-hours, 910 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:16:49Z [load_day 2025-08-06] 2025-08-06 hour 16: 161840 events in 0 files, snapshot none (task 7469 ms: download 4855 ms overlapping gunzip 1158 ms, parse 4697 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 82073 repo-hours, 937 releases; waiting 744 ms; commit 0 ms)
2026-11-08T13:16:50Z [load_day 2025-08-06] 2025-08-06 hour 17: 161865 events in 0 files, snapshot none (task 7110 ms: download 4599 ms overlapping gunzip 1146 ms, parse 4464 ms, sort 0 ms, write 0 ms, index 709 ms: 4 candidates, 79253 repo-hours, 732 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:16:58Z [load_day 2025-08-06] 2025-08-06 hour 18: 158417 events in 0 files, snapshot none (task 8459 ms: download 5577 ms overlapping gunzip 1251 ms, parse 4927 ms, sort 0 ms, write 0 ms, index 968 ms: 7 candidates, 82983 repo-hours, 840 releases; waiting 1002 ms; commit 0 ms)
2026-11-08T13:16:59Z [load_day 2025-08-06] 2025-08-06 hour 19: 155163 events in 0 files, snapshot none (task 8085 ms: download 4903 ms overlapping gunzip 1356 ms, parse 5292 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 69604 repo-hours, 758 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:17:07Z [load_day 2025-08-06] 2025-08-06 hour 20: 159041 events in 0 files, snapshot none (task 8189 ms: download 5320 ms overlapping gunzip 1080 ms, parse 4414 ms, sort 0 ms, write 0 ms, index 810 ms: 6 candidates, 73332 repo-hours, 849 releases; waiting 1622 ms; commit 0 ms)
2026-11-08T13:17:07Z [load_day 2025-08-06] 2025-08-06 hour 21: 154600 events in 0 files, snapshot none (task 7529 ms: download 3898 ms overlapping gunzip 1088 ms, parse 4461 ms, sort 0 ms, write 0 ms, index 975 ms: 9 candidates, 73442 repo-hours, 870 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:17:14Z [load_day 2025-08-06] 2025-08-06 hour 22: 149910 events in 0 files, snapshot none (task 6539 ms: download 3581 ms overlapping gunzip 1011 ms, parse 3880 ms, sort 0 ms, write 0 ms, index 952 ms: 4 candidates, 68434 repo-hours, 842 releases; waiting 372 ms; commit 0 ms)
2026-11-08T13:17:17Z [load_day 2025-08-06] 2025-08-06 hour 23: 149512 events in 0 files, snapshot none (task 9536 ms: download 7142 ms overlapping gunzip 1130 ms, parse 4719 ms, sort 0 ms, write 0 ms, index 542 ms: 4 candidates, 65718 repo-hours, 855 releases; waiting 2914 ms; commit 0 ms)
2026-11-08T13:17:26Z [load_day 2025-08-06] 2025-08-06: repo_hour merged from 24 files to 1 (1851140 rows, 8197 ms)
2026-11-08T13:17:29Z [load_day 2025-08-06] 2025-08-06: index committed in 11219 ms (24 + 1 + 24 files)
2026-11-08T13:17:29Z [load_day 2025-08-06] 2025-08-06: 3752363 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:17:29Z [load_day 2025-08-06] attempt 1 succeeded