orcaLog in

Runs · run 4003

load_day 2025-06-10, attempt 1 succeeded

Host
73ccef5e07c2:319757
Started
2026-11-08T12:22:07Z
Ended
2026-11-08T12:23:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4003/load_day/2025-06-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:22:07Z [load_day 2025-06-10] attempt 1 started
2026-11-08T12:22:08Z [load_day 2025-06-10] 2025-06-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:22:14Z [load_day 2025-06-10] 2025-06-10 hour 0: 147513 events in 0 files, snapshot none (task 6070 ms: download 3748 ms overlapping gunzip 948 ms, parse 3840 ms, sort 0 ms, write 0 ms, index 530 ms: 9 candidates, 72765 repo-hours, 1023 releases; waiting 467 ms; commit 0 ms)
2026-11-08T12:22:14Z [load_day 2025-06-10] 2025-06-10 hour 1: 151540 events in 0 files, snapshot none (task 5559 ms: download 3182 ms overlapping gunzip 843 ms, parse 3612 ms, sort 0 ms, write 0 ms, index 613 ms: 14 candidates, 87974 repo-hours, 829 releases; waiting 243 ms; commit 0 ms)
2026-11-08T12:22:20Z [load_day 2025-06-10] 2025-06-10 hour 2: 151719 events in 0 files, snapshot none (task 5399 ms: download 3099 ms overlapping gunzip 786 ms, parse 3151 ms, sort 0 ms, write 0 ms, index 555 ms: 12 candidates, 75888 repo-hours, 879 releases; waiting 554 ms; commit 0 ms)
2026-11-08T12:22:20Z [load_day 2025-06-10] 2025-06-10 hour 3: 147470 events in 0 files, snapshot none (task 5344 ms: download 3021 ms overlapping gunzip 789 ms, parse 3161 ms, sort 0 ms, write 0 ms, index 614 ms: 8 candidates, 71302 repo-hours, 1810 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:22:26Z [load_day 2025-06-10] 2025-06-10 hour 4: 146286 events in 0 files, snapshot none (task 5298 ms: download 3096 ms overlapping gunzip 785 ms, parse 3199 ms, sort 0 ms, write 0 ms, index 490 ms: 5 candidates, 64520 repo-hours, 950 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:22:26Z [load_day 2025-06-10] 2025-06-10 hour 5: 148342 events in 0 files, snapshot none (task 5199 ms: download 2977 ms overlapping gunzip 822 ms, parse 3208 ms, sort 0 ms, write 0 ms, index 552 ms: 8 candidates, 66463 repo-hours, 744 releases; waiting 309 ms; commit 0 ms)
2026-11-08T12:22:36Z [load_day 2025-06-10] 2025-06-10 hour 6: 154963 events in 0 files, snapshot none (task 7991 ms: download 4276 ms overlapping gunzip 1263 ms, parse 5115 ms, sort 0 ms, write 0 ms, index 832 ms: 13 candidates, 80421 repo-hours, 832 releases; waiting 456 ms; commit 0 ms)
2026-11-08T12:22:37Z [load_day 2025-06-10] 2025-06-10 hour 7: 157723 events in 0 files, snapshot none (task 8735 ms: download 5528 ms overlapping gunzip 1482 ms, parse 5567 ms, sort 0 ms, write 0 ms, index 639 ms: 15 candidates, 76170 repo-hours, 902 releases; waiting 685 ms; commit 0 ms)
2026-11-08T12:22:45Z [load_day 2025-06-10] 2025-06-10 hour 8: 162378 events in 0 files, snapshot none (task 8188 ms: download 5083 ms overlapping gunzip 1515 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 671 ms: 13 candidates, 83102 repo-hours, 935 releases; waiting 288 ms; commit 0 ms)
2026-11-08T12:22:46Z [load_day 2025-06-10] 2025-06-10 hour 9: 161032 events in 0 files, snapshot none (task 7923 ms: download 5441 ms overlapping gunzip 1313 ms, parse 5190 ms, sort 0 ms, write 0 ms, index 622 ms: 12 candidates, 81327 repo-hours, 949 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:22:53Z [load_day 2025-06-10] 2025-06-10 hour 10: 159634 events in 0 files, snapshot none (task 7761 ms: download 4989 ms overlapping gunzip 1156 ms, parse 4767 ms, sort 0 ms, write 0 ms, index 661 ms: 17 candidates, 78748 repo-hours, 796 releases; waiting 794 ms; commit 0 ms)
2026-11-08T12:22:55Z [load_day 2025-06-10] 2025-06-10 hour 11: 159575 events in 0 files, snapshot none (task 8017 ms: download 5428 ms overlapping gunzip 1254 ms, parse 5170 ms, sort 0 ms, write 0 ms, index 726 ms: 14 candidates, 77888 repo-hours, 783 releases; waiting 479 ms; commit 0 ms)
2026-11-08T12:23:01Z [load_day 2025-06-10] 2025-06-10 hour 12: 158846 events in 0 files, snapshot none (task 7223 ms: download 4129 ms overlapping gunzip 1096 ms, parse 4540 ms, sort 0 ms, write 0 ms, index 808 ms: 12 candidates, 95405 repo-hours, 863 releases; waiting 483 ms; commit 0 ms)
2026-11-08T12:23:02Z [load_day 2025-06-10] 2025-06-10 hour 13: 150029 events in 0 files, snapshot none (task 6872 ms: download 4319 ms overlapping gunzip 1148 ms, parse 4299 ms, sort 0 ms, write 0 ms, index 629 ms: 19 candidates, 87989 repo-hours, 720 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:23:08Z [load_day 2025-06-10] 2025-06-10 hour 14: 141567 events in 0 files, snapshot none (task 6876 ms: download 3737 ms overlapping gunzip 1045 ms, parse 4384 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 75681 repo-hours, 788 releases; waiting 468 ms; commit 0 ms)
2026-11-08T12:23:10Z [load_day 2025-06-10] 2025-06-10 hour 15: 149600 events in 0 files, snapshot none (task 6958 ms: download 4447 ms overlapping gunzip 1164 ms, parse 4434 ms, sort 0 ms, write 0 ms, index 602 ms: 9 candidates, 80429 repo-hours, 883 releases; waiting 390 ms; commit 0 ms)
2026-11-08T12:23:18Z [load_day 2025-06-10] 2025-06-10 hour 16: 164145 events in 0 files, snapshot none (task 9621 ms: download 7211 ms overlapping gunzip 1137 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 699 ms: 14 candidates, 92288 repo-hours, 857 releases; waiting 3030 ms; commit 0 ms)
2026-11-08T12:23:18Z [load_day 2025-06-10] 2025-06-10 hour 17: 163980 events in 0 files, snapshot none (task 6834 ms: download 4175 ms overlapping gunzip 1022 ms, parse 4105 ms, sort 0 ms, write 0 ms, index 665 ms: 6 candidates, 85282 repo-hours, 863 releases; waiting 691 ms; commit 0 ms)
2026-11-08T12:23:27Z [load_day 2025-06-10] 2025-06-10 hour 18: 162384 events in 0 files, snapshot none (task 8119 ms: download 5207 ms overlapping gunzip 1282 ms, parse 5373 ms, sort 0 ms, write 0 ms, index 579 ms: 3 candidates, 82428 repo-hours, 922 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:23:27Z [load_day 2025-06-10] 2025-06-10 hour 19: 156560 events in 0 files, snapshot none (task 7806 ms: download 4870 ms overlapping gunzip 1209 ms, parse 5155 ms, sort 0 ms, write 0 ms, index 639 ms: 19 candidates, 72799 repo-hours, 913 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:23:36Z [load_day 2025-06-10] 2025-06-10 hour 20: 153312 events in 0 files, snapshot none (task 7792 ms: download 4711 ms overlapping gunzip 1308 ms, parse 5166 ms, sort 0 ms, write 0 ms, index 725 ms: 5 candidates, 72093 repo-hours, 933 releases; waiting 318 ms; commit 0 ms)
2026-11-08T12:23:36Z [load_day 2025-06-10] 2025-06-10 hour 21: 151481 events in 0 files, snapshot none (task 8228 ms: download 4447 ms overlapping gunzip 1322 ms, parse 5244 ms, sort 0 ms, write 0 ms, index 763 ms: 6 candidates, 67827 repo-hours, 1025 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:23:45Z [load_day 2025-06-10] 2025-06-10 hour 22: 144639 events in 0 files, snapshot none (task 8510 ms: download 5034 ms overlapping gunzip 1413 ms, parse 5601 ms, sort 0 ms, write 0 ms, index 793 ms: 12 candidates, 63094 repo-hours, 999 releases; waiting 467 ms; commit 0 ms)
2026-11-08T12:23:45Z [load_day 2025-06-10] 2025-06-10 hour 23: 144644 events in 0 files, snapshot none (task 8021 ms: download 4673 ms overlapping gunzip 1300 ms, parse 5169 ms, sort 0 ms, write 0 ms, index 672 ms: 8 candidates, 60943 repo-hours, 1025 releases; waiting 550 ms; commit 0 ms)
2026-11-08T12:23:54Z [load_day 2025-06-10] 2025-06-10: repo_hour merged from 24 files to 1 (1852826 rows, 9078 ms)
2026-11-08T12:23:57Z [load_day 2025-06-10] 2025-06-10: index committed in 12082 ms (24 + 1 + 24 files)
2026-11-08T12:23:57Z [load_day 2025-06-10] 2025-06-10: 3689362 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:23:57Z [load_day 2025-06-10] attempt 1 succeeded