orcaLog in

Runs · run 4098

load_day 2025-07-01, attempt 1 succeeded

Host
73ccef5e07c2:335445
Started
2026-11-08T12:45:09Z
Ended
2026-11-08T12:46:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
723 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
158.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4098/load_day/2025-07-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:45:09Z [load_day 2025-07-01] attempt 1 started
2026-11-08T12:45:10Z [load_day 2025-07-01] 2025-07-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:45:18Z [load_day 2025-07-01] 2025-07-01 hour 0: 147484 events in 0 files, snapshot none (task 7402 ms: download 4335 ms overlapping gunzip 1106 ms, parse 4302 ms, sort 0 ms, write 0 ms, index 733 ms: 7 candidates, 68951 repo-hours, 1062 releases; waiting 854 ms; commit 0 ms)
2026-11-08T12:45:18Z [load_day 2025-07-01] 2025-07-01 hour 1: 153740 events in 0 files, snapshot none (task 6616 ms: download 3470 ms overlapping gunzip 1051 ms, parse 4064 ms, sort 0 ms, write 0 ms, index 947 ms: 7 candidates, 89040 repo-hours, 819 releases; waiting 297 ms; commit 0 ms)
2026-11-08T12:45:26Z [load_day 2025-07-01] 2025-07-01 hour 2: 152144 events in 0 files, snapshot none (task 7269 ms: download 4691 ms overlapping gunzip 1232 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 583 ms: 5 candidates, 78521 repo-hours, 972 releases; waiting 574 ms; commit 0 ms)
2026-11-08T12:45:26Z [load_day 2025-07-01] 2025-07-01 hour 3: 143696 events in 0 files, snapshot none (task 7076 ms: download 4205 ms overlapping gunzip 1216 ms, parse 4339 ms, sort 0 ms, write 0 ms, index 579 ms: 3 candidates, 67843 repo-hours, 904 releases; waiting 583 ms; commit 0 ms)
2026-11-08T12:45:33Z [load_day 2025-07-01] 2025-07-01 hour 4: 144210 events in 0 files, snapshot none (task 6612 ms: download 3760 ms overlapping gunzip 1108 ms, parse 4299 ms, sort 0 ms, write 0 ms, index 533 ms: 8 candidates, 66814 repo-hours, 1872 releases; waiting 317 ms; commit 0 ms)
2026-11-08T12:45:34Z [load_day 2025-07-01] 2025-07-01 hour 5: 147197 events in 0 files, snapshot none (task 7999 ms: download 5696 ms overlapping gunzip 1363 ms, parse 5282 ms, sort 0 ms, write 0 ms, index 491 ms: 3 candidates, 64946 repo-hours, 594 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:45:42Z [load_day 2025-07-01] 2025-07-01 hour 6: 157108 events in 0 files, snapshot none (task 8045 ms: download 4912 ms overlapping gunzip 1322 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 653 ms: 4 candidates, 80554 repo-hours, 829 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:45:43Z [load_day 2025-07-01] 2025-07-01 hour 7: 150810 events in 0 files, snapshot none (task 7646 ms: download 4929 ms overlapping gunzip 1143 ms, parse 4848 ms, sort 0 ms, write 0 ms, index 822 ms: 6 candidates, 74746 repo-hours, 816 releases; waiting 550 ms; commit 0 ms)
2026-11-08T12:45:51Z [load_day 2025-07-01] 2025-07-01 hour 8: 161042 events in 0 files, snapshot none (task 8659 ms: download 5652 ms overlapping gunzip 1346 ms, parse 5400 ms, sort 0 ms, write 0 ms, index 1030 ms: 14 candidates, 81338 repo-hours, 849 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:45:52Z [load_day 2025-07-01] 2025-07-01 hour 9: 164732 events in 0 files, snapshot none (task 8227 ms: download 5278 ms overlapping gunzip 1339 ms, parse 5293 ms, sort 0 ms, write 0 ms, index 771 ms: 7 candidates, 84024 repo-hours, 981 releases; waiting 479 ms; commit 0 ms)
2026-11-08T12:46:00Z [load_day 2025-07-01] 2025-07-01 hour 10: 160961 events in 0 files, snapshot none (task 8004 ms: download 4580 ms overlapping gunzip 1240 ms, parse 5159 ms, sort 0 ms, write 0 ms, index 1008 ms: 7 candidates, 80188 repo-hours, 809 releases; waiting 312 ms; commit 0 ms)
2026-11-08T12:46:00Z [load_day 2025-07-01] 2025-07-01 hour 11: 164656 events in 0 files, snapshot none (task 8035 ms: download 4557 ms overlapping gunzip 1248 ms, parse 5084 ms, sort 0 ms, write 0 ms, index 838 ms: 10 candidates, 79175 repo-hours, 832 releases; waiting 555 ms; commit 0 ms)
2026-11-08T12:46:09Z [load_day 2025-07-01] 2025-07-01 hour 12: 168170 events in 0 files, snapshot none (task 8732 ms: download 5393 ms overlapping gunzip 1421 ms, parse 5647 ms, sort 0 ms, write 0 ms, index 904 ms: 7 candidates, 97595 repo-hours, 847 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:46:09Z [load_day 2025-07-01] 2025-07-01 hour 13: 164273 events in 0 files, snapshot none (task 8789 ms: download 5758 ms overlapping gunzip 1349 ms, parse 5860 ms, sort 0 ms, write 0 ms, index 706 ms: 9 candidates, 91882 repo-hours, 816 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:46:16Z [load_day 2025-07-01] 2025-07-01 hour 14: 163763 events in 0 files, snapshot none (task 6729 ms: download 4148 ms overlapping gunzip 1024 ms, parse 3901 ms, sort 0 ms, write 0 ms, index 942 ms: 8 candidates, 84661 repo-hours, 865 releases; waiting 550 ms; commit 0 ms)
2026-11-08T12:46:17Z [load_day 2025-07-01] 2025-07-01 hour 15: 164891 events in 0 files, snapshot none (task 6978 ms: download 4586 ms overlapping gunzip 1022 ms, parse 4103 ms, sort 0 ms, write 0 ms, index 736 ms: 6 candidates, 83291 repo-hours, 943 releases; waiting 763 ms; commit 0 ms)
2026-11-08T12:46:25Z [load_day 2025-07-01] 2025-07-01 hour 16: 163591 events in 0 files, snapshot none (task 7669 ms: download 4402 ms overlapping gunzip 1176 ms, parse 4822 ms, sort 0 ms, write 0 ms, index 756 ms: 7 candidates, 82424 repo-hours, 943 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:46:25Z [load_day 2025-07-01] 2025-07-01 hour 17: 157435 events in 0 files, snapshot none (task 6872 ms: download 4463 ms overlapping gunzip 1058 ms, parse 4222 ms, sort 0 ms, write 0 ms, index 725 ms: 4 candidates, 76680 repo-hours, 740 releases; waiting 544 ms; commit 0 ms)
2026-11-08T12:46:32Z [load_day 2025-07-01] 2025-07-01 hour 18: 162053 events in 0 files, snapshot none (task 7386 ms: download 4402 ms overlapping gunzip 1100 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 758 ms: 7 candidates, 81239 repo-hours, 857 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:46:32Z [load_day 2025-07-01] 2025-07-01 hour 19: 154941 events in 0 files, snapshot none (task 7122 ms: download 4104 ms overlapping gunzip 1111 ms, parse 4434 ms, sort 0 ms, write 0 ms, index 730 ms: 8 candidates, 70193 repo-hours, 862 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:46:40Z [load_day 2025-07-01] 2025-07-01 hour 20: 155655 events in 0 files, snapshot none (task 7303 ms: download 4298 ms overlapping gunzip 1194 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 718 ms: 7 candidates, 70742 repo-hours, 864 releases; waiting 245 ms; commit 0 ms)
2026-11-08T12:46:40Z [load_day 2025-07-01] 2025-07-01 hour 21: 152867 events in 0 files, snapshot none (task 7428 ms: download 4825 ms overlapping gunzip 1130 ms, parse 4758 ms, sort 0 ms, write 0 ms, index 668 ms: 6 candidates, 67357 repo-hours, 807 releases; waiting 490 ms; commit 0 ms)
2026-11-08T12:46:47Z [load_day 2025-07-01] 2025-07-01 hour 22: 150911 events in 0 files, snapshot none (task 6805 ms: download 4295 ms overlapping gunzip 1077 ms, parse 4204 ms, sort 0 ms, write 0 ms, index 528 ms: 6 candidates, 62124 repo-hours, 910 releases; waiting 730 ms; commit 0 ms)
2026-11-08T12:46:48Z [load_day 2025-07-01] 2025-07-01 hour 23: 142079 events in 0 files, snapshot none (task 6675 ms: download 4414 ms overlapping gunzip 1009 ms, parse 4005 ms, sort 0 ms, write 0 ms, index 431 ms: 8 candidates, 60425 repo-hours, 860 releases; waiting 923 ms; commit 0 ms)
2026-11-08T12:46:56Z [load_day 2025-07-01] 2025-07-01: repo_hour merged from 24 files to 1 (1844753 rows, 8355 ms)
2026-11-08T12:46:59Z [load_day 2025-07-01] 2025-07-01: index committed in 11440 ms (24 + 1 + 24 files)
2026-11-08T12:46:59Z [load_day 2025-07-01] 2025-07-01: 3748409 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:46:59Z [load_day 2025-07-01] attempt 1 succeeded