orcaLog in

Runs · run 4370

load_day 2025-09-09, attempt 1 succeeded

Host
73ccef5e07c2:375818
Started
2026-11-08T13:45:20Z
Ended
2026-11-08T13:47:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
157.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4370/load_day/2025-09-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:45:20Z [load_day 2025-09-09] attempt 1 started
2026-11-08T13:45:21Z [load_day 2025-09-09] 2025-09-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:45:29Z [load_day 2025-09-09] 2025-09-09 hour 0: 148878 events in 0 files, snapshot none (task 6544 ms: download 3491 ms overlapping gunzip 982 ms, parse 4116 ms, sort 0 ms, write 0 ms, index 596 ms: 13 candidates, 77146 repo-hours, 956 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:45:30Z [load_day 2025-09-09] 2025-09-09 hour 1: 155951 events in 0 files, snapshot none (task 7659 ms: download 5213 ms overlapping gunzip 959 ms, parse 3788 ms, sort 0 ms, write 0 ms, index 647 ms: 2 candidates, 92517 repo-hours, 730 releases; waiting 2020 ms; commit 0 ms)
2026-11-08T13:45:35Z [load_day 2025-09-09] 2025-09-09 hour 2: 149590 events in 0 files, snapshot none (task 5304 ms: download 3197 ms overlapping gunzip 772 ms, parse 3078 ms, sort 0 ms, write 0 ms, index 600 ms: 8 candidates, 75430 repo-hours, 822 releases; waiting 639 ms; commit 0 ms)
2026-11-08T13:45:36Z [load_day 2025-09-09] 2025-09-09 hour 3: 149560 events in 0 files, snapshot none (task 5315 ms: download 3360 ms overlapping gunzip 759 ms, parse 2907 ms, sort 0 ms, write 0 ms, index 547 ms: 7 candidates, 68940 repo-hours, 1908 releases; waiting 836 ms; commit 0 ms)
2026-11-08T13:45:41Z [load_day 2025-09-09] 2025-09-09 hour 4: 150471 events in 0 files, snapshot none (task 5560 ms: download 3271 ms overlapping gunzip 795 ms, parse 3166 ms, sort 0 ms, write 0 ms, index 545 ms: 11 candidates, 66580 repo-hours, 586 releases; waiting 789 ms; commit 0 ms)
2026-11-08T13:45:41Z [load_day 2025-09-09] 2025-09-09 hour 5: 153251 events in 0 files, snapshot none (task 5032 ms: download 2556 ms overlapping gunzip 804 ms, parse 3141 ms, sort 0 ms, write 0 ms, index 586 ms: 5 candidates, 69185 repo-hours, 596 releases; waiting 212 ms; commit 0 ms)
2026-11-08T13:45:47Z [load_day 2025-09-09] 2025-09-09 hour 6: 159968 events in 0 files, snapshot none (task 5315 ms: download 3079 ms overlapping gunzip 839 ms, parse 3290 ms, sort 0 ms, write 0 ms, index 575 ms: 6 candidates, 81359 repo-hours, 773 releases; waiting 310 ms; commit 0 ms)
2026-11-08T13:45:48Z [load_day 2025-09-09] 2025-09-09 hour 7: 163133 events in 0 files, snapshot none (task 6016 ms: download 3496 ms overlapping gunzip 921 ms, parse 3641 ms, sort 0 ms, write 0 ms, index 579 ms: 9 candidates, 78094 repo-hours, 793 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:45:54Z [load_day 2025-09-09] 2025-09-09 hour 8: 163043 events in 0 files, snapshot none (task 6633 ms: download 4137 ms overlapping gunzip 1083 ms, parse 4088 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 80183 repo-hours, 805 releases; waiting 571 ms; commit 0 ms)
2026-11-08T13:45:55Z [load_day 2025-09-09] 2025-09-09 hour 9: 167840 events in 0 files, snapshot none (task 6844 ms: download 4476 ms overlapping gunzip 958 ms, parse 3799 ms, sort 0 ms, write 0 ms, index 604 ms: 10 candidates, 84115 repo-hours, 878 releases; waiting 1201 ms; commit 0 ms)
2026-11-08T13:46:00Z [load_day 2025-09-09] 2025-09-09 hour 10: 158030 events in 0 files, snapshot none (task 5960 ms: download 3464 ms overlapping gunzip 901 ms, parse 3543 ms, sort 0 ms, write 0 ms, index 682 ms: 3 candidates, 77392 repo-hours, 842 releases; waiting 601 ms; commit 0 ms)
2026-11-08T13:46:02Z [load_day 2025-09-09] 2025-09-09 hour 11: 167315 events in 0 files, snapshot none (task 6152 ms: download 4088 ms overlapping gunzip 907 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 708 ms: 2 candidates, 78445 repo-hours, 756 releases; waiting 669 ms; commit 0 ms)
2026-11-08T13:46:09Z [load_day 2025-09-09] 2025-09-09 hour 12: 168890 events in 0 files, snapshot none (task 8013 ms: download 3577 ms overlapping gunzip 1195 ms, parse 4687 ms, sort 0 ms, write 0 ms, index 1532 ms: 9 candidates, 100662 repo-hours, 911 releases; waiting 306 ms; commit 0 ms)
2026-11-08T13:46:11Z [load_day 2025-09-09] 2025-09-09 hour 13: 164052 events in 0 files, snapshot none (task 8550 ms: download 5050 ms overlapping gunzip 1153 ms, parse 5003 ms, sort 0 ms, write 0 ms, index 1309 ms: 8 candidates, 93138 repo-hours, 799 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:46:17Z [load_day 2025-09-09] 2025-09-09 hour 14: 164254 events in 0 files, snapshot none (task 7677 ms: download 3814 ms overlapping gunzip 1184 ms, parse 4641 ms, sort 0 ms, write 0 ms, index 1275 ms: 12 candidates, 87002 repo-hours, 901 releases; waiting 275 ms; commit 0 ms)
2026-11-08T13:46:20Z [load_day 2025-09-09] 2025-09-09 hour 15: 165857 events in 0 files, snapshot none (task 7611 ms: download 4843 ms overlapping gunzip 1132 ms, parse 4722 ms, sort 0 ms, write 0 ms, index 727 ms: 9 candidates, 86388 repo-hours, 826 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:46:25Z [load_day 2025-09-09] 2025-09-09 hour 16: 171001 events in 0 files, snapshot none (task 7074 ms: download 4197 ms overlapping gunzip 1031 ms, parse 4153 ms, sort 0 ms, write 0 ms, index 764 ms: 13 candidates, 85725 repo-hours, 812 releases; waiting 635 ms; commit 0 ms)
2026-11-08T13:46:26Z [load_day 2025-09-09] 2025-09-09 hour 17: 167335 events in 0 files, snapshot none (task 5845 ms: download 3514 ms overlapping gunzip 880 ms, parse 3649 ms, sort 0 ms, write 0 ms, index 574 ms: 12 candidates, 77656 repo-hours, 732 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:46:31Z [load_day 2025-09-09] 2025-09-09 hour 18: 167049 events in 0 files, snapshot none (task 6302 ms: download 3480 ms overlapping gunzip 964 ms, parse 3828 ms, sort 0 ms, write 0 ms, index 657 ms: 7 candidates, 81610 repo-hours, 901 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:46:33Z [load_day 2025-09-09] 2025-09-09 hour 19: 160086 events in 0 files, snapshot none (task 6167 ms: download 3730 ms overlapping gunzip 988 ms, parse 3897 ms, sort 0 ms, write 0 ms, index 536 ms: 7 candidates, 73025 repo-hours, 929 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:46:38Z [load_day 2025-09-09] 2025-09-09 hour 20: 158629 events in 0 files, snapshot none (task 6475 ms: download 4297 ms overlapping gunzip 957 ms, parse 3809 ms, sort 0 ms, write 0 ms, index 577 ms: 8 candidates, 72754 repo-hours, 935 releases; waiting 796 ms; commit 0 ms)
2026-11-08T13:46:40Z [load_day 2025-09-09] 2025-09-09 hour 21: 156939 events in 0 files, snapshot none (task 6680 ms: download 4250 ms overlapping gunzip 1079 ms, parse 4028 ms, sort 0 ms, write 0 ms, index 529 ms: 6 candidates, 71698 repo-hours, 912 releases; waiting 544 ms; commit 0 ms)
2026-11-08T13:46:47Z [load_day 2025-09-09] 2025-09-09 hour 22: 151895 events in 0 files, snapshot none (task 7664 ms: download 4690 ms overlapping gunzip 1167 ms, parse 4883 ms, sort 0 ms, write 0 ms, index 574 ms: 6 candidates, 65397 repo-hours, 888 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:46:48Z [load_day 2025-09-09] 2025-09-09 hour 23: 147128 events in 0 files, snapshot none (task 7421 ms: download 5159 ms overlapping gunzip 1250 ms, parse 4969 ms, sort 0 ms, write 0 ms, index 420 ms: 3 candidates, 59629 repo-hours, 802 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:46:57Z [load_day 2025-09-09] 2025-09-09: repo_hour merged from 24 files to 1 (1884070 rows, 9146 ms)
2026-11-08T13:47:00Z [load_day 2025-09-09] 2025-09-09: index committed in 12173 ms (24 + 1 + 24 files)
2026-11-08T13:47:00Z [load_day 2025-09-09] 2025-09-09: 3830145 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:47:00Z [load_day 2025-09-09] attempt 1 succeeded