orcaLog in

Runs · run 4027

load_day 2025-06-16, attempt 1 succeeded

Host
73ccef5e07c2:323508
Started
2026-11-08T12:27:37Z
Ended
2026-11-08T12:29:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
164.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4027/load_day/2025-06-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:27:37Z [load_day 2025-06-16] attempt 1 started
2026-11-08T12:27:38Z [load_day 2025-06-16] 2025-06-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:27:45Z [load_day 2025-06-16] 2025-06-16 hour 0: 141516 events in 0 files, snapshot none (task 6775 ms: download 4431 ms overlapping gunzip 1131 ms, parse 4260 ms, sort 0 ms, write 0 ms, index 542 ms: 11 candidates, 64930 repo-hours, 1142 releases; waiting 537 ms; commit 0 ms)
2026-11-08T12:27:45Z [load_day 2025-06-16] 2025-06-16 hour 1: 153711 events in 0 files, snapshot none (task 6765 ms: download 4172 ms overlapping gunzip 1074 ms, parse 4273 ms, sort 0 ms, write 0 ms, index 604 ms: 10 candidates, 87325 repo-hours, 707 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:27:53Z [load_day 2025-06-16] 2025-06-16 hour 2: 145735 events in 0 files, snapshot none (task 6439 ms: download 4253 ms overlapping gunzip 1110 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 513 ms: 12 candidates, 71146 repo-hours, 834 releases; waiting 445 ms; commit 0 ms)
2026-11-08T12:27:53Z [load_day 2025-06-16] 2025-06-16 hour 3: 148815 events in 0 files, snapshot none (task 6615 ms: download 4224 ms overlapping gunzip 1091 ms, parse 4166 ms, sort 0 ms, write 0 ms, index 624 ms: 6 candidates, 67938 repo-hours, 1481 releases; waiting 470 ms; commit 0 ms)
2026-11-08T12:28:01Z [load_day 2025-06-16] 2025-06-16 hour 4: 148709 events in 0 files, snapshot none (task 7631 ms: download 4388 ms overlapping gunzip 1187 ms, parse 4415 ms, sort 0 ms, write 0 ms, index 1242 ms: 6 candidates, 64566 repo-hours, 1243 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:28:01Z [load_day 2025-06-16] 2025-06-16 hour 5: 148096 events in 0 files, snapshot none (task 7361 ms: download 4385 ms overlapping gunzip 1149 ms, parse 4503 ms, sort 0 ms, write 0 ms, index 900 ms: 1 candidates, 63670 repo-hours, 628 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:28:10Z [load_day 2025-06-16] 2025-06-16 hour 6: 154083 events in 0 files, snapshot none (task 9160 ms: download 6061 ms overlapping gunzip 1562 ms, parse 5996 ms, sort 0 ms, write 0 ms, index 718 ms: 9 candidates, 78029 repo-hours, 778 releases; waiting 568 ms; commit 0 ms)
2026-11-08T12:28:11Z [load_day 2025-06-16] 2025-06-16 hour 7: 158604 events in 0 files, snapshot none (task 9319 ms: download 6119 ms overlapping gunzip 1687 ms, parse 6144 ms, sort 0 ms, write 0 ms, index 716 ms: 7 candidates, 76538 repo-hours, 833 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:28:20Z [load_day 2025-06-16] 2025-06-16 hour 8: 161894 events in 0 files, snapshot none (task 8652 ms: download 5460 ms overlapping gunzip 1437 ms, parse 5681 ms, sort 0 ms, write 0 ms, index 968 ms: 8 candidates, 80311 repo-hours, 857 releases; waiting 250 ms; commit 0 ms)
2026-11-08T12:28:20Z [load_day 2025-06-16] 2025-06-16 hour 9: 163781 events in 0 files, snapshot none (task 8686 ms: download 5703 ms overlapping gunzip 1458 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 80810 repo-hours, 905 releases; waiting 490 ms; commit 0 ms)
2026-11-08T12:28:29Z [load_day 2025-06-16] 2025-06-16 hour 10: 161328 events in 0 files, snapshot none (task 8231 ms: download 5764 ms overlapping gunzip 1200 ms, parse 4355 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 76535 repo-hours, 913 releases; waiting 1726 ms; commit 0 ms)
2026-11-08T12:28:29Z [load_day 2025-06-16] 2025-06-16 hour 11: 160667 events in 0 files, snapshot none (task 6838 ms: download 4121 ms overlapping gunzip 1070 ms, parse 4202 ms, sort 0 ms, write 0 ms, index 652 ms: 3 candidates, 77009 repo-hours, 796 releases; waiting 546 ms; commit 0 ms)
2026-11-08T12:28:35Z [load_day 2025-06-16] 2025-06-16 hour 12: 168683 events in 0 files, snapshot none (task 6136 ms: download 3531 ms overlapping gunzip 956 ms, parse 3768 ms, sort 0 ms, write 0 ms, index 809 ms: 8 candidates, 98407 repo-hours, 858 releases; waiting 340 ms; commit 0 ms)
2026-11-08T12:28:35Z [load_day 2025-06-16] 2025-06-16 hour 13: 166924 events in 0 files, snapshot none (task 5887 ms: download 3520 ms overlapping gunzip 938 ms, parse 3674 ms, sort 0 ms, write 0 ms, index 678 ms: 3 candidates, 92541 repo-hours, 888 releases; waiting 393 ms; commit 0 ms)
2026-11-08T12:28:44Z [load_day 2025-06-16] 2025-06-16 hour 14: 165253 events in 0 files, snapshot none (task 7829 ms: download 4758 ms overlapping gunzip 1283 ms, parse 5025 ms, sort 0 ms, write 0 ms, index 754 ms: 14 candidates, 85392 repo-hours, 955 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:28:44Z [load_day 2025-06-16] 2025-06-16 hour 15: 163657 events in 0 files, snapshot none (task 7741 ms: download 4404 ms overlapping gunzip 1310 ms, parse 4864 ms, sort 0 ms, write 0 ms, index 714 ms: 8 candidates, 85801 repo-hours, 874 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:28:52Z [load_day 2025-06-16] 2025-06-16 hour 16: 160452 events in 0 files, snapshot none (task 7582 ms: download 5102 ms overlapping gunzip 1242 ms, parse 4859 ms, sort 0 ms, write 0 ms, index 675 ms: 8 candidates, 81646 repo-hours, 720 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:28:52Z [load_day 2025-06-16] 2025-06-16 hour 17: 157552 events in 0 files, snapshot none (task 7561 ms: download 5087 ms overlapping gunzip 1273 ms, parse 4792 ms, sort 0 ms, write 0 ms, index 569 ms: 12 candidates, 76803 repo-hours, 718 releases; waiting 602 ms; commit 0 ms)
2026-11-08T12:29:01Z [load_day 2025-06-16] 2025-06-16 hour 18: 163137 events in 0 files, snapshot none (task 8206 ms: download 4997 ms overlapping gunzip 1298 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 802 ms: 8 candidates, 81739 repo-hours, 951 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:29:01Z [load_day 2025-06-16] 2025-06-16 hour 19: 155702 events in 0 files, snapshot none (task 7708 ms: download 4860 ms overlapping gunzip 1263 ms, parse 4848 ms, sort 0 ms, write 0 ms, index 741 ms: 13 candidates, 71788 repo-hours, 735 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:29:11Z [load_day 2025-06-16] 2025-06-16 hour 20: 158340 events in 0 files, snapshot none (task 10271 ms: download 7743 ms overlapping gunzip 1171 ms, parse 4638 ms, sort 0 ms, write 0 ms, index 678 ms: 17 candidates, 73594 repo-hours, 804 releases; waiting 3383 ms; commit 0 ms)
2026-11-08T12:29:11Z [load_day 2025-06-16] 2025-06-16 hour 21: 155102 events in 0 files, snapshot none (task 7255 ms: download 3962 ms overlapping gunzip 1103 ms, parse 4146 ms, sort 0 ms, write 0 ms, index 1114 ms: 13 candidates, 67639 repo-hours, 814 releases; waiting 565 ms; commit 0 ms)
2026-11-08T12:29:19Z [load_day 2025-06-16] 2025-06-16 hour 22: 146347 events in 0 files, snapshot none (task 7024 ms: download 4409 ms overlapping gunzip 1134 ms, parse 4443 ms, sort 0 ms, write 0 ms, index 625 ms: 14 candidates, 62478 repo-hours, 798 releases; waiting 502 ms; commit 0 ms)
2026-11-08T12:29:19Z [load_day 2025-06-16] 2025-06-16 hour 23: 143082 events in 0 files, snapshot none (task 6640 ms: download 4124 ms overlapping gunzip 1109 ms, parse 4292 ms, sort 0 ms, write 0 ms, index 452 ms: 14 candidates, 59859 repo-hours, 844 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:29:28Z [load_day 2025-06-16] 2025-06-16: repo_hour merged from 24 files to 1 (1826494 rows, 9099 ms)
2026-11-08T12:29:31Z [load_day 2025-06-16] 2025-06-16: index committed in 11733 ms (24 + 1 + 24 files)
2026-11-08T12:29:31Z [load_day 2025-06-16] 2025-06-16: 3751170 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:29:31Z [load_day 2025-06-16] attempt 1 succeeded