orcaLog in

Runs · run 4129

load_day 2025-07-10, attempt 1 succeeded

Host
73ccef5e07c2:339991
Started
2026-11-08T12:52:26Z
Ended
2026-11-08T12:54:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
685 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
142.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4129/load_day/2025-07-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:52:26Z [load_day 2025-07-10] attempt 1 started
2026-11-08T12:52:27Z [load_day 2025-07-10] 2025-07-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:52:34Z [load_day 2025-07-10] 2025-07-10 hour 0: 143928 events in 0 files, snapshot none (task 5527 ms: download 3126 ms overlapping gunzip 828 ms, parse 3373 ms, sort 0 ms, write 0 ms, index 538 ms: 6 candidates, 69685 repo-hours, 919 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:52:34Z [load_day 2025-07-10] 2025-07-10 hour 1: 150418 events in 0 files, snapshot none (task 5408 ms: download 2802 ms overlapping gunzip 779 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 598 ms: 11 candidates, 87496 repo-hours, 635 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:52:41Z [load_day 2025-07-10] 2025-07-10 hour 2: 151265 events in 0 files, snapshot none (task 7255 ms: download 4127 ms overlapping gunzip 1022 ms, parse 4371 ms, sort 0 ms, write 0 ms, index 967 ms: 7 candidates, 75550 repo-hours, 741 releases; waiting 471 ms; commit 0 ms)
2026-11-08T12:52:41Z [load_day 2025-07-10] 2025-07-10 hour 3: 148651 events in 0 files, snapshot none (task 6650 ms: download 4051 ms overlapping gunzip 1035 ms, parse 4169 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 69911 repo-hours, 1315 releases; waiting 471 ms; commit 0 ms)
2026-11-08T12:52:48Z [load_day 2025-07-10] 2025-07-10 hour 4: 147662 events in 0 files, snapshot none (task 6321 ms: download 3678 ms overlapping gunzip 896 ms, parse 4109 ms, sort 0 ms, write 0 ms, index 577 ms: 7 candidates, 66332 repo-hours, 1304 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:52:48Z [load_day 2025-07-10] 2025-07-10 hour 5: 146312 events in 0 files, snapshot none (task 6090 ms: download 3452 ms overlapping gunzip 887 ms, parse 3918 ms, sort 0 ms, write 0 ms, index 547 ms: 10 candidates, 65976 repo-hours, 615 releases; waiting 368 ms; commit 0 ms)
2026-11-08T12:52:55Z [load_day 2025-07-10] 2025-07-10 hour 6: 156320 events in 0 files, snapshot none (task 6511 ms: download 3398 ms overlapping gunzip 1016 ms, parse 4313 ms, sort 0 ms, write 0 ms, index 632 ms: 4 candidates, 79262 repo-hours, 759 releases; waiting 283 ms; commit 0 ms)
2026-11-08T12:52:56Z [load_day 2025-07-10] 2025-07-10 hour 7: 155153 events in 0 files, snapshot none (task 6952 ms: download 4171 ms overlapping gunzip 1035 ms, parse 4424 ms, sort 0 ms, write 0 ms, index 631 ms: 10 candidates, 75745 repo-hours, 777 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:53:03Z [load_day 2025-07-10] 2025-07-10 hour 8: 154395 events in 0 files, snapshot none (task 7579 ms: download 4293 ms overlapping gunzip 1177 ms, parse 4729 ms, sort 0 ms, write 0 ms, index 753 ms: 8 candidates, 78889 repo-hours, 832 releases; waiting 538 ms; commit 0 ms)
2026-11-08T12:53:04Z [load_day 2025-07-10] 2025-07-10 hour 9: 157493 events in 0 files, snapshot none (task 7694 ms: download 4191 ms overlapping gunzip 1192 ms, parse 4920 ms, sort 0 ms, write 0 ms, index 677 ms: 10 candidates, 80874 repo-hours, 928 releases; waiting 570 ms; commit 0 ms)
2026-11-08T12:53:13Z [load_day 2025-07-10] 2025-07-10 hour 10: 159481 events in 0 files, snapshot none (task 8679 ms: download 5578 ms overlapping gunzip 1438 ms, parse 5714 ms, sort 0 ms, write 0 ms, index 705 ms: 7 candidates, 78652 repo-hours, 829 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:53:13Z [load_day 2025-07-10] 2025-07-10 hour 11: 160686 events in 0 files, snapshot none (task 8815 ms: download 5820 ms overlapping gunzip 1410 ms, parse 6052 ms, sort 0 ms, write 0 ms, index 554 ms: 11 candidates, 76795 repo-hours, 827 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:53:19Z [load_day 2025-07-10] 2025-07-10 hour 12: 170034 events in 0 files, snapshot none (task 6104 ms: download 3369 ms overlapping gunzip 838 ms, parse 3471 ms, sort 0 ms, write 0 ms, index 770 ms: 13 candidates, 98987 repo-hours, 909 releases; waiting 675 ms; commit 0 ms)
2026-11-08T12:53:20Z [load_day 2025-07-10] 2025-07-10 hour 13: 165414 events in 0 files, snapshot none (task 6145 ms: download 3625 ms overlapping gunzip 855 ms, parse 3805 ms, sort 0 ms, write 0 ms, index 639 ms: 10 candidates, 93624 repo-hours, 846 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:53:26Z [load_day 2025-07-10] 2025-07-10 hour 14: 157346 events in 0 files, snapshot none (task 5858 ms: download 3566 ms overlapping gunzip 851 ms, parse 3379 ms, sort 0 ms, write 0 ms, index 605 ms: 11 candidates, 81260 repo-hours, 796 releases; waiting 658 ms; commit 0 ms)
2026-11-08T12:53:27Z [load_day 2025-07-10] 2025-07-10 hour 15: 163041 events in 0 files, snapshot none (task 6163 ms: download 3574 ms overlapping gunzip 925 ms, parse 3742 ms, sort 0 ms, write 0 ms, index 645 ms: 19 candidates, 84135 repo-hours, 908 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:53:34Z [load_day 2025-07-10] 2025-07-10 hour 16: 159626 events in 0 files, snapshot none (task 7848 ms: download 4804 ms overlapping gunzip 1291 ms, parse 5047 ms, sort 0 ms, write 0 ms, index 728 ms: 11 candidates, 81008 repo-hours, 878 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:53:35Z [load_day 2025-07-10] 2025-07-10 hour 17: 160314 events in 0 files, snapshot none (task 7487 ms: download 4860 ms overlapping gunzip 1175 ms, parse 4938 ms, sort 0 ms, write 0 ms, index 569 ms: 7 candidates, 77771 repo-hours, 847 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:53:42Z [load_day 2025-07-10] 2025-07-10 hour 18: 158907 events in 0 files, snapshot none (task 7325 ms: download 4362 ms overlapping gunzip 1196 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 81491 repo-hours, 888 releases; waiting 208 ms; commit 0 ms)
2026-11-08T12:53:42Z [load_day 2025-07-10] 2025-07-10 hour 19: 152709 events in 0 files, snapshot none (task 7031 ms: download 4544 ms overlapping gunzip 1130 ms, parse 4519 ms, sort 0 ms, write 0 ms, index 542 ms: 14 candidates, 70333 repo-hours, 763 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:53:50Z [load_day 2025-07-10] 2025-07-10 hour 20: 151348 events in 0 files, snapshot none (task 7366 ms: download 4481 ms overlapping gunzip 1007 ms, parse 4548 ms, sort 0 ms, write 0 ms, index 921 ms: 9 candidates, 70342 repo-hours, 747 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:53:50Z [load_day 2025-07-10] 2025-07-10 hour 21: 150027 events in 0 files, snapshot none (task 6548 ms: download 3908 ms overlapping gunzip 959 ms, parse 4094 ms, sort 0 ms, write 0 ms, index 650 ms: 16 candidates, 66851 repo-hours, 887 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:53:57Z [load_day 2025-07-10] 2025-07-10 hour 22: 143685 events in 0 files, snapshot none (task 6746 ms: download 4153 ms overlapping gunzip 1097 ms, parse 4373 ms, sort 0 ms, write 0 ms, index 628 ms: 9 candidates, 60585 repo-hours, 922 releases; waiting 322 ms; commit 0 ms)
2026-11-08T12:53:57Z [load_day 2025-07-10] 2025-07-10 hour 23: 139805 events in 0 files, snapshot none (task 6015 ms: download 3521 ms overlapping gunzip 933 ms, parse 3827 ms, sort 0 ms, write 0 ms, index 430 ms: 17 candidates, 59240 repo-hours, 918 releases; waiting 484 ms; commit 0 ms)
2026-11-08T12:54:07Z [load_day 2025-07-10] 2025-07-10: repo_hour merged from 24 files to 1 (1830794 rows, 9765 ms)
2026-11-08T12:54:10Z [load_day 2025-07-10] 2025-07-10: index committed in 13027 ms (24 + 1 + 24 files)
2026-11-08T12:54:10Z [load_day 2025-07-10] 2025-07-10: 3704020 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:54:10Z [load_day 2025-07-10] attempt 1 succeeded