orcaLog in

Runs · run 5020

load_day 2026-03-10, attempt 1 succeeded

Host
73ccef5e07c2:453448
Started
2026-11-08T15:32:17Z
Ended
2026-11-08T15:33:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
740 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5020/load_day/2026-03-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:32:17Z [load_day 2026-03-10] attempt 1 started
2026-11-08T15:32:18Z [load_day 2026-03-10] 2026-03-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:32:23Z [load_day 2026-03-10] 2026-03-10 hour 0: 155309 events in 0 files, snapshot none (task 3738 ms: download 2573 ms overlapping gunzip 562 ms, parse 1564 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 78793 repo-hours, 898 releases; waiting 655 ms; commit 0 ms)
2026-11-08T15:32:23Z [load_day 2026-03-10] 2026-03-10 hour 1: 162551 events in 0 files, snapshot none (task 3548 ms: download 2201 ms overlapping gunzip 482 ms, parse 1461 ms, sort 0 ms, write 0 ms, index 704 ms: 11 candidates, 98058 repo-hours, 466 releases; waiting 522 ms; commit 0 ms)
2026-11-08T15:32:27Z [load_day 2026-03-10] 2026-03-10 hour 2: 161618 events in 0 files, snapshot none (task 3244 ms: download 1613 ms overlapping gunzip 473 ms, parse 1486 ms, sort 0 ms, write 0 ms, index 699 ms: 8 candidates, 91651 repo-hours, 571 releases; waiting 249 ms; commit 0 ms)
2026-11-08T15:32:27Z [load_day 2026-03-10] 2026-03-10 hour 3: 152152 events in 0 files, snapshot none (task 3599 ms: download 1853 ms overlapping gunzip 532 ms, parse 1734 ms, sort 0 ms, write 0 ms, index 652 ms: 9 candidates, 77954 repo-hours, 868 releases; waiting 423 ms; commit 0 ms)
2026-11-08T15:32:31Z [load_day 2026-03-10] 2026-03-10 hour 4: 154881 events in 0 files, snapshot none (task 3618 ms: download 2285 ms overlapping gunzip 530 ms, parse 1644 ms, sort 0 ms, write 0 ms, index 571 ms: 4 candidates, 76879 repo-hours, 1011 releases; waiting 617 ms; commit 0 ms)
2026-11-08T15:32:31Z [load_day 2026-03-10] 2026-03-10 hour 5: 157586 events in 0 files, snapshot none (task 3531 ms: download 2023 ms overlapping gunzip 535 ms, parse 1601 ms, sort 0 ms, write 0 ms, index 583 ms: 5 candidates, 82266 repo-hours, 929 releases; waiting 535 ms; commit 0 ms)
2026-11-08T15:32:35Z [load_day 2026-03-10] 2026-03-10 hour 6: 152014 events in 0 files, snapshot none (task 3627 ms: download 2282 ms overlapping gunzip 473 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 771 ms: 3 candidates, 85440 repo-hours, 605 releases; waiting 636 ms; commit 0 ms)
2026-11-08T15:32:35Z [load_day 2026-03-10] 2026-03-10 hour 7: 155510 events in 0 files, snapshot none (task 3519 ms: download 2288 ms overlapping gunzip 411 ms, parse 1228 ms, sort 0 ms, write 0 ms, index 659 ms: 8 candidates, 84593 repo-hours, 578 releases; waiting 911 ms; commit 0 ms)
2026-11-08T15:32:39Z [load_day 2026-03-10] 2026-03-10 hour 8: 156658 events in 0 files, snapshot none (task 3277 ms: download 1954 ms overlapping gunzip 419 ms, parse 1169 ms, sort 0 ms, write 0 ms, index 767 ms: 12 candidates, 87975 repo-hours, 452 releases; waiting 614 ms; commit 0 ms)
2026-11-08T15:32:39Z [load_day 2026-03-10] 2026-03-10 hour 9: 156267 events in 0 files, snapshot none (task 3522 ms: download 2134 ms overlapping gunzip 422 ms, parse 1213 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 87853 repo-hours, 507 releases; waiting 920 ms; commit 0 ms)
2026-11-08T15:32:43Z [load_day 2026-03-10] 2026-03-10 hour 10: 152813 events in 0 files, snapshot none (task 3736 ms: download 2198 ms overlapping gunzip 358 ms, parse 1060 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 87800 repo-hours, 417 releases; waiting 1272 ms; commit 0 ms)
2026-11-08T15:32:43Z [load_day 2026-03-10] 2026-03-10 hour 11: 156905 events in 0 files, snapshot none (task 3674 ms: download 2209 ms overlapping gunzip 339 ms, parse 1048 ms, sort 0 ms, write 0 ms, index 679 ms: 9 candidates, 88549 repo-hours, 401 releases; waiting 1256 ms; commit 0 ms)
2026-11-08T15:32:46Z [load_day 2026-03-10] 2026-03-10 hour 12: 161817 events in 0 files, snapshot none (task 2553 ms: download 1206 ms overlapping gunzip 281 ms, parse 892 ms, sort 0 ms, write 0 ms, index 834 ms: 10 candidates, 98364 repo-hours, 272 releases; waiting 250 ms; commit 0 ms)
2026-11-08T15:32:47Z [load_day 2026-03-10] 2026-03-10 hour 13: 165207 events in 0 files, snapshot none (task 2698 ms: download 1385 ms overlapping gunzip 257 ms, parse 901 ms, sort 0 ms, write 0 ms, index 829 ms: 9 candidates, 102810 repo-hours, 125 releases; waiting 405 ms; commit 0 ms)
2026-11-08T15:32:50Z [load_day 2026-03-10] 2026-03-10 hour 14: 161018 events in 0 files, snapshot none (task 3227 ms: download 2021 ms overlapping gunzip 364 ms, parse 1057 ms, sort 0 ms, write 0 ms, index 673 ms: 9 candidates, 86795 repo-hours, 174 releases; waiting 830 ms; commit 0 ms)
2026-11-08T15:32:50Z [load_day 2026-03-10] 2026-03-10 hour 15: 154110 events in 0 files, snapshot none (task 2652 ms: download 1453 ms overlapping gunzip 313 ms, parse 1042 ms, sort 0 ms, write 0 ms, index 737 ms: 10 candidates, 89967 repo-hours, 173 releases; waiting 321 ms; commit 0 ms)
2026-11-08T15:32:53Z [load_day 2026-03-10] 2026-03-10 hour 16: 155030 events in 0 files, snapshot none (task 2792 ms: download 1510 ms overlapping gunzip 247 ms, parse 796 ms, sort 0 ms, write 0 ms, index 741 ms: 15 candidates, 91791 repo-hours, 223 releases; waiting 566 ms; commit 0 ms)
2026-11-08T15:32:53Z [load_day 2026-03-10] 2026-03-10 hour 17: 155179 events in 0 files, snapshot none (task 2707 ms: download 1565 ms overlapping gunzip 269 ms, parse 842 ms, sort 0 ms, write 0 ms, index 765 ms: 12 candidates, 89245 repo-hours, 283 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:32:57Z [load_day 2026-03-10] 2026-03-10 hour 18: 155254 events in 0 files, snapshot none (task 3094 ms: download 1864 ms overlapping gunzip 308 ms, parse 979 ms, sort 0 ms, write 0 ms, index 659 ms: 17 candidates, 90172 repo-hours, 311 releases; waiting 854 ms; commit 0 ms)
2026-11-08T15:32:57Z [load_day 2026-03-10] 2026-03-10 hour 19: 157871 events in 0 files, snapshot none (task 3347 ms: download 2109 ms overlapping gunzip 374 ms, parse 1131 ms, sort 0 ms, write 0 ms, index 676 ms: 10 candidates, 87202 repo-hours, 404 releases; waiting 882 ms; commit 0 ms)
2026-11-08T15:33:01Z [load_day 2026-03-10] 2026-03-10 hour 20: 151508 events in 0 files, snapshot none (task 3471 ms: download 2186 ms overlapping gunzip 366 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 638 ms: 11 candidates, 80581 repo-hours, 642 releases; waiting 972 ms; commit 0 ms)
2026-11-08T15:33:01Z [load_day 2026-03-10] 2026-03-10 hour 21: 156321 events in 0 files, snapshot none (task 3114 ms: download 1812 ms overlapping gunzip 380 ms, parse 1236 ms, sort 0 ms, write 0 ms, index 626 ms: 3 candidates, 81804 repo-hours, 714 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:33:05Z [load_day 2026-03-10] 2026-03-10 hour 22: 154095 events in 0 files, snapshot none (task 3687 ms: download 2512 ms overlapping gunzip 461 ms, parse 1341 ms, sort 0 ms, write 0 ms, index 624 ms: 6 candidates, 79020 repo-hours, 940 releases; waiting 922 ms; commit 0 ms)
2026-11-08T15:33:05Z [load_day 2026-03-10] 2026-03-10 hour 23: 150057 events in 0 files, snapshot none (task 3770 ms: download 2407 ms overlapping gunzip 451 ms, parse 1437 ms, sort 0 ms, write 0 ms, index 615 ms: 8 candidates, 76175 repo-hours, 926 releases; waiting 826 ms; commit 0 ms)
2026-11-08T15:33:15Z [load_day 2026-03-10] 2026-03-10: repo_hour merged from 24 files to 1 (2081737 rows, 9932 ms)
2026-11-08T15:33:19Z [load_day 2026-03-10] 2026-03-10: index committed in 13805 ms (24 + 1 + 24 files)
2026-11-08T15:33:19Z [load_day 2026-03-10] 2026-03-10: 3751731 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:33:19Z [load_day 2026-03-10] attempt 1 succeeded