orcaLog in

Runs · run 4765

load_day 2025-12-29, attempt 1 succeeded

Host
73ccef5e07c2:422684
Started
2026-11-08T14:53:09Z
Ended
2026-11-08T14:54:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.3 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4765/load_day/2025-12-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:53:09Z [load_day 2025-12-29] attempt 1 started
2026-11-08T14:53:10Z [load_day 2025-12-29] 2025-12-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:53:15Z [load_day 2025-12-29] 2025-12-29 hour 0: 138570 events in 0 files, snapshot none (task 3940 ms: download 2750 ms overlapping gunzip 494 ms, parse 1529 ms, sort 0 ms, write 0 ms, index 464 ms: 8 candidates, 60813 repo-hours, 969 releases; waiting 1101 ms; commit 0 ms)
2026-11-08T14:53:15Z [load_day 2025-12-29] 2025-12-29 hour 1: 149034 events in 0 files, snapshot none (task 3394 ms: download 2041 ms overlapping gunzip 438 ms, parse 1296 ms, sort 0 ms, write 0 ms, index 791 ms: 7 candidates, 84373 repo-hours, 748 releases; waiting 555 ms; commit 0 ms)
2026-11-08T14:53:19Z [load_day 2025-12-29] 2025-12-29 hour 2: 143717 events in 0 files, snapshot none (task 3556 ms: download 2268 ms overlapping gunzip 548 ms, parse 1713 ms, sort 0 ms, write 0 ms, index 577 ms: 8 candidates, 73175 repo-hours, 794 releases; waiting 464 ms; commit 0 ms)
2026-11-08T14:53:19Z [load_day 2025-12-29] 2025-12-29 hour 3: 140994 events in 0 files, snapshot none (task 3638 ms: download 1986 ms overlapping gunzip 551 ms, parse 1719 ms, sort 0 ms, write 0 ms, index 484 ms: 7 candidates, 62447 repo-hours, 937 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:53:23Z [load_day 2025-12-29] 2025-12-29 hour 4: 142327 events in 0 files, snapshot none (task 3583 ms: download 2212 ms overlapping gunzip 518 ms, parse 1615 ms, sort 0 ms, write 0 ms, index 525 ms: 8 candidates, 65996 repo-hours, 1768 releases; waiting 625 ms; commit 0 ms)
2026-11-08T14:53:23Z [load_day 2025-12-29] 2025-12-29 hour 5: 143904 events in 0 files, snapshot none (task 3401 ms: download 2206 ms overlapping gunzip 525 ms, parse 1508 ms, sort 0 ms, write 0 ms, index 536 ms: 2 candidates, 65752 repo-hours, 679 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:53:27Z [load_day 2025-12-29] 2025-12-29 hour 6: 147138 events in 0 files, snapshot none (task 3680 ms: download 2193 ms overlapping gunzip 574 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 542 ms: 3 candidates, 71911 repo-hours, 781 releases; waiting 514 ms; commit 0 ms)
2026-11-08T14:53:27Z [load_day 2025-12-29] 2025-12-29 hour 7: 144187 events in 0 files, snapshot none (task 3370 ms: download 2072 ms overlapping gunzip 496 ms, parse 1500 ms, sort 0 ms, write 0 ms, index 514 ms: 11 candidates, 66119 repo-hours, 612 releases; waiting 515 ms; commit 0 ms)
2026-11-08T14:53:31Z [load_day 2025-12-29] 2025-12-29 hour 8: 147297 events in 0 files, snapshot none (task 3627 ms: download 2377 ms overlapping gunzip 569 ms, parse 1618 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 70247 repo-hours, 742 releases; waiting 637 ms; commit 0 ms)
2026-11-08T14:53:31Z [load_day 2025-12-29] 2025-12-29 hour 9: 145523 events in 0 files, snapshot none (task 3659 ms: download 2203 ms overlapping gunzip 555 ms, parse 1685 ms, sort 0 ms, write 0 ms, index 524 ms: 2 candidates, 71385 repo-hours, 710 releases; waiting 598 ms; commit 0 ms)
2026-11-08T14:53:35Z [load_day 2025-12-29] 2025-12-29 hour 10: 145610 events in 0 files, snapshot none (task 3803 ms: download 2046 ms overlapping gunzip 603 ms, parse 1782 ms, sort 0 ms, write 0 ms, index 552 ms: 2 candidates, 70932 repo-hours, 786 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:53:35Z [load_day 2025-12-29] 2025-12-29 hour 11: 148107 events in 0 files, snapshot none (task 3567 ms: download 2553 ms overlapping gunzip 570 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 549 ms: 3 candidates, 68786 repo-hours, 694 releases; waiting 583 ms; commit 0 ms)
2026-11-08T14:53:40Z [load_day 2025-12-29] 2025-12-29 hour 12: 156106 events in 0 files, snapshot none (task 3805 ms: download 2068 ms overlapping gunzip 570 ms, parse 1603 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 90908 repo-hours, 645 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:53:40Z [load_day 2025-12-29] 2025-12-29 hour 13: 153221 events in 0 files, snapshot none (task 3406 ms: download 2045 ms overlapping gunzip 453 ms, parse 1410 ms, sort 0 ms, write 0 ms, index 683 ms: 2 candidates, 83941 repo-hours, 570 releases; waiting 580 ms; commit 0 ms)
2026-11-08T14:53:44Z [load_day 2025-12-29] 2025-12-29 hour 14: 150254 events in 0 files, snapshot none (task 3905 ms: download 2631 ms overlapping gunzip 532 ms, parse 1527 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 73948 repo-hours, 677 releases; waiting 746 ms; commit 0 ms)
2026-11-08T14:53:44Z [load_day 2025-12-29] 2025-12-29 hour 15: 152286 events in 0 files, snapshot none (task 3392 ms: download 2419 ms overlapping gunzip 433 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 622 ms: 6 candidates, 75670 repo-hours, 803 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:53:48Z [load_day 2025-12-29] 2025-12-29 hour 16: 150219 events in 0 files, snapshot none (task 3815 ms: download 2499 ms overlapping gunzip 502 ms, parse 1466 ms, sort 0 ms, write 0 ms, index 651 ms: 3 candidates, 74481 repo-hours, 797 releases; waiting 758 ms; commit 0 ms)
2026-11-08T14:53:48Z [load_day 2025-12-29] 2025-12-29 hour 17: 147886 events in 0 files, snapshot none (task 3831 ms: download 2456 ms overlapping gunzip 496 ms, parse 1545 ms, sort 0 ms, write 0 ms, index 581 ms: 4 candidates, 71596 repo-hours, 673 releases; waiting 782 ms; commit 0 ms)
2026-11-08T14:53:52Z [load_day 2025-12-29] 2025-12-29 hour 18: 150129 events in 0 files, snapshot none (task 3630 ms: download 2217 ms overlapping gunzip 490 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 726 ms: 3 candidates, 75254 repo-hours, 758 releases; waiting 702 ms; commit 0 ms)
2026-11-08T14:53:52Z [load_day 2025-12-29] 2025-12-29 hour 19: 150048 events in 0 files, snapshot none (task 3435 ms: download 2181 ms overlapping gunzip 504 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 541 ms: 1 candidates, 65081 repo-hours, 667 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:53:56Z [load_day 2025-12-29] 2025-12-29 hour 20: 146031 events in 0 files, snapshot none (task 3144 ms: download 1750 ms overlapping gunzip 447 ms, parse 1276 ms, sort 0 ms, write 0 ms, index 591 ms: 5 candidates, 65576 repo-hours, 706 releases; waiting 397 ms; commit 0 ms)
2026-11-08T14:53:56Z [load_day 2025-12-29] 2025-12-29 hour 21: 146561 events in 0 files, snapshot none (task 3204 ms: download 2023 ms overlapping gunzip 405 ms, parse 1359 ms, sort 0 ms, write 0 ms, index 566 ms: 8 candidates, 64129 repo-hours, 804 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:54:02Z [load_day 2025-12-29] 2025-12-29 hour 22: 143116 events in 0 files, snapshot none (task 3814 ms: download 2586 ms overlapping gunzip 516 ms, parse 1539 ms, sort 0 ms, write 0 ms, index 536 ms: 3 candidates, 61650 repo-hours, 872 releases; waiting 854 ms; commit 0 ms)
2026-11-08T14:54:02Z [load_day 2025-12-29] 2025-12-29 hour 23: 143654 events in 0 files, snapshot none (task 3710 ms: download 2306 ms overlapping gunzip 652 ms, parse 1720 ms, sort 0 ms, write 0 ms, index 443 ms: 2 candidates, 59146 repo-hours, 720 releases; waiting 587 ms; commit 0 ms)
2026-11-08T14:54:10Z [load_day 2025-12-29] 2025-12-29: repo_hour merged from 24 files to 1 (1693316 rows, 7534 ms)
2026-11-08T14:54:13Z [load_day 2025-12-29] 2025-12-29: index committed in 10855 ms (24 + 1 + 24 files)
2026-11-08T14:54:13Z [load_day 2025-12-29] 2025-12-29: 3525919 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:54:13Z [load_day 2025-12-29] attempt 1 succeeded