orcaLog in

Runs · run 4792

load_day 2026-01-05, attempt 1 succeeded

Host
73ccef5e07c2:425548
Started
2026-11-08T14:57:02Z
Ended
2026-11-08T14:58:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
763 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.8 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4792/load_day/2026-01-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:57:02Z [load_day 2026-01-05] attempt 1 started
2026-11-08T14:57:03Z [load_day 2026-01-05] 2026-01-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:57:07Z [load_day 2026-01-05] 2026-01-05 hour 0: 139440 events in 0 files, snapshot none (task 3290 ms: download 2024 ms overlapping gunzip 439 ms, parse 1510 ms, sort 0 ms, write 0 ms, index 553 ms: 11 candidates, 66406 repo-hours, 992 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:57:07Z [load_day 2026-01-05] 2026-01-05 hour 1: 148701 events in 0 files, snapshot none (task 3286 ms: download 2138 ms overlapping gunzip 437 ms, parse 1342 ms, sort 0 ms, write 0 ms, index 639 ms: 7 candidates, 85979 repo-hours, 817 releases; waiting 652 ms; commit 0 ms)
2026-11-08T14:57:11Z [load_day 2026-01-05] 2026-01-05 hour 2: 148103 events in 0 files, snapshot none (task 3211 ms: download 2034 ms overlapping gunzip 419 ms, parse 1326 ms, sort 0 ms, write 0 ms, index 582 ms: 13 candidates, 78196 repo-hours, 686 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:57:11Z [load_day 2026-01-05] 2026-01-05 hour 3: 146943 events in 0 files, snapshot none (task 3390 ms: download 2003 ms overlapping gunzip 416 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 620 ms: 10 candidates, 69248 repo-hours, 771 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:57:15Z [load_day 2026-01-05] 2026-01-05 hour 4: 144483 events in 0 files, snapshot none (task 3431 ms: download 2386 ms overlapping gunzip 385 ms, parse 1159 ms, sort 0 ms, write 0 ms, index 555 ms: 4 candidates, 69000 repo-hours, 1477 releases; waiting 1038 ms; commit 0 ms)
2026-11-08T14:57:15Z [load_day 2026-01-05] 2026-01-05 hour 5: 145837 events in 0 files, snapshot none (task 3279 ms: download 1903 ms overlapping gunzip 455 ms, parse 1335 ms, sort 0 ms, write 0 ms, index 532 ms: 9 candidates, 70593 repo-hours, 674 releases; waiting 657 ms; commit 0 ms)
2026-11-08T14:57:19Z [load_day 2026-01-05] 2026-01-05 hour 6: 145773 events in 0 files, snapshot none (task 3411 ms: download 1808 ms overlapping gunzip 416 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 592 ms: 9 candidates, 75780 repo-hours, 651 releases; waiting 560 ms; commit 0 ms)
2026-11-08T14:57:19Z [load_day 2026-01-05] 2026-01-05 hour 7: 142613 events in 0 files, snapshot none (task 3414 ms: download 2337 ms overlapping gunzip 481 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 582 ms: 3 candidates, 72719 repo-hours, 629 releases; waiting 730 ms; commit 0 ms)
2026-11-08T14:57:23Z [load_day 2026-01-05] 2026-01-05 hour 8: 146783 events in 0 files, snapshot none (task 4121 ms: download 2407 ms overlapping gunzip 627 ms, parse 1888 ms, sort 0 ms, write 0 ms, index 675 ms: 8 candidates, 76106 repo-hours, 734 releases; waiting 615 ms; commit 0 ms)
2026-11-08T14:57:24Z [load_day 2026-01-05] 2026-01-05 hour 9: 149047 events in 0 files, snapshot none (task 4567 ms: download 2979 ms overlapping gunzip 706 ms, parse 2281 ms, sort 0 ms, write 0 ms, index 619 ms: 3 candidates, 78143 repo-hours, 723 releases; waiting 600 ms; commit 0 ms)
2026-11-08T14:57:28Z [load_day 2026-01-05] 2026-01-05 hour 10: 148121 events in 0 files, snapshot none (task 4442 ms: download 3250 ms overlapping gunzip 674 ms, parse 1856 ms, sort 0 ms, write 0 ms, index 714 ms: 6 candidates, 78471 repo-hours, 665 releases; waiting 958 ms; commit 0 ms)
2026-11-08T14:57:28Z [load_day 2026-01-05] 2026-01-05 hour 11: 148063 events in 0 files, snapshot none (task 3869 ms: download 2249 ms overlapping gunzip 605 ms, parse 1850 ms, sort 0 ms, write 0 ms, index 572 ms: 5 candidates, 73225 repo-hours, 713 releases; waiting 621 ms; commit 0 ms)
2026-11-08T14:57:32Z [load_day 2026-01-05] 2026-01-05 hour 12: 159128 events in 0 files, snapshot none (task 3710 ms: download 2052 ms overlapping gunzip 505 ms, parse 1611 ms, sort 0 ms, write 0 ms, index 742 ms: 9 candidates, 97871 repo-hours, 472 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:57:32Z [load_day 2026-01-05] 2026-01-05 hour 13: 153716 events in 0 files, snapshot none (task 3318 ms: download 2129 ms overlapping gunzip 484 ms, parse 1325 ms, sort 0 ms, write 0 ms, index 690 ms: 11 candidates, 91633 repo-hours, 484 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:57:36Z [load_day 2026-01-05] 2026-01-05 hour 14: 146997 events in 0 files, snapshot none (task 3573 ms: download 1929 ms overlapping gunzip 576 ms, parse 1729 ms, sort 0 ms, write 0 ms, index 592 ms: 3 candidates, 80460 repo-hours, 589 releases; waiting 399 ms; commit 0 ms)
2026-11-08T14:57:36Z [load_day 2026-01-05] 2026-01-05 hour 15: 153215 events in 0 files, snapshot none (task 3767 ms: download 2453 ms overlapping gunzip 541 ms, parse 1635 ms, sort 0 ms, write 0 ms, index 670 ms: 5 candidates, 83342 repo-hours, 566 releases; waiting 645 ms; commit 0 ms)
2026-11-08T14:57:41Z [load_day 2026-01-05] 2026-01-05 hour 16: 149187 events in 0 files, snapshot none (task 4188 ms: download 2566 ms overlapping gunzip 660 ms, parse 1742 ms, sort 0 ms, write 0 ms, index 745 ms: 2 candidates, 79610 repo-hours, 649 releases; waiting 712 ms; commit 0 ms)
2026-11-08T14:57:41Z [load_day 2026-01-05] 2026-01-05 hour 17: 151588 events in 0 files, snapshot none (task 4225 ms: download 2553 ms overlapping gunzip 693 ms, parse 2000 ms, sort 0 ms, write 0 ms, index 659 ms: 4 candidates, 80504 repo-hours, 595 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:57:46Z [load_day 2026-01-05] 2026-01-05 hour 18: 152583 events in 0 files, snapshot none (task 4195 ms: download 3003 ms overlapping gunzip 634 ms, parse 1949 ms, sort 0 ms, write 0 ms, index 602 ms: 12 candidates, 84597 repo-hours, 742 releases; waiting 713 ms; commit 0 ms)
2026-11-08T14:57:46Z [load_day 2026-01-05] 2026-01-05 hour 19: 148522 events in 0 files, snapshot none (task 4163 ms: download 2534 ms overlapping gunzip 729 ms, parse 1981 ms, sort 0 ms, write 0 ms, index 588 ms: 8 candidates, 73002 repo-hours, 717 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:57:51Z [load_day 2026-01-05] 2026-01-05 hour 20: 150221 events in 0 files, snapshot none (task 4163 ms: download 2877 ms overlapping gunzip 634 ms, parse 1886 ms, sort 0 ms, write 0 ms, index 632 ms: 9 candidates, 75020 repo-hours, 829 releases; waiting 680 ms; commit 0 ms)
2026-11-08T14:57:51Z [load_day 2026-01-05] 2026-01-05 hour 21: 148846 events in 0 files, snapshot none (task 4577 ms: download 3094 ms overlapping gunzip 614 ms, parse 1914 ms, sort 0 ms, write 0 ms, index 570 ms: 9 candidates, 68570 repo-hours, 894 releases; waiting 1098 ms; commit 0 ms)
2026-11-08T14:57:56Z [load_day 2026-01-05] 2026-01-05 hour 22: 147086 events in 0 files, snapshot none (task 4375 ms: download 2577 ms overlapping gunzip 736 ms, parse 2073 ms, sort 0 ms, write 0 ms, index 728 ms: 7 candidates, 69642 repo-hours, 947 releases; waiting 508 ms; commit 0 ms)
2026-11-08T14:57:56Z [load_day 2026-01-05] 2026-01-05 hour 23: 148608 events in 0 files, snapshot none (task 4076 ms: download 2646 ms overlapping gunzip 645 ms, parse 1962 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 66458 repo-hours, 861 releases; waiting 517 ms; commit 0 ms)
2026-11-08T14:58:05Z [load_day 2026-01-05] 2026-01-05: repo_hour merged from 24 files to 1 (1844575 rows, 9505 ms)
2026-11-08T14:58:08Z [load_day 2026-01-05] 2026-01-05: index committed in 12524 ms (24 + 1 + 24 files)
2026-11-08T14:58:08Z [load_day 2026-01-05] 2026-01-05: 3563604 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:58:08Z [load_day 2026-01-05] attempt 1 succeeded