orcaLog in

Runs · run 4915

load_day 2026-02-09, attempt 1 succeeded

Host
73ccef5e07c2:440791
Started
2026-11-08T15:16:25Z
Ended
2026-11-08T15:17:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
702 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.6 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4915/load_day/2026-02-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:16:25Z [load_day 2026-02-09] attempt 1 started
2026-11-08T15:16:26Z [load_day 2026-02-09] 2026-02-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:16:30Z [load_day 2026-02-09] 2026-02-09 hour 0: 143974 events in 0 files, snapshot none (task 3175 ms: download 2208 ms overlapping gunzip 465 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 491 ms: 5 candidates, 63255 repo-hours, 1021 releases; waiting 588 ms; commit 0 ms)
2026-11-08T15:16:30Z [load_day 2026-02-09] 2026-02-09 hour 1: 153405 events in 0 files, snapshot none (task 3227 ms: download 1812 ms overlapping gunzip 407 ms, parse 1231 ms, sort 0 ms, write 0 ms, index 608 ms: 9 candidates, 83252 repo-hours, 603 releases; waiting 599 ms; commit 0 ms)
2026-11-08T15:16:34Z [load_day 2026-02-09] 2026-02-09 hour 2: 148844 events in 0 files, snapshot none (task 3342 ms: download 1908 ms overlapping gunzip 401 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 650 ms: 5 candidates, 80588 repo-hours, 691 releases; waiting 662 ms; commit 0 ms)
2026-11-08T15:16:34Z [load_day 2026-02-09] 2026-02-09 hour 3: 144916 events in 0 files, snapshot none (task 3205 ms: download 1938 ms overlapping gunzip 452 ms, parse 1302 ms, sort 0 ms, write 0 ms, index 620 ms: 8 candidates, 68951 repo-hours, 773 releases; waiting 563 ms; commit 0 ms)
2026-11-08T15:16:38Z [load_day 2026-02-09] 2026-02-09 hour 4: 144864 events in 0 files, snapshot none (task 4047 ms: download 2419 ms overlapping gunzip 658 ms, parse 2001 ms, sort 0 ms, write 0 ms, index 615 ms: 10 candidates, 69141 repo-hours, 686 releases; waiting 481 ms; commit 0 ms)
2026-11-08T15:16:38Z [load_day 2026-02-09] 2026-02-09 hour 5: 141709 events in 0 files, snapshot none (task 4342 ms: download 2696 ms overlapping gunzip 658 ms, parse 2165 ms, sort 0 ms, write 0 ms, index 551 ms: 6 candidates, 72333 repo-hours, 1480 releases; waiting 611 ms; commit 0 ms)
2026-11-08T15:16:42Z [load_day 2026-02-09] 2026-02-09 hour 6: 144466 events in 0 files, snapshot none (task 3800 ms: download 2283 ms overlapping gunzip 579 ms, parse 1661 ms, sort 0 ms, write 0 ms, index 811 ms: 6 candidates, 74597 repo-hours, 662 releases; waiting 425 ms; commit 0 ms)
2026-11-08T15:16:43Z [load_day 2026-02-09] 2026-02-09 hour 7: 141721 events in 0 files, snapshot none (task 3930 ms: download 2350 ms overlapping gunzip 564 ms, parse 1703 ms, sort 0 ms, write 0 ms, index 568 ms: 7 candidates, 74837 repo-hours, 650 releases; waiting 806 ms; commit 0 ms)
2026-11-08T15:16:47Z [load_day 2026-02-09] 2026-02-09 hour 8: 142890 events in 0 files, snapshot none (task 3984 ms: download 2475 ms overlapping gunzip 557 ms, parse 1616 ms, sort 0 ms, write 0 ms, index 598 ms: 10 candidates, 78538 repo-hours, 603 releases; waiting 876 ms; commit 0 ms)
2026-11-08T15:16:47Z [load_day 2026-02-09] 2026-02-09 hour 9: 140421 events in 0 files, snapshot none (task 3811 ms: download 2186 ms overlapping gunzip 576 ms, parse 1678 ms, sort 0 ms, write 0 ms, index 671 ms: 4 candidates, 78088 repo-hours, 587 releases; waiting 567 ms; commit 0 ms)
2026-11-08T15:16:51Z [load_day 2026-02-09] 2026-02-09 hour 10: 141222 events in 0 files, snapshot none (task 4100 ms: download 2424 ms overlapping gunzip 656 ms, parse 1843 ms, sort 0 ms, write 0 ms, index 698 ms: 7 candidates, 79646 repo-hours, 663 releases; waiting 555 ms; commit 0 ms)
2026-11-08T15:16:52Z [load_day 2026-02-09] 2026-02-09 hour 11: 134592 events in 0 files, snapshot none (task 4011 ms: download 2814 ms overlapping gunzip 673 ms, parse 1910 ms, sort 0 ms, write 0 ms, index 576 ms: 5 candidates, 75918 repo-hours, 649 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:16:56Z [load_day 2026-02-09] 2026-02-09 hour 12: 142934 events in 0 files, snapshot none (task 4147 ms: download 2482 ms overlapping gunzip 603 ms, parse 1714 ms, sort 0 ms, write 0 ms, index 645 ms: 5 candidates, 85744 repo-hours, 698 releases; waiting 902 ms; commit 0 ms)
2026-11-08T15:16:56Z [load_day 2026-02-09] 2026-02-09 hour 13: 147651 events in 0 files, snapshot none (task 3404 ms: download 1737 ms overlapping gunzip 440 ms, parse 1356 ms, sort 0 ms, write 0 ms, index 815 ms: 9 candidates, 92441 repo-hours, 493 releases; waiting 526 ms; commit 0 ms)
2026-11-08T15:17:00Z [load_day 2026-02-09] 2026-02-09 hour 14: 137165 events in 0 files, snapshot none (task 3614 ms: download 2242 ms overlapping gunzip 509 ms, parse 1392 ms, sort 0 ms, write 0 ms, index 770 ms: 5 candidates, 81862 repo-hours, 568 releases; waiting 537 ms; commit 0 ms)
2026-11-08T15:17:01Z [load_day 2026-02-09] 2026-02-09 hour 15: 140963 events in 0 files, snapshot none (task 4084 ms: download 2377 ms overlapping gunzip 521 ms, parse 1529 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 84318 repo-hours, 505 releases; waiting 1074 ms; commit 0 ms)
2026-11-08T15:17:05Z [load_day 2026-02-09] 2026-02-09 hour 16: 113869 events in 0 files, snapshot none (task 3870 ms: download 2500 ms overlapping gunzip 621 ms, parse 1576 ms, sort 0 ms, write 0 ms, index 588 ms: 7 candidates, 68220 repo-hours, 473 releases; waiting 816 ms; commit 0 ms)
2026-11-08T15:17:05Z [load_day 2026-02-09] 2026-02-09 hour 17: 125462 events in 0 files, snapshot none (task 3703 ms: download 2209 ms overlapping gunzip 535 ms, parse 1388 ms, sort 0 ms, write 0 ms, index 635 ms: 12 candidates, 76359 repo-hours, 455 releases; waiting 715 ms; commit 0 ms)
2026-11-08T15:17:09Z [load_day 2026-02-09] 2026-02-09 hour 18: 113392 events in 0 files, snapshot none (task 4040 ms: download 2109 ms overlapping gunzip 611 ms, parse 1735 ms, sort 0 ms, write 0 ms, index 820 ms: 4 candidates, 67578 repo-hours, 409 releases; waiting 577 ms; commit 0 ms)
2026-11-08T15:17:09Z [load_day 2026-02-09] 2026-02-09 hour 19: 108406 events in 0 files, snapshot none (task 3022 ms: download 1264 ms overlapping gunzip 457 ms, parse 1329 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 64993 repo-hours, 363 releases; waiting 196 ms; commit 0 ms)
2026-11-08T15:17:15Z [load_day 2026-02-09] 2026-02-09 hour 20: 142839 events in 0 files, snapshot none (task 4781 ms: download 2434 ms overlapping gunzip 791 ms, parse 2320 ms, sort 0 ms, write 0 ms, index 787 ms: 5 candidates, 78003 repo-hours, 580 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:17:15Z [load_day 2026-02-09] 2026-02-09 hour 21: 144041 events in 0 files, snapshot none (task 5006 ms: download 2818 ms overlapping gunzip 842 ms, parse 2374 ms, sort 0 ms, write 0 ms, index 776 ms: 5 candidates, 75303 repo-hours, 747 releases; waiting 745 ms; commit 0 ms)
2026-11-08T15:17:19Z [load_day 2026-02-09] 2026-02-09 hour 22: 141579 events in 0 files, snapshot none (task 4136 ms: download 2257 ms overlapping gunzip 738 ms, parse 2046 ms, sort 0 ms, write 0 ms, index 707 ms: 5 candidates, 74031 repo-hours, 651 releases; waiting 313 ms; commit 0 ms)
2026-11-08T15:17:20Z [load_day 2026-02-09] 2026-02-09 hour 23: 138836 events in 0 files, snapshot none (task 4621 ms: download 3035 ms overlapping gunzip 687 ms, parse 2020 ms, sort 0 ms, write 0 ms, index 521 ms: 6 candidates, 66777 repo-hours, 899 releases; waiting 1065 ms; commit 0 ms)
2026-11-08T15:17:28Z [load_day 2026-02-09] 2026-02-09: repo_hour merged from 24 files to 1 (1814773 rows, 8538 ms)
2026-11-08T15:17:32Z [load_day 2026-02-09] 2026-02-09: index committed in 11762 ms (24 + 1 + 24 files)
2026-11-08T15:17:32Z [load_day 2026-02-09] 2026-02-09: 3320161 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:17:32Z [load_day 2026-02-09] attempt 1 succeeded