orcaLog in

Runs · run 4948

load_day 2026-02-18, attempt 1 succeeded

Host
73ccef5e07c2:444525
Started
2026-11-08T15:20:55Z
Ended
2026-11-08T15:22:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
710 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.9 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4948/load_day/2026-02-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:20:55Z [load_day 2026-02-18] attempt 1 started
2026-11-08T15:20:56Z [load_day 2026-02-18] 2026-02-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:21:01Z [load_day 2026-02-18] 2026-02-18 hour 0: 145500 events in 0 files, snapshot none (task 4302 ms: download 2895 ms overlapping gunzip 612 ms, parse 1922 ms, sort 0 ms, write 0 ms, index 650 ms: 9 candidates, 70403 repo-hours, 1392 releases; waiting 906 ms; commit 0 ms)
2026-11-08T15:21:01Z [load_day 2026-02-18] 2026-02-18 hour 1: 149204 events in 0 files, snapshot none (task 4290 ms: download 2752 ms overlapping gunzip 557 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 806 ms: 9 candidates, 83862 repo-hours, 791 releases; waiting 947 ms; commit 0 ms)
2026-11-08T15:21:06Z [load_day 2026-02-18] 2026-02-18 hour 2: 149831 events in 0 files, snapshot none (task 4213 ms: download 2660 ms overlapping gunzip 564 ms, parse 1740 ms, sort 0 ms, write 0 ms, index 664 ms: 5 candidates, 82377 repo-hours, 852 releases; waiting 883 ms; commit 0 ms)
2026-11-08T15:21:06Z [load_day 2026-02-18] 2026-02-18 hour 3: 144992 events in 0 files, snapshot none (task 4013 ms: download 2593 ms overlapping gunzip 559 ms, parse 1650 ms, sort 0 ms, write 0 ms, index 848 ms: 5 candidates, 69842 repo-hours, 1169 releases; waiting 669 ms; commit 0 ms)
2026-11-08T15:21:10Z [load_day 2026-02-18] 2026-02-18 hour 4: 146751 events in 0 files, snapshot none (task 4214 ms: download 2601 ms overlapping gunzip 597 ms, parse 1858 ms, sort 0 ms, write 0 ms, index 784 ms: 10 candidates, 71558 repo-hours, 920 releases; waiting 628 ms; commit 0 ms)
2026-11-08T15:21:11Z [load_day 2026-02-18] 2026-02-18 hour 5: 143354 events in 0 files, snapshot none (task 4595 ms: download 2876 ms overlapping gunzip 646 ms, parse 1950 ms, sort 0 ms, write 0 ms, index 811 ms: 3 candidates, 72276 repo-hours, 2007 releases; waiting 762 ms; commit 0 ms)
2026-11-08T15:21:16Z [load_day 2026-02-18] 2026-02-18 hour 6: 145144 events in 0 files, snapshot none (task 4590 ms: download 2917 ms overlapping gunzip 676 ms, parse 2094 ms, sort 0 ms, write 0 ms, index 614 ms: 5 candidates, 73123 repo-hours, 1130 releases; waiting 886 ms; commit 0 ms)
2026-11-08T15:21:16Z [load_day 2026-02-18] 2026-02-18 hour 7: 146853 events in 0 files, snapshot none (task 4356 ms: download 1833 ms overlapping gunzip 710 ms, parse 2093 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 74305 repo-hours, 1196 releases; waiting 625 ms; commit 0 ms)
2026-11-08T15:21:20Z [load_day 2026-02-18] 2026-02-18 hour 8: 146610 events in 0 files, snapshot none (task 3624 ms: download 2239 ms overlapping gunzip 550 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 752 ms: 2 candidates, 76604 repo-hours, 1183 releases; waiting 441 ms; commit 0 ms)
2026-11-08T15:21:21Z [load_day 2026-02-18] 2026-02-18 hour 9: 146020 events in 0 files, snapshot none (task 4319 ms: download 2820 ms overlapping gunzip 635 ms, parse 1848 ms, sort 0 ms, write 0 ms, index 634 ms: 5 candidates, 80035 repo-hours, 1101 releases; waiting 930 ms; commit 0 ms)
2026-11-08T15:21:24Z [load_day 2026-02-18] 2026-02-18 hour 10: 147166 events in 0 files, snapshot none (task 3960 ms: download 2133 ms overlapping gunzip 576 ms, parse 1652 ms, sort 0 ms, write 0 ms, index 767 ms: 4 candidates, 80419 repo-hours, 945 releases; waiting 611 ms; commit 0 ms)
2026-11-08T15:21:25Z [load_day 2026-02-18] 2026-02-18 hour 11: 147775 events in 0 files, snapshot none (task 3515 ms: download 2109 ms overlapping gunzip 540 ms, parse 1443 ms, sort 0 ms, write 0 ms, index 656 ms: 10 candidates, 81161 repo-hours, 1080 releases; waiting 558 ms; commit 0 ms)
2026-11-08T15:21:28Z [load_day 2026-02-18] 2026-02-18 hour 12: 149191 events in 0 files, snapshot none (task 3748 ms: download 2140 ms overlapping gunzip 541 ms, parse 1610 ms, sort 0 ms, write 0 ms, index 669 ms: 11 candidates, 86686 repo-hours, 886 releases; waiting 653 ms; commit 0 ms)
2026-11-08T15:21:29Z [load_day 2026-02-18] 2026-02-18 hour 13: 153148 events in 0 files, snapshot none (task 3394 ms: download 1925 ms overlapping gunzip 467 ms, parse 1401 ms, sort 0 ms, write 0 ms, index 714 ms: 8 candidates, 94787 repo-hours, 551 releases; waiting 577 ms; commit 0 ms)
2026-11-08T15:21:32Z [load_day 2026-02-18] 2026-02-18 hour 14: 149214 events in 0 files, snapshot none (task 3624 ms: download 2275 ms overlapping gunzip 507 ms, parse 1559 ms, sort 0 ms, write 0 ms, index 686 ms: 7 candidates, 87425 repo-hours, 678 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:21:32Z [load_day 2026-02-18] 2026-02-18 hour 15: 144240 events in 0 files, snapshot none (task 3203 ms: download 1585 ms overlapping gunzip 458 ms, parse 1492 ms, sort 0 ms, write 0 ms, index 725 ms: 12 candidates, 83916 repo-hours, 760 releases; waiting 247 ms; commit 0 ms)
2026-11-08T15:21:37Z [load_day 2026-02-18] 2026-02-18 hour 16: 141224 events in 0 files, snapshot none (task 4122 ms: download 2291 ms overlapping gunzip 564 ms, parse 1787 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 79862 repo-hours, 846 releases; waiting 541 ms; commit 0 ms)
2026-11-08T15:21:37Z [load_day 2026-02-18] 2026-02-18 hour 17: 146873 events in 0 files, snapshot none (task 3670 ms: download 2183 ms overlapping gunzip 543 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 700 ms: 14 candidates, 83842 repo-hours, 646 releases; waiting 604 ms; commit 0 ms)
2026-11-08T15:21:41Z [load_day 2026-02-18] 2026-02-18 hour 18: 149255 events in 0 files, snapshot none (task 3778 ms: download 2131 ms overlapping gunzip 540 ms, parse 1708 ms, sort 0 ms, write 0 ms, index 678 ms: 8 candidates, 84836 repo-hours, 670 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:21:41Z [load_day 2026-02-18] 2026-02-18 hour 19: 147436 events in 0 files, snapshot none (task 3699 ms: download 2419 ms overlapping gunzip 526 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 682 ms: 9 candidates, 79357 repo-hours, 800 releases; waiting 701 ms; commit 0 ms)
2026-11-08T15:21:45Z [load_day 2026-02-18] 2026-02-18 hour 20: 148509 events in 0 files, snapshot none (task 3499 ms: download 2560 ms overlapping gunzip 383 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 604 ms: 8 candidates, 76667 repo-hours, 1683 releases; waiting 1032 ms; commit 0 ms)
2026-11-08T15:21:45Z [load_day 2026-02-18] 2026-02-18 hour 21: 146711 events in 0 files, snapshot none (task 3455 ms: download 2266 ms overlapping gunzip 390 ms, parse 1206 ms, sort 0 ms, write 0 ms, index 541 ms: 9 candidates, 75282 repo-hours, 2320 releases; waiting 1010 ms; commit 0 ms)
2026-11-08T15:21:58Z [load_day 2026-02-18] 2026-02-18 hour 22: 143753 events in 0 files, snapshot none (task 2913 ms: download 1758 ms overlapping gunzip 415 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 564 ms: 15 candidates, 71417 repo-hours, 2775 releases; waiting 323 ms; commit 0 ms)
2026-11-08T15:21:59Z [load_day 2026-02-18] 2026-02-18 hour 23: 140833 events in 0 files, snapshot none (task 3833 ms: download 2848 ms overlapping gunzip 444 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 543 ms: 7 candidates, 67402 repo-hours, 3286 releases; waiting 1091 ms; commit 0 ms)
2026-11-08T15:22:07Z [load_day 2026-02-18] 2026-02-18: repo_hour merged from 24 files to 1 (1887444 rows, 8558 ms)
2026-11-08T15:22:10Z [load_day 2026-02-18] 2026-02-18: index committed in 11591 ms (24 + 1 + 24 files)
2026-11-08T15:22:10Z [load_day 2026-02-18] 2026-02-18: 3519587 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:22:10Z [load_day 2026-02-18] attempt 1 succeeded