orcaLog in

Runs · run 4427

load_day 2025-09-22, attempt 1 succeeded

Host
73ccef5e07c2:383213
Started
2026-11-08T13:56:58Z
Ended
2026-11-08T13:58:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
708 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
174.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4427/load_day/2025-09-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:56:58Z [load_day 2025-09-22] attempt 1 started
2026-11-08T13:56:59Z [load_day 2025-09-22] 2025-09-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:57:07Z [load_day 2025-09-22] 2025-09-22 hour 0: 148039 events in 0 files, snapshot none (task 6885 ms: download 4425 ms overlapping gunzip 1207 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 566 ms: 12 candidates, 69750 repo-hours, 1224 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:57:07Z [load_day 2025-09-22] 2025-09-22 hour 1: 165614 events in 0 files, snapshot none (task 7027 ms: download 4598 ms overlapping gunzip 1143 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 675 ms: 9 candidates, 93566 repo-hours, 683 releases; waiting 451 ms; commit 0 ms)
2026-11-08T13:57:13Z [load_day 2025-09-22] 2025-09-22 hour 2: 153778 events in 0 files, snapshot none (task 6126 ms: download 3713 ms overlapping gunzip 992 ms, parse 3762 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 72246 repo-hours, 847 releases; waiting 357 ms; commit 0 ms)
2026-11-08T13:57:13Z [load_day 2025-09-22] 2025-09-22 hour 3: 157210 events in 0 files, snapshot none (task 5962 ms: download 3798 ms overlapping gunzip 963 ms, parse 3630 ms, sort 0 ms, write 0 ms, index 597 ms: 10 candidates, 71595 repo-hours, 2114 releases; waiting 427 ms; commit 0 ms)
2026-11-08T13:57:21Z [load_day 2025-09-22] 2025-09-22 hour 4: 155876 events in 0 files, snapshot none (task 7759 ms: download 4550 ms overlapping gunzip 1218 ms, parse 4437 ms, sort 0 ms, write 0 ms, index 867 ms: 8 candidates, 65331 repo-hours, 739 releases; waiting 849 ms; commit 0 ms)
2026-11-08T13:57:21Z [load_day 2025-09-22] 2025-09-22 hour 5: 160454 events in 0 files, snapshot none (task 7106 ms: download 4469 ms overlapping gunzip 1142 ms, parse 4042 ms, sort 0 ms, write 0 ms, index 1055 ms: 11 candidates, 70251 repo-hours, 735 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:57:30Z [load_day 2025-09-22] 2025-09-22 hour 6: 164773 events in 0 files, snapshot none (task 8164 ms: download 4737 ms overlapping gunzip 1300 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 1119 ms: 19 candidates, 82725 repo-hours, 734 releases; waiting 237 ms; commit 0 ms)
2026-11-08T13:57:30Z [load_day 2025-09-22] 2025-09-22 hour 7: 163929 events in 0 files, snapshot none (task 8051 ms: download 4818 ms overlapping gunzip 1395 ms, parse 5013 ms, sort 0 ms, write 0 ms, index 1088 ms: 23 candidates, 75829 repo-hours, 717 releases; waiting 236 ms; commit 0 ms)
2026-11-08T13:57:39Z [load_day 2025-09-22] 2025-09-22 hour 8: 167189 events in 0 files, snapshot none (task 8523 ms: download 5145 ms overlapping gunzip 1488 ms, parse 5687 ms, sort 0 ms, write 0 ms, index 789 ms: 19 candidates, 83398 repo-hours, 878 releases; waiting 205 ms; commit 0 ms)
2026-11-08T13:57:40Z [load_day 2025-09-22] 2025-09-22 hour 9: 168047 events in 0 files, snapshot none (task 8874 ms: download 6055 ms overlapping gunzip 1656 ms, parse 6020 ms, sort 0 ms, write 0 ms, index 714 ms: 23 candidates, 82672 repo-hours, 806 releases; waiting 273 ms; commit 0 ms)
2026-11-08T13:57:49Z [load_day 2025-09-22] 2025-09-22 hour 10: 166377 events in 0 files, snapshot none (task 9468 ms: download 6972 ms overlapping gunzip 1584 ms, parse 6031 ms, sort 0 ms, write 0 ms, index 673 ms: 20 candidates, 79895 repo-hours, 782 releases; waiting 940 ms; commit 0 ms)
2026-11-08T13:57:50Z [load_day 2025-09-22] 2025-09-22 hour 11: 163828 events in 0 files, snapshot none (task 9183 ms: download 6355 ms overlapping gunzip 1497 ms, parse 5934 ms, sort 0 ms, write 0 ms, index 579 ms: 14 candidates, 77271 repo-hours, 713 releases; waiting 727 ms; commit 0 ms)
2026-11-08T13:57:59Z [load_day 2025-09-22] 2025-09-22 hour 12: 168015 events in 0 files, snapshot none (task 8839 ms: download 5406 ms overlapping gunzip 1542 ms, parse 5736 ms, sort 0 ms, write 0 ms, index 757 ms: 22 candidates, 99073 repo-hours, 775 releases; waiting 556 ms; commit 0 ms)
2026-11-08T13:57:59Z [load_day 2025-09-22] 2025-09-22 hour 13: 171149 events in 0 files, snapshot none (task 8429 ms: download 5698 ms overlapping gunzip 1393 ms, parse 5620 ms, sort 0 ms, write 0 ms, index 685 ms: 16 candidates, 92734 repo-hours, 770 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:58:10Z [load_day 2025-09-22] 2025-09-22 hour 14: 166197 events in 0 files, snapshot none (task 10619 ms: download 7542 ms overlapping gunzip 1916 ms, parse 7139 ms, sort 0 ms, write 0 ms, index 901 ms: 14 candidates, 85006 repo-hours, 805 releases; waiting 332 ms; commit 0 ms)
2026-11-08T13:58:10Z [load_day 2025-09-22] 2025-09-22 hour 15: 169770 events in 0 files, snapshot none (task 10774 ms: download 7442 ms overlapping gunzip 1881 ms, parse 7281 ms, sort 0 ms, write 0 ms, index 914 ms: 17 candidates, 86994 repo-hours, 911 releases; waiting 249 ms; commit 0 ms)
2026-11-08T13:58:20Z [load_day 2025-09-22] 2025-09-22 hour 16: 168827 events in 0 files, snapshot none (task 9729 ms: download 6431 ms overlapping gunzip 1571 ms, parse 6333 ms, sort 0 ms, write 0 ms, index 989 ms: 18 candidates, 86293 repo-hours, 734 releases; waiting 593 ms; commit 0 ms)
2026-11-08T13:58:21Z [load_day 2025-09-22] 2025-09-22 hour 17: 167231 events in 0 files, snapshot none (task 9886 ms: download 6797 ms overlapping gunzip 1626 ms, parse 6460 ms, sort 0 ms, write 0 ms, index 718 ms: 18 candidates, 80458 repo-hours, 688 releases; waiting 634 ms; commit 0 ms)
2026-11-08T13:58:30Z [load_day 2025-09-22] 2025-09-22 hour 18: 167398 events in 0 files, snapshot none (task 9342 ms: download 6282 ms overlapping gunzip 1527 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 778 ms: 19 candidates, 84606 repo-hours, 867 releases; waiting 925 ms; commit 0 ms)
2026-11-08T13:58:30Z [load_day 2025-09-22] 2025-09-22 hour 19: 162716 events in 0 files, snapshot none (task 8527 ms: download 5459 ms overlapping gunzip 1389 ms, parse 5710 ms, sort 0 ms, write 0 ms, index 600 ms: 18 candidates, 73547 repo-hours, 696 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:58:39Z [load_day 2025-09-22] 2025-09-22 hour 20: 164000 events in 0 files, snapshot none (task 8621 ms: download 5626 ms overlapping gunzip 1373 ms, parse 5398 ms, sort 0 ms, write 0 ms, index 1129 ms: 23 candidates, 75592 repo-hours, 771 releases; waiting 366 ms; commit 0 ms)
2026-11-08T13:58:39Z [load_day 2025-09-22] 2025-09-22 hour 21: 156452 events in 0 files, snapshot none (task 8345 ms: download 5466 ms overlapping gunzip 1362 ms, parse 5214 ms, sort 0 ms, write 0 ms, index 929 ms: 9 candidates, 67787 repo-hours, 685 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:58:47Z [load_day 2025-09-22] 2025-09-22 hour 22: 154061 events in 0 files, snapshot none (task 6905 ms: download 4428 ms overlapping gunzip 1248 ms, parse 4376 ms, sort 0 ms, write 0 ms, index 555 ms: 7 candidates, 64340 repo-hours, 747 releases; waiting 351 ms; commit 0 ms)
2026-11-08T13:58:48Z [load_day 2025-09-22] 2025-09-22 hour 23: 151792 events in 0 files, snapshot none (task 7566 ms: download 4936 ms overlapping gunzip 1236 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 463 ms: 11 candidates, 60218 repo-hours, 818 releases; waiting 836 ms; commit 0 ms)
2026-11-08T13:58:56Z [load_day 2025-09-22] 2025-09-22: repo_hour merged from 24 files to 1 (1881177 rows, 8704 ms)
2026-11-08T13:58:59Z [load_day 2025-09-22] 2025-09-22: index committed in 11389 ms (24 + 1 + 24 files)
2026-11-08T13:58:59Z [load_day 2025-09-22] 2025-09-22: 3902722 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:58:59Z [load_day 2025-09-22] attempt 1 succeeded