orcaLog in

Runs · run 4256

load_day 2025-08-10, attempt 1 succeeded

Host
73ccef5e07c2:358780
Started
2026-11-08T13:19:19Z
Ended
2026-11-08T13:20:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
617 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4256/load_day/2025-08-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:19:19Z [load_day 2025-08-10] attempt 1 started
2026-11-08T13:19:20Z [load_day 2025-08-10] 2025-08-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:19:26Z [load_day 2025-08-10] 2025-08-10 hour 0: 132430 events in 0 files, snapshot none (task 5208 ms: download 3476 ms overlapping gunzip 771 ms, parse 3002 ms, sort 0 ms, write 0 ms, index 477 ms: 10 candidates, 54806 repo-hours, 1015 releases; waiting 564 ms; commit 0 ms)
2026-11-08T13:19:26Z [load_day 2025-08-10] 2025-08-10 hour 1: 143308 events in 0 files, snapshot none (task 5220 ms: download 2568 ms overlapping gunzip 777 ms, parse 3154 ms, sort 0 ms, write 0 ms, index 572 ms: 8 candidates, 77316 repo-hours, 686 releases; waiting 353 ms; commit 0 ms)
2026-11-08T13:19:32Z [load_day 2025-08-10] 2025-08-10 hour 2: 140894 events in 0 files, snapshot none (task 5165 ms: download 2736 ms overlapping gunzip 774 ms, parse 3087 ms, sort 0 ms, write 0 ms, index 510 ms: 3 candidates, 63829 repo-hours, 737 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:19:32Z [load_day 2025-08-10] 2025-08-10 hour 3: 132914 events in 0 files, snapshot none (task 4686 ms: download 2485 ms overlapping gunzip 765 ms, parse 2934 ms, sort 0 ms, write 0 ms, index 393 ms: 3 candidates, 49955 repo-hours, 813 releases; waiting 333 ms; commit 0 ms)
2026-11-08T13:19:37Z [load_day 2025-08-10] 2025-08-10 hour 4: 143165 events in 0 files, snapshot none (task 5190 ms: download 3091 ms overlapping gunzip 798 ms, parse 3123 ms, sort 0 ms, write 0 ms, index 408 ms: 5 candidates, 55336 repo-hours, 1938 releases; waiting 562 ms; commit 0 ms)
2026-11-08T13:19:38Z [load_day 2025-08-10] 2025-08-10 hour 5: 146918 events in 0 files, snapshot none (task 5390 ms: download 3066 ms overlapping gunzip 828 ms, parse 3264 ms, sort 0 ms, write 0 ms, index 404 ms: 9 candidates, 53463 repo-hours, 655 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:19:42Z [load_day 2025-08-10] 2025-08-10 hour 6: 149291 events in 0 files, snapshot none (task 4319 ms: download 2105 ms overlapping gunzip 708 ms, parse 2719 ms, sort 0 ms, write 0 ms, index 430 ms: 4 candidates, 62485 repo-hours, 680 releases; waiting 199 ms; commit 0 ms)
2026-11-08T13:19:43Z [load_day 2025-08-10] 2025-08-10 hour 7: 147101 events in 0 files, snapshot none (task 4572 ms: download 2926 ms overlapping gunzip 698 ms, parse 2671 ms, sort 0 ms, write 0 ms, index 385 ms: 6 candidates, 55578 repo-hours, 568 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:19:48Z [load_day 2025-08-10] 2025-08-10 hour 8: 145863 events in 0 files, snapshot none (task 4989 ms: download 2875 ms overlapping gunzip 719 ms, parse 2923 ms, sort 0 ms, write 0 ms, index 501 ms: 4 candidates, 59773 repo-hours, 650 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:19:48Z [load_day 2025-08-10] 2025-08-10 hour 9: 151605 events in 0 files, snapshot none (task 5047 ms: download 3422 ms overlapping gunzip 716 ms, parse 2772 ms, sort 0 ms, write 0 ms, index 467 ms: 2 candidates, 63025 repo-hours, 732 releases; waiting 785 ms; commit 0 ms)
2026-11-08T13:19:56Z [load_day 2025-08-10] 2025-08-10 hour 10: 148868 events in 0 files, snapshot none (task 7172 ms: download 3288 ms overlapping gunzip 1112 ms, parse 4352 ms, sort 0 ms, write 0 ms, index 902 ms: 6 candidates, 61945 repo-hours, 608 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:19:56Z [load_day 2025-08-10] 2025-08-10 hour 11: 148547 events in 0 files, snapshot none (task 7568 ms: download 4864 ms overlapping gunzip 1142 ms, parse 4432 ms, sort 0 ms, write 0 ms, index 561 ms: 6 candidates, 57911 repo-hours, 617 releases; waiting 1119 ms; commit 0 ms)
2026-11-08T13:20:04Z [load_day 2025-08-10] 2025-08-10 hour 12: 165447 events in 0 files, snapshot none (task 7449 ms: download 4274 ms overlapping gunzip 1103 ms, parse 4194 ms, sort 0 ms, write 0 ms, index 1202 ms: 3 candidates, 88441 repo-hours, 643 releases; waiting 650 ms; commit 0 ms)
2026-11-08T13:20:05Z [load_day 2025-08-10] 2025-08-10 hour 13: 161365 events in 0 files, snapshot none (task 8405 ms: download 4853 ms overlapping gunzip 1333 ms, parse 5410 ms, sort 0 ms, write 0 ms, index 808 ms: 6 candidates, 80771 repo-hours, 622 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:20:13Z [load_day 2025-08-10] 2025-08-10 hour 14: 159586 events in 0 files, snapshot none (task 8686 ms: download 4691 ms overlapping gunzip 1506 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 1043 ms: 8 candidates, 70901 repo-hours, 610 releases; waiting 481 ms; commit 0 ms)
2026-11-08T13:20:15Z [load_day 2025-08-10] 2025-08-10 hour 15: 161221 events in 0 files, snapshot none (task 9143 ms: download 6420 ms overlapping gunzip 1624 ms, parse 5953 ms, sort 0 ms, write 0 ms, index 730 ms: 5 candidates, 68963 repo-hours, 695 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:20:20Z [load_day 2025-08-10] 2025-08-10 hour 16: 160452 events in 0 files, snapshot none (task 6779 ms: download 4523 ms overlapping gunzip 1081 ms, parse 3521 ms, sort 0 ms, write 0 ms, index 1192 ms: 11 candidates, 67216 repo-hours, 664 releases; waiting 615 ms; commit 0 ms)
2026-11-08T13:20:23Z [load_day 2025-08-10] 2025-08-10 hour 17: 161418 events in 0 files, snapshot none (task 7549 ms: download 4700 ms overlapping gunzip 1113 ms, parse 3940 ms, sort 0 ms, write 0 ms, index 752 ms: 9 candidates, 64441 repo-hours, 694 releases; waiting 1454 ms; commit 0 ms)
2026-11-08T13:20:26Z [load_day 2025-08-10] 2025-08-10 hour 18: 160833 events in 0 files, snapshot none (task 4642 ms: download 2782 ms overlapping gunzip 727 ms, parse 2815 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 68020 repo-hours, 700 releases; waiting 190 ms; commit 0 ms)
2026-11-08T13:20:31Z [load_day 2025-08-10] 2025-08-10 hour 19: 152962 events in 0 files, snapshot none (task 6877 ms: download 2934 ms overlapping gunzip 1120 ms, parse 4199 ms, sort 0 ms, write 0 ms, index 779 ms: 6 candidates, 54823 repo-hours, 641 releases; waiting 456 ms; commit 0 ms)
2026-11-08T13:20:32Z [load_day 2025-08-10] 2025-08-10 hour 20: 147379 events in 0 files, snapshot none (task 5562 ms: download 3430 ms overlapping gunzip 898 ms, parse 3408 ms, sort 0 ms, write 0 ms, index 430 ms: 5 candidates, 57778 repo-hours, 719 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:20:38Z [load_day 2025-08-10] 2025-08-10 hour 21: 143055 events in 0 files, snapshot none (task 6590 ms: download 3898 ms overlapping gunzip 847 ms, parse 3563 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 54383 repo-hours, 896 releases; waiting 1285 ms; commit 0 ms)
2026-11-08T13:20:39Z [load_day 2025-08-10] 2025-08-10 hour 22: 139914 events in 0 files, snapshot none (task 6060 ms: download 3232 ms overlapping gunzip 882 ms, parse 3765 ms, sort 0 ms, write 0 ms, index 537 ms: 3 candidates, 51492 repo-hours, 798 releases; waiting 547 ms; commit 0 ms)
2026-11-08T13:20:43Z [load_day 2025-08-10] 2025-08-10 hour 23: 140322 events in 0 files, snapshot none (task 4481 ms: download 2918 ms overlapping gunzip 667 ms, parse 2691 ms, sort 0 ms, write 0 ms, index 412 ms: 2 candidates, 49348 repo-hours, 689 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:20:50Z [load_day 2025-08-10] 2025-08-10: repo_hour merged from 24 files to 1 (1491999 rows, 6986 ms)
2026-11-08T13:20:53Z [load_day 2025-08-10] 2025-08-10: index committed in 9852 ms (24 + 1 + 24 files)
2026-11-08T13:20:53Z [load_day 2025-08-10] 2025-08-10: 3584858 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:20:53Z [load_day 2025-08-10] attempt 1 succeeded