orcaLog in

Runs · run 4909

load_day 2026-02-07, attempt 1 succeeded

Host
73ccef5e07c2:440095
Started
2026-11-08T15:15:20Z
Ended
2026-11-08T15:16:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.0 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4909/load_day/2026-02-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:15:20Z [load_day 2026-02-07] attempt 1 started
2026-11-08T15:15:21Z [load_day 2026-02-07] 2026-02-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:15:25Z [load_day 2026-02-07] 2026-02-07 hour 0: 141717 events in 0 files, snapshot none (task 3259 ms: download 2067 ms overlapping gunzip 420 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 575 ms: 8 candidates, 70104 repo-hours, 1045 releases; waiting 713 ms; commit 0 ms)
2026-11-08T15:15:25Z [load_day 2026-02-07] 2026-02-07 hour 1: 145541 events in 0 files, snapshot none (task 3055 ms: download 1768 ms overlapping gunzip 397 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 82378 repo-hours, 704 releases; waiting 586 ms; commit 0 ms)
2026-11-08T15:15:29Z [load_day 2026-02-07] 2026-02-07 hour 2: 144704 events in 0 files, snapshot none (task 3414 ms: download 2373 ms overlapping gunzip 394 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 552 ms: 7 candidates, 76399 repo-hours, 623 releases; waiting 979 ms; commit 0 ms)
2026-11-08T15:15:29Z [load_day 2026-02-07] 2026-02-07 hour 3: 141335 events in 0 files, snapshot none (task 2646 ms: download 1653 ms overlapping gunzip 350 ms, parse 1093 ms, sort 0 ms, write 0 ms, index 504 ms: 9 candidates, 66313 repo-hours, 805 releases; waiting 444 ms; commit 0 ms)
2026-11-08T15:15:32Z [load_day 2026-02-07] 2026-02-07 hour 4: 141664 events in 0 files, snapshot none (task 3392 ms: download 2143 ms overlapping gunzip 435 ms, parse 1345 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 70255 repo-hours, 1563 releases; waiting 689 ms; commit 0 ms)
2026-11-08T15:15:33Z [load_day 2026-02-07] 2026-02-07 hour 5: 145049 events in 0 files, snapshot none (task 3801 ms: download 2705 ms overlapping gunzip 477 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 71211 repo-hours, 722 releases; waiting 942 ms; commit 0 ms)
2026-11-08T15:15:37Z [load_day 2026-02-07] 2026-02-07 hour 6: 148050 events in 0 files, snapshot none (task 3606 ms: download 2415 ms overlapping gunzip 506 ms, parse 1612 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 74932 repo-hours, 776 releases; waiting 608 ms; commit 0 ms)
2026-11-08T15:15:37Z [load_day 2026-02-07] 2026-02-07 hour 7: 147553 events in 0 files, snapshot none (task 3448 ms: download 2069 ms overlapping gunzip 527 ms, parse 1543 ms, sort 0 ms, write 0 ms, index 554 ms: 8 candidates, 67027 repo-hours, 817 releases; waiting 526 ms; commit 0 ms)
2026-11-08T15:15:41Z [load_day 2026-02-07] 2026-02-07 hour 8: 145602 events in 0 files, snapshot none (task 3608 ms: download 2205 ms overlapping gunzip 555 ms, parse 1598 ms, sort 0 ms, write 0 ms, index 565 ms: 7 candidates, 71159 repo-hours, 855 releases; waiting 552 ms; commit 0 ms)
2026-11-08T15:15:41Z [load_day 2026-02-07] 2026-02-07 hour 9: 143549 events in 0 files, snapshot none (task 3845 ms: download 2169 ms overlapping gunzip 650 ms, parse 1788 ms, sort 0 ms, write 0 ms, index 569 ms: 4 candidates, 72228 repo-hours, 814 releases; waiting 508 ms; commit 0 ms)
2026-11-08T15:15:45Z [load_day 2026-02-07] 2026-02-07 hour 10: 147973 events in 0 files, snapshot none (task 3879 ms: download 2292 ms overlapping gunzip 565 ms, parse 1855 ms, sort 0 ms, write 0 ms, index 655 ms: 2 candidates, 73190 repo-hours, 791 releases; waiting 570 ms; commit 0 ms)
2026-11-08T15:15:45Z [load_day 2026-02-07] 2026-02-07 hour 11: 148720 events in 0 files, snapshot none (task 3690 ms: download 2056 ms overlapping gunzip 565 ms, parse 1740 ms, sort 0 ms, write 0 ms, index 547 ms: 5 candidates, 73565 repo-hours, 721 releases; waiting 515 ms; commit 0 ms)
2026-11-08T15:15:49Z [load_day 2026-02-07] 2026-02-07 hour 12: 155405 events in 0 files, snapshot none (task 3780 ms: download 2327 ms overlapping gunzip 511 ms, parse 1731 ms, sort 0 ms, write 0 ms, index 733 ms: 8 candidates, 89358 repo-hours, 712 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:15:49Z [load_day 2026-02-07] 2026-02-07 hour 13: 151308 events in 0 files, snapshot none (task 3196 ms: download 1934 ms overlapping gunzip 417 ms, parse 1307 ms, sort 0 ms, write 0 ms, index 730 ms: 6 candidates, 85100 repo-hours, 575 releases; waiting 402 ms; commit 0 ms)
2026-11-08T15:15:54Z [load_day 2026-02-07] 2026-02-07 hour 14: 148435 events in 0 files, snapshot none (task 3643 ms: download 2265 ms overlapping gunzip 482 ms, parse 1391 ms, sort 0 ms, write 0 ms, index 586 ms: 10 candidates, 76537 repo-hours, 786 releases; waiting 836 ms; commit 0 ms)
2026-11-08T15:15:54Z [load_day 2026-02-07] 2026-02-07 hour 15: 150700 events in 0 files, snapshot none (task 3442 ms: download 2004 ms overlapping gunzip 516 ms, parse 1437 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 77649 repo-hours, 743 releases; waiting 586 ms; commit 0 ms)
2026-11-08T15:15:58Z [load_day 2026-02-07] 2026-02-07 hour 16: 148846 events in 0 files, snapshot none (task 3991 ms: download 2330 ms overlapping gunzip 540 ms, parse 1673 ms, sort 0 ms, write 0 ms, index 692 ms: 7 candidates, 77545 repo-hours, 700 releases; waiting 765 ms; commit 0 ms)
2026-11-08T15:15:58Z [load_day 2026-02-07] 2026-02-07 hour 17: 148071 events in 0 files, snapshot none (task 3992 ms: download 2196 ms overlapping gunzip 646 ms, parse 1758 ms, sort 0 ms, write 0 ms, index 725 ms: 9 candidates, 74505 repo-hours, 723 releases; waiting 581 ms; commit 0 ms)
2026-11-08T15:16:03Z [load_day 2026-02-07] 2026-02-07 hour 18: 148721 events in 0 files, snapshot none (task 4025 ms: download 2503 ms overlapping gunzip 607 ms, parse 1829 ms, sort 0 ms, write 0 ms, index 719 ms: 6 candidates, 75848 repo-hours, 829 releases; waiting 586 ms; commit 0 ms)
2026-11-08T15:16:03Z [load_day 2026-02-07] 2026-02-07 hour 19: 149893 events in 0 files, snapshot none (task 4108 ms: download 2833 ms overlapping gunzip 557 ms, parse 1888 ms, sort 0 ms, write 0 ms, index 724 ms: 10 candidates, 71398 repo-hours, 954 releases; waiting 661 ms; commit 0 ms)
2026-11-08T15:16:08Z [load_day 2026-02-07] 2026-02-07 hour 20: 145269 events in 0 files, snapshot none (task 4607 ms: download 2622 ms overlapping gunzip 685 ms, parse 2118 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 71394 repo-hours, 1169 releases; waiting 784 ms; commit 0 ms)
2026-11-08T15:16:08Z [load_day 2026-02-07] 2026-02-07 hour 21: 145364 events in 0 files, snapshot none (task 4439 ms: download 2892 ms overlapping gunzip 693 ms, parse 2063 ms, sort 0 ms, write 0 ms, index 843 ms: 8 candidates, 69405 repo-hours, 1183 releases; waiting 494 ms; commit 0 ms)
2026-11-08T15:16:12Z [load_day 2026-02-07] 2026-02-07 hour 22: 142686 events in 0 files, snapshot none (task 4433 ms: download 2474 ms overlapping gunzip 624 ms, parse 1834 ms, sort 0 ms, write 0 ms, index 637 ms: 10 candidates, 67812 repo-hours, 1187 releases; waiting 1030 ms; commit 0 ms)
2026-11-08T15:16:13Z [load_day 2026-02-07] 2026-02-07 hour 23: 144421 events in 0 files, snapshot none (task 4206 ms: download 2207 ms overlapping gunzip 621 ms, parse 2041 ms, sort 0 ms, write 0 ms, index 536 ms: 5 candidates, 64402 repo-hours, 1358 releases; waiting 621 ms; commit 0 ms)
2026-11-08T15:16:21Z [load_day 2026-02-07] 2026-02-07: repo_hour merged from 24 files to 1 (1769714 rows, 8055 ms)
2026-11-08T15:16:24Z [load_day 2026-02-07] 2026-02-07: index committed in 11093 ms (24 + 1 + 24 files)
2026-11-08T15:16:24Z [load_day 2026-02-07] 2026-02-07: 3520576 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:16:24Z [load_day 2026-02-07] attempt 1 succeeded