orcaLog in

Runs · run 4639

load_day 2025-11-21, attempt 1 succeeded

Host
73ccef5e07c2:407219
Started
2026-11-08T14:32:10Z
Ended
2026-11-08T14:33:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
731 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.9 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4639/load_day/2025-11-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:32:10Z [load_day 2025-11-21] attempt 1 started
2026-11-08T14:32:11Z [load_day 2025-11-21] 2025-11-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:32:16Z [load_day 2025-11-21] 2025-11-21 hour 0: 147053 events in 0 files, snapshot none (task 3898 ms: download 2408 ms overlapping gunzip 543 ms, parse 1815 ms, sort 0 ms, write 0 ms, index 583 ms: 9 candidates, 77257 repo-hours, 840 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:32:16Z [load_day 2025-11-21] 2025-11-21 hour 1: 154922 events in 0 files, snapshot none (task 3780 ms: download 2246 ms overlapping gunzip 507 ms, parse 1604 ms, sort 0 ms, write 0 ms, index 784 ms: 12 candidates, 93269 repo-hours, 788 releases; waiting 522 ms; commit 0 ms)
2026-11-08T14:32:20Z [load_day 2025-11-21] 2025-11-21 hour 2: 146992 events in 0 files, snapshot none (task 3701 ms: download 2060 ms overlapping gunzip 538 ms, parse 1761 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 71479 repo-hours, 663 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:32:20Z [load_day 2025-11-21] 2025-11-21 hour 3: 146860 events in 0 files, snapshot none (task 3885 ms: download 2098 ms overlapping gunzip 578 ms, parse 1855 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 70808 repo-hours, 1745 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:32:24Z [load_day 2025-11-21] 2025-11-21 hour 4: 148319 events in 0 files, snapshot none (task 3777 ms: download 2116 ms overlapping gunzip 501 ms, parse 1598 ms, sort 0 ms, write 0 ms, index 665 ms: 12 candidates, 69172 repo-hours, 635 releases; waiting 667 ms; commit 0 ms)
2026-11-08T14:32:24Z [load_day 2025-11-21] 2025-11-21 hour 5: 144709 events in 0 files, snapshot none (task 4015 ms: download 2998 ms overlapping gunzip 569 ms, parse 1767 ms, sort 0 ms, write 0 ms, index 527 ms: 6 candidates, 67416 repo-hours, 618 releases; waiting 859 ms; commit 0 ms)
2026-11-08T14:32:28Z [load_day 2025-11-21] 2025-11-21 hour 6: 148986 events in 0 files, snapshot none (task 3843 ms: download 1995 ms overlapping gunzip 484 ms, parse 1522 ms, sort 0 ms, write 0 ms, index 772 ms: 2 candidates, 75444 repo-hours, 626 releases; waiting 728 ms; commit 0 ms)
2026-11-08T14:32:29Z [load_day 2025-11-21] 2025-11-21 hour 7: 147417 events in 0 files, snapshot none (task 4358 ms: download 3282 ms overlapping gunzip 589 ms, parse 1735 ms, sort 0 ms, write 0 ms, index 534 ms: 5 candidates, 71268 repo-hours, 577 releases; waiting 1181 ms; commit 0 ms)
2026-11-08T14:32:33Z [load_day 2025-11-21] 2025-11-21 hour 8: 145487 events in 0 files, snapshot none (task 4117 ms: download 2194 ms overlapping gunzip 607 ms, parse 1775 ms, sort 0 ms, write 0 ms, index 697 ms: 11 candidates, 76193 repo-hours, 666 releases; waiting 703 ms; commit 0 ms)
2026-11-08T14:32:33Z [load_day 2025-11-21] 2025-11-21 hour 9: 156537 events in 0 files, snapshot none (task 3107 ms: download 1985 ms overlapping gunzip 402 ms, parse 1435 ms, sort 0 ms, write 0 ms, index 619 ms: 2 candidates, 73118 repo-hours, 449 releases; waiting 360 ms; commit 0 ms)
2026-11-08T14:32:37Z [load_day 2025-11-21] 2025-11-21 hour 10: 147672 events in 0 files, snapshot none (task 3882 ms: download 2661 ms overlapping gunzip 547 ms, parse 1716 ms, sort 0 ms, write 0 ms, index 576 ms: 2 candidates, 77683 repo-hours, 732 releases; waiting 731 ms; commit 0 ms)
2026-11-08T14:32:37Z [load_day 2025-11-21] 2025-11-21 hour 11: 145799 events in 0 files, snapshot none (task 3819 ms: download 2700 ms overlapping gunzip 588 ms, parse 1816 ms, sort 0 ms, write 0 ms, index 608 ms: 4 candidates, 71963 repo-hours, 576 releases; waiting 532 ms; commit 0 ms)
2026-11-08T14:32:41Z [load_day 2025-11-21] 2025-11-21 hour 12: 160916 events in 0 files, snapshot none (task 3373 ms: download 1774 ms overlapping gunzip 399 ms, parse 1248 ms, sort 0 ms, write 0 ms, index 779 ms: 6 candidates, 97151 repo-hours, 499 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:32:42Z [load_day 2025-11-21] 2025-11-21 hour 13: 157340 events in 0 files, snapshot none (task 3696 ms: download 2445 ms overlapping gunzip 461 ms, parse 1518 ms, sort 0 ms, write 0 ms, index 712 ms: 4 candidates, 91037 repo-hours, 478 releases; waiting 736 ms; commit 0 ms)
2026-11-08T14:32:46Z [load_day 2025-11-21] 2025-11-21 hour 14: 152196 events in 0 files, snapshot none (task 3989 ms: download 2730 ms overlapping gunzip 531 ms, parse 1646 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 81625 repo-hours, 578 releases; waiting 844 ms; commit 0 ms)
2026-11-08T14:32:46Z [load_day 2025-11-21] 2025-11-21 hour 15: 150028 events in 0 files, snapshot none (task 3901 ms: download 2340 ms overlapping gunzip 570 ms, parse 1784 ms, sort 0 ms, write 0 ms, index 660 ms: 8 candidates, 80306 repo-hours, 597 releases; waiting 558 ms; commit 0 ms)
2026-11-08T14:32:50Z [load_day 2025-11-21] 2025-11-21 hour 16: 148053 events in 0 files, snapshot none (task 3824 ms: download 2286 ms overlapping gunzip 594 ms, parse 1755 ms, sort 0 ms, write 0 ms, index 604 ms: 9 candidates, 78930 repo-hours, 689 releases; waiting 635 ms; commit 0 ms)
2026-11-08T14:32:50Z [load_day 2025-11-21] 2025-11-21 hour 17: 151407 events in 0 files, snapshot none (task 3728 ms: download 2376 ms overlapping gunzip 537 ms, parse 1712 ms, sort 0 ms, write 0 ms, index 638 ms: 4 candidates, 77979 repo-hours, 732 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:32:55Z [load_day 2025-11-21] 2025-11-21 hour 18: 148874 events in 0 files, snapshot none (task 4341 ms: download 2799 ms overlapping gunzip 529 ms, parse 1639 ms, sort 0 ms, write 0 ms, index 642 ms: 7 candidates, 79741 repo-hours, 741 releases; waiting 1182 ms; commit 0 ms)
2026-11-08T14:32:55Z [load_day 2025-11-21] 2025-11-21 hour 19: 149188 events in 0 files, snapshot none (task 4076 ms: download 2386 ms overlapping gunzip 533 ms, parse 1637 ms, sort 0 ms, write 0 ms, index 745 ms: 8 candidates, 72244 repo-hours, 845 releases; waiting 719 ms; commit 0 ms)
2026-11-08T14:32:59Z [load_day 2025-11-21] 2025-11-21 hour 20: 147922 events in 0 files, snapshot none (task 3488 ms: download 2279 ms overlapping gunzip 410 ms, parse 1406 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 70390 repo-hours, 919 releases; waiting 751 ms; commit 0 ms)
2026-11-08T14:32:59Z [load_day 2025-11-21] 2025-11-21 hour 21: 146625 events in 0 files, snapshot none (task 3402 ms: download 2232 ms overlapping gunzip 409 ms, parse 1331 ms, sort 0 ms, write 0 ms, index 565 ms: 7 candidates, 67591 repo-hours, 758 releases; waiting 819 ms; commit 0 ms)
2026-11-08T14:33:04Z [load_day 2025-11-21] 2025-11-21 hour 22: 146931 events in 0 files, snapshot none (task 4106 ms: download 2921 ms overlapping gunzip 392 ms, parse 1294 ms, sort 0 ms, write 0 ms, index 501 ms: 7 candidates, 67512 repo-hours, 883 releases; waiting 1598 ms; commit 0 ms)
2026-11-08T14:33:04Z [load_day 2025-11-21] 2025-11-21 hour 23: 144387 events in 0 files, snapshot none (task 3097 ms: download 1962 ms overlapping gunzip 370 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 457 ms: 6 candidates, 63063 repo-hours, 912 releases; waiting 594 ms; commit 0 ms)
2026-11-08T14:33:12Z [load_day 2025-11-21] 2025-11-21: repo_hour merged from 24 files to 1 (1822639 rows, 8298 ms)
2026-11-08T14:33:15Z [load_day 2025-11-21] 2025-11-21: index committed in 11244 ms (24 + 1 + 24 files)
2026-11-08T14:33:15Z [load_day 2025-11-21] 2025-11-21: 3584620 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:33:15Z [load_day 2025-11-21] attempt 1 succeeded