orcaLog in

Runs · run 4704

load_day 2025-12-11, attempt 1 succeeded

Host
73ccef5e07c2:415226
Started
2026-11-08T14:43:09Z
Ended
2026-11-08T14:44:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
761 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.8 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4704/load_day/2025-12-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:43:09Z [load_day 2025-12-11] attempt 1 started
2026-11-08T14:43:10Z [load_day 2025-12-11] 2025-12-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:43:17Z [load_day 2025-12-11] 2025-12-11 hour 0: 143906 events in 0 files, snapshot none (task 7150 ms: download 2024 ms overlapping gunzip 409 ms, parse 1350 ms, sort 0 ms, write 0 ms, index 4535 ms: 4 candidates, 75300 repo-hours, 1421 releases; waiting 547 ms; commit 0 ms)
2026-11-08T14:43:18Z [load_day 2025-12-11] 2025-12-11 hour 1: 150151 events in 0 files, snapshot none (task 7459 ms: download 2095 ms overlapping gunzip 420 ms, parse 1313 ms, sort 0 ms, write 0 ms, index 4816 ms: 6 candidates, 91282 repo-hours, 1122 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:43:22Z [load_day 2025-12-11] 2025-12-11 hour 2: 144332 events in 0 files, snapshot none (task 3465 ms: download 1918 ms overlapping gunzip 461 ms, parse 1511 ms, sort 0 ms, write 0 ms, index 776 ms: 8 candidates, 76423 repo-hours, 1298 releases; waiting 414 ms; commit 0 ms)
2026-11-08T14:43:23Z [load_day 2025-12-11] 2025-12-11 hour 3: 145148 events in 0 files, snapshot none (task 4060 ms: download 2859 ms overlapping gunzip 550 ms, parse 1720 ms, sort 0 ms, write 0 ms, index 533 ms: 5 candidates, 72021 repo-hours, 1410 releases; waiting 910 ms; commit 0 ms)
2026-11-08T14:43:26Z [load_day 2025-12-11] 2025-12-11 hour 4: 145317 events in 0 files, snapshot none (task 3778 ms: download 2225 ms overlapping gunzip 520 ms, parse 1720 ms, sort 0 ms, write 0 ms, index 598 ms: 7 candidates, 70038 repo-hours, 2186 releases; waiting 690 ms; commit 0 ms)
2026-11-08T14:43:27Z [load_day 2025-12-11] 2025-12-11 hour 5: 144719 events in 0 files, snapshot none (task 3636 ms: download 2300 ms overlapping gunzip 538 ms, parse 1573 ms, sort 0 ms, write 0 ms, index 611 ms: 6 candidates, 71532 repo-hours, 1265 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:43:40Z [load_day 2025-12-11] 2025-12-11 hour 6: 147618 events in 0 files, snapshot none (task 3801 ms: download 1877 ms overlapping gunzip 605 ms, parse 1739 ms, sort 0 ms, write 0 ms, index 637 ms: 7 candidates, 79609 repo-hours, 1241 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:43:40Z [load_day 2025-12-11] 2025-12-11 hour 7: 148995 events in 0 files, snapshot none (task 4167 ms: download 2763 ms overlapping gunzip 667 ms, parse 1961 ms, sort 0 ms, write 0 ms, index 556 ms: 12 candidates, 75453 repo-hours, 1029 releases; waiting 689 ms; commit 0 ms)
2026-11-08T14:43:44Z [load_day 2025-12-11] 2025-12-11 hour 8: 144900 events in 0 files, snapshot none (task 3929 ms: download 2598 ms overlapping gunzip 589 ms, parse 1541 ms, sort 0 ms, write 0 ms, index 737 ms: 10 candidates, 73781 repo-hours, 1127 releases; waiting 719 ms; commit 0 ms)
2026-11-08T14:43:44Z [load_day 2025-12-11] 2025-12-11 hour 9: 144708 events in 0 files, snapshot none (task 3685 ms: download 2441 ms overlapping gunzip 512 ms, parse 1490 ms, sort 0 ms, write 0 ms, index 666 ms: 3 candidates, 79366 repo-hours, 1099 releases; waiting 652 ms; commit 0 ms)
2026-11-08T14:43:49Z [load_day 2025-12-11] 2025-12-11 hour 10: 147495 events in 0 files, snapshot none (task 4002 ms: download 2468 ms overlapping gunzip 608 ms, parse 1795 ms, sort 0 ms, write 0 ms, index 610 ms: 3 candidates, 80380 repo-hours, 1062 releases; waiting 639 ms; commit 0 ms)
2026-11-08T14:43:49Z [load_day 2025-12-11] 2025-12-11 hour 11: 147713 events in 0 files, snapshot none (task 4023 ms: download 2408 ms overlapping gunzip 588 ms, parse 1730 ms, sort 0 ms, write 0 ms, index 688 ms: 5 candidates, 76956 repo-hours, 1136 releases; waiting 667 ms; commit 0 ms)
2026-11-08T14:43:54Z [load_day 2025-12-11] 2025-12-11 hour 12: 155426 events in 0 files, snapshot none (task 4037 ms: download 2158 ms overlapping gunzip 577 ms, parse 1784 ms, sort 0 ms, write 0 ms, index 899 ms: 3 candidates, 96225 repo-hours, 806 releases; waiting 517 ms; commit 0 ms)
2026-11-08T14:43:54Z [load_day 2025-12-11] 2025-12-11 hour 13: 158159 events in 0 files, snapshot none (task 4245 ms: download 2526 ms overlapping gunzip 665 ms, parse 1917 ms, sort 0 ms, write 0 ms, index 768 ms: 4 candidates, 91865 repo-hours, 522 releases; waiting 567 ms; commit 0 ms)
2026-11-08T14:43:58Z [load_day 2025-12-11] 2025-12-11 hour 14: 145682 events in 0 files, snapshot none (task 4110 ms: download 2644 ms overlapping gunzip 649 ms, parse 1889 ms, sort 0 ms, write 0 ms, index 662 ms: 8 candidates, 80757 repo-hours, 997 releases; waiting 638 ms; commit 0 ms)
2026-11-08T14:43:58Z [load_day 2025-12-11] 2025-12-11 hour 15: 142810 events in 0 files, snapshot none (task 4019 ms: download 2672 ms overlapping gunzip 628 ms, parse 1888 ms, sort 0 ms, write 0 ms, index 672 ms: 6 candidates, 80087 repo-hours, 1025 releases; waiting 527 ms; commit 0 ms)
2026-11-08T14:44:03Z [load_day 2025-12-11] 2025-12-11 hour 16: 143867 events in 0 files, snapshot none (task 3626 ms: download 2342 ms overlapping gunzip 441 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 671 ms: 4 candidates, 79378 repo-hours, 942 releases; waiting 837 ms; commit 0 ms)
2026-11-08T14:44:03Z [load_day 2025-12-11] 2025-12-11 hour 17: 145687 events in 0 files, snapshot none (task 3316 ms: download 2139 ms overlapping gunzip 443 ms, parse 1297 ms, sort 0 ms, write 0 ms, index 654 ms: 5 candidates, 73450 repo-hours, 855 releases; waiting 613 ms; commit 0 ms)
2026-11-08T14:44:07Z [load_day 2025-12-11] 2025-12-11 hour 18: 149411 events in 0 files, snapshot none (task 4187 ms: download 2692 ms overlapping gunzip 435 ms, parse 1354 ms, sort 0 ms, write 0 ms, index 548 ms: 1 candidates, 76845 repo-hours, 1100 releases; waiting 1533 ms; commit 0 ms)
2026-11-08T14:44:07Z [load_day 2025-12-11] 2025-12-11 hour 19: 148210 events in 0 files, snapshot none (task 4005 ms: download 2760 ms overlapping gunzip 530 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 595 ms: 5 candidates, 73769 repo-hours, 1090 releases; waiting 1045 ms; commit 0 ms)
2026-11-08T14:44:11Z [load_day 2025-12-11] 2025-12-11 hour 20: 146330 events in 0 files, snapshot none (task 3683 ms: download 2532 ms overlapping gunzip 450 ms, parse 1327 ms, sort 0 ms, write 0 ms, index 595 ms: 7 candidates, 73979 repo-hours, 1208 releases; waiting 1018 ms; commit 0 ms)
2026-11-08T14:44:11Z [load_day 2025-12-11] 2025-12-11 hour 21: 145000 events in 0 files, snapshot none (task 3471 ms: download 2402 ms overlapping gunzip 443 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 530 ms: 7 candidates, 70494 repo-hours, 1319 releases; waiting 872 ms; commit 0 ms)
2026-11-08T14:44:15Z [load_day 2025-12-11] 2025-12-11 hour 22: 144986 events in 0 files, snapshot none (task 3242 ms: download 1948 ms overlapping gunzip 449 ms, parse 1357 ms, sort 0 ms, write 0 ms, index 579 ms: 6 candidates, 70876 repo-hours, 1198 releases; waiting 566 ms; commit 0 ms)
2026-11-08T14:44:15Z [load_day 2025-12-11] 2025-12-11 hour 23: 143330 events in 0 files, snapshot none (task 3328 ms: download 2311 ms overlapping gunzip 463 ms, parse 1438 ms, sort 0 ms, write 0 ms, index 495 ms: 1 candidates, 63935 repo-hours, 1378 releases; waiting 624 ms; commit 0 ms)
2026-11-08T14:44:23Z [load_day 2025-12-11] 2025-12-11: repo_hour merged from 24 files to 1 (1853801 rows, 7571 ms)
2026-11-08T14:44:26Z [load_day 2025-12-11] 2025-12-11: index committed in 10388 ms (24 + 1 + 24 files)
2026-11-08T14:44:26Z [load_day 2025-12-11] 2025-12-11: 3523900 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:44:26Z [load_day 2025-12-11] attempt 1 succeeded