orcaLog in

Runs · run 4198

load_day 2025-07-27, attempt 1 succeeded

Host
73ccef5e07c2:350215
Started
2026-11-08T13:07:14Z
Ended
2026-11-08T13:08:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
608 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
115.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4198/load_day/2025-07-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:07:14Z [load_day 2025-07-27] attempt 1 started
2026-11-08T13:07:15Z [load_day 2025-07-27] 2025-07-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:07:20Z [load_day 2025-07-27] 2025-07-27 hour 0: 129613 events in 0 files, snapshot none (task 4528 ms: download 2532 ms overlapping gunzip 667 ms, parse 2585 ms, sort 0 ms, write 0 ms, index 384 ms: 5 candidates, 52681 repo-hours, 1157 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:07:21Z [load_day 2025-07-27] 2025-07-27 hour 1: 143764 events in 0 files, snapshot none (task 5452 ms: download 3612 ms overlapping gunzip 626 ms, parse 2629 ms, sort 0 ms, write 0 ms, index 538 ms: 1 candidates, 76305 repo-hours, 875 releases; waiting 1426 ms; commit 0 ms)
2026-11-08T13:07:25Z [load_day 2025-07-27] 2025-07-27 hour 2: 137585 events in 0 files, snapshot none (task 4420 ms: download 2704 ms overlapping gunzip 591 ms, parse 2410 ms, sort 0 ms, write 0 ms, index 435 ms: 3 candidates, 63431 repo-hours, 855 releases; waiting 556 ms; commit 0 ms)
2026-11-08T13:07:26Z [load_day 2025-07-27] 2025-07-27 hour 3: 129770 events in 0 files, snapshot none (task 4449 ms: download 2327 ms overlapping gunzip 620 ms, parse 2478 ms, sort 0 ms, write 0 ms, index 463 ms: 7 candidates, 49696 repo-hours, 925 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:07:31Z [load_day 2025-07-27] 2025-07-27 hour 4: 135927 events in 0 files, snapshot none (task 5013 ms: download 2131 ms overlapping gunzip 652 ms, parse 2702 ms, sort 0 ms, write 0 ms, index 953 ms: 1 candidates, 55586 repo-hours, 2112 releases; waiting 464 ms; commit 0 ms)
2026-11-08T13:07:32Z [load_day 2025-07-27] 2025-07-27 hour 5: 141726 events in 0 files, snapshot none (task 5667 ms: download 3272 ms overlapping gunzip 805 ms, parse 3376 ms, sort 0 ms, write 0 ms, index 474 ms: 8 candidates, 54126 repo-hours, 714 releases; waiting 698 ms; commit 0 ms)
2026-11-08T13:07:36Z [load_day 2025-07-27] 2025-07-27 hour 6: 142175 events in 0 files, snapshot none (task 4141 ms: download 2620 ms overlapping gunzip 556 ms, parse 2354 ms, sort 0 ms, write 0 ms, index 436 ms: 6 candidates, 63057 repo-hours, 799 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:07:38Z [load_day 2025-07-27] 2025-07-27 hour 7: 145493 events in 0 files, snapshot none (task 4988 ms: download 2763 ms overlapping gunzip 656 ms, parse 2687 ms, sort 0 ms, write 0 ms, index 801 ms: 4 candidates, 57613 repo-hours, 705 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:07:41Z [load_day 2025-07-27] 2025-07-27 hour 8: 144521 events in 0 files, snapshot none (task 4797 ms: download 2573 ms overlapping gunzip 672 ms, parse 2833 ms, sort 0 ms, write 0 ms, index 464 ms: 5 candidates, 60558 repo-hours, 682 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:07:45Z [load_day 2025-07-27] 2025-07-27 hour 9: 152081 events in 0 files, snapshot none (task 6250 ms: download 3758 ms overlapping gunzip 846 ms, parse 3536 ms, sort 0 ms, write 0 ms, index 975 ms: 5 candidates, 63106 repo-hours, 798 releases; waiting 577 ms; commit 0 ms)
2026-11-08T13:07:47Z [load_day 2025-07-27] 2025-07-27 hour 10: 151484 events in 0 files, snapshot none (task 5823 ms: download 3029 ms overlapping gunzip 858 ms, parse 3577 ms, sort 0 ms, write 0 ms, index 664 ms: 3 candidates, 63267 repo-hours, 722 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:07:50Z [load_day 2025-07-27] 2025-07-27 hour 11: 146836 events in 0 files, snapshot none (task 4807 ms: download 2337 ms overlapping gunzip 689 ms, parse 2947 ms, sort 0 ms, write 0 ms, index 638 ms: 9 candidates, 59674 repo-hours, 856 releases; waiting 244 ms; commit 0 ms)
2026-11-08T13:07:55Z [load_day 2025-07-27] 2025-07-27 hour 12: 166519 events in 0 files, snapshot none (task 7537 ms: download 4353 ms overlapping gunzip 730 ms, parse 3379 ms, sort 0 ms, write 0 ms, index 702 ms: 3 candidates, 90368 repo-hours, 940 releases; waiting 2450 ms; commit 0 ms)
2026-11-08T13:07:57Z [load_day 2025-07-27] 2025-07-27 hour 13: 157562 events in 0 files, snapshot none (task 6152 ms: download 3581 ms overlapping gunzip 888 ms, parse 3956 ms, sort 0 ms, write 0 ms, index 609 ms: 8 candidates, 80240 repo-hours, 857 releases; waiting 445 ms; commit 0 ms)
2026-11-08T13:08:04Z [load_day 2025-07-27] 2025-07-27 hour 14: 152296 events in 0 files, snapshot none (task 7739 ms: download 4076 ms overlapping gunzip 1020 ms, parse 4343 ms, sort 0 ms, write 0 ms, index 928 ms: 5 candidates, 67095 repo-hours, 806 releases; waiting 1144 ms; commit 0 ms)
2026-11-08T13:08:04Z [load_day 2025-07-27] 2025-07-27 hour 15: 158320 events in 0 files, snapshot none (task 7326 ms: download 3864 ms overlapping gunzip 1065 ms, parse 4705 ms, sort 0 ms, write 0 ms, index 698 ms: 10 candidates, 70180 repo-hours, 929 releases; waiting 578 ms; commit 0 ms)
2026-11-08T13:08:11Z [load_day 2025-07-27] 2025-07-27 hour 16: 154430 events in 0 files, snapshot none (task 6449 ms: download 2775 ms overlapping gunzip 864 ms, parse 3695 ms, sort 0 ms, write 0 ms, index 1338 ms: 15 candidates, 69044 repo-hours, 883 releases; waiting 265 ms; commit 0 ms)
2026-11-08T13:08:12Z [load_day 2025-07-27] 2025-07-27 hour 17: 157057 events in 0 files, snapshot none (task 7053 ms: download 3547 ms overlapping gunzip 1092 ms, parse 4418 ms, sort 0 ms, write 0 ms, index 772 ms: 3 candidates, 65809 repo-hours, 728 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:08:17Z [load_day 2025-07-27] 2025-07-27 hour 18: 155728 events in 0 files, snapshot none (task 5318 ms: download 2623 ms overlapping gunzip 795 ms, parse 3385 ms, sort 0 ms, write 0 ms, index 524 ms: 5 candidates, 72635 repo-hours, 840 releases; waiting 322 ms; commit 0 ms)
2026-11-08T13:08:17Z [load_day 2025-07-27] 2025-07-27 hour 19: 147557 events in 0 files, snapshot none (task 4833 ms: download 3219 ms overlapping gunzip 705 ms, parse 2829 ms, sort 0 ms, write 0 ms, index 477 ms: 6 candidates, 58313 repo-hours, 783 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:08:23Z [load_day 2025-07-27] 2025-07-27 hour 20: 144015 events in 0 files, snapshot none (task 6030 ms: download 3238 ms overlapping gunzip 902 ms, parse 3713 ms, sort 0 ms, write 0 ms, index 556 ms: 7 candidates, 58573 repo-hours, 953 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:08:23Z [load_day 2025-07-27] 2025-07-27 hour 21: 140646 events in 0 files, snapshot none (task 5467 ms: download 3186 ms overlapping gunzip 863 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 416 ms: 8 candidates, 54614 repo-hours, 1010 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:08:30Z [load_day 2025-07-27] 2025-07-27 hour 22: 135974 events in 0 files, snapshot none (task 6046 ms: download 3448 ms overlapping gunzip 974 ms, parse 3618 ms, sort 0 ms, write 0 ms, index 500 ms: 7 candidates, 51277 repo-hours, 832 releases; waiting 639 ms; commit 0 ms)
2026-11-08T13:08:30Z [load_day 2025-07-27] 2025-07-27 hour 23: 133543 events in 0 files, snapshot none (task 6257 ms: download 2827 ms overlapping gunzip 942 ms, parse 3917 ms, sort 0 ms, write 0 ms, index 533 ms: 5 candidates, 49907 repo-hours, 726 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:08:37Z [load_day 2025-07-27] 2025-07-27: repo_hour merged from 24 files to 1 (1507155 rows, 7524 ms)
2026-11-08T13:08:40Z [load_day 2025-07-27] 2025-07-27: index committed in 10325 ms (24 + 1 + 24 files)
2026-11-08T13:08:40Z [load_day 2025-07-27] 2025-07-27: 3504622 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:08:40Z [load_day 2025-07-27] attempt 1 succeeded