orcaLog in

Runs · run 4419

load_day 2025-09-20, attempt 1 succeeded

Host
73ccef5e07c2:382206
Started
2026-11-08T13:55:28Z
Ended
2026-11-08T13:56:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
661 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
118.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4419/load_day/2025-09-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:55:28Z [load_day 2025-09-20] attempt 1 started
2026-11-08T13:55:29Z [load_day 2025-09-20] 2025-09-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:55:34Z [load_day 2025-09-20] 2025-09-20 hour 0: 146011 events in 0 files, snapshot none (task 4471 ms: download 2851 ms overlapping gunzip 638 ms, parse 2589 ms, sort 0 ms, write 0 ms, index 600 ms: 8 candidates, 74938 repo-hours, 1006 releases; waiting 415 ms; commit 0 ms)
2026-11-08T13:55:35Z [load_day 2025-09-20] 2025-09-20 hour 1: 153240 events in 0 files, snapshot none (task 4858 ms: download 3200 ms overlapping gunzip 663 ms, parse 2653 ms, sort 0 ms, write 0 ms, index 632 ms: 2 candidates, 87478 repo-hours, 873 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:55:39Z [load_day 2025-09-20] 2025-09-20 hour 2: 137176 events in 0 files, snapshot none (task 4482 ms: download 2683 ms overlapping gunzip 621 ms, parse 2489 ms, sort 0 ms, write 0 ms, index 459 ms: 7 candidates, 61900 repo-hours, 783 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:55:40Z [load_day 2025-09-20] 2025-09-20 hour 3: 145055 events in 0 files, snapshot none (task 5130 ms: download 3864 ms overlapping gunzip 610 ms, parse 2510 ms, sort 0 ms, write 0 ms, index 450 ms: 10 candidates, 60510 repo-hours, 2156 releases; waiting 1201 ms; commit 0 ms)
2026-11-08T13:55:44Z [load_day 2025-09-20] 2025-09-20 hour 4: 142144 events in 0 files, snapshot none (task 4572 ms: download 2988 ms overlapping gunzip 592 ms, parse 2404 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 56119 repo-hours, 663 releases; waiting 643 ms; commit 0 ms)
2026-11-08T13:55:45Z [load_day 2025-09-20] 2025-09-20 hour 5: 146737 events in 0 files, snapshot none (task 4492 ms: download 2949 ms overlapping gunzip 608 ms, parse 2435 ms, sort 0 ms, write 0 ms, index 510 ms: 12 candidates, 60427 repo-hours, 616 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:55:52Z [load_day 2025-09-20] 2025-09-20 hour 6: 152386 events in 0 files, snapshot none (task 6991 ms: download 3650 ms overlapping gunzip 1031 ms, parse 4459 ms, sort 0 ms, write 0 ms, index 583 ms: 8 candidates, 70760 repo-hours, 782 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:55:53Z [load_day 2025-09-20] 2025-09-20 hour 7: 152037 events in 0 files, snapshot none (task 6496 ms: download 3715 ms overlapping gunzip 981 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 482 ms: 5 candidates, 62725 repo-hours, 694 releases; waiting 398 ms; commit 0 ms)
2026-11-08T13:56:00Z [load_day 2025-09-20] 2025-09-20 hour 8: 156322 events in 0 files, snapshot none (task 7176 ms: download 3878 ms overlapping gunzip 1173 ms, parse 4582 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 68280 repo-hours, 690 releases; waiting 513 ms; commit 0 ms)
2026-11-08T13:56:00Z [load_day 2025-09-20] 2025-09-20 hour 9: 155022 events in 0 files, snapshot none (task 6738 ms: download 3621 ms overlapping gunzip 1062 ms, parse 4229 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 64358 repo-hours, 799 releases; waiting 462 ms; commit 0 ms)
2026-11-08T13:56:06Z [load_day 2025-09-20] 2025-09-20 hour 10: 151863 events in 0 files, snapshot none (task 6192 ms: download 3968 ms overlapping gunzip 701 ms, parse 3136 ms, sort 0 ms, write 0 ms, index 458 ms: 7 candidates, 65222 repo-hours, 678 releases; waiting 1609 ms; commit 0 ms)
2026-11-08T13:56:06Z [load_day 2025-09-20] 2025-09-20 hour 11: 152934 events in 0 files, snapshot none (task 5390 ms: download 2678 ms overlapping gunzip 795 ms, parse 3453 ms, sort 0 ms, write 0 ms, index 490 ms: 5 candidates, 61883 repo-hours, 659 releases; waiting 344 ms; commit 0 ms)
2026-11-08T13:56:13Z [load_day 2025-09-20] 2025-09-20 hour 12: 167774 events in 0 files, snapshot none (task 6499 ms: download 3613 ms overlapping gunzip 990 ms, parse 4172 ms, sort 0 ms, write 0 ms, index 644 ms: 7 candidates, 93796 repo-hours, 721 releases; waiting 348 ms; commit 0 ms)
2026-11-08T13:56:14Z [load_day 2025-09-20] 2025-09-20 hour 13: 160291 events in 0 files, snapshot none (task 6679 ms: download 3994 ms overlapping gunzip 1091 ms, parse 4237 ms, sort 0 ms, write 0 ms, index 566 ms: 12 candidates, 79257 repo-hours, 598 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:56:21Z [load_day 2025-09-20] 2025-09-20 hour 14: 159666 events in 0 files, snapshot none (task 6825 ms: download 4156 ms overlapping gunzip 992 ms, parse 4099 ms, sort 0 ms, write 0 ms, index 565 ms: 7 candidates, 69880 repo-hours, 775 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:56:21Z [load_day 2025-09-20] 2025-09-20 hour 15: 160488 events in 0 files, snapshot none (task 6663 ms: download 3726 ms overlapping gunzip 940 ms, parse 4144 ms, sort 0 ms, write 0 ms, index 781 ms: 8 candidates, 71598 repo-hours, 756 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:56:28Z [load_day 2025-09-20] 2025-09-20 hour 16: 158959 events in 0 files, snapshot none (task 6196 ms: download 3259 ms overlapping gunzip 915 ms, parse 3812 ms, sort 0 ms, write 0 ms, index 605 ms: 10 candidates, 71717 repo-hours, 731 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:56:28Z [load_day 2025-09-20] 2025-09-20 hour 17: 159469 events in 0 files, snapshot none (task 5749 ms: download 3138 ms overlapping gunzip 815 ms, parse 3461 ms, sort 0 ms, write 0 ms, index 670 ms: 4 candidates, 65902 repo-hours, 728 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:56:35Z [load_day 2025-09-20] 2025-09-20 hour 18: 161951 events in 0 files, snapshot none (task 5713 ms: download 2998 ms overlapping gunzip 858 ms, parse 3423 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 75717 repo-hours, 731 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:56:35Z [load_day 2025-09-20] 2025-09-20 hour 19: 151624 events in 0 files, snapshot none (task 5642 ms: download 2976 ms overlapping gunzip 786 ms, parse 3376 ms, sort 0 ms, write 0 ms, index 709 ms: 7 candidates, 61015 repo-hours, 620 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:56:41Z [load_day 2025-09-20] 2025-09-20 hour 20: 149455 events in 0 files, snapshot none (task 5613 ms: download 3169 ms overlapping gunzip 751 ms, parse 3385 ms, sort 0 ms, write 0 ms, index 547 ms: 3 candidates, 61060 repo-hours, 671 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:56:41Z [load_day 2025-09-20] 2025-09-20 hour 21: 147497 events in 0 files, snapshot none (task 5251 ms: download 2838 ms overlapping gunzip 743 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 490 ms: 4 candidates, 57152 repo-hours, 767 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:56:47Z [load_day 2025-09-20] 2025-09-20 hour 22: 138644 events in 0 files, snapshot none (task 5537 ms: download 2587 ms overlapping gunzip 817 ms, parse 3315 ms, sort 0 ms, write 0 ms, index 532 ms: 9 candidates, 53702 repo-hours, 754 releases; waiting 550 ms; commit 0 ms)
2026-11-08T13:56:47Z [load_day 2025-09-20] 2025-09-20 hour 23: 137110 events in 0 files, snapshot none (task 5841 ms: download 3114 ms overlapping gunzip 891 ms, parse 3717 ms, sort 0 ms, write 0 ms, index 535 ms: 8 candidates, 49862 repo-hours, 679 releases; waiting 352 ms; commit 0 ms)
2026-11-08T13:56:54Z [load_day 2025-09-20] 2025-09-20: repo_hour merged from 24 files to 1 (1605258 rows, 7270 ms)
2026-11-08T13:56:57Z [load_day 2025-09-20] 2025-09-20: index committed in 10049 ms (24 + 1 + 24 files)
2026-11-08T13:56:57Z [load_day 2025-09-20] 2025-09-20: 3643855 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:56:57Z [load_day 2025-09-20] attempt 1 succeeded