orcaLog in

Runs · run 4229

load_day 2025-08-03, attempt 1 succeeded

Host
73ccef5e07c2:354758
Started
2026-11-08T13:13:00Z
Ended
2026-11-08T13:14:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
621 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
115.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4229/load_day/2025-08-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:13:00Z [load_day 2025-08-03] attempt 1 started
2026-11-08T13:13:01Z [load_day 2025-08-03] 2025-08-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:13:06Z [load_day 2025-08-03] 2025-08-03 hour 0: 126248 events in 0 files, snapshot none (task 4289 ms: download 2328 ms overlapping gunzip 583 ms, parse 2556 ms, sort 0 ms, write 0 ms, index 396 ms: 4 candidates, 52693 repo-hours, 1047 releases; waiting 456 ms; commit 0 ms)
2026-11-08T13:13:06Z [load_day 2025-08-03] 2025-08-03 hour 1: 139292 events in 0 files, snapshot none (task 4525 ms: download 2625 ms overlapping gunzip 586 ms, parse 2393 ms, sort 0 ms, write 0 ms, index 880 ms: 1 candidates, 76720 repo-hours, 732 releases; waiting 402 ms; commit 0 ms)
2026-11-08T13:13:11Z [load_day 2025-08-03] 2025-08-03 hour 2: 139545 events in 0 files, snapshot none (task 4743 ms: download 2208 ms overlapping gunzip 716 ms, parse 3054 ms, sort 0 ms, write 0 ms, index 504 ms: 1 candidates, 65468 repo-hours, 835 releases; waiting 176 ms; commit 0 ms)
2026-11-08T13:13:11Z [load_day 2025-08-03] 2025-08-03 hour 3: 129184 events in 0 files, snapshot none (task 4984 ms: download 2587 ms overlapping gunzip 741 ms, parse 3225 ms, sort 0 ms, write 0 ms, index 383 ms: 3 candidates, 51460 repo-hours, 894 releases; waiting 332 ms; commit 0 ms)
2026-11-08T13:13:17Z [load_day 2025-08-03] 2025-08-03 hour 4: 136700 events in 0 files, snapshot none (task 5471 ms: download 2795 ms overlapping gunzip 820 ms, parse 3345 ms, sort 0 ms, write 0 ms, index 531 ms: 7 candidates, 56910 repo-hours, 2058 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:13:17Z [load_day 2025-08-03] 2025-08-03 hour 5: 135532 events in 0 files, snapshot none (task 5109 ms: download 2608 ms overlapping gunzip 713 ms, parse 3161 ms, sort 0 ms, write 0 ms, index 413 ms: 7 candidates, 54684 repo-hours, 658 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:13:23Z [load_day 2025-08-03] 2025-08-03 hour 6: 144652 events in 0 files, snapshot none (task 5723 ms: download 3077 ms overlapping gunzip 815 ms, parse 3480 ms, sort 0 ms, write 0 ms, index 603 ms: 11 candidates, 65474 repo-hours, 816 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:13:23Z [load_day 2025-08-03] 2025-08-03 hour 7: 144100 events in 0 files, snapshot none (task 5458 ms: download 3841 ms overlapping gunzip 803 ms, parse 3380 ms, sort 0 ms, write 0 ms, index 516 ms: 7 candidates, 57654 repo-hours, 618 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:13:29Z [load_day 2025-08-03] 2025-08-03 hour 8: 144132 events in 0 files, snapshot none (task 5474 ms: download 3052 ms overlapping gunzip 768 ms, parse 3288 ms, sort 0 ms, write 0 ms, index 544 ms: 8 candidates, 61958 repo-hours, 768 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:13:29Z [load_day 2025-08-03] 2025-08-03 hour 9: 145207 events in 0 files, snapshot none (task 5589 ms: download 3232 ms overlapping gunzip 781 ms, parse 3291 ms, sort 0 ms, write 0 ms, index 622 ms: 7 candidates, 62393 repo-hours, 882 releases; waiting 624 ms; commit 0 ms)
2026-11-08T13:13:36Z [load_day 2025-08-03] 2025-08-03 hour 10: 148744 events in 0 files, snapshot none (task 5940 ms: download 3231 ms overlapping gunzip 846 ms, parse 3567 ms, sort 0 ms, write 0 ms, index 713 ms: 8 candidates, 62928 repo-hours, 700 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:13:37Z [load_day 2025-08-03] 2025-08-03 hour 11: 145912 events in 0 files, snapshot none (task 6936 ms: download 3767 ms overlapping gunzip 991 ms, parse 4212 ms, sort 0 ms, write 0 ms, index 460 ms: 5 candidates, 60077 repo-hours, 728 releases; waiting 589 ms; commit 0 ms)
2026-11-08T13:13:42Z [load_day 2025-08-03] 2025-08-03 hour 12: 158202 events in 0 files, snapshot none (task 5582 ms: download 2938 ms overlapping gunzip 715 ms, parse 3291 ms, sort 0 ms, write 0 ms, index 733 ms: 6 candidates, 87964 repo-hours, 823 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:13:43Z [load_day 2025-08-03] 2025-08-03 hour 13: 157544 events in 0 files, snapshot none (task 5490 ms: download 3113 ms overlapping gunzip 746 ms, parse 3227 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 81331 repo-hours, 715 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:13:47Z [load_day 2025-08-03] 2025-08-03 hour 14: 154617 events in 0 files, snapshot none (task 4860 ms: download 2616 ms overlapping gunzip 675 ms, parse 2693 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 69114 repo-hours, 852 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:13:49Z [load_day 2025-08-03] 2025-08-03 hour 15: 155992 events in 0 files, snapshot none (task 5188 ms: download 4148 ms overlapping gunzip 697 ms, parse 2801 ms, sort 0 ms, write 0 ms, index 608 ms: 3 candidates, 71169 repo-hours, 893 releases; waiting 806 ms; commit 0 ms)
2026-11-08T13:13:55Z [load_day 2025-08-03] 2025-08-03 hour 16: 157236 events in 0 files, snapshot none (task 7716 ms: download 3533 ms overlapping gunzip 1236 ms, parse 4904 ms, sort 0 ms, write 0 ms, index 736 ms: 3 candidates, 71207 repo-hours, 813 releases; waiting 540 ms; commit 0 ms)
2026-11-08T13:13:56Z [load_day 2025-08-03] 2025-08-03 hour 17: 150260 events in 0 files, snapshot none (task 7248 ms: download 3758 ms overlapping gunzip 1187 ms, parse 4738 ms, sort 0 ms, write 0 ms, index 572 ms: 5 candidates, 66083 repo-hours, 645 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:14:03Z [load_day 2025-08-03] 2025-08-03 hour 18: 149816 events in 0 files, snapshot none (task 6818 ms: download 3641 ms overlapping gunzip 1091 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 747 ms: 7 candidates, 72008 repo-hours, 812 releases; waiting 585 ms; commit 0 ms)
2026-11-08T13:14:03Z [load_day 2025-08-03] 2025-08-03 hour 19: 144663 events in 0 files, snapshot none (task 6241 ms: download 3438 ms overlapping gunzip 964 ms, parse 3849 ms, sort 0 ms, write 0 ms, index 566 ms: 12 candidates, 59497 repo-hours, 795 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:14:09Z [load_day 2025-08-03] 2025-08-03 hour 20: 143427 events in 0 files, snapshot none (task 5780 ms: download 3169 ms overlapping gunzip 852 ms, parse 3311 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 60072 repo-hours, 832 releases; waiting 685 ms; commit 0 ms)
2026-11-08T13:14:10Z [load_day 2025-08-03] 2025-08-03 hour 21: 139898 events in 0 files, snapshot none (task 6413 ms: download 3100 ms overlapping gunzip 997 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 521 ms: 10 candidates, 56020 repo-hours, 856 releases; waiting 561 ms; commit 0 ms)
2026-11-08T13:14:15Z [load_day 2025-08-03] 2025-08-03 hour 22: 133703 events in 0 files, snapshot none (task 5203 ms: download 2520 ms overlapping gunzip 741 ms, parse 2883 ms, sort 0 ms, write 0 ms, index 668 ms: 10 candidates, 51488 repo-hours, 780 releases; waiting 569 ms; commit 0 ms)
2026-11-08T13:14:15Z [load_day 2025-08-03] 2025-08-03 hour 23: 132611 events in 0 files, snapshot none (task 4970 ms: download 2473 ms overlapping gunzip 755 ms, parse 2930 ms, sort 0 ms, write 0 ms, index 467 ms: 6 candidates, 50317 repo-hours, 752 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:14:23Z [load_day 2025-08-03] 2025-08-03: repo_hour merged from 24 files to 1 (1524689 rows, 7862 ms)
2026-11-08T13:14:26Z [load_day 2025-08-03] 2025-08-03: index committed in 10524 ms (24 + 1 + 24 files)
2026-11-08T13:14:26Z [load_day 2025-08-03] 2025-08-03: 3457217 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:14:26Z [load_day 2025-08-03] attempt 1 succeeded