orcaLog in

Runs · run 4878

load_day 2026-01-29, attempt 1 succeeded

Host
73ccef5e07c2:436291
Started
2026-11-08T15:10:09Z
Ended
2026-11-08T15:11:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.7 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4878/load_day/2026-01-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:10:09Z [load_day 2026-01-29] attempt 1 started
2026-11-08T15:10:10Z [load_day 2026-01-29] 2026-01-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:10:14Z [load_day 2026-01-29] 2026-01-29 hour 0: 144957 events in 0 files, snapshot none (task 4037 ms: download 2298 ms overlapping gunzip 572 ms, parse 1660 ms, sort 0 ms, write 0 ms, index 594 ms: 6 candidates, 72240 repo-hours, 903 releases; waiting 677 ms; commit 0 ms)
2026-11-08T15:10:14Z [load_day 2026-01-29] 2026-01-29 hour 1: 150341 events in 0 files, snapshot none (task 3984 ms: download 2551 ms overlapping gunzip 477 ms, parse 1488 ms, sort 0 ms, write 0 ms, index 643 ms: 12 candidates, 88792 repo-hours, 677 releases; waiting 832 ms; commit 0 ms)
2026-11-08T15:10:18Z [load_day 2026-01-29] 2026-01-29 hour 2: 148300 events in 0 files, snapshot none (task 3242 ms: download 2136 ms overlapping gunzip 414 ms, parse 1231 ms, sort 0 ms, write 0 ms, index 640 ms: 10 candidates, 81720 repo-hours, 736 releases; waiting 613 ms; commit 0 ms)
2026-11-08T15:10:19Z [load_day 2026-01-29] 2026-01-29 hour 3: 144951 events in 0 files, snapshot none (task 3597 ms: download 2569 ms overlapping gunzip 469 ms, parse 1377 ms, sort 0 ms, write 0 ms, index 517 ms: 11 candidates, 69855 repo-hours, 872 releases; waiting 921 ms; commit 0 ms)
2026-11-08T15:10:22Z [load_day 2026-01-29] 2026-01-29 hour 4: 142506 events in 0 files, snapshot none (task 3676 ms: download 2345 ms overlapping gunzip 462 ms, parse 1336 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 72451 repo-hours, 1469 releases; waiting 930 ms; commit 0 ms)
2026-11-08T15:10:23Z [load_day 2026-01-29] 2026-01-29 hour 5: 148066 events in 0 files, snapshot none (task 3612 ms: download 2565 ms overlapping gunzip 511 ms, parse 1435 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 76650 repo-hours, 790 releases; waiting 741 ms; commit 0 ms)
2026-11-08T15:10:26Z [load_day 2026-01-29] 2026-01-29 hour 6: 145570 events in 0 files, snapshot none (task 3090 ms: download 2005 ms overlapping gunzip 422 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 619 ms: 7 candidates, 76728 repo-hours, 686 releases; waiting 632 ms; commit 0 ms)
2026-11-08T15:10:27Z [load_day 2026-01-29] 2026-01-29 hour 7: 147439 events in 0 files, snapshot none (task 3404 ms: download 2171 ms overlapping gunzip 388 ms, parse 1177 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 77648 repo-hours, 671 releases; waiting 878 ms; commit 0 ms)
2026-11-08T15:10:30Z [load_day 2026-01-29] 2026-01-29 hour 8: 151285 events in 0 files, snapshot none (task 3314 ms: download 2065 ms overlapping gunzip 355 ms, parse 1110 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 76543 repo-hours, 530 releases; waiting 859 ms; commit 0 ms)
2026-11-08T15:10:31Z [load_day 2026-01-29] 2026-01-29 hour 9: 147141 events in 0 files, snapshot none (task 3550 ms: download 2404 ms overlapping gunzip 378 ms, parse 1128 ms, sort 0 ms, write 0 ms, index 621 ms: 8 candidates, 81177 repo-hours, 637 releases; waiting 1066 ms; commit 0 ms)
2026-11-08T15:10:34Z [load_day 2026-01-29] 2026-01-29 hour 10: 144876 events in 0 files, snapshot none (task 4366 ms: download 2841 ms overlapping gunzip 414 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 630 ms: 7 candidates, 78626 repo-hours, 646 releases; waiting 1784 ms; commit 0 ms)
2026-11-08T15:10:34Z [load_day 2026-01-29] 2026-01-29 hour 11: 146572 events in 0 files, snapshot none (task 3272 ms: download 2040 ms overlapping gunzip 413 ms, parse 1165 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 78834 repo-hours, 615 releases; waiting 808 ms; commit 0 ms)
2026-11-08T15:10:37Z [load_day 2026-01-29] 2026-01-29 hour 12: 155146 events in 0 files, snapshot none (task 2693 ms: download 1298 ms overlapping gunzip 302 ms, parse 941 ms, sort 0 ms, write 0 ms, index 851 ms: 3 candidates, 94609 repo-hours, 430 releases; waiting 296 ms; commit 0 ms)
2026-11-08T15:10:39Z [load_day 2026-01-29] 2026-01-29 hour 13: 155648 events in 0 files, snapshot none (task 3650 ms: download 1944 ms overlapping gunzip 366 ms, parse 1349 ms, sort 0 ms, write 0 ms, index 982 ms: 7 candidates, 96577 repo-hours, 250 releases; waiting 625 ms; commit 0 ms)
2026-11-08T15:10:41Z [load_day 2026-01-29] 2026-01-29 hour 14: 145720 events in 0 files, snapshot none (task 3198 ms: download 1885 ms overlapping gunzip 348 ms, parse 1068 ms, sort 0 ms, write 0 ms, index 759 ms: 10 candidates, 83189 repo-hours, 553 releases; waiting 657 ms; commit 0 ms)
2026-11-08T15:10:42Z [load_day 2026-01-29] 2026-01-29 hour 15: 146461 events in 0 files, snapshot none (task 3110 ms: download 1851 ms overlapping gunzip 346 ms, parse 1122 ms, sort 0 ms, write 0 ms, index 714 ms: 12 candidates, 84176 repo-hours, 603 releases; waiting 561 ms; commit 0 ms)
2026-11-08T15:10:46Z [load_day 2026-01-29] 2026-01-29 hour 16: 148673 events in 0 files, snapshot none (task 3831 ms: download 2389 ms overlapping gunzip 506 ms, parse 1477 ms, sort 0 ms, write 0 ms, index 731 ms: 9 candidates, 84508 repo-hours, 441 releases; waiting 685 ms; commit 0 ms)
2026-11-08T15:10:46Z [load_day 2026-01-29] 2026-01-29 hour 17: 142786 events in 0 files, snapshot none (task 2971 ms: download 1662 ms overlapping gunzip 431 ms, parse 1185 ms, sort 0 ms, write 0 ms, index 762 ms: 10 candidates, 79243 repo-hours, 573 releases; waiting 255 ms; commit 0 ms)
2026-11-08T15:10:50Z [load_day 2026-01-29] 2026-01-29 hour 18: 147468 events in 0 files, snapshot none (task 4121 ms: download 2577 ms overlapping gunzip 474 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 744 ms: 8 candidates, 83273 repo-hours, 617 releases; waiting 1142 ms; commit 0 ms)
2026-11-08T15:10:51Z [load_day 2026-01-29] 2026-01-29 hour 19: 147224 events in 0 files, snapshot none (task 3861 ms: download 2583 ms overlapping gunzip 467 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 74039 repo-hours, 831 releases; waiting 1128 ms; commit 0 ms)
2026-11-08T15:10:54Z [load_day 2026-01-29] 2026-01-29 hour 20: 147816 events in 0 files, snapshot none (task 3486 ms: download 2432 ms overlapping gunzip 416 ms, parse 1210 ms, sort 0 ms, write 0 ms, index 573 ms: 9 candidates, 76621 repo-hours, 735 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T15:10:55Z [load_day 2026-01-29] 2026-01-29 hour 21: 144296 events in 0 files, snapshot none (task 3906 ms: download 2555 ms overlapping gunzip 444 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 569 ms: 5 candidates, 72866 repo-hours, 825 releases; waiting 1250 ms; commit 0 ms)
2026-11-08T15:10:58Z [load_day 2026-01-29] 2026-01-29 hour 22: 147072 events in 0 files, snapshot none (task 2825 ms: download 1642 ms overlapping gunzip 388 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 671 ms: 7 candidates, 72604 repo-hours, 854 releases; waiting 273 ms; commit 0 ms)
2026-11-08T15:10:59Z [load_day 2026-01-29] 2026-01-29 hour 23: 142626 events in 0 files, snapshot none (task 3143 ms: download 2135 ms overlapping gunzip 402 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 498 ms: 11 candidates, 65564 repo-hours, 975 releases; waiting 690 ms; commit 0 ms)
2026-11-08T15:11:07Z [load_day 2026-01-29] 2026-01-29: repo_hour merged from 24 files to 1 (1898533 rows, 8665 ms)
2026-11-08T15:11:10Z [load_day 2026-01-29] 2026-01-29: index committed in 11654 ms (24 + 1 + 24 files)
2026-11-08T15:11:10Z [load_day 2026-01-29] 2026-01-29: 3532940 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:11:10Z [load_day 2026-01-29] attempt 1 succeeded