orcaLog in

Runs · run 4780

load_day 2026-01-02, attempt 1 succeeded

Host
73ccef5e07c2:424462
Started
2026-11-08T14:55:14Z
Ended
2026-11-08T14:56:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
714 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.0 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4780/load_day/2026-01-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:55:14Z [load_day 2026-01-02] attempt 1 started
2026-11-08T14:55:15Z [load_day 2026-01-02] 2026-01-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:55:19Z [load_day 2026-01-02] 2026-01-02 hour 0: 141755 events in 0 files, snapshot none (task 3272 ms: download 1701 ms overlapping gunzip 498 ms, parse 1534 ms, sort 0 ms, write 0 ms, index 539 ms: 12 candidates, 68244 repo-hours, 831 releases; waiting 377 ms; commit 0 ms)
2026-11-08T14:55:19Z [load_day 2026-01-02] 2026-01-02 hour 1: 146607 events in 0 files, snapshot none (task 3591 ms: download 2181 ms overlapping gunzip 454 ms, parse 1460 ms, sort 0 ms, write 0 ms, index 734 ms: 13 candidates, 82602 repo-hours, 764 releases; waiting 643 ms; commit 0 ms)
2026-11-08T14:55:23Z [load_day 2026-01-02] 2026-01-02 hour 2: 142452 events in 0 files, snapshot none (task 3426 ms: download 1888 ms overlapping gunzip 475 ms, parse 1489 ms, sort 0 ms, write 0 ms, index 600 ms: 9 candidates, 71678 repo-hours, 633 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:55:23Z [load_day 2026-01-02] 2026-01-02 hour 3: 139467 events in 0 files, snapshot none (task 3267 ms: download 1954 ms overlapping gunzip 464 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 572 ms: 6 candidates, 63405 repo-hours, 739 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:55:27Z [load_day 2026-01-02] 2026-01-02 hour 4: 140584 events in 0 files, snapshot none (task 3841 ms: download 2788 ms overlapping gunzip 494 ms, parse 1479 ms, sort 0 ms, write 0 ms, index 549 ms: 4 candidates, 66800 repo-hours, 1443 releases; waiting 987 ms; commit 0 ms)
2026-11-08T14:55:27Z [load_day 2026-01-02] 2026-01-02 hour 5: 142271 events in 0 files, snapshot none (task 3316 ms: download 1789 ms overlapping gunzip 399 ms, parse 1314 ms, sort 0 ms, write 0 ms, index 693 ms: 3 candidates, 64132 repo-hours, 558 releases; waiting 600 ms; commit 0 ms)
2026-11-08T14:55:31Z [load_day 2026-01-02] 2026-01-02 hour 6: 145933 events in 0 files, snapshot none (task 3484 ms: download 1982 ms overlapping gunzip 512 ms, parse 1577 ms, sort 0 ms, write 0 ms, index 597 ms: 5 candidates, 70798 repo-hours, 632 releases; waiting 433 ms; commit 0 ms)
2026-11-08T14:55:31Z [load_day 2026-01-02] 2026-01-02 hour 7: 145963 events in 0 files, snapshot none (task 3467 ms: download 2315 ms overlapping gunzip 522 ms, parse 1443 ms, sort 0 ms, write 0 ms, index 641 ms: 11 candidates, 67323 repo-hours, 538 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:55:35Z [load_day 2026-01-02] 2026-01-02 hour 8: 146764 events in 0 files, snapshot none (task 3615 ms: download 2268 ms overlapping gunzip 495 ms, parse 1435 ms, sort 0 ms, write 0 ms, index 656 ms: 10 candidates, 71867 repo-hours, 702 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:55:35Z [load_day 2026-01-02] 2026-01-02 hour 9: 149783 events in 0 files, snapshot none (task 3804 ms: download 1793 ms overlapping gunzip 551 ms, parse 1728 ms, sort 0 ms, write 0 ms, index 738 ms: 5 candidates, 72502 repo-hours, 774 releases; waiting 482 ms; commit 0 ms)
2026-11-08T14:55:39Z [load_day 2026-01-02] 2026-01-02 hour 10: 143664 events in 0 files, snapshot none (task 3767 ms: download 2304 ms overlapping gunzip 527 ms, parse 1642 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 70701 repo-hours, 616 releases; waiting 689 ms; commit 0 ms)
2026-11-08T14:55:39Z [load_day 2026-01-02] 2026-01-02 hour 11: 145906 events in 0 files, snapshot none (task 3607 ms: download 2137 ms overlapping gunzip 525 ms, parse 1518 ms, sort 0 ms, write 0 ms, index 725 ms: 27 candidates, 69177 repo-hours, 599 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:55:43Z [load_day 2026-01-02] 2026-01-02 hour 12: 156843 events in 0 files, snapshot none (task 3197 ms: download 1834 ms overlapping gunzip 434 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 698 ms: 5 candidates, 93670 repo-hours, 642 releases; waiting 463 ms; commit 0 ms)
2026-11-08T14:55:43Z [load_day 2026-01-02] 2026-01-02 hour 13: 150746 events in 0 files, snapshot none (task 2911 ms: download 1537 ms overlapping gunzip 387 ms, parse 1179 ms, sort 0 ms, write 0 ms, index 719 ms: 9 candidates, 85542 repo-hours, 575 releases; waiting 351 ms; commit 0 ms)
2026-11-08T14:55:48Z [load_day 2026-01-02] 2026-01-02 hour 14: 149446 events in 0 files, snapshot none (task 3984 ms: download 2403 ms overlapping gunzip 431 ms, parse 1342 ms, sort 0 ms, write 0 ms, index 575 ms: 6 candidates, 73478 repo-hours, 913 releases; waiting 1325 ms; commit 0 ms)
2026-11-08T14:55:48Z [load_day 2026-01-02] 2026-01-02 hour 15: 147692 events in 0 files, snapshot none (task 3346 ms: download 2176 ms overlapping gunzip 397 ms, parse 1209 ms, sort 0 ms, write 0 ms, index 799 ms: 5 candidates, 76728 repo-hours, 844 releases; waiting 659 ms; commit 0 ms)
2026-11-08T14:55:52Z [load_day 2026-01-02] 2026-01-02 hour 16: 151520 events in 0 files, snapshot none (task 3894 ms: download 2769 ms overlapping gunzip 436 ms, parse 1336 ms, sort 0 ms, write 0 ms, index 610 ms: 11 candidates, 76690 repo-hours, 759 releases; waiting 1259 ms; commit 0 ms)
2026-11-08T14:55:52Z [load_day 2026-01-02] 2026-01-02 hour 17: 148160 events in 0 files, snapshot none (task 3989 ms: download 2455 ms overlapping gunzip 401 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 74306 repo-hours, 905 releases; waiting 1436 ms; commit 0 ms)
2026-11-08T14:55:56Z [load_day 2026-01-02] 2026-01-02 hour 18: 151817 events in 0 files, snapshot none (task 3194 ms: download 1947 ms overlapping gunzip 380 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 644 ms: 9 candidates, 79279 repo-hours, 877 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:55:56Z [load_day 2026-01-02] 2026-01-02 hour 19: 143111 events in 0 files, snapshot none (task 2690 ms: download 1704 ms overlapping gunzip 379 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 469 ms: 5 candidates, 63835 repo-hours, 784 releases; waiting 377 ms; commit 0 ms)
2026-11-08T14:56:00Z [load_day 2026-01-02] 2026-01-02 hour 20: 148636 events in 0 files, snapshot none (task 3591 ms: download 2235 ms overlapping gunzip 430 ms, parse 1325 ms, sort 0 ms, write 0 ms, index 555 ms: 8 candidates, 67246 repo-hours, 880 releases; waiting 697 ms; commit 0 ms)
2026-11-08T14:56:00Z [load_day 2026-01-02] 2026-01-02 hour 21: 145543 events in 0 files, snapshot none (task 3466 ms: download 2373 ms overlapping gunzip 426 ms, parse 1344 ms, sort 0 ms, write 0 ms, index 503 ms: 8 candidates, 64392 repo-hours, 810 releases; waiting 753 ms; commit 0 ms)
2026-11-08T14:56:04Z [load_day 2026-01-02] 2026-01-02 hour 22: 144363 events in 0 files, snapshot none (task 3694 ms: download 2488 ms overlapping gunzip 517 ms, parse 1573 ms, sort 0 ms, write 0 ms, index 658 ms: 8 candidates, 62116 repo-hours, 807 releases; waiting 615 ms; commit 0 ms)
2026-11-08T14:56:04Z [load_day 2026-01-02] 2026-01-02 hour 23: 142629 events in 0 files, snapshot none (task 3785 ms: download 2074 ms overlapping gunzip 536 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 634 ms: 2 candidates, 62288 repo-hours, 699 releases; waiting 607 ms; commit 0 ms)
2026-11-08T14:56:11Z [load_day 2026-01-02] 2026-01-02: repo_hour merged from 24 files to 1 (1718799 rows, 7497 ms)
2026-11-08T14:56:15Z [load_day 2026-01-02] 2026-01-02: index committed in 10567 ms (24 + 1 + 24 files)
2026-11-08T14:56:15Z [load_day 2026-01-02] 2026-01-02: 3511655 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:56:15Z [load_day 2026-01-02] attempt 1 succeeded