orcaLog in

Runs · run 4918

load_day 2026-02-10, attempt 1 succeeded

Host
73ccef5e07c2:440927
Started
2026-11-08T15:16:33Z
Ended
2026-11-08T15:17:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
690 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.2 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4918/load_day/2026-02-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:16:33Z [load_day 2026-02-10] attempt 1 started
2026-11-08T15:16:34Z [load_day 2026-02-10] 2026-02-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:16:38Z [load_day 2026-02-10] 2026-02-10 hour 0: 139182 events in 0 files, snapshot none (task 3781 ms: download 1889 ms overlapping gunzip 672 ms, parse 1870 ms, sort 0 ms, write 0 ms, index 607 ms: 13 candidates, 68491 repo-hours, 920 releases; waiting 394 ms; commit 0 ms)
2026-11-08T15:16:39Z [load_day 2026-02-10] 2026-02-10 hour 1: 146203 events in 0 files, snapshot none (task 3935 ms: download 2099 ms overlapping gunzip 674 ms, parse 2013 ms, sort 0 ms, write 0 ms, index 593 ms: 10 candidates, 83235 repo-hours, 705 releases; waiting 289 ms; commit 0 ms)
2026-11-08T15:16:43Z [load_day 2026-02-10] 2026-02-10 hour 2: 145303 events in 0 files, snapshot none (task 3925 ms: download 1981 ms overlapping gunzip 578 ms, parse 1814 ms, sort 0 ms, write 0 ms, index 650 ms: 5 candidates, 88368 repo-hours, 696 releases; waiting 317 ms; commit 0 ms)
2026-11-08T15:16:43Z [load_day 2026-02-10] 2026-02-10 hour 3: 141520 events in 0 files, snapshot none (task 4041 ms: download 2511 ms overlapping gunzip 568 ms, parse 1727 ms, sort 0 ms, write 0 ms, index 536 ms: 4 candidates, 71372 repo-hours, 857 releases; waiting 835 ms; commit 0 ms)
2026-11-08T15:16:47Z [load_day 2026-02-10] 2026-02-10 hour 4: 137449 events in 0 files, snapshot none (task 3582 ms: download 2184 ms overlapping gunzip 531 ms, parse 1543 ms, sort 0 ms, write 0 ms, index 614 ms: 8 candidates, 68688 repo-hours, 793 releases; waiting 569 ms; commit 0 ms)
2026-11-08T15:16:47Z [load_day 2026-02-10] 2026-02-10 hour 5: 143020 events in 0 files, snapshot none (task 3802 ms: download 2222 ms overlapping gunzip 595 ms, parse 1668 ms, sort 0 ms, write 0 ms, index 579 ms: 5 candidates, 76790 repo-hours, 1398 releases; waiting 613 ms; commit 0 ms)
2026-11-08T15:16:52Z [load_day 2026-02-10] 2026-02-10 hour 6: 142634 events in 0 files, snapshot none (task 4264 ms: download 2250 ms overlapping gunzip 700 ms, parse 2069 ms, sort 0 ms, write 0 ms, index 658 ms: 5 candidates, 75889 repo-hours, 724 releases; waiting 528 ms; commit 0 ms)
2026-11-08T15:16:52Z [load_day 2026-02-10] 2026-02-10 hour 7: 145573 events in 0 files, snapshot none (task 4055 ms: download 2440 ms overlapping gunzip 654 ms, parse 1905 ms, sort 0 ms, write 0 ms, index 644 ms: 4 candidates, 79088 repo-hours, 697 releases; waiting 556 ms; commit 0 ms)
2026-11-08T15:16:56Z [load_day 2026-02-10] 2026-02-10 hour 8: 135759 events in 0 files, snapshot none (task 3867 ms: download 2631 ms overlapping gunzip 624 ms, parse 1702 ms, sort 0 ms, write 0 ms, index 578 ms: 8 candidates, 72066 repo-hours, 706 releases; waiting 586 ms; commit 0 ms)
2026-11-08T15:16:56Z [load_day 2026-02-10] 2026-02-10 hour 9: 136326 events in 0 files, snapshot none (task 3783 ms: download 2433 ms overlapping gunzip 641 ms, parse 1701 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 77491 repo-hours, 728 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:17:00Z [load_day 2026-02-10] 2026-02-10 hour 10: 131083 events in 0 files, snapshot none (task 3751 ms: download 2017 ms overlapping gunzip 587 ms, parse 1682 ms, sort 0 ms, write 0 ms, index 613 ms: 7 candidates, 75421 repo-hours, 738 releases; waiting 525 ms; commit 0 ms)
2026-11-08T15:17:00Z [load_day 2026-02-10] 2026-02-10 hour 11: 135095 events in 0 files, snapshot none (task 3783 ms: download 1945 ms overlapping gunzip 642 ms, parse 1802 ms, sort 0 ms, write 0 ms, index 586 ms: 5 candidates, 76433 repo-hours, 800 releases; waiting 443 ms; commit 0 ms)
2026-11-08T15:17:04Z [load_day 2026-02-10] 2026-02-10 hour 12: 138480 events in 0 files, snapshot none (task 3341 ms: download 1874 ms overlapping gunzip 463 ms, parse 1283 ms, sort 0 ms, write 0 ms, index 712 ms: 6 candidates, 81877 repo-hours, 680 releases; waiting 633 ms; commit 0 ms)
2026-11-08T15:17:04Z [load_day 2026-02-10] 2026-02-10 hour 13: 142559 events in 0 files, snapshot none (task 3427 ms: download 2169 ms overlapping gunzip 397 ms, parse 1198 ms, sort 0 ms, write 0 ms, index 855 ms: 8 candidates, 89167 repo-hours, 416 releases; waiting 684 ms; commit 0 ms)
2026-11-08T15:17:09Z [load_day 2026-02-10] 2026-02-10 hour 14: 130105 events in 0 files, snapshot none (task 4217 ms: download 1786 ms overlapping gunzip 656 ms, parse 1927 ms, sort 0 ms, write 0 ms, index 961 ms: 7 candidates, 80061 repo-hours, 633 releases; waiting 313 ms; commit 0 ms)
2026-11-08T15:17:09Z [load_day 2026-02-10] 2026-02-10 hour 15: 118097 events in 0 files, snapshot none (task 4401 ms: download 2121 ms overlapping gunzip 683 ms, parse 2049 ms, sort 0 ms, write 0 ms, index 703 ms: 9 candidates, 71652 repo-hours, 793 releases; waiting 673 ms; commit 0 ms)
2026-11-08T15:17:14Z [load_day 2026-02-10] 2026-02-10 hour 16: 115158 events in 0 files, snapshot none (task 4348 ms: download 2404 ms overlapping gunzip 640 ms, parse 1763 ms, sort 0 ms, write 0 ms, index 861 ms: 8 candidates, 71193 repo-hours, 660 releases; waiting 763 ms; commit 0 ms)
2026-11-08T15:17:14Z [load_day 2026-02-10] 2026-02-10 hour 17: 113387 events in 0 files, snapshot none (task 4586 ms: download 2680 ms overlapping gunzip 624 ms, parse 1722 ms, sort 0 ms, write 0 ms, index 907 ms: 9 candidates, 67830 repo-hours, 490 releases; waiting 1041 ms; commit 0 ms)
2026-11-08T15:17:18Z [load_day 2026-02-10] 2026-02-10 hour 18: 121409 events in 0 files, snapshot none (task 3707 ms: download 1575 ms overlapping gunzip 496 ms, parse 1478 ms, sort 0 ms, write 0 ms, index 971 ms: 7 candidates, 70946 repo-hours, 456 releases; waiting 368 ms; commit 0 ms)
2026-11-08T15:17:19Z [load_day 2026-02-10] 2026-02-10 hour 19: 131992 events in 0 files, snapshot none (task 3876 ms: download 1946 ms overlapping gunzip 529 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 910 ms: 4 candidates, 74965 repo-hours, 574 releases; waiting 519 ms; commit 0 ms)
2026-11-08T15:17:22Z [load_day 2026-02-10] 2026-02-10 hour 20: 129061 events in 0 files, snapshot none (task 3083 ms: download 2029 ms overlapping gunzip 376 ms, parse 1023 ms, sort 0 ms, write 0 ms, index 580 ms: 9 candidates, 67995 repo-hours, 662 releases; waiting 774 ms; commit 0 ms)
2026-11-08T15:17:22Z [load_day 2026-02-10] 2026-02-10 hour 21: 121826 events in 0 files, snapshot none (task 2804 ms: download 1570 ms overlapping gunzip 350 ms, parse 1075 ms, sort 0 ms, write 0 ms, index 530 ms: 9 candidates, 64119 repo-hours, 657 releases; waiting 527 ms; commit 0 ms)
2026-11-08T15:17:26Z [load_day 2026-02-10] 2026-02-10 hour 22: 120977 events in 0 files, snapshot none (task 3176 ms: download 2090 ms overlapping gunzip 405 ms, parse 1193 ms, sort 0 ms, write 0 ms, index 519 ms: 4 candidates, 62789 repo-hours, 754 releases; waiting 769 ms; commit 0 ms)
2026-11-08T15:17:26Z [load_day 2026-02-10] 2026-02-10 hour 23: 113568 events in 0 files, snapshot none (task 3791 ms: download 2883 ms overlapping gunzip 440 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 419 ms: 4 candidates, 57847 repo-hours, 892 releases; waiting 1375 ms; commit 0 ms)
2026-11-08T15:17:34Z [load_day 2026-02-10] 2026-02-10: repo_hour merged from 24 files to 1 (1773773 rows, 7760 ms)
2026-11-08T15:17:37Z [load_day 2026-02-10] 2026-02-10: index committed in 10916 ms (24 + 1 + 24 files)
2026-11-08T15:17:37Z [load_day 2026-02-10] 2026-02-10: 3175766 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:17:37Z [load_day 2026-02-10] attempt 1 succeeded