orcaLog in

Runs · run 4441

load_day 2025-09-26, attempt 1 succeeded

Host
73ccef5e07c2:385640
Started
2026-11-08T14:00:51Z
Ended
2026-11-08T14:02:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
705 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
150.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4441/load_day/2025-09-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:00:51Z [load_day 2025-09-26] attempt 1 started
2026-11-08T14:00:52Z [load_day 2025-09-26] 2025-09-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:00:58Z [load_day 2025-09-26] 2025-09-26 hour 0: 152685 events in 0 files, snapshot none (task 5731 ms: download 3150 ms overlapping gunzip 720 ms, parse 2924 ms, sort 0 ms, write 0 ms, index 971 ms: 7 candidates, 76171 repo-hours, 1047 releases; waiting 815 ms; commit 0 ms)
2026-11-08T14:00:58Z [load_day 2025-09-26] 2025-09-26 hour 1: 166511 events in 0 files, snapshot none (task 5776 ms: download 3649 ms overlapping gunzip 698 ms, parse 2875 ms, sort 0 ms, write 0 ms, index 1085 ms: 7 candidates, 97478 repo-hours, 725 releases; waiting 785 ms; commit 0 ms)
2026-11-08T14:01:06Z [load_day 2025-09-26] 2025-09-26 hour 2: 153877 events in 0 files, snapshot none (task 6230 ms: download 3914 ms overlapping gunzip 984 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 571 ms: 6 candidates, 73544 repo-hours, 742 releases; waiting 669 ms; commit 0 ms)
2026-11-08T14:01:06Z [load_day 2025-09-26] 2025-09-26 hour 3: 156912 events in 0 files, snapshot none (task 6027 ms: download 3722 ms overlapping gunzip 909 ms, parse 3667 ms, sort 0 ms, write 0 ms, index 579 ms: 6 candidates, 68273 repo-hours, 1805 releases; waiting 642 ms; commit 0 ms)
2026-11-08T14:01:14Z [load_day 2025-09-26] 2025-09-26 hour 4: 157368 events in 0 files, snapshot none (task 7258 ms: download 4485 ms overlapping gunzip 1159 ms, parse 4638 ms, sort 0 ms, write 0 ms, index 618 ms: 5 candidates, 65783 repo-hours, 645 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:01:14Z [load_day 2025-09-26] 2025-09-26 hour 5: 154374 events in 0 files, snapshot none (task 7426 ms: download 4781 ms overlapping gunzip 1167 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 65140 repo-hours, 742 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:01:23Z [load_day 2025-09-26] 2025-09-26 hour 6: 162011 events in 0 files, snapshot none (task 8217 ms: download 5304 ms overlapping gunzip 1275 ms, parse 5471 ms, sort 0 ms, write 0 ms, index 682 ms: 9 candidates, 80390 repo-hours, 644 releases; waiting 472 ms; commit 0 ms)
2026-11-08T14:01:23Z [load_day 2025-09-26] 2025-09-26 hour 7: 160783 events in 0 files, snapshot none (task 8001 ms: download 5047 ms overlapping gunzip 1346 ms, parse 5364 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 74219 repo-hours, 728 releases; waiting 483 ms; commit 0 ms)
2026-11-08T14:01:33Z [load_day 2025-09-26] 2025-09-26 hour 8: 161769 events in 0 files, snapshot none (task 8016 ms: download 4803 ms overlapping gunzip 1184 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 572 ms: 10 candidates, 76903 repo-hours, 810 releases; waiting 896 ms; commit 0 ms)
2026-11-08T14:01:33Z [load_day 2025-09-26] 2025-09-26 hour 9: 166980 events in 0 files, snapshot none (task 7481 ms: download 4671 ms overlapping gunzip 1158 ms, parse 4637 ms, sort 0 ms, write 0 ms, index 895 ms: 13 candidates, 81629 repo-hours, 832 releases; waiting 500 ms; commit 0 ms)
2026-11-08T14:01:41Z [load_day 2025-09-26] 2025-09-26 hour 10: 167343 events in 0 files, snapshot none (task 7922 ms: download 5092 ms overlapping gunzip 1157 ms, parse 4999 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 79133 repo-hours, 760 releases; waiting 679 ms; commit 0 ms)
2026-11-08T14:01:41Z [load_day 2025-09-26] 2025-09-26 hour 11: 169780 events in 0 files, snapshot none (task 7896 ms: download 5080 ms overlapping gunzip 1237 ms, parse 4831 ms, sort 0 ms, write 0 ms, index 630 ms: 9 candidates, 74951 repo-hours, 797 releases; waiting 730 ms; commit 0 ms)
2026-11-08T14:01:49Z [load_day 2025-09-26] 2025-09-26 hour 12: 173739 events in 0 files, snapshot none (task 7555 ms: download 4754 ms overlapping gunzip 1167 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 731 ms: 14 candidates, 99972 repo-hours, 781 releases; waiting 496 ms; commit 0 ms)
2026-11-08T14:01:49Z [load_day 2025-09-26] 2025-09-26 hour 13: 163724 events in 0 files, snapshot none (task 7394 ms: download 4860 ms overlapping gunzip 1167 ms, parse 5049 ms, sort 0 ms, write 0 ms, index 626 ms: 9 candidates, 88484 repo-hours, 702 releases; waiting 247 ms; commit 0 ms)
2026-11-08T14:01:57Z [load_day 2025-09-26] 2025-09-26 hour 14: 166011 events in 0 files, snapshot none (task 7264 ms: download 4530 ms overlapping gunzip 1128 ms, parse 4550 ms, sort 0 ms, write 0 ms, index 749 ms: 6 candidates, 81525 repo-hours, 732 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:01:57Z [load_day 2025-09-26] 2025-09-26 hour 15: 170164 events in 0 files, snapshot none (task 6792 ms: download 4088 ms overlapping gunzip 1079 ms, parse 4334 ms, sort 0 ms, write 0 ms, index 736 ms: 3 candidates, 82454 repo-hours, 1034 releases; waiting 290 ms; commit 0 ms)
2026-11-08T14:02:04Z [load_day 2025-09-26] 2025-09-26 hour 16: 167748 events in 0 files, snapshot none (task 6373 ms: download 3752 ms overlapping gunzip 952 ms, parse 3845 ms, sort 0 ms, write 0 ms, index 682 ms: 15 candidates, 80522 repo-hours, 780 releases; waiting 591 ms; commit 0 ms)
2026-11-08T14:02:04Z [load_day 2025-09-26] 2025-09-26 hour 17: 162229 events in 0 files, snapshot none (task 6134 ms: download 3428 ms overlapping gunzip 923 ms, parse 3859 ms, sort 0 ms, write 0 ms, index 731 ms: 9 candidates, 74340 repo-hours, 689 releases; waiting 323 ms; commit 0 ms)
2026-11-08T14:02:12Z [load_day 2025-09-26] 2025-09-26 hour 18: 166174 events in 0 files, snapshot none (task 7789 ms: download 4695 ms overlapping gunzip 1058 ms, parse 4247 ms, sort 0 ms, write 0 ms, index 565 ms: 9 candidates, 81690 repo-hours, 799 releases; waiting 1530 ms; commit 0 ms)
2026-11-08T14:02:12Z [load_day 2025-09-26] 2025-09-26 hour 19: 162632 events in 0 files, snapshot none (task 6780 ms: download 5072 ms overlapping gunzip 898 ms, parse 3663 ms, sort 0 ms, write 0 ms, index 981 ms: 9 candidates, 69323 repo-hours, 659 releases; waiting 900 ms; commit 0 ms)
2026-11-08T14:02:20Z [load_day 2025-09-26] 2025-09-26 hour 20: 162486 events in 0 files, snapshot none (task 6951 ms: download 3909 ms overlapping gunzip 1071 ms, parse 4549 ms, sort 0 ms, write 0 ms, index 599 ms: 10 candidates, 72447 repo-hours, 752 releases; waiting 403 ms; commit 0 ms)
2026-11-08T14:02:20Z [load_day 2025-09-26] 2025-09-26 hour 21: 158732 events in 0 files, snapshot none (task 6816 ms: download 4190 ms overlapping gunzip 1066 ms, parse 4287 ms, sort 0 ms, write 0 ms, index 514 ms: 19 candidates, 66592 repo-hours, 765 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:02:26Z [load_day 2025-09-26] 2025-09-26 hour 22: 146719 events in 0 files, snapshot none (task 5767 ms: download 3580 ms overlapping gunzip 832 ms, parse 3468 ms, sort 0 ms, write 0 ms, index 443 ms: 3 candidates, 57773 repo-hours, 1054 releases; waiting 614 ms; commit 0 ms)
2026-11-08T14:02:26Z [load_day 2025-09-26] 2025-09-26 hour 23: 148170 events in 0 files, snapshot none (task 5537 ms: download 3137 ms overlapping gunzip 833 ms, parse 3470 ms, sort 0 ms, write 0 ms, index 478 ms: 7 candidates, 57320 repo-hours, 1053 releases; waiting 498 ms; commit 0 ms)
2026-11-08T14:02:34Z [load_day 2025-09-26] 2025-09-26: repo_hour merged from 24 files to 1 (1826056 rows, 7772 ms)
2026-11-08T14:02:37Z [load_day 2025-09-26] 2025-09-26: index committed in 11283 ms (24 + 1 + 24 files)
2026-11-08T14:02:37Z [load_day 2025-09-26] 2025-09-26: 3878921 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:02:37Z [load_day 2025-09-26] attempt 1 succeeded