orcaLog in

Runs · run 4211

load_day 2025-07-30, attempt 1 succeeded

Host
73ccef5e07c2:351922
Started
2026-11-08T13:09:19Z
Ended
2026-11-08T13:11:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
151.9 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4211/load_day/2025-07-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:09:19Z [load_day 2025-07-30] attempt 1 started
2026-11-08T13:09:20Z [load_day 2025-07-30] 2025-07-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:09:27Z [load_day 2025-07-30] 2025-07-30 hour 0: 143662 events in 0 files, snapshot none (task 6473 ms: download 3933 ms overlapping gunzip 975 ms, parse 4105 ms, sort 0 ms, write 0 ms, index 568 ms: 7 candidates, 68688 repo-hours, 1016 releases; waiting 488 ms; commit 0 ms)
2026-11-08T13:09:27Z [load_day 2025-07-30] 2025-07-30 hour 1: 154712 events in 0 files, snapshot none (task 6443 ms: download 3479 ms overlapping gunzip 898 ms, parse 3931 ms, sort 0 ms, write 0 ms, index 842 ms: 6 candidates, 88486 repo-hours, 758 releases; waiting 482 ms; commit 0 ms)
2026-11-08T13:09:34Z [load_day 2025-07-30] 2025-07-30 hour 2: 150021 events in 0 files, snapshot none (task 6295 ms: download 3753 ms overlapping gunzip 985 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 549 ms: 4 candidates, 76696 repo-hours, 836 releases; waiting 458 ms; commit 0 ms)
2026-11-08T13:09:34Z [load_day 2025-07-30] 2025-07-30 hour 3: 145197 events in 0 files, snapshot none (task 6028 ms: download 3260 ms overlapping gunzip 971 ms, parse 3898 ms, sort 0 ms, write 0 ms, index 534 ms: 7 candidates, 64054 repo-hours, 858 releases; waiting 297 ms; commit 0 ms)
2026-11-08T13:09:41Z [load_day 2025-07-30] 2025-07-30 hour 4: 149561 events in 0 files, snapshot none (task 6546 ms: download 3342 ms overlapping gunzip 977 ms, parse 4172 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 66252 repo-hours, 1868 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:09:42Z [load_day 2025-07-30] 2025-07-30 hour 5: 148694 events in 0 files, snapshot none (task 7136 ms: download 4656 ms overlapping gunzip 1120 ms, parse 4406 ms, sort 0 ms, write 0 ms, index 522 ms: 6 candidates, 65849 repo-hours, 659 releases; waiting 729 ms; commit 0 ms)
2026-11-08T13:09:50Z [load_day 2025-07-30] 2025-07-30 hour 6: 156934 events in 0 files, snapshot none (task 8443 ms: download 4989 ms overlapping gunzip 1097 ms, parse 4603 ms, sort 0 ms, write 0 ms, index 660 ms: 2 candidates, 79929 repo-hours, 814 releases; waiting 1594 ms; commit 0 ms)
2026-11-08T13:09:50Z [load_day 2025-07-30] 2025-07-30 hour 7: 156552 events in 0 files, snapshot none (task 7630 ms: download 5203 ms overlapping gunzip 1120 ms, parse 4614 ms, sort 0 ms, write 0 ms, index 725 ms: 7 candidates, 75545 repo-hours, 723 releases; waiting 757 ms; commit 0 ms)
2026-11-08T13:09:59Z [load_day 2025-07-30] 2025-07-30 hour 8: 160988 events in 0 files, snapshot none (task 8090 ms: download 5279 ms overlapping gunzip 1246 ms, parse 5236 ms, sort 0 ms, write 0 ms, index 721 ms: 6 candidates, 79438 repo-hours, 817 releases; waiting 563 ms; commit 0 ms)
2026-11-08T13:09:59Z [load_day 2025-07-30] 2025-07-30 hour 9: 163001 events in 0 files, snapshot none (task 8619 ms: download 6064 ms overlapping gunzip 1030 ms, parse 4218 ms, sort 0 ms, write 0 ms, index 688 ms: 8 candidates, 80872 repo-hours, 940 releases; waiting 2338 ms; commit 0 ms)
2026-11-08T13:10:07Z [load_day 2025-07-30] 2025-07-30 hour 10: 154596 events in 0 files, snapshot none (task 7982 ms: download 5206 ms overlapping gunzip 1206 ms, parse 4905 ms, sort 0 ms, write 0 ms, index 627 ms: 2 candidates, 76071 repo-hours, 757 releases; waiting 907 ms; commit 0 ms)
2026-11-08T13:10:07Z [load_day 2025-07-30] 2025-07-30 hour 11: 161249 events in 0 files, snapshot none (task 7554 ms: download 4736 ms overlapping gunzip 1198 ms, parse 4829 ms, sort 0 ms, write 0 ms, index 576 ms: 11 candidates, 76132 repo-hours, 844 releases; waiting 616 ms; commit 0 ms)
2026-11-08T13:10:16Z [load_day 2025-07-30] 2025-07-30 hour 12: 164201 events in 0 files, snapshot none (task 7779 ms: download 5105 ms overlapping gunzip 1145 ms, parse 5030 ms, sort 0 ms, write 0 ms, index 741 ms: 12 candidates, 95304 repo-hours, 788 releases; waiting 629 ms; commit 0 ms)
2026-11-08T13:10:16Z [load_day 2025-07-30] 2025-07-30 hour 13: 163528 events in 0 files, snapshot none (task 8358 ms: download 5459 ms overlapping gunzip 1352 ms, parse 5383 ms, sort 0 ms, write 0 ms, index 759 ms: 14 candidates, 92938 repo-hours, 845 releases; waiting 547 ms; commit 0 ms)
2026-11-08T13:10:23Z [load_day 2025-07-30] 2025-07-30 hour 14: 165691 events in 0 files, snapshot none (task 7451 ms: download 4450 ms overlapping gunzip 1184 ms, parse 4742 ms, sort 0 ms, write 0 ms, index 711 ms: 12 candidates, 84269 repo-hours, 801 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:10:24Z [load_day 2025-07-30] 2025-07-30 hour 15: 163677 events in 0 files, snapshot none (task 7544 ms: download 4953 ms overlapping gunzip 1255 ms, parse 4848 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 82804 repo-hours, 865 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:10:30Z [load_day 2025-07-30] 2025-07-30 hour 16: 160996 events in 0 files, snapshot none (task 6351 ms: download 3833 ms overlapping gunzip 995 ms, parse 3901 ms, sort 0 ms, write 0 ms, index 649 ms: 8 candidates, 79982 repo-hours, 783 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:10:31Z [load_day 2025-07-30] 2025-07-30 hour 17: 160457 events in 0 files, snapshot none (task 6548 ms: download 4118 ms overlapping gunzip 1015 ms, parse 4021 ms, sort 0 ms, write 0 ms, index 559 ms: 9 candidates, 75383 repo-hours, 778 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:10:38Z [load_day 2025-07-30] 2025-07-30 hour 18: 160398 events in 0 files, snapshot none (task 7610 ms: download 4941 ms overlapping gunzip 1249 ms, parse 4954 ms, sort 0 ms, write 0 ms, index 616 ms: 7 candidates, 80584 repo-hours, 799 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:10:39Z [load_day 2025-07-30] 2025-07-30 hour 19: 157490 events in 0 files, snapshot none (task 7214 ms: download 4479 ms overlapping gunzip 1098 ms, parse 4725 ms, sort 0 ms, write 0 ms, index 531 ms: 11 candidates, 69591 repo-hours, 781 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:10:46Z [load_day 2025-07-30] 2025-07-30 hour 20: 153066 events in 0 files, snapshot none (task 7467 ms: download 4960 ms overlapping gunzip 1197 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 585 ms: 16 candidates, 69397 repo-hours, 748 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:10:46Z [load_day 2025-07-30] 2025-07-30 hour 21: 150837 events in 0 files, snapshot none (task 7238 ms: download 4714 ms overlapping gunzip 1217 ms, parse 4952 ms, sort 0 ms, write 0 ms, index 454 ms: 13 candidates, 64882 repo-hours, 840 releases; waiting 301 ms; commit 0 ms)
2026-11-08T13:10:54Z [load_day 2025-07-30] 2025-07-30 hour 22: 144693 events in 0 files, snapshot none (task 7324 ms: download 4578 ms overlapping gunzip 1156 ms, parse 4817 ms, sort 0 ms, write 0 ms, index 437 ms: 7 candidates, 60862 repo-hours, 1006 releases; waiting 607 ms; commit 0 ms)
2026-11-08T13:10:54Z [load_day 2025-07-30] 2025-07-30 hour 23: 141291 events in 0 files, snapshot none (task 6797 ms: download 4275 ms overlapping gunzip 1150 ms, parse 4715 ms, sort 0 ms, write 0 ms, index 428 ms: 6 candidates, 58173 repo-hours, 710 releases; waiting 222 ms; commit 0 ms)
2026-11-08T13:11:02Z [load_day 2025-07-30] 2025-07-30: repo_hour merged from 24 files to 1 (1812181 rows, 8363 ms)
2026-11-08T13:11:05Z [load_day 2025-07-30] 2025-07-30: index committed in 11490 ms (24 + 1 + 24 files)
2026-11-08T13:11:05Z [load_day 2025-07-30] 2025-07-30: 3731492 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:11:05Z [load_day 2025-07-30] attempt 1 succeeded