orcaLog in

Runs · run 3978

load_day 2025-06-03, attempt 1 succeeded

Host
73ccef5e07c2:316291
Started
2026-11-08T12:15:58Z
Ended
2026-11-08T12:17:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3978/load_day/2025-06-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:15:58Z [load_day 2025-06-03] attempt 1 started
2026-11-08T12:15:59Z [load_day 2025-06-03] 2025-06-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:16:06Z [load_day 2025-06-03] 2025-06-03 hour 0: 146974 events in 0 files, snapshot none (task 6415 ms: download 3067 ms overlapping gunzip 1003 ms, parse 4222 ms, sort 0 ms, write 0 ms, index 648 ms: 9 candidates, 73929 repo-hours, 1097 releases; waiting 233 ms; commit 0 ms)
2026-11-08T12:16:06Z [load_day 2025-06-03] 2025-06-03 hour 1: 153552 events in 0 files, snapshot none (task 6085 ms: download 3232 ms overlapping gunzip 858 ms, parse 3637 ms, sort 0 ms, write 0 ms, index 702 ms: 7 candidates, 90555 repo-hours, 776 releases; waiting 576 ms; commit 0 ms)
2026-11-08T12:16:13Z [load_day 2025-06-03] 2025-06-03 hour 2: 144649 events in 0 files, snapshot none (task 6231 ms: download 2894 ms overlapping gunzip 909 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 914 ms: 15 candidates, 72858 repo-hours, 772 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:16:13Z [load_day 2025-06-03] 2025-06-03 hour 3: 142748 events in 0 files, snapshot none (task 6712 ms: download 3503 ms overlapping gunzip 994 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 68754 repo-hours, 1971 releases; waiting 707 ms; commit 0 ms)
2026-11-08T12:16:20Z [load_day 2025-06-03] 2025-06-03 hour 4: 135887 events in 0 files, snapshot none (task 6132 ms: download 3091 ms overlapping gunzip 759 ms, parse 3289 ms, sort 0 ms, write 0 ms, index 1047 ms: 5 candidates, 63962 repo-hours, 795 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:16:21Z [load_day 2025-06-03] 2025-06-03 hour 5: 144106 events in 0 files, snapshot none (task 6572 ms: download 3351 ms overlapping gunzip 1055 ms, parse 4225 ms, sort 0 ms, write 0 ms, index 570 ms: 3 candidates, 64796 repo-hours, 696 releases; waiting 495 ms; commit 0 ms)
2026-11-08T12:16:27Z [load_day 2025-06-03] 2025-06-03 hour 6: 154542 events in 0 files, snapshot none (task 6716 ms: download 3825 ms overlapping gunzip 939 ms, parse 3760 ms, sort 0 ms, write 0 ms, index 1023 ms: 11 candidates, 81997 repo-hours, 792 releases; waiting 628 ms; commit 0 ms)
2026-11-08T12:16:30Z [load_day 2025-06-03] 2025-06-03 hour 7: 158597 events in 0 files, snapshot none (task 9026 ms: download 5568 ms overlapping gunzip 1297 ms, parse 4875 ms, sort 0 ms, write 0 ms, index 830 ms: 10 candidates, 78319 repo-hours, 773 releases; waiting 1797 ms; commit 0 ms)
2026-11-08T12:16:34Z [load_day 2025-06-03] 2025-06-03 hour 8: 145278 events in 0 files, snapshot none (task 6704 ms: download 4332 ms overlapping gunzip 1058 ms, parse 3964 ms, sort 0 ms, write 0 ms, index 857 ms: 7 candidates, 75883 repo-hours, 775 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:16:37Z [load_day 2025-06-03] 2025-06-03 hour 9: 135449 events in 0 files, snapshot none (task 6522 ms: download 2907 ms overlapping gunzip 883 ms, parse 3641 ms, sort 0 ms, write 0 ms, index 1105 ms: 10 candidates, 73873 repo-hours, 813 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:16:41Z [load_day 2025-06-03] 2025-06-03 hour 10: 150340 events in 0 files, snapshot none (task 6580 ms: download 3736 ms overlapping gunzip 965 ms, parse 4043 ms, sort 0 ms, write 0 ms, index 813 ms: 12 candidates, 75763 repo-hours, 806 releases; waiting 535 ms; commit 0 ms)
2026-11-08T12:16:45Z [load_day 2025-06-03] 2025-06-03 hour 11: 159888 events in 0 files, snapshot none (task 6696 ms: download 3646 ms overlapping gunzip 1020 ms, parse 4018 ms, sort 0 ms, write 0 ms, index 757 ms: 10 candidates, 77908 repo-hours, 1118 releases; waiting 661 ms; commit 0 ms)
2026-11-08T12:16:49Z [load_day 2025-06-03] 2025-06-03 hour 12: 160719 events in 0 files, snapshot none (task 6849 ms: download 3628 ms overlapping gunzip 1056 ms, parse 4279 ms, sort 0 ms, write 0 ms, index 709 ms: 4 candidates, 95988 repo-hours, 1028 releases; waiting 483 ms; commit 0 ms)
2026-11-08T12:16:53Z [load_day 2025-06-03] 2025-06-03 hour 13: 167192 events in 0 files, snapshot none (task 7191 ms: download 4415 ms overlapping gunzip 962 ms, parse 4003 ms, sort 0 ms, write 0 ms, index 890 ms: 29 candidates, 93339 repo-hours, 985 releases; waiting 1040 ms; commit 0 ms)
2026-11-08T12:16:57Z [load_day 2025-06-03] 2025-06-03 hour 14: 163272 events in 0 files, snapshot none (task 7573 ms: download 4893 ms overlapping gunzip 1156 ms, parse 4655 ms, sort 0 ms, write 0 ms, index 766 ms: 9 candidates, 86169 repo-hours, 1004 releases; waiting 740 ms; commit 0 ms)
2026-11-08T12:17:00Z [load_day 2025-06-03] 2025-06-03 hour 15: 145879 events in 0 files, snapshot none (task 6453 ms: download 3495 ms overlapping gunzip 1015 ms, parse 4162 ms, sort 0 ms, write 0 ms, index 848 ms: 6 candidates, 80200 repo-hours, 829 releases; waiting 205 ms; commit 0 ms)
2026-11-08T12:17:06Z [load_day 2025-06-03] 2025-06-03 hour 16: 135376 events in 0 files, snapshot none (task 8135 ms: download 4278 ms overlapping gunzip 1390 ms, parse 5551 ms, sort 0 ms, write 0 ms, index 728 ms: 10 candidates, 73298 repo-hours, 689 releases; waiting 198 ms; commit 0 ms)
2026-11-08T12:17:07Z [load_day 2025-06-03] 2025-06-03 hour 17: 124391 events in 0 files, snapshot none (task 6881 ms: download 3628 ms overlapping gunzip 1171 ms, parse 4697 ms, sort 0 ms, write 0 ms, index 546 ms: 10 candidates, 65597 repo-hours, 725 releases; waiting 205 ms; commit 0 ms)
2026-11-08T12:17:14Z [load_day 2025-06-03] 2025-06-03 hour 18: 141309 events in 0 files, snapshot none (task 7046 ms: download 3611 ms overlapping gunzip 973 ms, parse 4250 ms, sort 0 ms, write 0 ms, index 940 ms: 9 candidates, 76841 repo-hours, 954 releases; waiting 586 ms; commit 0 ms)
2026-11-08T12:17:15Z [load_day 2025-06-03] 2025-06-03 hour 19: 140775 events in 0 files, snapshot none (task 6855 ms: download 4072 ms overlapping gunzip 1024 ms, parse 4206 ms, sort 0 ms, write 0 ms, index 512 ms: 3 candidates, 67131 repo-hours, 757 releases; waiting 768 ms; commit 0 ms)
2026-11-08T12:17:20Z [load_day 2025-06-03] 2025-06-03 hour 20: 158221 events in 0 files, snapshot none (task 5951 ms: download 3346 ms overlapping gunzip 874 ms, parse 3555 ms, sort 0 ms, write 0 ms, index 662 ms: 8 candidates, 74738 repo-hours, 930 releases; waiting 544 ms; commit 0 ms)
2026-11-08T12:17:21Z [load_day 2025-06-03] 2025-06-03 hour 21: 152958 events in 0 files, snapshot none (task 5779 ms: download 3404 ms overlapping gunzip 926 ms, parse 3773 ms, sort 0 ms, write 0 ms, index 525 ms: 7 candidates, 69114 repo-hours, 1036 releases; waiting 221 ms; commit 0 ms)
2026-11-08T12:17:26Z [load_day 2025-06-03] 2025-06-03 hour 22: 149873 events in 0 files, snapshot none (task 5538 ms: download 3002 ms overlapping gunzip 827 ms, parse 3371 ms, sort 0 ms, write 0 ms, index 491 ms: 10 candidates, 64425 repo-hours, 875 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:17:27Z [load_day 2025-06-03] 2025-06-03 hour 23: 142049 events in 0 files, snapshot none (task 5189 ms: download 3593 ms overlapping gunzip 782 ms, parse 3087 ms, sort 0 ms, write 0 ms, index 476 ms: 9 candidates, 61331 repo-hours, 1068 releases; waiting 563 ms; commit 0 ms)
2026-11-08T12:17:35Z [load_day 2025-06-03] 2025-06-03: repo_hour merged from 24 files to 1 (1806768 rows, 8382 ms)
2026-11-08T12:17:38Z [load_day 2025-06-03] 2025-06-03: index committed in 11111 ms (24 + 1 + 24 files)
2026-11-08T12:17:38Z [load_day 2025-06-03] 2025-06-03: 3554024 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:17:38Z [load_day 2025-06-03] attempt 1 succeeded