orcaLog in

Runs · run 3758

load_day 2025-04-06, attempt 1 succeeded

Host
73ccef5e07c2:283545
Started
2026-11-08T11:15:32Z
Ended
2026-11-08T11:17:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
715 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.1 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3758/load_day/2025-04-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:15:32Z [load_day 2025-04-06] attempt 1 started
2026-11-08T11:15:33Z [load_day 2025-04-06] 2025-04-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:15:40Z [load_day 2025-04-06] 2025-04-06 hour 0: 169059 events in 0 files, snapshot none (task 7053 ms: download 3501 ms overlapping gunzip 1036 ms, parse 4549 ms, sort 0 ms, write 0 ms, index 585 ms: 11 candidates, 74912 repo-hours, 1063 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:15:40Z [load_day 2025-04-06] 2025-04-06 hour 1: 200477 events in 0 files, snapshot none (task 6886 ms: download 3888 ms overlapping gunzip 966 ms, parse 4639 ms, sort 0 ms, write 0 ms, index 827 ms: 12 candidates, 107169 repo-hours, 947 releases; waiting 223 ms; commit 0 ms)
2026-11-08T11:15:48Z [load_day 2025-04-06] 2025-04-06 hour 2: 163436 events in 0 files, snapshot none (task 6867 ms: download 3559 ms overlapping gunzip 1091 ms, parse 4341 ms, sort 0 ms, write 0 ms, index 577 ms: 4 candidates, 67817 repo-hours, 821 releases; waiting 540 ms; commit 0 ms)
2026-11-08T11:15:48Z [load_day 2025-04-06] 2025-04-06 hour 3: 177234 events in 0 files, snapshot none (task 6549 ms: download 3257 ms overlapping gunzip 990 ms, parse 4149 ms, sort 0 ms, write 0 ms, index 654 ms: 6 candidates, 66556 repo-hours, 2959 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:15:53Z [load_day 2025-04-06] 2025-04-06 hour 4: 158452 events in 0 files, snapshot none (task 4913 ms: download 2816 ms overlapping gunzip 663 ms, parse 2963 ms, sort 0 ms, write 0 ms, index 458 ms: 3 candidates, 57286 repo-hours, 634 releases; waiting 547 ms; commit 0 ms)
2026-11-08T11:15:54Z [load_day 2025-04-06] 2025-04-06 hour 5: 173016 events in 0 files, snapshot none (task 5243 ms: download 2796 ms overlapping gunzip 709 ms, parse 3310 ms, sort 0 ms, write 0 ms, index 449 ms: 4 candidates, 60591 repo-hours, 716 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:16:01Z [load_day 2025-04-06] 2025-04-06 hour 6: 191460 events in 0 files, snapshot none (task 7021 ms: download 3544 ms overlapping gunzip 1064 ms, parse 4797 ms, sort 0 ms, write 0 ms, index 637 ms: 2 candidates, 78023 repo-hours, 861 releases; waiting 201 ms; commit 0 ms)
2026-11-08T11:16:01Z [load_day 2025-04-06] 2025-04-06 hour 7: 183886 events in 0 files, snapshot none (task 6671 ms: download 3713 ms overlapping gunzip 1004 ms, parse 4314 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 65721 repo-hours, 782 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:16:08Z [load_day 2025-04-06] 2025-04-06 hour 8: 192143 events in 0 files, snapshot none (task 6335 ms: download 2901 ms overlapping gunzip 906 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 707 ms: 2 candidates, 72184 repo-hours, 795 releases; waiting 230 ms; commit 0 ms)
2026-11-08T11:16:08Z [load_day 2025-04-06] 2025-04-06 hour 9: 211233 events in 0 files, snapshot none (task 7131 ms: download 3693 ms overlapping gunzip 1022 ms, parse 4530 ms, sort 0 ms, write 0 ms, index 779 ms: 2 candidates, 80895 repo-hours, 935 releases; waiting 524 ms; commit 0 ms)
2026-11-08T11:16:14Z [load_day 2025-04-06] 2025-04-06 hour 10: 208015 events in 0 files, snapshot none (task 5879 ms: download 3329 ms overlapping gunzip 837 ms, parse 3706 ms, sort 0 ms, write 0 ms, index 575 ms: 1 candidates, 78350 repo-hours, 805 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:16:15Z [load_day 2025-04-06] 2025-04-06 hour 11: 205040 events in 0 files, snapshot none (task 6009 ms: download 3298 ms overlapping gunzip 909 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 75181 repo-hours, 871 releases; waiting 189 ms; commit 0 ms)
2026-11-08T11:16:23Z [load_day 2025-04-06] 2025-04-06 hour 12: 257875 events in 0 files, snapshot none (task 8417 ms: download 4476 ms overlapping gunzip 1146 ms, parse 5287 ms, sort 0 ms, write 0 ms, index 1157 ms: 4 candidates, 126059 repo-hours, 1071 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:16:24Z [load_day 2025-04-06] 2025-04-06 hour 13: 235499 events in 0 files, snapshot none (task 8058 ms: download 4938 ms overlapping gunzip 1099 ms, parse 5267 ms, sort 0 ms, write 0 ms, index 736 ms: 4 candidates, 105512 repo-hours, 982 releases; waiting 543 ms; commit 0 ms)
2026-11-08T11:16:31Z [load_day 2025-04-06] 2025-04-06 hour 14: 225848 events in 0 files, snapshot none (task 8004 ms: download 4787 ms overlapping gunzip 1177 ms, parse 4904 ms, sort 0 ms, write 0 ms, index 698 ms: 4 candidates, 87560 repo-hours, 1107 releases; waiting 797 ms; commit 0 ms)
2026-11-08T11:16:33Z [load_day 2025-04-06] 2025-04-06 hour 15: 237707 events in 0 files, snapshot none (task 8494 ms: download 5209 ms overlapping gunzip 1288 ms, parse 5496 ms, sort 0 ms, write 0 ms, index 856 ms: 6 candidates, 97238 repo-hours, 1155 releases; waiting 592 ms; commit 0 ms)
2026-11-08T11:16:39Z [load_day 2025-04-06] 2025-04-06 hour 16: 227779 events in 0 files, snapshot none (task 6767 ms: download 3718 ms overlapping gunzip 914 ms, parse 4047 ms, sort 0 ms, write 0 ms, index 1134 ms: 6 candidates, 91464 repo-hours, 908 releases; waiting 418 ms; commit 0 ms)
2026-11-08T11:16:41Z [load_day 2025-04-06] 2025-04-06 hour 17: 227506 events in 0 files, snapshot none (task 7548 ms: download 3599 ms overlapping gunzip 1102 ms, parse 4720 ms, sort 0 ms, write 0 ms, index 912 ms: 2 candidates, 89068 repo-hours, 879 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:16:48Z [load_day 2025-04-06] 2025-04-06 hour 18: 234554 events in 0 files, snapshot none (task 8419 ms: download 5095 ms overlapping gunzip 1215 ms, parse 5708 ms, sort 0 ms, write 0 ms, index 789 ms: 3 candidates, 99913 repo-hours, 1166 releases; waiting 466 ms; commit 0 ms)
2026-11-08T11:16:49Z [load_day 2025-04-06] 2025-04-06 hour 19: 214271 events in 0 files, snapshot none (task 7626 ms: download 4761 ms overlapping gunzip 1175 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 681 ms: 12 candidates, 77485 repo-hours, 957 releases; waiting 483 ms; commit 0 ms)
2026-11-08T11:16:56Z [load_day 2025-04-06] 2025-04-06 hour 20: 211860 events in 0 files, snapshot none (task 7279 ms: download 4037 ms overlapping gunzip 1078 ms, parse 4684 ms, sort 0 ms, write 0 ms, index 684 ms: 10 candidates, 79234 repo-hours, 996 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:16:57Z [load_day 2025-04-06] 2025-04-06 hour 21: 204657 events in 0 files, snapshot none (task 7097 ms: download 4376 ms overlapping gunzip 1042 ms, parse 4637 ms, sort 0 ms, write 0 ms, index 569 ms: 8 candidates, 75665 repo-hours, 1017 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:17:03Z [load_day 2025-04-06] 2025-04-06 hour 22: 183283 events in 0 files, snapshot none (task 6589 ms: download 4106 ms overlapping gunzip 992 ms, parse 4234 ms, sort 0 ms, write 0 ms, index 498 ms: 3 candidates, 64034 repo-hours, 970 releases; waiting 625 ms; commit 0 ms)
2026-11-08T11:17:03Z [load_day 2025-04-06] 2025-04-06 hour 23: 170315 events in 0 files, snapshot none (task 5977 ms: download 2948 ms overlapping gunzip 844 ms, parse 3841 ms, sort 0 ms, write 0 ms, index 517 ms: 4 candidates, 59305 repo-hours, 795 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:17:11Z [load_day 2025-04-06] 2025-04-06: repo_hour merged from 24 files to 1 (1937222 rows, 8144 ms)
2026-11-08T11:17:16Z [load_day 2025-04-06] 2025-04-06: index committed in 12764 ms (24 + 1 + 24 files)
2026-11-08T11:17:16Z [load_day 2025-04-06] 2025-04-06: 4864605 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:17:16Z [load_day 2025-04-06] attempt 1 succeeded