orcaLog in

Runs · run 3987

load_day 2025-06-06, attempt 1 succeeded

Host
73ccef5e07c2:318021
Started
2026-11-08T12:19:09Z
Ended
2026-11-08T12:20:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3987/load_day/2025-06-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:19:09Z [load_day 2025-06-06] attempt 1 started
2026-11-08T12:19:10Z [load_day 2025-06-06] 2025-06-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:19:16Z [load_day 2025-06-06] 2025-06-06 hour 0: 138954 events in 0 files, snapshot none (task 5198 ms: download 3060 ms overlapping gunzip 758 ms, parse 2988 ms, sort 0 ms, write 0 ms, index 530 ms: 13 candidates, 69833 repo-hours, 1068 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:19:16Z [load_day 2025-06-06] 2025-06-06 hour 1: 145676 events in 0 files, snapshot none (task 5183 ms: download 2717 ms overlapping gunzip 694 ms, parse 2961 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 85756 repo-hours, 652 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:19:21Z [load_day 2025-06-06] 2025-06-06 hour 2: 139173 events in 0 files, snapshot none (task 4896 ms: download 2558 ms overlapping gunzip 682 ms, parse 2780 ms, sort 0 ms, write 0 ms, index 644 ms: 9 candidates, 67804 repo-hours, 725 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:19:23Z [load_day 2025-06-06] 2025-06-06 hour 3: 139942 events in 0 files, snapshot none (task 6203 ms: download 4041 ms overlapping gunzip 783 ms, parse 2918 ms, sort 0 ms, write 0 ms, index 583 ms: 7 candidates, 65541 repo-hours, 1842 releases; waiting 1605 ms; commit 0 ms)
2026-11-08T12:19:27Z [load_day 2025-06-06] 2025-06-06 hour 4: 134413 events in 0 files, snapshot none (task 5030 ms: download 3177 ms overlapping gunzip 703 ms, parse 2848 ms, sort 0 ms, write 0 ms, index 478 ms: 10 candidates, 59272 repo-hours, 771 releases; waiting 616 ms; commit 0 ms)
2026-11-08T12:19:28Z [load_day 2025-06-06] 2025-06-06 hour 5: 136669 events in 0 files, snapshot none (task 5363 ms: download 3119 ms overlapping gunzip 728 ms, parse 3036 ms, sort 0 ms, write 0 ms, index 720 ms: 5 candidates, 61543 repo-hours, 689 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:19:33Z [load_day 2025-06-06] 2025-06-06 hour 6: 144286 events in 0 files, snapshot none (task 6024 ms: download 3318 ms overlapping gunzip 952 ms, parse 3935 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 73057 repo-hours, 709 releases; waiting 228 ms; commit 0 ms)
2026-11-08T12:19:35Z [load_day 2025-06-06] 2025-06-06 hour 7: 147246 events in 0 files, snapshot none (task 5616 ms: download 3086 ms overlapping gunzip 821 ms, parse 3260 ms, sort 0 ms, write 0 ms, index 673 ms: 13 candidates, 70284 repo-hours, 768 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:19:40Z [load_day 2025-06-06] 2025-06-06 hour 8: 145743 events in 0 files, snapshot none (task 6411 ms: download 3929 ms overlapping gunzip 966 ms, parse 3978 ms, sort 0 ms, write 0 ms, index 628 ms: 12 candidates, 71551 repo-hours, 824 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:19:41Z [load_day 2025-06-06] 2025-06-06 hour 9: 152660 events in 0 files, snapshot none (task 6348 ms: download 3600 ms overlapping gunzip 966 ms, parse 3958 ms, sort 0 ms, write 0 ms, index 679 ms: 11 candidates, 75642 repo-hours, 947 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:19:47Z [load_day 2025-06-06] 2025-06-06 hour 10: 153732 events in 0 files, snapshot none (task 6358 ms: download 3261 ms overlapping gunzip 892 ms, parse 3739 ms, sort 0 ms, write 0 ms, index 891 ms: 13 candidates, 74361 repo-hours, 819 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:19:49Z [load_day 2025-06-06] 2025-06-06 hour 11: 150906 events in 0 files, snapshot none (task 7269 ms: download 4910 ms overlapping gunzip 1003 ms, parse 4039 ms, sort 0 ms, write 0 ms, index 536 ms: 14 candidates, 70009 repo-hours, 737 releases; waiting 1426 ms; commit 0 ms)
2026-11-08T12:19:54Z [load_day 2025-06-06] 2025-06-06 hour 12: 160362 events in 0 files, snapshot none (task 6247 ms: download 2797 ms overlapping gunzip 839 ms, parse 3679 ms, sort 0 ms, write 0 ms, index 840 ms: 12 candidates, 93305 repo-hours, 792 releases; waiting 487 ms; commit 0 ms)
2026-11-08T12:19:57Z [load_day 2025-06-06] 2025-06-06 hour 13: 156676 events in 0 files, snapshot none (task 6681 ms: download 3916 ms overlapping gunzip 983 ms, parse 4079 ms, sort 0 ms, write 0 ms, index 748 ms: 10 candidates, 85671 repo-hours, 794 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:20:02Z [load_day 2025-06-06] 2025-06-06 hour 14: 158458 events in 0 files, snapshot none (task 7305 ms: download 4574 ms overlapping gunzip 1004 ms, parse 4291 ms, sort 0 ms, write 0 ms, index 617 ms: 12 candidates, 77209 repo-hours, 985 releases; waiting 1051 ms; commit 0 ms)
2026-11-08T12:20:04Z [load_day 2025-06-06] 2025-06-06 hour 15: 156553 events in 0 files, snapshot none (task 6625 ms: download 4091 ms overlapping gunzip 987 ms, parse 4154 ms, sort 0 ms, write 0 ms, index 643 ms: 8 candidates, 78704 repo-hours, 887 releases; waiting 538 ms; commit 0 ms)
2026-11-08T12:20:11Z [load_day 2025-06-06] 2025-06-06 hour 16: 153573 events in 0 files, snapshot none (task 7521 ms: download 4960 ms overlapping gunzip 1091 ms, parse 4491 ms, sort 0 ms, write 0 ms, index 555 ms: 14 candidates, 76383 repo-hours, 876 releases; waiting 1150 ms; commit 0 ms)
2026-11-08T12:20:11Z [load_day 2025-06-06] 2025-06-06 hour 17: 151158 events in 0 files, snapshot none (task 7077 ms: download 4454 ms overlapping gunzip 1135 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 552 ms: 12 candidates, 70905 repo-hours, 711 releases; waiting 493 ms; commit 0 ms)
2026-11-08T12:20:19Z [load_day 2025-06-06] 2025-06-06 hour 18: 150884 events in 0 files, snapshot none (task 6845 ms: download 4280 ms overlapping gunzip 1010 ms, parse 4286 ms, sort 0 ms, write 0 ms, index 747 ms: 8 candidates, 77530 repo-hours, 829 releases; waiting 545 ms; commit 0 ms)
2026-11-08T12:20:19Z [load_day 2025-06-06] 2025-06-06 hour 19: 152230 events in 0 files, snapshot none (task 6663 ms: download 4039 ms overlapping gunzip 996 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 684 ms: 19 candidates, 68217 repo-hours, 722 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:20:27Z [load_day 2025-06-06] 2025-06-06 hour 20: 149334 events in 0 files, snapshot none (task 7224 ms: download 3856 ms overlapping gunzip 1133 ms, parse 4386 ms, sort 0 ms, write 0 ms, index 871 ms: 12 candidates, 66720 repo-hours, 756 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:20:27Z [load_day 2025-06-06] 2025-06-06 hour 21: 144822 events in 0 files, snapshot none (task 6785 ms: download 4272 ms overlapping gunzip 1022 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 713 ms: 14 candidates, 63878 repo-hours, 833 releases; waiting 603 ms; commit 0 ms)
2026-11-08T12:20:34Z [load_day 2025-06-06] 2025-06-06 hour 22: 134670 events in 0 files, snapshot none (task 6620 ms: download 3810 ms overlapping gunzip 918 ms, parse 3715 ms, sort 0 ms, write 0 ms, index 449 ms: 5 candidates, 56045 repo-hours, 772 releases; waiting 1046 ms; commit 0 ms)
2026-11-08T12:20:34Z [load_day 2025-06-06] 2025-06-06 hour 23: 137157 events in 0 files, snapshot none (task 6444 ms: download 3746 ms overlapping gunzip 998 ms, parse 3969 ms, sort 0 ms, write 0 ms, index 459 ms: 11 candidates, 56796 repo-hours, 614 releases; waiting 559 ms; commit 0 ms)
2026-11-08T12:20:41Z [load_day 2025-06-06] 2025-06-06: repo_hour merged from 24 files to 1 (1716016 rows, 7555 ms)
2026-11-08T12:20:44Z [load_day 2025-06-06] 2025-06-06: index committed in 10533 ms (24 + 1 + 24 files)
2026-11-08T12:20:44Z [load_day 2025-06-06] 2025-06-06: 3535277 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:20:44Z [load_day 2025-06-06] attempt 1 succeeded