orcaLog in

Runs · run 4039

load_day 2025-06-18, attempt 1 succeeded

Host
73ccef5e07c2:325626
Started
2026-11-08T12:31:17Z
Ended
2026-11-08T12:33:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
150.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4039/load_day/2025-06-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:31:17Z [load_day 2025-06-18] attempt 1 started
2026-11-08T12:31:18Z [load_day 2025-06-18] 2025-06-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:31:25Z [load_day 2025-06-18] 2025-06-18 hour 0: 145205 events in 0 files, snapshot none (task 5911 ms: download 3277 ms overlapping gunzip 908 ms, parse 3564 ms, sort 0 ms, write 0 ms, index 597 ms: 5 candidates, 72242 repo-hours, 982 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:31:25Z [load_day 2025-06-18] 2025-06-18 hour 1: 152532 events in 0 files, snapshot none (task 5612 ms: download 3746 ms overlapping gunzip 721 ms, parse 3067 ms, sort 0 ms, write 0 ms, index 745 ms: 5 candidates, 88083 repo-hours, 732 releases; waiting 803 ms; commit 0 ms)
2026-11-08T12:31:30Z [load_day 2025-06-18] 2025-06-18 hour 2: 149563 events in 0 files, snapshot none (task 5127 ms: download 3078 ms overlapping gunzip 723 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 601 ms: 14 candidates, 75246 repo-hours, 792 releases; waiting 539 ms; commit 0 ms)
2026-11-08T12:31:30Z [load_day 2025-06-18] 2025-06-18 hour 3: 147827 events in 0 files, snapshot none (task 5013 ms: download 2973 ms overlapping gunzip 721 ms, parse 2949 ms, sort 0 ms, write 0 ms, index 506 ms: 4 candidates, 68658 repo-hours, 1864 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:31:37Z [load_day 2025-06-18] 2025-06-18 hour 4: 146469 events in 0 files, snapshot none (task 5835 ms: download 3418 ms overlapping gunzip 812 ms, parse 3406 ms, sort 0 ms, write 0 ms, index 494 ms: 7 candidates, 63868 repo-hours, 757 releases; waiting 831 ms; commit 0 ms)
2026-11-08T12:31:37Z [load_day 2025-06-18] 2025-06-18 hour 5: 135872 events in 0 files, snapshot none (task 5884 ms: download 3622 ms overlapping gunzip 965 ms, parse 3879 ms, sort 0 ms, write 0 ms, index 489 ms: 6 candidates, 62998 repo-hours, 638 releases; waiting 230 ms; commit 0 ms)
2026-11-08T12:31:43Z [load_day 2025-06-18] 2025-06-18 hour 6: 126317 events in 0 files, snapshot none (task 6211 ms: download 3457 ms overlapping gunzip 946 ms, parse 3881 ms, sort 0 ms, write 0 ms, index 565 ms: 10 candidates, 67118 repo-hours, 648 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:31:45Z [load_day 2025-06-18] 2025-06-18 hour 7: 157763 events in 0 files, snapshot none (task 7461 ms: download 4783 ms overlapping gunzip 1209 ms, parse 5137 ms, sort 0 ms, write 0 ms, index 581 ms: 4 candidates, 76683 repo-hours, 750 releases; waiting 211 ms; commit 0 ms)
2026-11-08T12:31:52Z [load_day 2025-06-18] 2025-06-18 hour 8: 158631 events in 0 files, snapshot none (task 8004 ms: download 5088 ms overlapping gunzip 1222 ms, parse 5099 ms, sort 0 ms, write 0 ms, index 645 ms: 2 candidates, 80007 repo-hours, 908 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:31:53Z [load_day 2025-06-18] 2025-06-18 hour 9: 160540 events in 0 files, snapshot none (task 7468 ms: download 4860 ms overlapping gunzip 1053 ms, parse 4768 ms, sort 0 ms, write 0 ms, index 673 ms: 3 candidates, 81971 repo-hours, 908 releases; waiting 682 ms; commit 0 ms)
2026-11-08T12:32:01Z [load_day 2025-06-18] 2025-06-18 hour 10: 161571 events in 0 files, snapshot none (task 8857 ms: download 5360 ms overlapping gunzip 1474 ms, parse 5893 ms, sort 0 ms, write 0 ms, index 647 ms: 1 candidates, 78665 repo-hours, 712 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:32:02Z [load_day 2025-06-18] 2025-06-18 hour 11: 164177 events in 0 files, snapshot none (task 8784 ms: download 6198 ms overlapping gunzip 1507 ms, parse 5882 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 78747 repo-hours, 742 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:32:10Z [load_day 2025-06-18] 2025-06-18 hour 12: 169971 events in 0 files, snapshot none (task 8000 ms: download 5233 ms overlapping gunzip 1180 ms, parse 5226 ms, sort 0 ms, write 0 ms, index 779 ms: 5 candidates, 99403 repo-hours, 869 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:32:10Z [load_day 2025-06-18] 2025-06-18 hour 13: 164964 events in 0 files, snapshot none (task 7360 ms: download 4764 ms overlapping gunzip 1127 ms, parse 4686 ms, sort 0 ms, write 0 ms, index 710 ms: 10 candidates, 92639 repo-hours, 815 releases; waiting 478 ms; commit 0 ms)
2026-11-08T12:32:18Z [load_day 2025-06-18] 2025-06-18 hour 14: 168562 events in 0 files, snapshot none (task 8079 ms: download 5222 ms overlapping gunzip 1238 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 754 ms: 11 candidates, 86987 repo-hours, 875 releases; waiting 519 ms; commit 0 ms)
2026-11-08T12:32:19Z [load_day 2025-06-18] 2025-06-18 hour 15: 166248 events in 0 files, snapshot none (task 8260 ms: download 5551 ms overlapping gunzip 1379 ms, parse 5267 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 87019 repo-hours, 899 releases; waiting 553 ms; commit 0 ms)
2026-11-08T12:32:27Z [load_day 2025-06-18] 2025-06-18 hour 16: 161220 events in 0 files, snapshot none (task 8233 ms: download 5409 ms overlapping gunzip 1315 ms, parse 5333 ms, sort 0 ms, write 0 ms, index 675 ms: 7 candidates, 81964 repo-hours, 842 releases; waiting 601 ms; commit 0 ms)
2026-11-08T12:32:27Z [load_day 2025-06-18] 2025-06-18 hour 17: 160131 events in 0 files, snapshot none (task 7601 ms: download 4800 ms overlapping gunzip 1157 ms, parse 4723 ms, sort 0 ms, write 0 ms, index 685 ms: 6 candidates, 78095 repo-hours, 835 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:32:35Z [load_day 2025-06-18] 2025-06-18 hour 18: 161089 events in 0 files, snapshot none (task 7381 ms: download 4833 ms overlapping gunzip 1215 ms, parse 5038 ms, sort 0 ms, write 0 ms, index 602 ms: 12 candidates, 82297 repo-hours, 802 releases; waiting 254 ms; commit 0 ms)
2026-11-08T12:32:36Z [load_day 2025-06-18] 2025-06-18 hour 19: 154194 events in 0 files, snapshot none (task 7667 ms: download 5183 ms overlapping gunzip 1177 ms, parse 5081 ms, sort 0 ms, write 0 ms, index 527 ms: 9 candidates, 70640 repo-hours, 821 releases; waiting 532 ms; commit 0 ms)
2026-11-08T12:32:43Z [load_day 2025-06-18] 2025-06-18 hour 20: 155286 events in 0 files, snapshot none (task 7620 ms: download 5188 ms overlapping gunzip 1139 ms, parse 5044 ms, sort 0 ms, write 0 ms, index 542 ms: 7 candidates, 71134 repo-hours, 775 releases; waiting 553 ms; commit 0 ms)
2026-11-08T12:32:43Z [load_day 2025-06-18] 2025-06-18 hour 21: 151680 events in 0 files, snapshot none (task 6772 ms: download 4313 ms overlapping gunzip 1003 ms, parse 4384 ms, sort 0 ms, write 0 ms, index 544 ms: 8 candidates, 68248 repo-hours, 878 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:32:51Z [load_day 2025-06-18] 2025-06-18 hour 22: 146415 events in 0 files, snapshot none (task 7731 ms: download 5496 ms overlapping gunzip 930 ms, parse 3741 ms, sort 0 ms, write 0 ms, index 440 ms: 10 candidates, 62929 repo-hours, 940 releases; waiting 2306 ms; commit 0 ms)
2026-11-08T12:32:51Z [load_day 2025-06-18] 2025-06-18 hour 23: 135405 events in 0 files, snapshot none (task 5727 ms: download 3137 ms overlapping gunzip 882 ms, parse 3551 ms, sort 0 ms, write 0 ms, index 512 ms: 6 candidates, 57876 repo-hours, 737 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:33:01Z [load_day 2025-06-18] 2025-06-18: repo_hour merged from 24 files to 1 (1833517 rows, 9150 ms)
2026-11-08T12:33:04Z [load_day 2025-06-18] 2025-06-18: index committed in 12139 ms (24 + 1 + 24 files)
2026-11-08T12:33:04Z [load_day 2025-06-18] 2025-06-18: 3701632 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:33:04Z [load_day 2025-06-18] attempt 1 succeeded