orcaLog in

Runs · run 3566

load_day 2025-02-15, attempt 1 succeeded

Host
73ccef5e07c2:255921
Started
2026-11-08T10:21:31Z
Ended
2026-11-08T10:23:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
733 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
136.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3566/load_day/2025-02-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:21:31Z [load_day 2025-02-15] attempt 1 started
2026-11-08T10:21:32Z [load_day 2025-02-15] 2025-02-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:21:40Z [load_day 2025-02-15] 2025-02-15 hour 0: 187855 events in 0 files, snapshot none (task 8032 ms: download 4123 ms overlapping gunzip 1131 ms, parse 4694 ms, sort 0 ms, write 0 ms, index 1090 ms: 6 candidates, 91248 repo-hours, 1406 releases; waiting 848 ms; commit 0 ms)
2026-11-08T10:21:40Z [load_day 2025-02-15] 2025-02-15 hour 1: 194903 events in 0 files, snapshot none (task 7963 ms: download 4228 ms overlapping gunzip 1128 ms, parse 4938 ms, sort 0 ms, write 0 ms, index 1081 ms: 5 candidates, 103986 repo-hours, 945 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:21:47Z [load_day 2025-02-15] 2025-02-15 hour 2: 163051 events in 0 files, snapshot none (task 6051 ms: download 4358 ms overlapping gunzip 783 ms, parse 3200 ms, sort 0 ms, write 0 ms, index 1033 ms: 7 candidates, 70583 repo-hours, 718 releases; waiting 658 ms; commit 0 ms)
2026-11-08T10:21:47Z [load_day 2025-02-15] 2025-02-15 hour 3: 176837 events in 0 files, snapshot none (task 6049 ms: download 2823 ms overlapping gunzip 868 ms, parse 3475 ms, sort 0 ms, write 0 ms, index 924 ms: 6 candidates, 69679 repo-hours, 3851 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:21:53Z [load_day 2025-02-15] 2025-02-15 hour 4: 163155 events in 0 files, snapshot none (task 5564 ms: download 2629 ms overlapping gunzip 805 ms, parse 3617 ms, sort 0 ms, write 0 ms, index 573 ms: 11 candidates, 60591 repo-hours, 621 releases; waiting 309 ms; commit 0 ms)
2026-11-08T10:21:53Z [load_day 2025-02-15] 2025-02-15 hour 5: 174201 events in 0 files, snapshot none (task 5908 ms: download 3288 ms overlapping gunzip 910 ms, parse 4030 ms, sort 0 ms, write 0 ms, index 466 ms: 9 candidates, 64277 repo-hours, 776 releases; waiting 272 ms; commit 0 ms)
2026-11-08T10:22:02Z [load_day 2025-02-15] 2025-02-15 hour 6: 191700 events in 0 files, snapshot none (task 8815 ms: download 3283 ms overlapping gunzip 850 ms, parse 3676 ms, sort 0 ms, write 0 ms, index 3669 ms: 4 candidates, 81431 repo-hours, 1269 releases; waiting 339 ms; commit 0 ms)
2026-11-08T10:22:05Z [load_day 2025-02-15] 2025-02-15 hour 7: 178516 events in 0 files, snapshot none (task 10819 ms: download 3305 ms overlapping gunzip 841 ms, parse 3519 ms, sort 0 ms, write 0 ms, index 5717 ms: 8 candidates, 67104 repo-hours, 922 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:22:14Z [load_day 2025-02-15] 2025-02-15 hour 8: 188192 events in 0 files, snapshot none (task 6293 ms: download 3866 ms overlapping gunzip 975 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 562 ms: 3 candidates, 71733 repo-hours, 928 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:22:14Z [load_day 2025-02-15] 2025-02-15 hour 9: 190409 events in 0 files, snapshot none (task 6193 ms: download 3582 ms overlapping gunzip 898 ms, parse 3823 ms, sort 0 ms, write 0 ms, index 607 ms: 4 candidates, 77129 repo-hours, 1148 releases; waiting 577 ms; commit 0 ms)
2026-11-08T10:22:19Z [load_day 2025-02-15] 2025-02-15 hour 10: 190973 events in 0 files, snapshot none (task 4459 ms: download 2066 ms overlapping gunzip 692 ms, parse 2961 ms, sort 0 ms, write 0 ms, index 565 ms: 2 candidates, 74590 repo-hours, 1054 releases; waiting 22 ms; commit 0 ms)
2026-11-08T10:22:19Z [load_day 2025-02-15] 2025-02-15 hour 11: 189273 events in 0 files, snapshot none (task 4159 ms: download 1780 ms overlapping gunzip 632 ms, parse 2699 ms, sort 0 ms, write 0 ms, index 592 ms: 8 candidates, 70521 repo-hours, 924 releases; waiting 17 ms; commit 0 ms)
2026-11-08T10:22:25Z [load_day 2025-02-15] 2025-02-15 hour 12: 253922 events in 0 files, snapshot none (task 5359 ms: download 2554 ms overlapping gunzip 780 ms, parse 3524 ms, sort 0 ms, write 0 ms, index 808 ms: 14 candidates, 121567 repo-hours, 1127 releases; waiting 16 ms; commit 0 ms)
2026-11-08T10:22:25Z [load_day 2025-02-15] 2025-02-15 hour 13: 220466 events in 0 files, snapshot none (task 5009 ms: download 2526 ms overlapping gunzip 770 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 672 ms: 9 candidates, 99133 repo-hours, 843 releases; waiting 10 ms; commit 0 ms)
2026-11-08T10:22:30Z [load_day 2025-02-15] 2025-02-15 hour 14: 213840 events in 0 files, snapshot none (task 4973 ms: download 2487 ms overlapping gunzip 760 ms, parse 3360 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 83977 repo-hours, 935 releases; waiting 18 ms; commit 0 ms)
2026-11-08T10:22:30Z [load_day 2025-02-15] 2025-02-15 hour 15: 219635 events in 0 files, snapshot none (task 4914 ms: download 2377 ms overlapping gunzip 758 ms, parse 3214 ms, sort 0 ms, write 0 ms, index 750 ms: 7 candidates, 90253 repo-hours, 1092 releases; waiting 13 ms; commit 0 ms)
2026-11-08T10:22:38Z [load_day 2025-02-15] 2025-02-15 hour 16: 220813 events in 0 files, snapshot none (task 6672 ms: download 3939 ms overlapping gunzip 1069 ms, parse 4765 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 88644 repo-hours, 879 releases; waiting 17 ms; commit 0 ms)
2026-11-08T10:22:38Z [load_day 2025-02-15] 2025-02-15 hour 17: 214467 events in 0 files, snapshot none (task 6919 ms: download 4240 ms overlapping gunzip 1024 ms, parse 5061 ms, sort 0 ms, write 0 ms, index 604 ms: 8 candidates, 81778 repo-hours, 975 releases; waiting 12 ms; commit 0 ms)
2026-11-08T10:22:45Z [load_day 2025-02-15] 2025-02-15 hour 18: 222755 events in 0 files, snapshot none (task 6927 ms: download 4259 ms overlapping gunzip 1002 ms, parse 4403 ms, sort 0 ms, write 0 ms, index 721 ms: 9 candidates, 95714 repo-hours, 1227 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:22:45Z [load_day 2025-02-15] 2025-02-15 hour 19: 195508 events in 0 files, snapshot none (task 6185 ms: download 3569 ms overlapping gunzip 998 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 538 ms: 4 candidates, 70844 repo-hours, 883 releases; waiting 17 ms; commit 0 ms)
2026-11-08T10:22:51Z [load_day 2025-02-15] 2025-02-15 hour 20: 194120 events in 0 files, snapshot none (task 5773 ms: download 3537 ms overlapping gunzip 785 ms, parse 3537 ms, sort 0 ms, write 0 ms, index 653 ms: 6 candidates, 73401 repo-hours, 819 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:22:52Z [load_day 2025-02-15] 2025-02-15 hour 21: 193175 events in 0 files, snapshot none (task 6316 ms: download 3659 ms overlapping gunzip 877 ms, parse 3898 ms, sort 0 ms, write 0 ms, index 750 ms: 8 candidates, 74044 repo-hours, 956 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:22:57Z [load_day 2025-02-15] 2025-02-15 hour 22: 171252 events in 0 files, snapshot none (task 5621 ms: download 2994 ms overlapping gunzip 973 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 532 ms: 10 candidates, 63883 repo-hours, 904 releases; waiting 18 ms; commit 0 ms)
2026-11-08T10:22:57Z [load_day 2025-02-15] 2025-02-15 hour 23: 160416 events in 0 files, snapshot none (task 4638 ms: download 2145 ms overlapping gunzip 745 ms, parse 3113 ms, sort 0 ms, write 0 ms, index 506 ms: 8 candidates, 58309 repo-hours, 821 releases; waiting 13 ms; commit 0 ms)
2026-11-08T10:23:06Z [load_day 2025-02-15] 2025-02-15: repo_hour merged from 24 files to 1 (1904419 rows, 8813 ms)
2026-11-08T10:23:09Z [load_day 2025-02-15] 2025-02-15: index committed in 11434 ms (24 + 1 + 24 files)
2026-11-08T10:23:09Z [load_day 2025-02-15] 2025-02-15: 4669434 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:23:09Z [load_day 2025-02-15] attempt 1 succeeded