orcaLog in

Runs · run 3918

load_day 2025-05-18, attempt 1 succeeded

Host
73ccef5e07c2:307529
Started
2026-11-08T12:00:42Z
Ended
2026-11-08T12:02:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
146.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3918/load_day/2025-05-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:00:42Z [load_day 2025-05-18] attempt 1 started
2026-11-08T12:00:43Z [load_day 2025-05-18] 2025-05-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:00:50Z [load_day 2025-05-18] 2025-05-18 hour 0: 164459 events in 0 files, snapshot none (task 6208 ms: download 3027 ms overlapping gunzip 932 ms, parse 4189 ms, sort 0 ms, write 0 ms, index 581 ms: 8 candidates, 72432 repo-hours, 1265 releases; waiting 204 ms; commit 0 ms)
2026-11-08T12:00:50Z [load_day 2025-05-18] 2025-05-18 hour 1: 193011 events in 0 files, snapshot none (task 6588 ms: download 3563 ms overlapping gunzip 888 ms, parse 3890 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 106749 repo-hours, 857 releases; waiting 626 ms; commit 0 ms)
2026-11-08T12:00:57Z [load_day 2025-05-18] 2025-05-18 hour 2: 163598 events in 0 files, snapshot none (task 6147 ms: download 3030 ms overlapping gunzip 850 ms, parse 3811 ms, sort 0 ms, write 0 ms, index 645 ms: 7 candidates, 75509 repo-hours, 845 releases; waiting 628 ms; commit 0 ms)
2026-11-08T12:00:57Z [load_day 2025-05-18] 2025-05-18 hour 3: 168637 events in 0 files, snapshot none (task 6019 ms: download 2968 ms overlapping gunzip 807 ms, parse 3697 ms, sort 0 ms, write 0 ms, index 615 ms: 6 candidates, 68972 repo-hours, 2614 releases; waiting 577 ms; commit 0 ms)
2026-11-08T12:01:02Z [load_day 2025-05-18] 2025-05-18 hour 4: 163682 events in 0 files, snapshot none (task 5020 ms: download 2339 ms overlapping gunzip 683 ms, parse 3036 ms, sort 0 ms, write 0 ms, index 558 ms: 9 candidates, 63706 repo-hours, 872 releases; waiting 466 ms; commit 0 ms)
2026-11-08T12:01:02Z [load_day 2025-05-18] 2025-05-18 hour 5: 168682 events in 0 files, snapshot none (task 4958 ms: download 2954 ms overlapping gunzip 726 ms, parse 3075 ms, sort 0 ms, write 0 ms, index 468 ms: 3 candidates, 62940 repo-hours, 773 releases; waiting 269 ms; commit 0 ms)
2026-11-08T12:01:11Z [load_day 2025-05-18] 2025-05-18 hour 6: 189450 events in 0 files, snapshot none (task 8454 ms: download 4928 ms overlapping gunzip 907 ms, parse 3796 ms, sort 0 ms, write 0 ms, index 1118 ms: 6 candidates, 82119 repo-hours, 882 releases; waiting 2242 ms; commit 0 ms)
2026-11-08T12:01:11Z [load_day 2025-05-18] 2025-05-18 hour 7: 184591 events in 0 files, snapshot none (task 5953 ms: download 3172 ms overlapping gunzip 900 ms, parse 3796 ms, sort 0 ms, write 0 ms, index 608 ms: 8 candidates, 69778 repo-hours, 737 releases; waiting 314 ms; commit 0 ms)
2026-11-08T12:01:18Z [load_day 2025-05-18] 2025-05-18 hour 8: 189872 events in 0 files, snapshot none (task 5589 ms: download 3124 ms overlapping gunzip 775 ms, parse 3371 ms, sort 0 ms, write 0 ms, index 592 ms: 5 candidates, 75881 repo-hours, 939 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:01:18Z [load_day 2025-05-18] 2025-05-18 hour 9: 201620 events in 0 files, snapshot none (task 5554 ms: download 3379 ms overlapping gunzip 761 ms, parse 3281 ms, sort 0 ms, write 0 ms, index 671 ms: 8 candidates, 82283 repo-hours, 1099 releases; waiting 606 ms; commit 0 ms)
2026-11-08T12:01:24Z [load_day 2025-05-18] 2025-05-18 hour 10: 197747 events in 0 files, snapshot none (task 5986 ms: download 3714 ms overlapping gunzip 802 ms, parse 3420 ms, sort 0 ms, write 0 ms, index 637 ms: 7 candidates, 78202 repo-hours, 874 releases; waiting 845 ms; commit 0 ms)
2026-11-08T12:01:24Z [load_day 2025-05-18] 2025-05-18 hour 11: 203706 events in 0 files, snapshot none (task 5510 ms: download 3383 ms overlapping gunzip 752 ms, parse 3282 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 77789 repo-hours, 958 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:01:31Z [load_day 2025-05-18] 2025-05-18 hour 12: 251743 events in 0 files, snapshot none (task 6132 ms: download 3233 ms overlapping gunzip 819 ms, parse 3678 ms, sort 0 ms, write 0 ms, index 885 ms: 14 candidates, 127213 repo-hours, 1020 releases; waiting 384 ms; commit 0 ms)
2026-11-08T12:01:31Z [load_day 2025-05-18] 2025-05-18 hour 13: 240198 events in 0 files, snapshot none (task 6487 ms: download 3423 ms overlapping gunzip 870 ms, parse 3930 ms, sort 0 ms, write 0 ms, index 819 ms: 11 candidates, 111713 repo-hours, 1003 releases; waiting 270 ms; commit 0 ms)
2026-11-08T12:01:39Z [load_day 2025-05-18] 2025-05-18 hour 14: 223421 events in 0 files, snapshot none (task 7763 ms: download 4522 ms overlapping gunzip 1147 ms, parse 4930 ms, sort 0 ms, write 0 ms, index 811 ms: 9 candidates, 90514 repo-hours, 1013 releases; waiting 552 ms; commit 0 ms)
2026-11-08T12:01:39Z [load_day 2025-05-18] 2025-05-18 hour 15: 232022 events in 0 files, snapshot none (task 7684 ms: download 4537 ms overlapping gunzip 1105 ms, parse 4979 ms, sort 0 ms, write 0 ms, index 705 ms: 11 candidates, 98437 repo-hours, 1256 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:01:48Z [load_day 2025-05-18] 2025-05-18 hour 16: 224137 events in 0 files, snapshot none (task 8354 ms: download 4846 ms overlapping gunzip 1208 ms, parse 5189 ms, sort 0 ms, write 0 ms, index 807 ms: 7 candidates, 92345 repo-hours, 981 releases; waiting 816 ms; commit 0 ms)
2026-11-08T12:01:48Z [load_day 2025-05-18] 2025-05-18 hour 17: 216430 events in 0 files, snapshot none (task 7542 ms: download 4553 ms overlapping gunzip 1084 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 841 ms: 16 candidates, 84163 repo-hours, 959 releases; waiting 586 ms; commit 0 ms)
2026-11-08T12:01:56Z [load_day 2025-05-18] 2025-05-18 hour 18: 226244 events in 0 files, snapshot none (task 7584 ms: download 4236 ms overlapping gunzip 1020 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 1147 ms: 10 candidates, 99795 repo-hours, 1151 releases; waiting 199 ms; commit 0 ms)
2026-11-08T12:01:56Z [load_day 2025-05-18] 2025-05-18 hour 19: 202594 events in 0 files, snapshot none (task 7305 ms: download 4151 ms overlapping gunzip 1029 ms, parse 4607 ms, sort 0 ms, write 0 ms, index 901 ms: 5 candidates, 75847 repo-hours, 974 releases; waiting 480 ms; commit 0 ms)
2026-11-08T12:02:03Z [load_day 2025-05-18] 2025-05-18 hour 20: 198062 events in 0 files, snapshot none (task 6520 ms: download 3571 ms overlapping gunzip 911 ms, parse 4121 ms, sort 0 ms, write 0 ms, index 643 ms: 11 candidates, 77137 repo-hours, 941 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:02:04Z [load_day 2025-05-18] 2025-05-18 hour 21: 190500 events in 0 files, snapshot none (task 7976 ms: download 5457 ms overlapping gunzip 860 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 531 ms: 13 candidates, 73522 repo-hours, 1050 releases; waiting 2444 ms; commit 0 ms)
2026-11-08T12:02:10Z [load_day 2025-05-18] 2025-05-18 hour 22: 170182 events in 0 files, snapshot none (task 6841 ms: download 2867 ms overlapping gunzip 1013 ms, parse 4522 ms, sort 0 ms, write 0 ms, index 619 ms: 13 candidates, 64012 repo-hours, 930 releases; waiting 389 ms; commit 0 ms)
2026-11-08T12:02:12Z [load_day 2025-05-18] 2025-05-18 hour 23: 163349 events in 0 files, snapshot none (task 6841 ms: download 3934 ms overlapping gunzip 931 ms, parse 4491 ms, sort 0 ms, write 0 ms, index 523 ms: 6 candidates, 60585 repo-hours, 752 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:02:20Z [load_day 2025-05-18] 2025-05-18: repo_hour merged from 24 files to 1 (1971643 rows, 8569 ms)
2026-11-08T12:02:23Z [load_day 2025-05-18] 2025-05-18: index committed in 11065 ms (24 + 1 + 24 files)
2026-11-08T12:02:23Z [load_day 2025-05-18] 2025-05-18: 4727937 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:02:23Z [load_day 2025-05-18] attempt 1 succeeded