orcaLog in

Runs · run 3850

load_day 2025-05-01, attempt 1 succeeded

Host
73ccef5e07c2:297036
Started
2026-11-08T11:42:18Z
Ended
2026-11-08T11:44:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
791 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
198.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3850/load_day/2025-05-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:42:18Z [load_day 2025-05-01] attempt 1 started
2026-11-08T11:42:19Z [load_day 2025-05-01] 2025-05-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:42:30Z [load_day 2025-05-01] 2025-05-01 hour 0: 195836 events in 0 files, snapshot none (task 10171 ms: download 7171 ms overlapping gunzip 1824 ms, parse 6901 ms, sort 0 ms, write 0 ms, index 678 ms: 7 candidates, 84501 repo-hours, 1573 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:42:30Z [load_day 2025-05-01] 2025-05-01 hour 1: 221373 events in 0 files, snapshot none (task 10321 ms: download 7473 ms overlapping gunzip 1687 ms, parse 7141 ms, sort 0 ms, write 0 ms, index 794 ms: 5 candidates, 114429 repo-hours, 1249 releases; waiting 425 ms; commit 0 ms)
2026-11-08T11:42:40Z [load_day 2025-05-01] 2025-05-01 hour 2: 200306 events in 0 files, snapshot none (task 10512 ms: download 7216 ms overlapping gunzip 1775 ms, parse 7185 ms, sort 0 ms, write 0 ms, index 692 ms: 3 candidates, 86202 repo-hours, 1139 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:42:40Z [load_day 2025-05-01] 2025-05-01 hour 3: 191145 events in 0 files, snapshot none (task 10025 ms: download 6887 ms overlapping gunzip 1689 ms, parse 6737 ms, sort 0 ms, write 0 ms, index 684 ms: 4 candidates, 75628 repo-hours, 2884 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:42:50Z [load_day 2025-05-01] 2025-05-01 hour 4: 184259 events in 0 files, snapshot none (task 8562 ms: download 5059 ms overlapping gunzip 1381 ms, parse 5391 ms, sort 0 ms, write 0 ms, index 758 ms: 6 candidates, 67569 repo-hours, 963 releases; waiting 678 ms; commit 0 ms)
2026-11-08T11:42:50Z [load_day 2025-05-01] 2025-05-01 hour 5: 192940 events in 0 files, snapshot none (task 7867 ms: download 4911 ms overlapping gunzip 1269 ms, parse 5023 ms, sort 0 ms, write 0 ms, index 806 ms: 1 candidates, 71084 repo-hours, 864 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:42:59Z [load_day 2025-05-01] 2025-05-01 hour 6: 205519 events in 0 files, snapshot none (task 8986 ms: download 5668 ms overlapping gunzip 1306 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 861 ms: 8 candidates, 85975 repo-hours, 962 releases; waiting 1201 ms; commit 0 ms)
2026-11-08T11:42:59Z [load_day 2025-05-01] 2025-05-01 hour 7: 205101 events in 0 files, snapshot none (task 8616 ms: download 5169 ms overlapping gunzip 1414 ms, parse 5404 ms, sort 0 ms, write 0 ms, index 1011 ms: 3 candidates, 76496 repo-hours, 970 releases; waiting 498 ms; commit 0 ms)
2026-11-08T11:43:08Z [load_day 2025-05-01] 2025-05-01 hour 8: 210544 events in 0 files, snapshot none (task 8263 ms: download 5368 ms overlapping gunzip 1325 ms, parse 5319 ms, sort 0 ms, write 0 ms, index 804 ms: 9 candidates, 83650 repo-hours, 1074 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:43:08Z [load_day 2025-05-01] 2025-05-01 hour 9: 222294 events in 0 files, snapshot none (task 8214 ms: download 5001 ms overlapping gunzip 1261 ms, parse 5204 ms, sort 0 ms, write 0 ms, index 1170 ms: 8 candidates, 88563 repo-hours, 1316 releases; waiting 260 ms; commit 0 ms)
2026-11-08T11:43:16Z [load_day 2025-05-01] 2025-05-01 hour 10: 218110 events in 0 files, snapshot none (task 7834 ms: download 5196 ms overlapping gunzip 1264 ms, parse 5011 ms, sort 0 ms, write 0 ms, index 697 ms: 5 candidates, 86322 repo-hours, 973 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:43:16Z [load_day 2025-05-01] 2025-05-01 hour 11: 220443 events in 0 files, snapshot none (task 7716 ms: download 5204 ms overlapping gunzip 1261 ms, parse 5095 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 83084 repo-hours, 956 releases; waiting 362 ms; commit 0 ms)
2026-11-08T11:43:25Z [load_day 2025-05-01] 2025-05-01 hour 12: 266416 events in 0 files, snapshot none (task 8108 ms: download 5377 ms overlapping gunzip 1189 ms, parse 5227 ms, sort 0 ms, write 0 ms, index 875 ms: 6 candidates, 129613 repo-hours, 1258 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:43:25Z [load_day 2025-05-01] 2025-05-01 hour 13: 257941 events in 0 files, snapshot none (task 7994 ms: download 5292 ms overlapping gunzip 1225 ms, parse 5125 ms, sort 0 ms, write 0 ms, index 793 ms: 9 candidates, 116719 repo-hours, 1157 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:43:36Z [load_day 2025-05-01] 2025-05-01 hour 14: 254139 events in 0 files, snapshot none (task 10447 ms: download 7064 ms overlapping gunzip 1704 ms, parse 6827 ms, sort 0 ms, write 0 ms, index 1061 ms: 7 candidates, 101041 repo-hours, 1128 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:43:36Z [load_day 2025-05-01] 2025-05-01 hour 15: 253928 events in 0 files, snapshot none (task 10828 ms: download 7813 ms overlapping gunzip 1761 ms, parse 7114 ms, sort 0 ms, write 0 ms, index 854 ms: 6 candidates, 105390 repo-hours, 1248 releases; waiting 792 ms; commit 0 ms)
2026-11-08T11:43:47Z [load_day 2025-05-01] 2025-05-01 hour 16: 244550 events in 0 files, snapshot none (task 10947 ms: download 8059 ms overlapping gunzip 1763 ms, parse 7241 ms, sort 0 ms, write 0 ms, index 959 ms: 7 candidates, 101535 repo-hours, 1348 releases; waiting 661 ms; commit 0 ms)
2026-11-08T11:43:47Z [load_day 2025-05-01] 2025-05-01 hour 17: 241504 events in 0 files, snapshot none (task 10351 ms: download 7592 ms overlapping gunzip 1632 ms, parse 7106 ms, sort 0 ms, write 0 ms, index 784 ms: 12 candidates, 94176 repo-hours, 1087 releases; waiting 539 ms; commit 0 ms)
2026-11-08T11:43:59Z [load_day 2025-05-01] 2025-05-01 hour 18: 246850 events in 0 files, snapshot none (task 11428 ms: download 7596 ms overlapping gunzip 1842 ms, parse 7795 ms, sort 0 ms, write 0 ms, index 1016 ms: 10 candidates, 106667 repo-hours, 1301 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:43:59Z [load_day 2025-05-01] 2025-05-01 hour 19: 230791 events in 0 files, snapshot none (task 9924 ms: download 6332 ms overlapping gunzip 1695 ms, parse 6706 ms, sort 0 ms, write 0 ms, index 932 ms: 9 candidates, 88046 repo-hours, 1166 releases; waiting 299 ms; commit 0 ms)
2026-11-08T11:44:10Z [load_day 2025-05-01] 2025-05-01 hour 20: 224951 events in 0 files, snapshot none (task 10026 ms: download 6663 ms overlapping gunzip 1582 ms, parse 6915 ms, sort 0 ms, write 0 ms, index 703 ms: 5 candidates, 85880 repo-hours, 1102 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:44:10Z [load_day 2025-05-01] 2025-05-01 hour 21: 212507 events in 0 files, snapshot none (task 9144 ms: download 6059 ms overlapping gunzip 1514 ms, parse 6358 ms, sort 0 ms, write 0 ms, index 764 ms: 6 candidates, 80133 repo-hours, 1250 releases; waiting 184 ms; commit 0 ms)
2026-11-08T11:44:19Z [load_day 2025-05-01] 2025-05-01 hour 22: 198798 events in 0 files, snapshot none (task 8065 ms: download 5169 ms overlapping gunzip 1276 ms, parse 5354 ms, sort 0 ms, write 0 ms, index 573 ms: 4 candidates, 72212 repo-hours, 1025 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:44:19Z [load_day 2025-05-01] 2025-05-01 hour 23: 184304 events in 0 files, snapshot none (task 7548 ms: download 4368 ms overlapping gunzip 1185 ms, parse 5035 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 67285 repo-hours, 1111 releases; waiting 283 ms; commit 0 ms)
2026-11-08T11:44:28Z [load_day 2025-05-01] 2025-05-01: repo_hour merged from 24 files to 1 (2152200 rows, 9608 ms)
2026-11-08T11:44:31Z [load_day 2025-05-01] 2025-05-01: index committed in 12392 ms (24 + 1 + 24 files)
2026-11-08T11:44:31Z [load_day 2025-05-01] 2025-05-01: 5284549 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:44:31Z [load_day 2025-05-01] attempt 1 succeeded