orcaLog in

Runs · run 3432

load_day 2025-01-14, attempt 1 succeeded

Host
73ccef5e07c2:237337
Started
2026-11-08T09:48:40Z
Ended
2026-11-08T09:50:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
805 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
198.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3432/load_day/2025-01-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:48:40Z [load_day 2025-01-14] attempt 1 started
2026-11-08T09:48:41Z [load_day 2025-01-14] 2025-01-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:48:50Z [load_day 2025-01-14] 2025-01-14 hour 0: 168141 events in 0 files, snapshot none (task 8518 ms: download 4706 ms overlapping gunzip 1330 ms, parse 5346 ms, sort 0 ms, write 0 ms, index 985 ms: 13 candidates, 88640 repo-hours, 860 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:48:51Z [load_day 2025-01-14] 2025-01-14 hour 1: 212141 events in 0 files, snapshot none (task 9973 ms: download 6061 ms overlapping gunzip 1519 ms, parse 6517 ms, sort 0 ms, write 0 ms, index 1172 ms: 6 candidates, 114289 repo-hours, 988 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:48:59Z [load_day 2025-01-14] 2025-01-14 hour 2: 184622 events in 0 files, snapshot none (task 8598 ms: download 4506 ms overlapping gunzip 1213 ms, parse 5161 ms, sort 0 ms, write 0 ms, index 1402 ms: 10 candidates, 80222 repo-hours, 1080 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:49:00Z [load_day 2025-01-14] 2025-01-14 hour 3: 193695 events in 0 files, snapshot none (task 8069 ms: download 4096 ms overlapping gunzip 1219 ms, parse 5180 ms, sort 0 ms, write 0 ms, index 846 ms: 5 candidates, 77536 repo-hours, 4080 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:49:07Z [load_day 2025-01-14] 2025-01-14 hour 4: 171325 events in 0 files, snapshot none (task 7346 ms: download 4477 ms overlapping gunzip 1208 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 616 ms: 12 candidates, 63024 repo-hours, 1014 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:49:07Z [load_day 2025-01-14] 2025-01-14 hour 5: 178772 events in 0 files, snapshot none (task 6961 ms: download 4235 ms overlapping gunzip 1088 ms, parse 4549 ms, sort 0 ms, write 0 ms, index 576 ms: 1 candidates, 68468 repo-hours, 859 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:49:16Z [load_day 2025-01-14] 2025-01-14 hour 6: 200891 events in 0 files, snapshot none (task 8428 ms: download 4973 ms overlapping gunzip 1291 ms, parse 5251 ms, sort 0 ms, write 0 ms, index 1080 ms: 9 candidates, 88583 repo-hours, 1103 releases; waiting 573 ms; commit 0 ms)
2026-11-08T09:49:17Z [load_day 2025-01-14] 2025-01-14 hour 7: 206049 events in 0 files, snapshot none (task 9110 ms: download 5846 ms overlapping gunzip 1539 ms, parse 6060 ms, sort 0 ms, write 0 ms, index 760 ms: 10 candidates, 80722 repo-hours, 1122 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:49:25Z [load_day 2025-01-14] 2025-01-14 hour 8: 223741 events in 0 files, snapshot none (task 8850 ms: download 5118 ms overlapping gunzip 1360 ms, parse 5501 ms, sort 0 ms, write 0 ms, index 1201 ms: 3 candidates, 91967 repo-hours, 1148 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:49:27Z [load_day 2025-01-14] 2025-01-14 hour 9: 241948 events in 0 files, snapshot none (task 10181 ms: download 6781 ms overlapping gunzip 1587 ms, parse 6665 ms, sort 0 ms, write 0 ms, index 1104 ms: 15 candidates, 99925 repo-hours, 1440 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:49:35Z [load_day 2025-01-14] 2025-01-14 hour 10: 238653 events in 0 files, snapshot none (task 9151 ms: download 5450 ms overlapping gunzip 1483 ms, parse 6121 ms, sort 0 ms, write 0 ms, index 1080 ms: 12 candidates, 93488 repo-hours, 1275 releases; waiting 189 ms; commit 0 ms)
2026-11-08T09:49:37Z [load_day 2025-01-14] 2025-01-14 hour 11: 245786 events in 0 files, snapshot none (task 8723 ms: download 5725 ms overlapping gunzip 1289 ms, parse 5912 ms, sort 0 ms, write 0 ms, index 771 ms: 4 candidates, 87458 repo-hours, 1186 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:49:44Z [load_day 2025-01-14] 2025-01-14 hour 12: 297542 events in 0 files, snapshot none (task 8172 ms: download 5061 ms overlapping gunzip 1174 ms, parse 5102 ms, sort 0 ms, write 0 ms, index 1008 ms: 8 candidates, 129653 repo-hours, 1296 releases; waiting 547 ms; commit 0 ms)
2026-11-08T09:49:46Z [load_day 2025-01-14] 2025-01-14 hour 13: 290370 events in 0 files, snapshot none (task 8509 ms: download 5461 ms overlapping gunzip 1244 ms, parse 5455 ms, sort 0 ms, write 0 ms, index 925 ms: 11 candidates, 113049 repo-hours, 1217 releases; waiting 333 ms; commit 0 ms)
2026-11-08T09:49:53Z [load_day 2025-01-14] 2025-01-14 hour 14: 284102 events in 0 files, snapshot none (task 9309 ms: download 6246 ms overlapping gunzip 1485 ms, parse 6345 ms, sort 0 ms, write 0 ms, index 792 ms: 8 candidates, 101885 repo-hours, 1332 releases; waiting 377 ms; commit 0 ms)
2026-11-08T09:49:55Z [load_day 2025-01-14] 2025-01-14 hour 15: 285788 events in 0 files, snapshot none (task 9110 ms: download 6253 ms overlapping gunzip 1385 ms, parse 6073 ms, sort 0 ms, write 0 ms, index 909 ms: 7 candidates, 108738 repo-hours, 1384 releases; waiting 460 ms; commit 0 ms)
2026-11-08T09:50:05Z [load_day 2025-01-14] 2025-01-14 hour 16: 273296 events in 0 files, snapshot none (task 10775 ms: download 8091 ms overlapping gunzip 1646 ms, parse 7627 ms, sort 0 ms, write 0 ms, index 861 ms: 10 candidates, 102918 repo-hours, 1227 releases; waiting 363 ms; commit 0 ms)
2026-11-08T09:50:06Z [load_day 2025-01-14] 2025-01-14 hour 17: 246083 events in 0 files, snapshot none (task 10067 ms: download 7266 ms overlapping gunzip 1489 ms, parse 6956 ms, sort 0 ms, write 0 ms, index 857 ms: 10 candidates, 92092 repo-hours, 1126 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:50:16Z [load_day 2025-01-14] 2025-01-14 hour 18: 269568 events in 0 files, snapshot none (task 11023 ms: download 7571 ms overlapping gunzip 1840 ms, parse 7531 ms, sort 0 ms, write 0 ms, index 911 ms: 12 candidates, 107599 repo-hours, 1279 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:50:16Z [load_day 2025-01-14] 2025-01-14 hour 19: 247804 events in 0 files, snapshot none (task 9527 ms: download 6070 ms overlapping gunzip 1467 ms, parse 6406 ms, sort 0 ms, write 0 ms, index 878 ms: 10 candidates, 83658 repo-hours, 1090 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:50:26Z [load_day 2025-01-14] 2025-01-14 hour 20: 242753 events in 0 files, snapshot none (task 9684 ms: download 7073 ms overlapping gunzip 1611 ms, parse 6690 ms, sort 0 ms, write 0 ms, index 612 ms: 10 candidates, 84036 repo-hours, 1219 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:50:26Z [load_day 2025-01-14] 2025-01-14 hour 21: 239638 events in 0 files, snapshot none (task 9453 ms: download 6565 ms overlapping gunzip 1561 ms, parse 6384 ms, sort 0 ms, write 0 ms, index 698 ms: 6 candidates, 83639 repo-hours, 1319 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:50:36Z [load_day 2025-01-14] 2025-01-14 hour 22: 225370 events in 0 files, snapshot none (task 8993 ms: download 6502 ms overlapping gunzip 1468 ms, parse 6184 ms, sort 0 ms, write 0 ms, index 530 ms: 6 candidates, 72375 repo-hours, 1328 releases; waiting 585 ms; commit 0 ms)
2026-11-08T09:50:36Z [load_day 2025-01-14] 2025-01-14 hour 23: 212022 events in 0 files, snapshot none (task 8452 ms: download 5855 ms overlapping gunzip 1369 ms, parse 5737 ms, sort 0 ms, write 0 ms, index 553 ms: 8 candidates, 68287 repo-hours, 982 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:50:46Z [load_day 2025-01-14] 2025-01-14: repo_hour merged from 24 files to 1 (2182251 rows, 9890 ms)
2026-11-08T09:50:49Z [load_day 2025-01-14] 2025-01-14: index committed in 12793 ms (24 + 1 + 24 files)
2026-11-08T09:50:49Z [load_day 2025-01-14] 2025-01-14: 5580100 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:50:49Z [load_day 2025-01-14] attempt 1 succeeded