orcaLog in

Runs · run 3558

load_day 2025-02-13, attempt 1 succeeded

Host
73ccef5e07c2:254795
Started
2026-11-08T10:19:14Z
Ended
2026-11-08T10:21:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
943 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.1 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3558/load_day/2025-02-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:19:14Z [load_day 2025-02-13] attempt 1 started
2026-11-08T10:19:15Z [load_day 2025-02-13] 2025-02-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:19:24Z [load_day 2025-02-13] 2025-02-13 hour 0: 227497 events in 0 files, snapshot none (task 8899 ms: download 5946 ms overlapping gunzip 1328 ms, parse 5993 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 99288 repo-hours, 1553 releases; waiting 616 ms; commit 0 ms)
2026-11-08T10:19:24Z [load_day 2025-02-13] 2025-02-13 hour 1: 248852 events in 0 files, snapshot none (task 8533 ms: download 5285 ms overlapping gunzip 1291 ms, parse 5555 ms, sort 0 ms, write 0 ms, index 902 ms: 9 candidates, 118059 repo-hours, 1464 releases; waiting 485 ms; commit 0 ms)
2026-11-08T10:19:32Z [load_day 2025-02-13] 2025-02-13 hour 2: 213203 events in 0 files, snapshot none (task 7581 ms: download 4257 ms overlapping gunzip 1118 ms, parse 4645 ms, sort 0 ms, write 0 ms, index 933 ms: 8 candidates, 87676 repo-hours, 1235 releases; waiting 654 ms; commit 0 ms)
2026-11-08T10:19:33Z [load_day 2025-02-13] 2025-02-13 hour 3: 220997 events in 0 files, snapshot none (task 7757 ms: download 4206 ms overlapping gunzip 1202 ms, parse 5170 ms, sort 0 ms, write 0 ms, index 817 ms: 1 candidates, 83948 repo-hours, 4048 releases; waiting 290 ms; commit 0 ms)
2026-11-08T10:19:40Z [load_day 2025-02-13] 2025-02-13 hour 4: 202790 events in 0 files, snapshot none (task 7146 ms: download 4535 ms overlapping gunzip 1074 ms, parse 4716 ms, sort 0 ms, write 0 ms, index 586 ms: 5 candidates, 71400 repo-hours, 823 releases; waiting 447 ms; commit 0 ms)
2026-11-08T10:19:41Z [load_day 2025-02-13] 2025-02-13 hour 5: 218948 events in 0 files, snapshot none (task 8006 ms: download 5162 ms overlapping gunzip 1278 ms, parse 5218 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 78014 repo-hours, 921 releases; waiting 482 ms; commit 0 ms)
2026-11-08T10:19:50Z [load_day 2025-02-13] 2025-02-13 hour 6: 240600 events in 0 files, snapshot none (task 8761 ms: download 5862 ms overlapping gunzip 1330 ms, parse 5997 ms, sort 0 ms, write 0 ms, index 762 ms: 7 candidates, 101573 repo-hours, 1391 releases; waiting 354 ms; commit 0 ms)
2026-11-08T10:19:50Z [load_day 2025-02-13] 2025-02-13 hour 7: 239568 events in 0 files, snapshot none (task 8500 ms: download 5885 ms overlapping gunzip 1330 ms, parse 5617 ms, sort 0 ms, write 0 ms, index 705 ms: 7 candidates, 91232 repo-hours, 1051 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:20:00Z [load_day 2025-02-13] 2025-02-13 hour 8: 253202 events in 0 files, snapshot none (task 9694 ms: download 7155 ms overlapping gunzip 1572 ms, parse 6560 ms, sort 0 ms, write 0 ms, index 788 ms: 8 candidates, 100192 repo-hours, 1300 releases; waiting 533 ms; commit 0 ms)
2026-11-08T10:20:01Z [load_day 2025-02-13] 2025-02-13 hour 9: 267697 events in 0 files, snapshot none (task 9577 ms: download 6923 ms overlapping gunzip 1591 ms, parse 6387 ms, sort 0 ms, write 0 ms, index 777 ms: 5 candidates, 109462 repo-hours, 1391 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:20:09Z [load_day 2025-02-13] 2025-02-13 hour 10: 257264 events in 0 files, snapshot none (task 9163 ms: download 6281 ms overlapping gunzip 1391 ms, parse 5947 ms, sort 0 ms, write 0 ms, index 808 ms: 7 candidates, 104380 repo-hours, 1360 releases; waiting 647 ms; commit 0 ms)
2026-11-08T10:20:09Z [load_day 2025-02-13] 2025-02-13 hour 11: 244362 events in 0 files, snapshot none (task 8479 ms: download 5760 ms overlapping gunzip 1285 ms, parse 5355 ms, sort 0 ms, write 0 ms, index 714 ms: 9 candidates, 98687 repo-hours, 1268 releases; waiting 742 ms; commit 0 ms)
2026-11-08T10:20:22Z [load_day 2025-02-13] 2025-02-13 hour 12: 283128 events in 0 files, snapshot none (task 11879 ms: download 6083 ms overlapping gunzip 1610 ms, parse 7477 ms, sort 0 ms, write 0 ms, index 1806 ms: 11 candidates, 141441 repo-hours, 1516 releases; waiting 634 ms; commit 0 ms)
2026-11-08T10:20:22Z [load_day 2025-02-13] 2025-02-13 hour 13: 280958 events in 0 files, snapshot none (task 11830 ms: download 7087 ms overlapping gunzip 1681 ms, parse 7481 ms, sort 0 ms, write 0 ms, index 1756 ms: 10 candidates, 124380 repo-hours, 1338 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:20:35Z [load_day 2025-02-13] 2025-02-13 hour 14: 280036 events in 0 files, snapshot none (task 12830 ms: download 9578 ms overlapping gunzip 2125 ms, parse 9218 ms, sort 0 ms, write 0 ms, index 830 ms: 15 candidates, 111594 repo-hours, 1495 releases; waiting 352 ms; commit 0 ms)
2026-11-08T10:20:35Z [load_day 2025-02-13] 2025-02-13 hour 15: 277061 events in 0 files, snapshot none (task 12543 ms: download 9346 ms overlapping gunzip 2075 ms, parse 8935 ms, sort 0 ms, write 0 ms, index 960 ms: 8 candidates, 117394 repo-hours, 1676 releases; waiting 301 ms; commit 0 ms)
2026-11-08T10:20:48Z [load_day 2025-02-13] 2025-02-13 hour 16: 274756 events in 0 files, snapshot none (task 11916 ms: download 8680 ms overlapping gunzip 2031 ms, parse 8530 ms, sort 0 ms, write 0 ms, index 914 ms: 11 candidates, 112475 repo-hours, 1585 releases; waiting 228 ms; commit 0 ms)
2026-11-08T10:20:48Z [load_day 2025-02-13] 2025-02-13 hour 17: 267437 events in 0 files, snapshot none (task 11247 ms: download 7956 ms overlapping gunzip 1805 ms, parse 7735 ms, sort 0 ms, write 0 ms, index 996 ms: 4 candidates, 103598 repo-hours, 1358 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:20:59Z [load_day 2025-02-13] 2025-02-13 hour 18: 271046 events in 0 files, snapshot none (task 10601 ms: download 6931 ms overlapping gunzip 1651 ms, parse 7273 ms, sort 0 ms, write 0 ms, index 974 ms: 17 candidates, 116013 repo-hours, 1726 releases; waiting 380 ms; commit 0 ms)
2026-11-08T10:20:59Z [load_day 2025-02-13] 2025-02-13 hour 19: 247880 events in 0 files, snapshot none (task 9187 ms: download 6085 ms overlapping gunzip 1388 ms, parse 5971 ms, sort 0 ms, write 0 ms, index 961 ms: 20 candidates, 96732 repo-hours, 1450 releases; waiting 466 ms; commit 0 ms)
2026-11-08T10:21:09Z [load_day 2025-02-13] 2025-02-13 hour 20: 237579 events in 0 files, snapshot none (task 9165 ms: download 5834 ms overlapping gunzip 1429 ms, parse 6238 ms, sort 0 ms, write 0 ms, index 790 ms: 12 candidates, 92082 repo-hours, 1499 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:21:09Z [load_day 2025-02-13] 2025-02-13 hour 21: 229849 events in 0 files, snapshot none (task 9382 ms: download 6150 ms overlapping gunzip 1545 ms, parse 6273 ms, sort 0 ms, write 0 ms, index 824 ms: 16 candidates, 92012 repo-hours, 1369 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:21:17Z [load_day 2025-02-13] 2025-02-13 hour 22: 215612 events in 0 files, snapshot none (task 8137 ms: download 5365 ms overlapping gunzip 1291 ms, parse 5395 ms, sort 0 ms, write 0 ms, index 658 ms: 15 candidates, 80538 repo-hours, 1450 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:21:17Z [load_day 2025-02-13] 2025-02-13 hour 23: 211474 events in 0 files, snapshot none (task 8050 ms: download 5018 ms overlapping gunzip 1194 ms, parse 5252 ms, sort 0 ms, write 0 ms, index 807 ms: 14 candidates, 78258 repo-hours, 1058 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:21:28Z [load_day 2025-02-13] 2025-02-13: repo_hour merged from 24 files to 1 (2410428 rows, 10362 ms)
2026-11-08T10:21:30Z [load_day 2025-02-13] 2025-02-13: index committed in 12934 ms (24 + 1 + 24 files)
2026-11-08T10:21:30Z [load_day 2025-02-13] 2025-02-13: 5911796 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:21:30Z [load_day 2025-02-13] attempt 1 succeeded