orcaLog in

Runs · run 3530

load_day 2025-02-07, attempt 1 succeeded

Host
73ccef5e07c2:251127
Started
2026-11-08T10:12:59Z
Ended
2026-11-08T10:15:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
869 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
197.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3530/load_day/2025-02-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:12:59Z [load_day 2025-02-07] attempt 1 started
2026-11-08T10:13:00Z [load_day 2025-02-07] 2025-02-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:13:09Z [load_day 2025-02-07] 2025-02-07 hour 0: 204468 events in 0 files, snapshot none (task 8459 ms: download 5374 ms overlapping gunzip 1377 ms, parse 5575 ms, sort 0 ms, write 0 ms, index 800 ms: 15 candidates, 98136 repo-hours, 1290 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:13:09Z [load_day 2025-02-07] 2025-02-07 hour 1: 224415 events in 0 files, snapshot none (task 8323 ms: download 5014 ms overlapping gunzip 1233 ms, parse 5181 ms, sort 0 ms, write 0 ms, index 1070 ms: 7 candidates, 119440 repo-hours, 1159 releases; waiting 530 ms; commit 0 ms)
2026-11-08T10:13:17Z [load_day 2025-02-07] 2025-02-07 hour 2: 195268 events in 0 files, snapshot none (task 7709 ms: download 4587 ms overlapping gunzip 1246 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 733 ms: 6 candidates, 86559 repo-hours, 985 releases; waiting 202 ms; commit 0 ms)
2026-11-08T10:13:18Z [load_day 2025-02-07] 2025-02-07 hour 3: 212050 events in 0 files, snapshot none (task 8015 ms: download 4606 ms overlapping gunzip 1317 ms, parse 5500 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 82681 repo-hours, 4235 releases; waiting 225 ms; commit 0 ms)
2026-11-08T10:13:25Z [load_day 2025-02-07] 2025-02-07 hour 4: 191012 events in 0 files, snapshot none (task 7059 ms: download 4557 ms overlapping gunzip 1113 ms, parse 4587 ms, sort 0 ms, write 0 ms, index 542 ms: 7 candidates, 70276 repo-hours, 820 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:13:26Z [load_day 2025-02-07] 2025-02-07 hour 5: 204745 events in 0 files, snapshot none (task 7449 ms: download 5137 ms overlapping gunzip 1187 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 586 ms: 9 candidates, 75183 repo-hours, 919 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:13:32Z [load_day 2025-02-07] 2025-02-07 hour 6: 227071 events in 0 files, snapshot none (task 6883 ms: download 4300 ms overlapping gunzip 1061 ms, parse 4342 ms, sort 0 ms, write 0 ms, index 722 ms: 12 candidates, 98150 repo-hours, 1126 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:13:33Z [load_day 2025-02-07] 2025-02-07 hour 7: 221063 events in 0 files, snapshot none (task 7218 ms: download 4651 ms overlapping gunzip 1080 ms, parse 4592 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 85394 repo-hours, 1116 releases; waiting 561 ms; commit 0 ms)
2026-11-08T10:13:41Z [load_day 2025-02-07] 2025-02-07 hour 8: 240203 events in 0 files, snapshot none (task 8173 ms: download 5594 ms overlapping gunzip 1247 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 680 ms: 7 candidates, 95787 repo-hours, 1268 releases; waiting 1015 ms; commit 0 ms)
2026-11-08T10:13:42Z [load_day 2025-02-07] 2025-02-07 hour 9: 253125 events in 0 files, snapshot none (task 8018 ms: download 5503 ms overlapping gunzip 1280 ms, parse 5057 ms, sort 0 ms, write 0 ms, index 735 ms: 5 candidates, 106617 repo-hours, 1494 releases; waiting 710 ms; commit 0 ms)
2026-11-08T10:13:52Z [load_day 2025-02-07] 2025-02-07 hour 10: 238798 events in 0 files, snapshot none (task 10267 ms: download 7426 ms overlapping gunzip 1621 ms, parse 6843 ms, sort 0 ms, write 0 ms, index 938 ms: 11 candidates, 99584 repo-hours, 1346 releases; waiting 569 ms; commit 0 ms)
2026-11-08T10:13:52Z [load_day 2025-02-07] 2025-02-07 hour 11: 232881 events in 0 files, snapshot none (task 9464 ms: download 6421 ms overlapping gunzip 1429 ms, parse 6087 ms, sort 0 ms, write 0 ms, index 981 ms: 9 candidates, 91090 repo-hours, 1208 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:14:03Z [load_day 2025-02-07] 2025-02-07 hour 12: 281115 events in 0 files, snapshot none (task 10336 ms: download 6584 ms overlapping gunzip 1608 ms, parse 6807 ms, sort 0 ms, write 0 ms, index 1150 ms: 7 candidates, 138092 repo-hours, 1260 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:14:03Z [load_day 2025-02-07] 2025-02-07 hour 13: 263260 events in 0 files, snapshot none (task 10026 ms: download 6325 ms overlapping gunzip 1626 ms, parse 7014 ms, sort 0 ms, write 0 ms, index 903 ms: 7 candidates, 118790 repo-hours, 1210 releases; waiting 196 ms; commit 0 ms)
2026-11-08T10:14:14Z [load_day 2025-02-07] 2025-02-07 hour 14: 249929 events in 0 files, snapshot none (task 11261 ms: download 7911 ms overlapping gunzip 1660 ms, parse 7369 ms, sort 0 ms, write 0 ms, index 1386 ms: 8 candidates, 104092 repo-hours, 1321 releases; waiting 541 ms; commit 0 ms)
2026-11-08T10:14:14Z [load_day 2025-02-07] 2025-02-07 hour 15: 258588 events in 0 files, snapshot none (task 10713 ms: download 7651 ms overlapping gunzip 1683 ms, parse 7048 ms, sort 0 ms, write 0 ms, index 1079 ms: 3 candidates, 109887 repo-hours, 1438 releases; waiting 551 ms; commit 0 ms)
2026-11-08T10:14:24Z [load_day 2025-02-07] 2025-02-07 hour 16: 256562 events in 0 files, snapshot none (task 9056 ms: download 6306 ms overlapping gunzip 1394 ms, parse 6311 ms, sort 0 ms, write 0 ms, index 906 ms: 12 candidates, 105517 repo-hours, 1329 releases; waiting 222 ms; commit 0 ms)
2026-11-08T10:14:24Z [load_day 2025-02-07] 2025-02-07 hour 17: 247936 events in 0 files, snapshot none (task 9430 ms: download 6764 ms overlapping gunzip 1606 ms, parse 6287 ms, sort 0 ms, write 0 ms, index 765 ms: 10 candidates, 97033 repo-hours, 1136 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:14:34Z [load_day 2025-02-07] 2025-02-07 hour 18: 247434 events in 0 files, snapshot none (task 9877 ms: download 7287 ms overlapping gunzip 1601 ms, parse 6727 ms, sort 0 ms, write 0 ms, index 791 ms: 6 candidates, 109515 repo-hours, 1304 releases; waiting 530 ms; commit 0 ms)
2026-11-08T10:14:34Z [load_day 2025-02-07] 2025-02-07 hour 19: 221569 events in 0 files, snapshot none (task 8493 ms: download 5886 ms overlapping gunzip 1319 ms, parse 5848 ms, sort 0 ms, write 0 ms, index 598 ms: 12 candidates, 83870 repo-hours, 1093 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:14:44Z [load_day 2025-02-07] 2025-02-07 hour 20: 218304 events in 0 files, snapshot none (task 8978 ms: download 5665 ms overlapping gunzip 1301 ms, parse 5986 ms, sort 0 ms, write 0 ms, index 891 ms: 10 candidates, 83165 repo-hours, 1079 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:14:44Z [load_day 2025-02-07] 2025-02-07 hour 21: 214614 events in 0 files, snapshot none (task 7590 ms: download 4793 ms overlapping gunzip 1203 ms, parse 4981 ms, sort 0 ms, write 0 ms, index 873 ms: 8 candidates, 83638 repo-hours, 1158 releases; waiting 234 ms; commit 0 ms)
2026-11-08T10:14:53Z [load_day 2025-02-07] 2025-02-07 hour 22: 196066 events in 0 files, snapshot none (task 8608 ms: download 5786 ms overlapping gunzip 1338 ms, parse 5803 ms, sort 0 ms, write 0 ms, index 671 ms: 8 candidates, 73349 repo-hours, 1110 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:14:53Z [load_day 2025-02-07] 2025-02-07 hour 23: 179362 events in 0 files, snapshot none (task 8262 ms: download 4899 ms overlapping gunzip 1321 ms, parse 5452 ms, sort 0 ms, write 0 ms, index 685 ms: 5 candidates, 65673 repo-hours, 982 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:15:03Z [load_day 2025-02-07] 2025-02-07: repo_hour merged from 24 files to 1 (2281518 rows, 9856 ms)
2026-11-08T10:15:06Z [load_day 2025-02-07] 2025-02-07: index committed in 13545 ms (24 + 1 + 24 files)
2026-11-08T10:15:06Z [load_day 2025-02-07] 2025-02-07: 5479838 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:15:06Z [load_day 2025-02-07] attempt 1 succeeded