orcaLog in

Runs · run 3662

load_day 2025-03-13, attempt 1 succeeded

Host
73ccef5e07c2:269528
Started
2026-11-08T10:49:11Z
Ended
2026-11-08T10:51:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
916 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
211.1 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3662/load_day/2025-03-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:49:11Z [load_day 2025-03-13] attempt 1 started
2026-11-08T10:49:12Z [load_day 2025-03-13] 2025-03-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:49:22Z [load_day 2025-03-13] 2025-03-13 hour 0: 226264 events in 0 files, snapshot none (task 9643 ms: download 5057 ms overlapping gunzip 1332 ms, parse 5684 ms, sort 0 ms, write 0 ms, index 1596 ms: 4 candidates, 102689 repo-hours, 1297 releases; waiting 598 ms; commit 0 ms)
2026-11-08T10:49:22Z [load_day 2025-03-13] 2025-03-13 hour 1: 254299 events in 0 files, snapshot none (task 9709 ms: download 5860 ms overlapping gunzip 1469 ms, parse 6137 ms, sort 0 ms, write 0 ms, index 1351 ms: 9 candidates, 131128 repo-hours, 1152 releases; waiting 464 ms; commit 0 ms)
2026-11-08T10:49:31Z [load_day 2025-03-13] 2025-03-13 hour 2: 214459 events in 0 files, snapshot none (task 8318 ms: download 5423 ms overlapping gunzip 1206 ms, parse 5314 ms, sort 0 ms, write 0 ms, index 1037 ms: 3 candidates, 91771 repo-hours, 1019 releases; waiting 538 ms; commit 0 ms)
2026-11-08T10:49:31Z [load_day 2025-03-13] 2025-03-13 hour 3: 222945 events in 0 files, snapshot none (task 7909 ms: download 4673 ms overlapping gunzip 1242 ms, parse 5196 ms, sort 0 ms, write 0 ms, index 945 ms: 4 candidates, 90855 repo-hours, 3849 releases; waiting 253 ms; commit 0 ms)
2026-11-08T10:49:41Z [load_day 2025-03-13] 2025-03-13 hour 4: 207945 events in 0 files, snapshot none (task 8855 ms: download 5461 ms overlapping gunzip 1430 ms, parse 5942 ms, sort 0 ms, write 0 ms, index 732 ms: 9 candidates, 75374 repo-hours, 735 releases; waiting 473 ms; commit 0 ms)
2026-11-08T10:49:41Z [load_day 2025-03-13] 2025-03-13 hour 5: 215503 events in 0 files, snapshot none (task 9294 ms: download 6292 ms overlapping gunzip 1467 ms, parse 6382 ms, sort 0 ms, write 0 ms, index 686 ms: 3 candidates, 80610 repo-hours, 863 releases; waiting 450 ms; commit 0 ms)
2026-11-08T10:49:51Z [load_day 2025-03-13] 2025-03-13 hour 6: 240980 events in 0 files, snapshot none (task 9531 ms: download 6102 ms overlapping gunzip 1422 ms, parse 6420 ms, sort 0 ms, write 0 ms, index 958 ms: 5 candidates, 102685 repo-hours, 1038 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:49:52Z [load_day 2025-03-13] 2025-03-13 hour 7: 241976 events in 0 files, snapshot none (task 9859 ms: download 6942 ms overlapping gunzip 1551 ms, parse 6618 ms, sort 0 ms, write 0 ms, index 698 ms: 4 candidates, 94122 repo-hours, 923 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:50:01Z [load_day 2025-03-13] 2025-03-13 hour 8: 254155 events in 0 files, snapshot none (task 9968 ms: download 6309 ms overlapping gunzip 1531 ms, parse 6334 ms, sort 0 ms, write 0 ms, index 932 ms: 8 candidates, 104954 repo-hours, 1136 releases; waiting 681 ms; commit 0 ms)
2026-11-08T10:50:03Z [load_day 2025-03-13] 2025-03-13 hour 9: 270565 events in 0 files, snapshot none (task 10509 ms: download 7774 ms overlapping gunzip 1702 ms, parse 7216 ms, sort 0 ms, write 0 ms, index 836 ms: 5 candidates, 112387 repo-hours, 2135 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:50:10Z [load_day 2025-03-13] 2025-03-13 hour 10: 266540 events in 0 files, snapshot none (task 8373 ms: download 5679 ms overlapping gunzip 1258 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 836 ms: 8 candidates, 107839 repo-hours, 1334 releases; waiting 766 ms; commit 0 ms)
2026-11-08T10:50:11Z [load_day 2025-03-13] 2025-03-13 hour 11: 266765 events in 0 files, snapshot none (task 7923 ms: download 5364 ms overlapping gunzip 1257 ms, parse 5292 ms, sort 0 ms, write 0 ms, index 774 ms: 3 candidates, 100985 repo-hours, 1123 releases; waiting 379 ms; commit 0 ms)
2026-11-08T10:50:19Z [load_day 2025-03-13] 2025-03-13 hour 12: 301403 events in 0 files, snapshot none (task 8408 ms: download 5419 ms overlapping gunzip 1150 ms, parse 4951 ms, sort 0 ms, write 0 ms, index 1039 ms: 10 candidates, 142535 repo-hours, 1277 releases; waiting 928 ms; commit 0 ms)
2026-11-08T10:50:20Z [load_day 2025-03-13] 2025-03-13 hour 13: 283984 events in 0 files, snapshot none (task 8589 ms: download 5797 ms overlapping gunzip 1275 ms, parse 5472 ms, sort 0 ms, write 0 ms, index 901 ms: 5 candidates, 130116 repo-hours, 1323 releases; waiting 649 ms; commit 0 ms)
2026-11-08T10:50:32Z [load_day 2025-03-13] 2025-03-13 hour 14: 280950 events in 0 files, snapshot none (task 12224 ms: download 8945 ms overlapping gunzip 1971 ms, parse 8027 ms, sort 0 ms, write 0 ms, index 1277 ms: 9 candidates, 118052 repo-hours, 1446 releases; waiting 641 ms; commit 0 ms)
2026-11-08T10:50:32Z [load_day 2025-03-13] 2025-03-13 hour 15: 283560 events in 0 files, snapshot none (task 11743 ms: download 8442 ms overlapping gunzip 1905 ms, parse 8192 ms, sort 0 ms, write 0 ms, index 1157 ms: 8 candidates, 123955 repo-hours, 1523 releases; waiting 231 ms; commit 0 ms)
2026-11-08T10:50:44Z [load_day 2025-03-13] 2025-03-13 hour 16: 274820 events in 0 files, snapshot none (task 11352 ms: download 7993 ms overlapping gunzip 1775 ms, parse 7810 ms, sort 0 ms, write 0 ms, index 898 ms: 9 candidates, 114539 repo-hours, 1467 releases; waiting 558 ms; commit 0 ms)
2026-11-08T10:50:44Z [load_day 2025-03-13] 2025-03-13 hour 17: 261904 events in 0 files, snapshot none (task 10423 ms: download 6775 ms overlapping gunzip 1614 ms, parse 6991 ms, sort 0 ms, write 0 ms, index 936 ms: 11 candidates, 104233 repo-hours, 1282 releases; waiting 441 ms; commit 0 ms)
2026-11-08T10:50:54Z [load_day 2025-03-13] 2025-03-13 hour 18: 268853 events in 0 files, snapshot none (task 10090 ms: download 7215 ms overlapping gunzip 1647 ms, parse 6726 ms, sort 0 ms, write 0 ms, index 841 ms: 10 candidates, 115923 repo-hours, 1433 releases; waiting 584 ms; commit 0 ms)
2026-11-08T10:50:54Z [load_day 2025-03-13] 2025-03-13 hour 19: 249987 events in 0 files, snapshot none (task 9776 ms: download 6469 ms overlapping gunzip 1575 ms, parse 6798 ms, sort 0 ms, write 0 ms, index 813 ms: 6 candidates, 94361 repo-hours, 1118 releases; waiting 180 ms; commit 0 ms)
2026-11-08T10:51:05Z [load_day 2025-03-13] 2025-03-13 hour 20: 244283 events in 0 files, snapshot none (task 9873 ms: download 7210 ms overlapping gunzip 1588 ms, parse 7044 ms, sort 0 ms, write 0 ms, index 749 ms: 12 candidates, 93624 repo-hours, 1222 releases; waiting 244 ms; commit 0 ms)
2026-11-08T10:51:05Z [load_day 2025-03-13] 2025-03-13 hour 21: 235244 events in 0 files, snapshot none (task 10130 ms: download 7308 ms overlapping gunzip 1592 ms, parse 7019 ms, sort 0 ms, write 0 ms, index 724 ms: 19 candidates, 90154 repo-hours, 1289 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:51:14Z [load_day 2025-03-13] 2025-03-13 hour 22: 218468 events in 0 files, snapshot none (task 8927 ms: download 6116 ms overlapping gunzip 1434 ms, parse 6018 ms, sort 0 ms, write 0 ms, index 627 ms: 10 candidates, 79407 repo-hours, 1491 releases; waiting 537 ms; commit 0 ms)
2026-11-08T10:51:14Z [load_day 2025-03-13] 2025-03-13 hour 23: 205979 events in 0 files, snapshot none (task 7894 ms: download 4724 ms overlapping gunzip 1240 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 739 ms: 7 candidates, 72877 repo-hours, 1167 releases; waiting 394 ms; commit 0 ms)
2026-11-08T10:51:24Z [load_day 2025-03-13] 2025-03-13: repo_hour merged from 24 files to 1 (2475175 rows, 10462 ms)
2026-11-08T10:51:27Z [load_day 2025-03-13] 2025-03-13: index committed in 13503 ms (24 + 1 + 24 files)
2026-11-08T10:51:27Z [load_day 2025-03-13] 2025-03-13: 5991831 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:51:27Z [load_day 2025-03-13] attempt 1 succeeded