orcaLog in

Runs · run 4603

load_day 2025-11-11, attempt 1 succeeded

Host
73ccef5e07c2:403470
Started
2026-11-08T14:26:59Z
Ended
2026-11-08T14:27:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
664 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.2 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4603/load_day/2025-11-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:26:59Z [load_day 2025-11-11] attempt 1 started
2026-11-08T14:27:01Z [load_day 2025-11-11] 2025-11-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:27:06Z [load_day 2025-11-11] 2025-11-11 hour 0: 151868 events in 0 files, snapshot none (task 3833 ms: download 2206 ms overlapping gunzip 567 ms, parse 1753 ms, sort 0 ms, write 0 ms, index 641 ms: 4 candidates, 71296 repo-hours, 605 releases; waiting 476 ms; commit 0 ms)
2026-11-08T14:27:06Z [load_day 2025-11-11] 2025-11-11 hour 1: 156212 events in 0 files, snapshot none (task 3182 ms: download 1523 ms overlapping gunzip 389 ms, parse 1371 ms, sort 0 ms, write 0 ms, index 935 ms: 4 candidates, 86567 repo-hours, 547 releases; waiting 209 ms; commit 0 ms)
2026-11-08T14:27:10Z [load_day 2025-11-11] 2025-11-11 hour 2: 149567 events in 0 files, snapshot none (task 4150 ms: download 2502 ms overlapping gunzip 622 ms, parse 1975 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 67910 repo-hours, 486 releases; waiting 592 ms; commit 0 ms)
2026-11-08T14:27:10Z [load_day 2025-11-11] 2025-11-11 hour 3: 149443 events in 0 files, snapshot none (task 4169 ms: download 2305 ms overlapping gunzip 618 ms, parse 2028 ms, sort 0 ms, write 0 ms, index 611 ms: 4 candidates, 66555 repo-hours, 1440 releases; waiting 565 ms; commit 0 ms)
2026-11-08T14:27:15Z [load_day 2025-11-11] 2025-11-11 hour 4: 153175 events in 0 files, snapshot none (task 3874 ms: download 2275 ms overlapping gunzip 598 ms, parse 1766 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 62436 repo-hours, 490 releases; waiting 571 ms; commit 0 ms)
2026-11-08T14:27:15Z [load_day 2025-11-11] 2025-11-11 hour 5: 148510 events in 0 files, snapshot none (task 3862 ms: download 2348 ms overlapping gunzip 611 ms, parse 1853 ms, sort 0 ms, write 0 ms, index 566 ms: 5 candidates, 61620 repo-hours, 443 releases; waiting 504 ms; commit 0 ms)
2026-11-08T14:27:19Z [load_day 2025-11-11] 2025-11-11 hour 6: 150416 events in 0 files, snapshot none (task 3606 ms: download 2225 ms overlapping gunzip 484 ms, parse 1585 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 68610 repo-hours, 494 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:27:19Z [load_day 2025-11-11] 2025-11-11 hour 7: 153701 events in 0 files, snapshot none (task 3833 ms: download 2262 ms overlapping gunzip 594 ms, parse 1818 ms, sort 0 ms, write 0 ms, index 528 ms: 3 candidates, 67142 repo-hours, 469 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:27:23Z [load_day 2025-11-11] 2025-11-11 hour 8: 149548 events in 0 files, snapshot none (task 3646 ms: download 2223 ms overlapping gunzip 501 ms, parse 1541 ms, sort 0 ms, write 0 ms, index 654 ms: 4 candidates, 68074 repo-hours, 517 releases; waiting 638 ms; commit 0 ms)
2026-11-08T14:27:23Z [load_day 2025-11-11] 2025-11-11 hour 9: 151477 events in 0 files, snapshot none (task 2675 ms: download 682 ms overlapping gunzip 386 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 827 ms: 15 candidates, 69546 repo-hours, 485 releases; waiting 13 ms; commit 0 ms)
2026-11-08T14:27:26Z [load_day 2025-11-11] 2025-11-11 hour 10: 151775 events in 0 files, snapshot none (task 2629 ms: download 560 ms overlapping gunzip 447 ms, parse 1329 ms, sort 0 ms, write 0 ms, index 631 ms: 1 candidates, 70235 repo-hours, 470 releases; waiting 19 ms; commit 0 ms)
2026-11-08T14:27:26Z [load_day 2025-11-11] 2025-11-11 hour 11: 153218 events in 0 files, snapshot none (task 2767 ms: download 1435 ms overlapping gunzip 357 ms, parse 1185 ms, sort 0 ms, write 0 ms, index 652 ms: 2 candidates, 66493 repo-hours, 388 releases; waiting 350 ms; commit 0 ms)
2026-11-08T14:27:29Z [load_day 2025-11-11] 2025-11-11 hour 12: 167101 events in 0 files, snapshot none (task 2462 ms: download 1354 ms overlapping gunzip 262 ms, parse 938 ms, sort 0 ms, write 0 ms, index 583 ms: 8 candidates, 87016 repo-hours, 239 releases; waiting 384 ms; commit 0 ms)
2026-11-08T14:27:29Z [load_day 2025-11-11] 2025-11-11 hour 13: 167178 events in 0 files, snapshot none (task 1951 ms: download 415 ms overlapping gunzip 273 ms, parse 849 ms, sort 0 ms, write 0 ms, index 632 ms: 5 candidates, 80992 repo-hours, 175 releases; waiting 12 ms; commit 0 ms)
2026-11-08T14:27:32Z [load_day 2025-11-11] 2025-11-11 hour 14: 162972 events in 0 files, snapshot none (task 2080 ms: download 579 ms overlapping gunzip 316 ms, parse 990 ms, sort 0 ms, write 0 ms, index 540 ms: 8 candidates, 72557 repo-hours, 215 releases; waiting 17 ms; commit 0 ms)
2026-11-08T14:27:32Z [load_day 2025-11-11] 2025-11-11 hour 15: 165432 events in 0 files, snapshot none (task 1884 ms: download 444 ms overlapping gunzip 253 ms, parse 871 ms, sort 0 ms, write 0 ms, index 531 ms: 6 candidates, 74333 repo-hours, 137 releases; waiting 16 ms; commit 0 ms)
2026-11-08T14:27:35Z [load_day 2025-11-11] 2025-11-11 hour 16: 164659 events in 0 files, snapshot none (task 2777 ms: download 1739 ms overlapping gunzip 286 ms, parse 967 ms, sort 0 ms, write 0 ms, index 562 ms: 2 candidates, 75582 repo-hours, 231 releases; waiting 623 ms; commit 0 ms)
2026-11-08T14:27:35Z [load_day 2025-11-11] 2025-11-11 hour 17: 157173 events in 0 files, snapshot none (task 2112 ms: download 466 ms overlapping gunzip 315 ms, parse 971 ms, sort 0 ms, write 0 ms, index 602 ms: 2 candidates, 75736 repo-hours, 368 releases; waiting 16 ms; commit 0 ms)
2026-11-08T14:27:38Z [load_day 2025-11-11] 2025-11-11 hour 18: 157595 events in 0 files, snapshot none (task 2249 ms: download 601 ms overlapping gunzip 317 ms, parse 999 ms, sort 0 ms, write 0 ms, index 717 ms: 9 candidates, 79687 repo-hours, 526 releases; waiting 17 ms; commit 0 ms)
2026-11-08T14:27:39Z [load_day 2025-11-11] 2025-11-11 hour 19: 150175 events in 0 files, snapshot none (task 3768 ms: download 2731 ms overlapping gunzip 369 ms, parse 1179 ms, sort 0 ms, write 0 ms, index 650 ms: 3 candidates, 68475 repo-hours, 575 releases; waiting 1285 ms; commit 0 ms)
2026-11-08T14:27:40Z [load_day 2025-11-11] 2025-11-11 hour 20: 150506 events in 0 files, snapshot none (task 2332 ms: download 598 ms overlapping gunzip 357 ms, parse 1096 ms, sort 0 ms, write 0 ms, index 661 ms: 5 candidates, 68564 repo-hours, 591 releases; waiting 17 ms; commit 0 ms)
2026-11-08T14:27:42Z [load_day 2025-11-11] 2025-11-11 hour 21: 148029 events in 0 files, snapshot none (task 2364 ms: download 569 ms overlapping gunzip 376 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 583 ms: 4 candidates, 67858 repo-hours, 709 releases; waiting 23 ms; commit 0 ms)
2026-11-08T14:27:44Z [load_day 2025-11-11] 2025-11-11 hour 22: 144404 events in 0 files, snapshot none (task 2640 ms: download 566 ms overlapping gunzip 398 ms, parse 1239 ms, sort 0 ms, write 0 ms, index 779 ms: 6 candidates, 67617 repo-hours, 764 releases; waiting 12 ms; commit 0 ms)
2026-11-08T14:27:46Z [load_day 2025-11-11] 2025-11-11 hour 23: 146997 events in 0 files, snapshot none (task 3295 ms: download 2323 ms overlapping gunzip 349 ms, parse 1135 ms, sort 0 ms, write 0 ms, index 493 ms: 2 candidates, 62808 repo-hours, 678 releases; waiting 905 ms; commit 0 ms)
2026-11-08T14:27:53Z [load_day 2025-11-11] 2025-11-11: repo_hour merged from 24 files to 1 (1707709 rows, 7815 ms)
2026-11-08T14:27:56Z [load_day 2025-11-11] 2025-11-11: index committed in 10485 ms (24 + 1 + 24 files)
2026-11-08T14:27:56Z [load_day 2025-11-11] 2025-11-11: 3701131 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:27:56Z [load_day 2025-11-11] attempt 1 succeeded