orcaLog in

Runs · run 4611

load_day 2025-11-13, attempt 1 succeeded

Host
73ccef5e07c2:404327
Started
2026-11-08T14:27:57Z
Ended
2026-11-08T14:29:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.9 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4611/load_day/2025-11-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:27:57Z [load_day 2025-11-13] attempt 1 started
2026-11-08T14:27:57Z [load_day 2025-11-13] 2025-11-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:28:02Z [load_day 2025-11-13] 2025-11-13 hour 0: 147466 events in 0 files, snapshot none (task 3558 ms: download 2235 ms overlapping gunzip 383 ms, parse 1297 ms, sort 0 ms, write 0 ms, index 563 ms: 3 candidates, 76248 repo-hours, 759 releases; waiting 936 ms; commit 0 ms)
2026-11-08T14:28:02Z [load_day 2025-11-13] 2025-11-13 hour 1: 143487 events in 0 files, snapshot none (task 3174 ms: download 1998 ms overlapping gunzip 394 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 677 ms: 8 candidates, 88487 repo-hours, 673 releases; waiting 514 ms; commit 0 ms)
2026-11-08T14:28:06Z [load_day 2025-11-13] 2025-11-13 hour 2: 140846 events in 0 files, snapshot none (task 3536 ms: download 2053 ms overlapping gunzip 515 ms, parse 1556 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 70153 repo-hours, 566 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:28:06Z [load_day 2025-11-13] 2025-11-13 hour 3: 142057 events in 0 files, snapshot none (task 2995 ms: download 1971 ms overlapping gunzip 424 ms, parse 1240 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 69803 repo-hours, 1421 releases; waiting 457 ms; commit 0 ms)
2026-11-08T14:28:10Z [load_day 2025-11-13] 2025-11-13 hour 4: 143668 events in 0 files, snapshot none (task 3573 ms: download 2492 ms overlapping gunzip 450 ms, parse 1336 ms, sort 0 ms, write 0 ms, index 561 ms: 3 candidates, 65917 repo-hours, 495 releases; waiting 938 ms; commit 0 ms)
2026-11-08T14:28:10Z [load_day 2025-11-13] 2025-11-13 hour 5: 145845 events in 0 files, snapshot none (task 3579 ms: download 2091 ms overlapping gunzip 487 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 532 ms: 3 candidates, 66546 repo-hours, 469 releases; waiting 569 ms; commit 0 ms)
2026-11-08T14:28:13Z [load_day 2025-11-13] 2025-11-13 hour 6: 148962 events in 0 files, snapshot none (task 3280 ms: download 2304 ms overlapping gunzip 424 ms, parse 1392 ms, sort 0 ms, write 0 ms, index 560 ms: 3 candidates, 75523 repo-hours, 573 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:28:14Z [load_day 2025-11-13] 2025-11-13 hour 7: 145623 events in 0 files, snapshot none (task 3538 ms: download 2335 ms overlapping gunzip 457 ms, parse 1470 ms, sort 0 ms, write 0 ms, index 555 ms: 4 candidates, 71778 repo-hours, 577 releases; waiting 788 ms; commit 0 ms)
2026-11-08T14:28:18Z [load_day 2025-11-13] 2025-11-13 hour 8: 143736 events in 0 files, snapshot none (task 4130 ms: download 2402 ms overlapping gunzip 649 ms, parse 1892 ms, sort 0 ms, write 0 ms, index 669 ms: 2 candidates, 73779 repo-hours, 541 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:28:18Z [load_day 2025-11-13] 2025-11-13 hour 9: 146667 events in 0 files, snapshot none (task 3944 ms: download 2354 ms overlapping gunzip 693 ms, parse 1818 ms, sort 0 ms, write 0 ms, index 570 ms: 4 candidates, 76422 repo-hours, 698 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:28:22Z [load_day 2025-11-13] 2025-11-13 hour 10: 143811 events in 0 files, snapshot none (task 3587 ms: download 2107 ms overlapping gunzip 502 ms, parse 1572 ms, sort 0 ms, write 0 ms, index 608 ms: 3 candidates, 75158 repo-hours, 620 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:28:22Z [load_day 2025-11-13] 2025-11-13 hour 11: 144023 events in 0 files, snapshot none (task 3672 ms: download 1886 ms overlapping gunzip 576 ms, parse 1753 ms, sort 0 ms, write 0 ms, index 622 ms: 3 candidates, 74163 repo-hours, 612 releases; waiting 392 ms; commit 0 ms)
2026-11-08T14:28:26Z [load_day 2025-11-13] 2025-11-13 hour 12: 149637 events in 0 files, snapshot none (task 3192 ms: download 1570 ms overlapping gunzip 449 ms, parse 1270 ms, sort 0 ms, write 0 ms, index 903 ms: 4 candidates, 92140 repo-hours, 456 releases; waiting 282 ms; commit 0 ms)
2026-11-08T14:28:26Z [load_day 2025-11-13] 2025-11-13 hour 13: 152117 events in 0 files, snapshot none (task 3706 ms: download 2471 ms overlapping gunzip 479 ms, parse 1466 ms, sort 0 ms, write 0 ms, index 740 ms: 2 candidates, 89301 repo-hours, 438 releases; waiting 725 ms; commit 0 ms)
2026-11-08T14:28:32Z [load_day 2025-11-13] 2025-11-13 hour 14: 139821 events in 0 files, snapshot none (task 5351 ms: download 2701 ms overlapping gunzip 545 ms, parse 1555 ms, sort 0 ms, write 0 ms, index 1434 ms: 2 candidates, 74897 repo-hours, 596 releases; waiting 1505 ms; commit 0 ms)
2026-11-08T14:28:32Z [load_day 2025-11-13] 2025-11-13 hour 15: 146641 events in 0 files, snapshot none (task 3666 ms: download 2375 ms overlapping gunzip 481 ms, parse 1531 ms, sort 0 ms, write 0 ms, index 679 ms: 1 candidates, 80728 repo-hours, 542 releases; waiting 634 ms; commit 0 ms)
2026-11-08T14:28:36Z [load_day 2025-11-13] 2025-11-13 hour 16: 145671 events in 0 files, snapshot none (task 3437 ms: download 2231 ms overlapping gunzip 382 ms, parse 1198 ms, sort 0 ms, write 0 ms, index 597 ms: 9 candidates, 78938 repo-hours, 483 releases; waiting 921 ms; commit 0 ms)
2026-11-08T14:28:36Z [load_day 2025-11-13] 2025-11-13 hour 17: 147569 events in 0 files, snapshot none (task 3445 ms: download 2456 ms overlapping gunzip 466 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 76894 repo-hours, 591 releases; waiting 754 ms; commit 0 ms)
2026-11-08T14:28:39Z [load_day 2025-11-13] 2025-11-13 hour 18: 148012 events in 0 files, snapshot none (task 3535 ms: download 2129 ms overlapping gunzip 471 ms, parse 1464 ms, sort 0 ms, write 0 ms, index 641 ms: 2 candidates, 79750 repo-hours, 569 releases; waiting 619 ms; commit 0 ms)
2026-11-08T14:28:39Z [load_day 2025-11-13] 2025-11-13 hour 19: 147944 events in 0 files, snapshot none (task 3253 ms: download 2314 ms overlapping gunzip 411 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 533 ms: 7 candidates, 71128 repo-hours, 574 releases; waiting 684 ms; commit 0 ms)
2026-11-08T14:28:43Z [load_day 2025-11-13] 2025-11-13 hour 20: 147290 events in 0 files, snapshot none (task 3179 ms: download 2116 ms overlapping gunzip 432 ms, parse 1344 ms, sort 0 ms, write 0 ms, index 495 ms: 6 candidates, 70342 repo-hours, 656 releases; waiting 566 ms; commit 0 ms)
2026-11-08T14:28:44Z [load_day 2025-11-13] 2025-11-13 hour 21: 142830 events in 0 files, snapshot none (task 3521 ms: download 2570 ms overlapping gunzip 451 ms, parse 1380 ms, sort 0 ms, write 0 ms, index 510 ms: 4 candidates, 66791 repo-hours, 680 releases; waiting 836 ms; commit 0 ms)
2026-11-08T14:28:49Z [load_day 2025-11-13] 2025-11-13 hour 22: 144862 events in 0 files, snapshot none (task 5156 ms: download 3080 ms overlapping gunzip 518 ms, parse 1748 ms, sort 0 ms, write 0 ms, index 574 ms: 10 candidates, 66738 repo-hours, 713 releases; waiting 2001 ms; commit 0 ms)
2026-11-08T14:28:49Z [load_day 2025-11-13] 2025-11-13 hour 23: 144472 events in 0 files, snapshot none (task 3858 ms: download 2427 ms overlapping gunzip 527 ms, parse 1673 ms, sort 0 ms, write 0 ms, index 501 ms: 4 candidates, 64520 repo-hours, 711 releases; waiting 840 ms; commit 0 ms)
2026-11-08T14:28:57Z [load_day 2025-11-13] 2025-11-13: repo_hour merged from 24 files to 1 (1796144 rows, 7901 ms)
2026-11-08T14:29:00Z [load_day 2025-11-13] 2025-11-13: index committed in 11276 ms (24 + 1 + 24 files)
2026-11-08T14:29:00Z [load_day 2025-11-13] 2025-11-13: 3493057 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:29:00Z [load_day 2025-11-13] attempt 1 succeeded