orcaLog in

Runs · run 4714

load_day 2025-12-14, attempt 1 succeeded

Host
73ccef5e07c2:416797
Started
2026-11-08T14:45:25Z
Ended
2026-11-08T14:46:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
666 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
68.8 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4714/load_day/2025-12-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:45:25Z [load_day 2025-12-14] attempt 1 started
2026-11-08T14:45:26Z [load_day 2025-12-14] 2025-12-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:45:30Z [load_day 2025-12-14] 2025-12-14 hour 0: 138269 events in 0 files, snapshot none (task 3298 ms: download 1865 ms overlapping gunzip 424 ms, parse 1349 ms, sort 0 ms, write 0 ms, index 586 ms: 8 candidates, 67528 repo-hours, 850 releases; waiting 450 ms; commit 0 ms)
2026-11-08T14:45:30Z [load_day 2025-12-14] 2025-12-14 hour 1: 145922 events in 0 files, snapshot none (task 3206 ms: download 2104 ms overlapping gunzip 384 ms, parse 1217 ms, sort 0 ms, write 0 ms, index 639 ms: 8 candidates, 88060 repo-hours, 644 releases; waiting 634 ms; commit 0 ms)
2026-11-08T14:45:34Z [load_day 2025-12-14] 2025-12-14 hour 2: 140732 events in 0 files, snapshot none (task 3067 ms: download 1881 ms overlapping gunzip 356 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 74419 repo-hours, 669 releases; waiting 636 ms; commit 0 ms)
2026-11-08T14:45:34Z [load_day 2025-12-14] 2025-12-14 hour 3: 134392 events in 0 files, snapshot none (task 3123 ms: download 2166 ms overlapping gunzip 415 ms, parse 1157 ms, sort 0 ms, write 0 ms, index 481 ms: 2 candidates, 57498 repo-hours, 782 releases; waiting 756 ms; commit 0 ms)
2026-11-08T14:45:37Z [load_day 2025-12-14] 2025-12-14 hour 4: 139918 events in 0 files, snapshot none (task 3421 ms: download 1963 ms overlapping gunzip 354 ms, parse 1106 ms, sort 0 ms, write 0 ms, index 565 ms: 9 candidates, 65967 repo-hours, 1516 releases; waiting 684 ms; commit 0 ms)
2026-11-08T14:45:38Z [load_day 2025-12-14] 2025-12-14 hour 5: 141361 events in 0 files, snapshot none (task 3854 ms: download 2976 ms overlapping gunzip 481 ms, parse 1213 ms, sort 0 ms, write 0 ms, index 459 ms: 7 candidates, 62832 repo-hours, 553 releases; waiting 1378 ms; commit 0 ms)
2026-11-08T14:45:42Z [load_day 2025-12-14] 2025-12-14 hour 6: 145906 events in 0 files, snapshot none (task 3610 ms: download 2305 ms overlapping gunzip 517 ms, parse 1289 ms, sort 0 ms, write 0 ms, index 598 ms: 8 candidates, 70542 repo-hours, 606 releases; waiting 908 ms; commit 0 ms)
2026-11-08T14:45:42Z [load_day 2025-12-14] 2025-12-14 hour 7: 142553 events in 0 files, snapshot none (task 2941 ms: download 1772 ms overlapping gunzip 361 ms, parse 1112 ms, sort 0 ms, write 0 ms, index 496 ms: 4 candidates, 61081 repo-hours, 509 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:45:46Z [load_day 2025-12-14] 2025-12-14 hour 8: 143731 events in 0 files, snapshot none (task 3655 ms: download 2715 ms overlapping gunzip 373 ms, parse 1085 ms, sort 0 ms, write 0 ms, index 560 ms: 7 candidates, 67901 repo-hours, 579 releases; waiting 1351 ms; commit 0 ms)
2026-11-08T14:45:46Z [load_day 2025-12-14] 2025-12-14 hour 9: 142916 events in 0 files, snapshot none (task 2945 ms: download 1748 ms overlapping gunzip 338 ms, parse 1055 ms, sort 0 ms, write 0 ms, index 549 ms: 6 candidates, 67669 repo-hours, 561 releases; waiting 655 ms; commit 0 ms)
2026-11-08T14:45:49Z [load_day 2025-12-14] 2025-12-14 hour 10: 145787 events in 0 files, snapshot none (task 3266 ms: download 2040 ms overlapping gunzip 395 ms, parse 1190 ms, sort 0 ms, write 0 ms, index 620 ms: 8 candidates, 69383 repo-hours, 587 releases; waiting 773 ms; commit 0 ms)
2026-11-08T14:45:49Z [load_day 2025-12-14] 2025-12-14 hour 11: 142426 events in 0 files, snapshot none (task 3029 ms: download 1853 ms overlapping gunzip 397 ms, parse 1200 ms, sort 0 ms, write 0 ms, index 581 ms: 12 candidates, 66703 repo-hours, 532 releases; waiting 537 ms; commit 0 ms)
2026-11-08T14:45:55Z [load_day 2025-12-14] 2025-12-14 hour 12: 157862 events in 0 files, snapshot none (task 4970 ms: download 2504 ms overlapping gunzip 767 ms, parse 2334 ms, sort 0 ms, write 0 ms, index 981 ms: 8 candidates, 92393 repo-hours, 587 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:45:55Z [load_day 2025-12-14] 2025-12-14 hour 13: 153027 events in 0 files, snapshot none (task 4954 ms: download 2846 ms overlapping gunzip 673 ms, parse 2236 ms, sort 0 ms, write 0 ms, index 1124 ms: 7 candidates, 84998 repo-hours, 563 releases; waiting 497 ms; commit 0 ms)
2026-11-08T14:46:00Z [load_day 2025-12-14] 2025-12-14 hour 14: 153857 events in 0 files, snapshot none (task 5073 ms: download 2235 ms overlapping gunzip 968 ms, parse 2619 ms, sort 0 ms, write 0 ms, index 799 ms: 11 candidates, 75213 repo-hours, 642 releases; waiting 290 ms; commit 0 ms)
2026-11-08T14:46:01Z [load_day 2025-12-14] 2025-12-14 hour 15: 153702 events in 0 files, snapshot none (task 5316 ms: download 3112 ms overlapping gunzip 1098 ms, parse 2691 ms, sort 0 ms, write 0 ms, index 765 ms: 7 candidates, 75200 repo-hours, 695 releases; waiting 505 ms; commit 0 ms)
2026-11-08T14:46:05Z [load_day 2025-12-14] 2025-12-14 hour 16: 152208 events in 0 files, snapshot none (task 4084 ms: download 2824 ms overlapping gunzip 502 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 598 ms: 7 candidates, 74456 repo-hours, 654 releases; waiting 1155 ms; commit 0 ms)
2026-11-08T14:46:05Z [load_day 2025-12-14] 2025-12-14 hour 17: 150575 events in 0 files, snapshot none (task 4273 ms: download 3201 ms overlapping gunzip 474 ms, parse 1549 ms, sort 0 ms, write 0 ms, index 529 ms: 10 candidates, 70055 repo-hours, 671 releases; waiting 1394 ms; commit 0 ms)
2026-11-08T14:46:09Z [load_day 2025-12-14] 2025-12-14 hour 18: 152295 events in 0 files, snapshot none (task 3965 ms: download 2783 ms overlapping gunzip 488 ms, parse 1473 ms, sort 0 ms, write 0 ms, index 652 ms: 7 candidates, 79283 repo-hours, 799 releases; waiting 1025 ms; commit 0 ms)
2026-11-08T14:46:09Z [load_day 2025-12-14] 2025-12-14 hour 19: 146015 events in 0 files, snapshot none (task 3474 ms: download 1897 ms overlapping gunzip 478 ms, parse 1510 ms, sort 0 ms, write 0 ms, index 626 ms: 9 candidates, 67561 repo-hours, 647 releases; waiting 522 ms; commit 0 ms)
2026-11-08T14:46:14Z [load_day 2025-12-14] 2025-12-14 hour 20: 146958 events in 0 files, snapshot none (task 3913 ms: download 2094 ms overlapping gunzip 401 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 748 ms: 11 candidates, 68755 repo-hours, 641 releases; waiting 1161 ms; commit 0 ms)
2026-11-08T14:46:14Z [load_day 2025-12-14] 2025-12-14 hour 21: 146454 events in 0 files, snapshot none (task 3928 ms: download 2873 ms overlapping gunzip 410 ms, parse 1290 ms, sort 0 ms, write 0 ms, index 540 ms: 5 candidates, 65879 repo-hours, 743 releases; waiting 1399 ms; commit 0 ms)
2026-11-08T14:46:18Z [load_day 2025-12-14] 2025-12-14 hour 22: 140682 events in 0 files, snapshot none (task 3478 ms: download 1813 ms overlapping gunzip 486 ms, parse 1548 ms, sort 0 ms, write 0 ms, index 554 ms: 3 candidates, 61840 repo-hours, 702 releases; waiting 497 ms; commit 0 ms)
2026-11-08T14:46:18Z [load_day 2025-12-14] 2025-12-14 hour 23: 142026 events in 0 files, snapshot none (task 3506 ms: download 1992 ms overlapping gunzip 546 ms, parse 1640 ms, sort 0 ms, write 0 ms, index 508 ms: 2 candidates, 62382 repo-hours, 663 releases; waiting 501 ms; commit 0 ms)
2026-11-08T14:46:25Z [load_day 2025-12-14] 2025-12-14: repo_hour merged from 24 files to 1 (1697598 rows, 7337 ms)
2026-11-08T14:46:28Z [load_day 2025-12-14] 2025-12-14: index committed in 10591 ms (24 + 1 + 24 files)
2026-11-08T14:46:28Z [load_day 2025-12-14] 2025-12-14: 3499574 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:46:28Z [load_day 2025-12-14] attempt 1 succeeded