orcaLog in

Runs · run 4682

load_day 2025-12-05, attempt 1 succeeded

Host
73ccef5e07c2:412519
Started
2026-11-08T14:39:52Z
Ended
2026-11-08T14:41:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
689 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.5 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4682/load_day/2025-12-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:39:52Z [load_day 2025-12-05] attempt 1 started
2026-11-08T14:39:53Z [load_day 2025-12-05] 2025-12-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:39:57Z [load_day 2025-12-05] 2025-12-05 hour 0: 143934 events in 0 files, snapshot none (task 3633 ms: download 2371 ms overlapping gunzip 402 ms, parse 1219 ms, sort 0 ms, write 0 ms, index 885 ms: 5 candidates, 73470 repo-hours, 737 releases; waiting 820 ms; commit 0 ms)
2026-11-08T14:39:59Z [load_day 2025-12-05] 2025-12-05 hour 1: 149388 events in 0 files, snapshot none (task 5231 ms: download 3037 ms overlapping gunzip 464 ms, parse 1478 ms, sort 0 ms, write 0 ms, index 685 ms: 4 candidates, 89645 repo-hours, 615 releases; waiting 1183 ms; commit 0 ms)
2026-11-08T14:40:02Z [load_day 2025-12-05] 2025-12-05 hour 2: 145613 events in 0 files, snapshot none (task 3709 ms: download 2069 ms overlapping gunzip 418 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 979 ms: 8 candidates, 72774 repo-hours, 600 releases; waiting 703 ms; commit 0 ms)
2026-11-08T14:40:04Z [load_day 2025-12-05] 2025-12-05 hour 3: 145740 events in 0 files, snapshot none (task 4181 ms: download 2743 ms overlapping gunzip 488 ms, parse 1544 ms, sort 0 ms, write 0 ms, index 770 ms: 6 candidates, 70821 repo-hours, 1464 releases; waiting 1037 ms; commit 0 ms)
2026-11-08T14:40:07Z [load_day 2025-12-05] 2025-12-05 hour 4: 144782 events in 0 files, snapshot none (task 4076 ms: download 2505 ms overlapping gunzip 409 ms, parse 1232 ms, sort 0 ms, write 0 ms, index 1093 ms: 4 candidates, 67921 repo-hours, 672 releases; waiting 985 ms; commit 0 ms)
2026-11-08T14:40:08Z [load_day 2025-12-05] 2025-12-05 hour 5: 147288 events in 0 files, snapshot none (task 4206 ms: download 2351 ms overlapping gunzip 595 ms, parse 1757 ms, sort 0 ms, write 0 ms, index 842 ms: 9 candidates, 70529 repo-hours, 565 releases; waiting 686 ms; commit 0 ms)
2026-11-08T14:40:10Z [load_day 2025-12-05] 2025-12-05 hour 6: 146042 events in 0 files, snapshot none (task 3315 ms: download 2192 ms overlapping gunzip 427 ms, parse 1284 ms, sort 0 ms, write 0 ms, index 632 ms: 3 candidates, 76333 repo-hours, 651 releases; waiting 659 ms; commit 0 ms)
2026-11-08T14:40:13Z [load_day 2025-12-05] 2025-12-05 hour 7: 145035 events in 0 files, snapshot none (task 4296 ms: download 2820 ms overlapping gunzip 533 ms, parse 1741 ms, sort 0 ms, write 0 ms, index 885 ms: 6 candidates, 70056 repo-hours, 661 releases; waiting 790 ms; commit 0 ms)
2026-11-08T14:40:15Z [load_day 2025-12-05] 2025-12-05 hour 8: 145453 events in 0 files, snapshot none (task 3724 ms: download 2220 ms overlapping gunzip 583 ms, parse 1762 ms, sort 0 ms, write 0 ms, index 625 ms: 9 candidates, 73931 repo-hours, 723 releases; waiting 433 ms; commit 0 ms)
2026-11-08T14:40:17Z [load_day 2025-12-05] 2025-12-05 hour 9: 152063 events in 0 files, snapshot none (task 3396 ms: download 2136 ms overlapping gunzip 425 ms, parse 1326 ms, sort 0 ms, write 0 ms, index 737 ms: 3 candidates, 78304 repo-hours, 708 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:40:19Z [load_day 2025-12-05] 2025-12-05 hour 10: 148805 events in 0 files, snapshot none (task 3822 ms: download 2616 ms overlapping gunzip 502 ms, parse 1449 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 76085 repo-hours, 744 releases; waiting 851 ms; commit 0 ms)
2026-11-08T14:40:21Z [load_day 2025-12-05] 2025-12-05 hour 11: 147920 events in 0 files, snapshot none (task 3392 ms: download 1941 ms overlapping gunzip 374 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 844 ms: 10 candidates, 71622 repo-hours, 737 releases; waiting 707 ms; commit 0 ms)
2026-11-08T14:40:23Z [load_day 2025-12-05] 2025-12-05 hour 12: 162992 events in 0 files, snapshot none (task 3198 ms: download 1664 ms overlapping gunzip 408 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 666 ms: 7 candidates, 96287 repo-hours, 523 releases; waiting 370 ms; commit 0 ms)
2026-11-08T14:40:26Z [load_day 2025-12-05] 2025-12-05 hour 13: 154538 events in 0 files, snapshot none (task 4030 ms: download 2256 ms overlapping gunzip 372 ms, parse 1180 ms, sort 0 ms, write 0 ms, index 1099 ms: 7 candidates, 88969 repo-hours, 575 releases; waiting 1041 ms; commit 0 ms)
2026-11-08T14:40:27Z [load_day 2025-12-05] 2025-12-05 hour 14: 151063 events in 0 files, snapshot none (task 3771 ms: download 2467 ms overlapping gunzip 566 ms, parse 1645 ms, sort 0 ms, write 0 ms, index 587 ms: 4 candidates, 80345 repo-hours, 631 releases; waiting 605 ms; commit 0 ms)
2026-11-08T14:40:30Z [load_day 2025-12-05] 2025-12-05 hour 15: 148885 events in 0 files, snapshot none (task 3609 ms: download 2433 ms overlapping gunzip 388 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 713 ms: 3 candidates, 80028 repo-hours, 654 releases; waiting 1026 ms; commit 0 ms)
2026-11-08T14:40:31Z [load_day 2025-12-05] 2025-12-05 hour 16: 150571 events in 0 files, snapshot none (task 3871 ms: download 2811 ms overlapping gunzip 444 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 606 ms: 6 candidates, 79275 repo-hours, 808 releases; waiting 1060 ms; commit 0 ms)
2026-11-08T14:40:34Z [load_day 2025-12-05] 2025-12-05 hour 17: 144238 events in 0 files, snapshot none (task 3359 ms: download 2172 ms overlapping gunzip 398 ms, parse 1136 ms, sort 0 ms, write 0 ms, index 645 ms: 6 candidates, 73397 repo-hours, 736 releases; waiting 830 ms; commit 0 ms)
2026-11-08T14:40:38Z [load_day 2025-12-05] 2025-12-05 hour 18: 144666 events in 0 files, snapshot none (task 4281 ms: download 2126 ms overlapping gunzip 407 ms, parse 1205 ms, sort 0 ms, write 0 ms, index 1603 ms: 7 candidates, 76523 repo-hours, 726 releases; waiting 808 ms; commit 0 ms)
2026-11-08T14:40:42Z [load_day 2025-12-05] 2025-12-05 hour 19: 146991 events in 0 files, snapshot none (task 3341 ms: download 2029 ms overlapping gunzip 430 ms, parse 1309 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 70720 repo-hours, 787 releases; waiting 718 ms; commit 0 ms)
2026-11-08T14:40:43Z [load_day 2025-12-05] 2025-12-05 hour 20: 145348 events in 0 files, snapshot none (task 3283 ms: download 2153 ms overlapping gunzip 386 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 629 ms: 7 candidates, 70254 repo-hours, 684 releases; waiting 832 ms; commit 0 ms)
2026-11-08T14:40:47Z [load_day 2025-12-05] 2025-12-05 hour 21: 148317 events in 0 files, snapshot none (task 4201 ms: download 2765 ms overlapping gunzip 583 ms, parse 1727 ms, sort 0 ms, write 0 ms, index 580 ms: 7 candidates, 68455 repo-hours, 796 releases; waiting 931 ms; commit 0 ms)
2026-11-08T14:40:47Z [load_day 2025-12-05] 2025-12-05 hour 22: 149171 events in 0 files, snapshot none (task 3865 ms: download 2425 ms overlapping gunzip 547 ms, parse 1758 ms, sort 0 ms, write 0 ms, index 623 ms: 9 candidates, 64357 repo-hours, 858 releases; waiting 663 ms; commit 0 ms)
2026-11-08T14:40:51Z [load_day 2025-12-05] 2025-12-05 hour 23: 145457 events in 0 files, snapshot none (task 3440 ms: download 2387 ms overlapping gunzip 391 ms, parse 1323 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 60606 repo-hours, 1003 releases; waiting 758 ms; commit 0 ms)
2026-11-08T14:40:59Z [load_day 2025-12-05] 2025-12-05: repo_hour merged from 24 files to 1 (1800707 rows, 8036 ms)
2026-11-08T14:41:02Z [load_day 2025-12-05] 2025-12-05: index committed in 10954 ms (24 + 1 + 24 files)
2026-11-08T14:41:02Z [load_day 2025-12-05] 2025-12-05: 3554300 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:41:02Z [load_day 2025-12-05] attempt 1 succeeded