orcaLog in

Runs · run 4821

load_day 2026-01-13, attempt 1 succeeded

Host
73ccef5e07c2:429193
Started
2026-11-08T15:01:29Z
Ended
2026-11-08T15:02:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
731 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4821/load_day/2026-01-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:01:29Z [load_day 2026-01-13] attempt 1 started
2026-11-08T15:01:30Z [load_day 2026-01-13] 2026-01-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:01:35Z [load_day 2026-01-13] 2026-01-13 hour 0: 146621 events in 0 files, snapshot none (task 4134 ms: download 2629 ms overlapping gunzip 689 ms, parse 1971 ms, sort 0 ms, write 0 ms, index 559 ms: 7 candidates, 73313 repo-hours, 894 releases; waiting 559 ms; commit 0 ms)
2026-11-08T15:01:35Z [load_day 2026-01-13] 2026-01-13 hour 1: 154456 events in 0 files, snapshot none (task 4276 ms: download 2237 ms overlapping gunzip 641 ms, parse 1968 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 91068 repo-hours, 821 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:01:39Z [load_day 2026-01-13] 2026-01-13 hour 2: 150833 events in 0 files, snapshot none (task 3547 ms: download 2361 ms overlapping gunzip 425 ms, parse 1286 ms, sort 0 ms, write 0 ms, index 571 ms: 8 candidates, 78899 repo-hours, 800 releases; waiting 857 ms; commit 0 ms)
2026-11-08T15:01:39Z [load_day 2026-01-13] 2026-01-13 hour 3: 141549 events in 0 files, snapshot none (task 3177 ms: download 1523 ms overlapping gunzip 425 ms, parse 1301 ms, sort 0 ms, write 0 ms, index 504 ms: 8 candidates, 69367 repo-hours, 812 releases; waiting 516 ms; commit 0 ms)
2026-11-08T15:01:43Z [load_day 2026-01-13] 2026-01-13 hour 4: 142902 events in 0 files, snapshot none (task 3692 ms: download 2334 ms overlapping gunzip 376 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 596 ms: 3 candidates, 72040 repo-hours, 1474 releases; waiting 1263 ms; commit 0 ms)
2026-11-08T15:01:43Z [load_day 2026-01-13] 2026-01-13 hour 5: 147322 events in 0 files, snapshot none (task 3320 ms: download 2082 ms overlapping gunzip 461 ms, parse 1387 ms, sort 0 ms, write 0 ms, index 549 ms: 2 candidates, 69777 repo-hours, 684 releases; waiting 629 ms; commit 0 ms)
2026-11-08T15:01:47Z [load_day 2026-01-13] 2026-01-13 hour 6: 151135 events in 0 files, snapshot none (task 3292 ms: download 2113 ms overlapping gunzip 433 ms, parse 1286 ms, sort 0 ms, write 0 ms, index 648 ms: 6 candidates, 82401 repo-hours, 786 releases; waiting 615 ms; commit 0 ms)
2026-11-08T15:01:47Z [load_day 2026-01-13] 2026-01-13 hour 7: 144021 events in 0 files, snapshot none (task 3044 ms: download 1950 ms overlapping gunzip 392 ms, parse 1152 ms, sort 0 ms, write 0 ms, index 560 ms: 8 candidates, 76696 repo-hours, 918 releases; waiting 611 ms; commit 0 ms)
2026-11-08T15:01:52Z [load_day 2026-01-13] 2026-01-13 hour 8: 147896 events in 0 files, snapshot none (task 4279 ms: download 2439 ms overlapping gunzip 509 ms, parse 1411 ms, sort 0 ms, write 0 ms, index 893 ms: 8 candidates, 80165 repo-hours, 817 releases; waiting 1138 ms; commit 0 ms)
2026-11-08T15:01:52Z [load_day 2026-01-13] 2026-01-13 hour 9: 146078 events in 0 files, snapshot none (task 3876 ms: download 2384 ms overlapping gunzip 452 ms, parse 1262 ms, sort 0 ms, write 0 ms, index 966 ms: 5 candidates, 81283 repo-hours, 616 releases; waiting 894 ms; commit 0 ms)
2026-11-08T15:01:56Z [load_day 2026-01-13] 2026-01-13 hour 10: 147043 events in 0 files, snapshot none (task 4008 ms: download 2636 ms overlapping gunzip 464 ms, parse 1313 ms, sort 0 ms, write 0 ms, index 817 ms: 1 candidates, 79360 repo-hours, 605 releases; waiting 1028 ms; commit 0 ms)
2026-11-08T15:01:57Z [load_day 2026-01-13] 2026-01-13 hour 11: 148159 events in 0 files, snapshot none (task 4468 ms: download 2577 ms overlapping gunzip 530 ms, parse 1579 ms, sort 0 ms, write 0 ms, index 946 ms: 9 candidates, 77584 repo-hours, 822 releases; waiting 1038 ms; commit 0 ms)
2026-11-08T15:02:01Z [load_day 2026-01-13] 2026-01-13 hour 12: 158414 events in 0 files, snapshot none (task 4157 ms: download 2150 ms overlapping gunzip 466 ms, parse 1727 ms, sort 0 ms, write 0 ms, index 956 ms: 7 candidates, 97279 repo-hours, 485 releases; waiting 695 ms; commit 0 ms)
2026-11-08T15:02:01Z [load_day 2026-01-13] 2026-01-13 hour 13: 154031 events in 0 files, snapshot none (task 3956 ms: download 1977 ms overlapping gunzip 453 ms, parse 1621 ms, sort 0 ms, write 0 ms, index 1012 ms: 11 candidates, 93911 repo-hours, 816 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:02:06Z [load_day 2026-01-13] 2026-01-13 hour 14: 142492 events in 0 files, snapshot none (task 3689 ms: download 2320 ms overlapping gunzip 492 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 744 ms: 4 candidates, 78613 repo-hours, 1631 releases; waiting 656 ms; commit 0 ms)
2026-11-08T15:02:06Z [load_day 2026-01-13] 2026-01-13 hour 15: 149742 events in 0 files, snapshot none (task 3309 ms: download 1556 ms overlapping gunzip 418 ms, parse 1275 ms, sort 0 ms, write 0 ms, index 706 ms: 10 candidates, 80359 repo-hours, 692 releases; waiting 418 ms; commit 0 ms)
2026-11-08T15:02:10Z [load_day 2026-01-13] 2026-01-13 hour 16: 148871 events in 0 files, snapshot none (task 3938 ms: download 1935 ms overlapping gunzip 593 ms, parse 1871 ms, sort 0 ms, write 0 ms, index 846 ms: 8 candidates, 82650 repo-hours, 482 releases; waiting 266 ms; commit 0 ms)
2026-11-08T15:02:11Z [load_day 2026-01-13] 2026-01-13 hour 17: 150235 events in 0 files, snapshot none (task 4438 ms: download 3114 ms overlapping gunzip 623 ms, parse 1964 ms, sort 0 ms, write 0 ms, index 635 ms: 4 candidates, 81503 repo-hours, 519 releases; waiting 714 ms; commit 0 ms)
2026-11-08T15:02:15Z [load_day 2026-01-13] 2026-01-13 hour 18: 145012 events in 0 files, snapshot none (task 4212 ms: download 2286 ms overlapping gunzip 643 ms, parse 1999 ms, sort 0 ms, write 0 ms, index 715 ms: 6 candidates, 79585 repo-hours, 665 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:02:15Z [load_day 2026-01-13] 2026-01-13 hour 19: 147151 events in 0 files, snapshot none (task 3807 ms: download 2474 ms overlapping gunzip 577 ms, parse 1806 ms, sort 0 ms, write 0 ms, index 555 ms: 7 candidates, 74863 repo-hours, 608 releases; waiting 527 ms; commit 0 ms)
2026-11-08T15:02:19Z [load_day 2026-01-13] 2026-01-13 hour 20: 142281 events in 0 files, snapshot none (task 4054 ms: download 2383 ms overlapping gunzip 555 ms, parse 1846 ms, sort 0 ms, write 0 ms, index 602 ms: 8 candidates, 72582 repo-hours, 631 releases; waiting 661 ms; commit 0 ms)
2026-11-08T15:02:20Z [load_day 2026-01-13] 2026-01-13 hour 21: 146419 events in 0 files, snapshot none (task 3772 ms: download 2343 ms overlapping gunzip 590 ms, parse 1700 ms, sort 0 ms, write 0 ms, index 616 ms: 7 candidates, 72097 repo-hours, 745 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:02:24Z [load_day 2026-01-13] 2026-01-13 hour 22: 143690 events in 0 files, snapshot none (task 4576 ms: download 2890 ms overlapping gunzip 533 ms, parse 1715 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 65585 repo-hours, 776 releases; waiting 1331 ms; commit 0 ms)
2026-11-08T15:02:24Z [load_day 2026-01-13] 2026-01-13 hour 23: 143587 events in 0 files, snapshot none (task 4139 ms: download 2720 ms overlapping gunzip 592 ms, parse 1808 ms, sort 0 ms, write 0 ms, index 699 ms: 3 candidates, 67538 repo-hours, 845 releases; waiting 747 ms; commit 0 ms)
2026-11-08T15:02:33Z [load_day 2026-01-13] 2026-01-13: repo_hour merged from 24 files to 1 (1878518 rows, 8620 ms)
2026-11-08T15:02:36Z [load_day 2026-01-13] 2026-01-13: index committed in 11565 ms (24 + 1 + 24 files)
2026-11-08T15:02:36Z [load_day 2026-01-13] 2026-01-13: 3539940 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:02:36Z [load_day 2026-01-13] attempt 1 succeeded