orcaLog in

Runs · run 4806

load_day 2026-01-09, attempt 1 succeeded

Host
73ccef5e07c2:427594
Started
2026-11-08T14:59:17Z
Ended
2026-11-08T15:00:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
730 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.7 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4806/load_day/2026-01-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:59:17Z [load_day 2026-01-09] attempt 1 started
2026-11-08T14:59:17Z [load_day 2026-01-09] 2026-01-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:59:22Z [load_day 2026-01-09] 2026-01-09 hour 0: 141618 events in 0 files, snapshot none (task 3916 ms: download 2511 ms overlapping gunzip 597 ms, parse 1777 ms, sort 0 ms, write 0 ms, index 605 ms: 5 candidates, 72376 repo-hours, 845 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:59:22Z [load_day 2026-01-09] 2026-01-09 hour 1: 152547 events in 0 files, snapshot none (task 3798 ms: download 1887 ms overlapping gunzip 578 ms, parse 1993 ms, sort 0 ms, write 0 ms, index 715 ms: 11 candidates, 91630 repo-hours, 731 releases; waiting 229 ms; commit 0 ms)
2026-11-08T14:59:26Z [load_day 2026-01-09] 2026-01-09 hour 2: 145769 events in 0 files, snapshot none (task 3634 ms: download 2366 ms overlapping gunzip 440 ms, parse 1400 ms, sort 0 ms, write 0 ms, index 599 ms: 7 candidates, 78329 repo-hours, 724 releases; waiting 800 ms; commit 0 ms)
2026-11-08T14:59:26Z [load_day 2026-01-09] 2026-01-09 hour 3: 142141 events in 0 files, snapshot none (task 3091 ms: download 1544 ms overlapping gunzip 406 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 774 ms: 10 candidates, 68581 repo-hours, 757 releases; waiting 319 ms; commit 0 ms)
2026-11-08T14:59:30Z [load_day 2026-01-09] 2026-01-09 hour 4: 143717 events in 0 files, snapshot none (task 3260 ms: download 2033 ms overlapping gunzip 367 ms, parse 1185 ms, sort 0 ms, write 0 ms, index 549 ms: 4 candidates, 70384 repo-hours, 1488 releases; waiting 800 ms; commit 0 ms)
2026-11-08T14:59:30Z [load_day 2026-01-09] 2026-01-09 hour 5: 145722 events in 0 files, snapshot none (task 3214 ms: download 2092 ms overlapping gunzip 417 ms, parse 1212 ms, sort 0 ms, write 0 ms, index 539 ms: 6 candidates, 70985 repo-hours, 667 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:59:34Z [load_day 2026-01-09] 2026-01-09 hour 6: 146730 events in 0 files, snapshot none (task 3667 ms: download 2378 ms overlapping gunzip 437 ms, parse 1239 ms, sort 0 ms, write 0 ms, index 676 ms: 5 candidates, 78634 repo-hours, 691 releases; waiting 1029 ms; commit 0 ms)
2026-11-08T14:59:34Z [load_day 2026-01-09] 2026-01-09 hour 7: 150471 events in 0 files, snapshot none (task 3498 ms: download 2262 ms overlapping gunzip 385 ms, parse 1190 ms, sort 0 ms, write 0 ms, index 619 ms: 14 candidates, 73761 repo-hours, 626 releases; waiting 930 ms; commit 0 ms)
2026-11-08T14:59:38Z [load_day 2026-01-09] 2026-01-09 hour 8: 144935 events in 0 files, snapshot none (task 3758 ms: download 2188 ms overlapping gunzip 521 ms, parse 1556 ms, sort 0 ms, write 0 ms, index 821 ms: 4 candidates, 74203 repo-hours, 750 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:59:39Z [load_day 2026-01-09] 2026-01-09 hour 9: 145631 events in 0 files, snapshot none (task 4470 ms: download 3258 ms overlapping gunzip 593 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 76276 repo-hours, 703 releases; waiting 1425 ms; commit 0 ms)
2026-11-08T14:59:43Z [load_day 2026-01-09] 2026-01-09 hour 10: 153096 events in 0 files, snapshot none (task 4472 ms: download 2850 ms overlapping gunzip 572 ms, parse 1674 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 80131 repo-hours, 626 releases; waiting 1334 ms; commit 0 ms)
2026-11-08T14:59:43Z [load_day 2026-01-09] 2026-01-09 hour 11: 150734 events in 0 files, snapshot none (task 3880 ms: download 2186 ms overlapping gunzip 542 ms, parse 1599 ms, sort 0 ms, write 0 ms, index 618 ms: 7 candidates, 78055 repo-hours, 725 releases; waiting 822 ms; commit 0 ms)
2026-11-08T14:59:48Z [load_day 2026-01-09] 2026-01-09 hour 12: 156727 events in 0 files, snapshot none (task 3630 ms: download 2033 ms overlapping gunzip 470 ms, parse 1546 ms, sort 0 ms, write 0 ms, index 754 ms: 4 candidates, 97281 repo-hours, 518 releases; waiting 594 ms; commit 0 ms)
2026-11-08T14:59:48Z [load_day 2026-01-09] 2026-01-09 hour 13: 158370 events in 0 files, snapshot none (task 3800 ms: download 2369 ms overlapping gunzip 493 ms, parse 1588 ms, sort 0 ms, write 0 ms, index 746 ms: 8 candidates, 93742 repo-hours, 590 releases; waiting 649 ms; commit 0 ms)
2026-11-08T14:59:52Z [load_day 2026-01-09] 2026-01-09 hour 14: 145036 events in 0 files, snapshot none (task 3907 ms: download 2523 ms overlapping gunzip 644 ms, parse 1687 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 78337 repo-hours, 687 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:59:52Z [load_day 2026-01-09] 2026-01-09 hour 15: 147959 events in 0 files, snapshot none (task 3925 ms: download 2585 ms overlapping gunzip 551 ms, parse 1659 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 81441 repo-hours, 646 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:59:57Z [load_day 2026-01-09] 2026-01-09 hour 16: 147421 events in 0 files, snapshot none (task 3909 ms: download 2160 ms overlapping gunzip 556 ms, parse 1677 ms, sort 0 ms, write 0 ms, index 630 ms: 4 candidates, 79774 repo-hours, 686 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:59:57Z [load_day 2026-01-09] 2026-01-09 hour 17: 152577 events in 0 files, snapshot none (task 3888 ms: download 2403 ms overlapping gunzip 581 ms, parse 1579 ms, sort 0 ms, write 0 ms, index 889 ms: 7 candidates, 77399 repo-hours, 666 releases; waiting 481 ms; commit 0 ms)
2026-11-08T15:00:02Z [load_day 2026-01-09] 2026-01-09 hour 18: 149464 events in 0 files, snapshot none (task 4945 ms: download 2515 ms overlapping gunzip 855 ms, parse 2462 ms, sort 0 ms, write 0 ms, index 760 ms: 3 candidates, 80859 repo-hours, 713 releases; waiting 533 ms; commit 0 ms)
2026-11-08T15:00:02Z [load_day 2026-01-09] 2026-01-09 hour 19: 149796 events in 0 files, snapshot none (task 4972 ms: download 2611 ms overlapping gunzip 862 ms, parse 2596 ms, sort 0 ms, write 0 ms, index 719 ms: 10 candidates, 72254 repo-hours, 716 releases; waiting 504 ms; commit 0 ms)
2026-11-08T15:00:08Z [load_day 2026-01-09] 2026-01-09 hour 20: 148396 events in 0 files, snapshot none (task 4770 ms: download 3320 ms overlapping gunzip 708 ms, parse 2003 ms, sort 0 ms, write 0 ms, index 618 ms: 6 candidates, 73626 repo-hours, 768 releases; waiting 1107 ms; commit 0 ms)
2026-11-08T15:00:08Z [load_day 2026-01-09] 2026-01-09 hour 21: 147631 events in 0 files, snapshot none (task 4539 ms: download 2927 ms overlapping gunzip 660 ms, parse 2123 ms, sort 0 ms, write 0 ms, index 604 ms: 7 candidates, 69607 repo-hours, 835 releases; waiting 811 ms; commit 0 ms)
2026-11-08T15:00:12Z [load_day 2026-01-09] 2026-01-09 hour 22: 145650 events in 0 files, snapshot none (task 3753 ms: download 2477 ms overlapping gunzip 560 ms, parse 1664 ms, sort 0 ms, write 0 ms, index 658 ms: 8 candidates, 65954 repo-hours, 899 releases; waiting 558 ms; commit 0 ms)
2026-11-08T15:00:12Z [load_day 2026-01-09] 2026-01-09 hour 23: 142272 events in 0 files, snapshot none (task 4031 ms: download 2667 ms overlapping gunzip 652 ms, parse 2022 ms, sort 0 ms, write 0 ms, index 490 ms: 9 candidates, 62718 repo-hours, 856 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:00:20Z [load_day 2026-01-09] 2026-01-09: repo_hour merged from 24 files to 1 (1846337 rows, 7957 ms)
2026-11-08T15:00:23Z [load_day 2026-01-09] 2026-01-09: index committed in 11235 ms (24 + 1 + 24 files)
2026-11-08T15:00:23Z [load_day 2026-01-09] 2026-01-09: 3554410 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:00:23Z [load_day 2026-01-09] attempt 1 succeeded