orcaLog in

Runs · run 4817

load_day 2026-01-12, attempt 1 succeeded

Host
73ccef5e07c2:428745
Started
2026-11-08T15:00:41Z
Ended
2026-11-08T15:01:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
717 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
77.3 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4817/load_day/2026-01-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:00:41Z [load_day 2026-01-12] attempt 1 started
2026-11-08T15:00:42Z [load_day 2026-01-12] 2026-01-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:00:46Z [load_day 2026-01-12] 2026-01-12 hour 0: 144570 events in 0 files, snapshot none (task 3431 ms: download 1584 ms overlapping gunzip 517 ms, parse 1651 ms, sort 0 ms, write 0 ms, index 560 ms: 7 candidates, 69234 repo-hours, 892 releases; waiting 391 ms; commit 0 ms)
2026-11-08T15:00:46Z [load_day 2026-01-12] 2026-01-12 hour 1: 150531 events in 0 files, snapshot none (task 3850 ms: download 2404 ms overlapping gunzip 453 ms, parse 1492 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 86806 repo-hours, 727 releases; waiting 926 ms; commit 0 ms)
2026-11-08T15:00:51Z [load_day 2026-01-12] 2026-01-12 hour 2: 145953 events in 0 files, snapshot none (task 4168 ms: download 2734 ms overlapping gunzip 619 ms, parse 1847 ms, sort 0 ms, write 0 ms, index 743 ms: 10 candidates, 76605 repo-hours, 659 releases; waiting 720 ms; commit 0 ms)
2026-11-08T15:00:51Z [load_day 2026-01-12] 2026-01-12 hour 3: 143597 events in 0 files, snapshot none (task 3865 ms: download 2320 ms overlapping gunzip 596 ms, parse 1697 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 69331 repo-hours, 785 releases; waiting 618 ms; commit 0 ms)
2026-11-08T15:00:55Z [load_day 2026-01-12] 2026-01-12 hour 4: 145675 events in 0 files, snapshot none (task 3807 ms: download 2715 ms overlapping gunzip 492 ms, parse 1490 ms, sort 0 ms, write 0 ms, index 576 ms: 9 candidates, 74981 repo-hours, 1429 releases; waiting 926 ms; commit 0 ms)
2026-11-08T15:00:55Z [load_day 2026-01-12] 2026-01-12 hour 5: 146921 events in 0 files, snapshot none (task 3570 ms: download 2167 ms overlapping gunzip 471 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 619 ms: 3 candidates, 72519 repo-hours, 654 releases; waiting 633 ms; commit 0 ms)
2026-11-08T15:00:59Z [load_day 2026-01-12] 2026-01-12 hour 6: 149592 events in 0 files, snapshot none (task 3925 ms: download 2650 ms overlapping gunzip 508 ms, parse 1716 ms, sort 0 ms, write 0 ms, index 711 ms: 7 candidates, 78332 repo-hours, 685 releases; waiting 672 ms; commit 0 ms)
2026-11-08T15:01:00Z [load_day 2026-01-12] 2026-01-12 hour 7: 151143 events in 0 files, snapshot none (task 4251 ms: download 2983 ms overlapping gunzip 673 ms, parse 1898 ms, sort 0 ms, write 0 ms, index 651 ms: 4 candidates, 74649 repo-hours, 662 releases; waiting 726 ms; commit 0 ms)
2026-11-08T15:01:04Z [load_day 2026-01-12] 2026-01-12 hour 8: 148165 events in 0 files, snapshot none (task 4200 ms: download 2532 ms overlapping gunzip 705 ms, parse 1978 ms, sort 0 ms, write 0 ms, index 707 ms: 5 candidates, 79729 repo-hours, 752 releases; waiting 507 ms; commit 0 ms)
2026-11-08T15:01:04Z [load_day 2026-01-12] 2026-01-12 hour 9: 146900 events in 0 files, snapshot none (task 3843 ms: download 2295 ms overlapping gunzip 616 ms, parse 1828 ms, sort 0 ms, write 0 ms, index 587 ms: 1 candidates, 79441 repo-hours, 648 releases; waiting 579 ms; commit 0 ms)
2026-11-08T15:01:09Z [load_day 2026-01-12] 2026-01-12 hour 10: 149107 events in 0 files, snapshot none (task 3997 ms: download 2335 ms overlapping gunzip 639 ms, parse 1826 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 80098 repo-hours, 726 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:01:09Z [load_day 2026-01-12] 2026-01-12 hour 11: 148583 events in 0 files, snapshot none (task 4233 ms: download 3019 ms overlapping gunzip 574 ms, parse 1749 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 77777 repo-hours, 822 releases; waiting 1004 ms; commit 0 ms)
2026-11-08T15:01:13Z [load_day 2026-01-12] 2026-01-12 hour 12: 154571 events in 0 files, snapshot none (task 3818 ms: download 2428 ms overlapping gunzip 486 ms, parse 1457 ms, sort 0 ms, write 0 ms, index 685 ms: 4 candidates, 94871 repo-hours, 612 releases; waiting 893 ms; commit 0 ms)
2026-11-08T15:01:13Z [load_day 2026-01-12] 2026-01-12 hour 13: 155691 events in 0 files, snapshot none (task 3535 ms: download 1896 ms overlapping gunzip 460 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 95605 repo-hours, 558 releases; waiting 605 ms; commit 0 ms)
2026-11-08T15:01:17Z [load_day 2026-01-12] 2026-01-12 hour 14: 150575 events in 0 files, snapshot none (task 3919 ms: download 2741 ms overlapping gunzip 466 ms, parse 1502 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 84253 repo-hours, 602 releases; waiting 944 ms; commit 0 ms)
2026-11-08T15:01:17Z [load_day 2026-01-12] 2026-01-12 hour 15: 149640 events in 0 files, snapshot none (task 3694 ms: download 2034 ms overlapping gunzip 540 ms, parse 1584 ms, sort 0 ms, write 0 ms, index 776 ms: 8 candidates, 83986 repo-hours, 648 releases; waiting 458 ms; commit 0 ms)
2026-11-08T15:01:22Z [load_day 2026-01-12] 2026-01-12 hour 16: 148756 events in 0 files, snapshot none (task 3818 ms: download 2754 ms overlapping gunzip 477 ms, parse 1302 ms, sort 0 ms, write 0 ms, index 632 ms: 8 candidates, 82783 repo-hours, 703 releases; waiting 1008 ms; commit 0 ms)
2026-11-08T15:01:22Z [load_day 2026-01-12] 2026-01-12 hour 17: 145933 events in 0 files, snapshot none (task 3555 ms: download 2266 ms overlapping gunzip 442 ms, parse 1271 ms, sort 0 ms, write 0 ms, index 658 ms: 3 candidates, 79766 repo-hours, 668 releases; waiting 815 ms; commit 0 ms)
2026-11-08T15:01:26Z [load_day 2026-01-12] 2026-01-12 hour 18: 147455 events in 0 files, snapshot none (task 3787 ms: download 2617 ms overlapping gunzip 406 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 585 ms: 7 candidates, 83475 repo-hours, 768 releases; waiting 1271 ms; commit 0 ms)
2026-11-08T15:01:26Z [load_day 2026-01-12] 2026-01-12 hour 19: 146366 events in 0 files, snapshot none (task 3447 ms: download 2477 ms overlapping gunzip 458 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 553 ms: 3 candidates, 71813 repo-hours, 804 releases; waiting 771 ms; commit 0 ms)
2026-11-08T15:01:30Z [load_day 2026-01-12] 2026-01-12 hour 20: 147883 events in 0 files, snapshot none (task 3564 ms: download 2549 ms overlapping gunzip 445 ms, parse 1304 ms, sort 0 ms, write 0 ms, index 576 ms: 8 candidates, 74642 repo-hours, 769 releases; waiting 964 ms; commit 0 ms)
2026-11-08T15:01:30Z [load_day 2026-01-12] 2026-01-12 hour 21: 149199 events in 0 files, snapshot none (task 3532 ms: download 2480 ms overlapping gunzip 442 ms, parse 1314 ms, sort 0 ms, write 0 ms, index 535 ms: 6 candidates, 72098 repo-hours, 879 releases; waiting 871 ms; commit 0 ms)
2026-11-08T15:01:35Z [load_day 2026-01-12] 2026-01-12 hour 22: 144252 events in 0 files, snapshot none (task 4339 ms: download 2675 ms overlapping gunzip 701 ms, parse 2101 ms, sort 0 ms, write 0 ms, index 617 ms: 5 candidates, 69756 repo-hours, 922 releases; waiting 617 ms; commit 0 ms)
2026-11-08T15:01:35Z [load_day 2026-01-12] 2026-01-12 hour 23: 143829 events in 0 files, snapshot none (task 3718 ms: download 2456 ms overlapping gunzip 604 ms, parse 1805 ms, sort 0 ms, write 0 ms, index 545 ms: 6 candidates, 65453 repo-hours, 1074 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:01:43Z [load_day 2026-01-12] 2026-01-12: repo_hour merged from 24 files to 1 (1878003 rows, 8128 ms)
2026-11-08T15:01:46Z [load_day 2026-01-12] 2026-01-12: index committed in 11283 ms (24 + 1 + 24 files)
2026-11-08T15:01:46Z [load_day 2026-01-12] 2026-01-12: 3554887 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:01:46Z [load_day 2026-01-12] attempt 1 succeeded