orcaLog in

Runs · run 4193

load_day 2025-07-26, attempt 1 succeeded

Host
73ccef5e07c2:349243
Started
2026-11-08T13:06:01Z
Ended
2026-11-08T13:07:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
616 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
113.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4193/load_day/2025-07-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:06:01Z [load_day 2025-07-26] attempt 1 started
2026-11-08T13:06:02Z [load_day 2025-07-26] 2025-07-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:06:08Z [load_day 2025-07-26] 2025-07-26 hour 0: 131306 events in 0 files, snapshot none (task 5588 ms: download 3002 ms overlapping gunzip 844 ms, parse 3520 ms, sort 0 ms, write 0 ms, index 463 ms: 3 candidates, 61622 repo-hours, 1156 releases; waiting 452 ms; commit 0 ms)
2026-11-08T13:06:08Z [load_day 2025-07-26] 2025-07-26 hour 1: 145597 events in 0 files, snapshot none (task 5548 ms: download 2785 ms overlapping gunzip 820 ms, parse 3314 ms, sort 0 ms, write 0 ms, index 596 ms: 11 candidates, 81189 repo-hours, 980 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:06:15Z [load_day 2025-07-26] 2025-07-26 hour 2: 134704 events in 0 files, snapshot none (task 5794 ms: download 3840 ms overlapping gunzip 889 ms, parse 3360 ms, sort 0 ms, write 0 ms, index 642 ms: 7 candidates, 63383 repo-hours, 966 releases; waiting 617 ms; commit 0 ms)
2026-11-08T13:06:15Z [load_day 2025-07-26] 2025-07-26 hour 3: 131202 events in 0 files, snapshot none (task 5598 ms: download 3286 ms overlapping gunzip 756 ms, parse 3112 ms, sort 0 ms, write 0 ms, index 496 ms: 2 candidates, 55619 repo-hours, 886 releases; waiting 575 ms; commit 0 ms)
2026-11-08T13:06:22Z [load_day 2025-07-26] 2025-07-26 hour 4: 139337 events in 0 files, snapshot none (task 6542 ms: download 2862 ms overlapping gunzip 1003 ms, parse 4096 ms, sort 0 ms, write 0 ms, index 556 ms: 2 candidates, 59173 repo-hours, 2061 releases; waiting 528 ms; commit 0 ms)
2026-11-08T13:06:22Z [load_day 2025-07-26] 2025-07-26 hour 5: 138271 events in 0 files, snapshot none (task 6454 ms: download 2416 ms overlapping gunzip 1036 ms, parse 4420 ms, sort 0 ms, write 0 ms, index 543 ms: 2 candidates, 55947 repo-hours, 684 releases; waiting 225 ms; commit 0 ms)
2026-11-08T13:06:28Z [load_day 2025-07-26] 2025-07-26 hour 6: 142478 events in 0 files, snapshot none (task 6066 ms: download 3329 ms overlapping gunzip 894 ms, parse 3571 ms, sort 0 ms, write 0 ms, index 713 ms: 3 candidates, 66005 repo-hours, 925 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:06:28Z [load_day 2025-07-26] 2025-07-26 hour 7: 141250 events in 0 files, snapshot none (task 5723 ms: download 2747 ms overlapping gunzip 847 ms, parse 3511 ms, sort 0 ms, write 0 ms, index 560 ms: 12 candidates, 59087 repo-hours, 918 releases; waiting 460 ms; commit 0 ms)
2026-11-08T13:06:34Z [load_day 2025-07-26] 2025-07-26 hour 8: 143559 events in 0 files, snapshot none (task 5089 ms: download 2737 ms overlapping gunzip 710 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 521 ms: 7 candidates, 62413 repo-hours, 1022 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:06:34Z [load_day 2025-07-26] 2025-07-26 hour 9: 144647 events in 0 files, snapshot none (task 5102 ms: download 2880 ms overlapping gunzip 755 ms, parse 3132 ms, sort 0 ms, write 0 ms, index 466 ms: 5 candidates, 61836 repo-hours, 991 releases; waiting 395 ms; commit 0 ms)
2026-11-08T13:06:40Z [load_day 2025-07-26] 2025-07-26 hour 10: 146975 events in 0 files, snapshot none (task 6015 ms: download 3387 ms overlapping gunzip 928 ms, parse 3741 ms, sort 0 ms, write 0 ms, index 479 ms: 7 candidates, 62729 repo-hours, 1009 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:06:40Z [load_day 2025-07-26] 2025-07-26 hour 11: 153972 events in 0 files, snapshot none (task 5821 ms: download 2971 ms overlapping gunzip 867 ms, parse 3615 ms, sort 0 ms, write 0 ms, index 462 ms: 9 candidates, 60521 repo-hours, 913 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:06:47Z [load_day 2025-07-26] 2025-07-26 hour 12: 162236 events in 0 files, snapshot none (task 6770 ms: download 3326 ms overlapping gunzip 941 ms, parse 4414 ms, sort 0 ms, write 0 ms, index 647 ms: 9 candidates, 86185 repo-hours, 817 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:06:48Z [load_day 2025-07-26] 2025-07-26 hour 13: 161406 events in 0 files, snapshot none (task 6963 ms: download 3240 ms overlapping gunzip 956 ms, parse 4383 ms, sort 0 ms, write 0 ms, index 818 ms: 10 candidates, 78928 repo-hours, 798 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:06:54Z [load_day 2025-07-26] 2025-07-26 hour 14: 149227 events in 0 files, snapshot none (task 5999 ms: download 3097 ms overlapping gunzip 880 ms, parse 3692 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 65463 repo-hours, 828 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:06:54Z [load_day 2025-07-26] 2025-07-26 hour 15: 153583 events in 0 files, snapshot none (task 5905 ms: download 2791 ms overlapping gunzip 851 ms, parse 3644 ms, sort 0 ms, write 0 ms, index 583 ms: 8 candidates, 68580 repo-hours, 934 releases; waiting 591 ms; commit 0 ms)
2026-11-08T13:07:00Z [load_day 2025-07-26] 2025-07-26 hour 16: 150254 events in 0 files, snapshot none (task 5837 ms: download 3774 ms overlapping gunzip 829 ms, parse 3357 ms, sort 0 ms, write 0 ms, index 618 ms: 15 candidates, 67913 repo-hours, 655 releases; waiting 758 ms; commit 0 ms)
2026-11-08T13:07:00Z [load_day 2025-07-26] 2025-07-26 hour 17: 149223 events in 0 files, snapshot none (task 5525 ms: download 3165 ms overlapping gunzip 747 ms, parse 3211 ms, sort 0 ms, write 0 ms, index 626 ms: 8 candidates, 63559 repo-hours, 642 releases; waiting 647 ms; commit 0 ms)
2026-11-08T13:07:06Z [load_day 2025-07-26] 2025-07-26 hour 18: 154096 events in 0 files, snapshot none (task 5001 ms: download 2694 ms overlapping gunzip 666 ms, parse 2758 ms, sort 0 ms, write 0 ms, index 582 ms: 8 candidates, 70994 repo-hours, 781 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:07:06Z [load_day 2025-07-26] 2025-07-26 hour 19: 144676 events in 0 files, snapshot none (task 4223 ms: download 2546 ms overlapping gunzip 584 ms, parse 2503 ms, sort 0 ms, write 0 ms, index 464 ms: 14 candidates, 56439 repo-hours, 670 releases; waiting 393 ms; commit 0 ms)
2026-11-08T13:07:11Z [load_day 2025-07-26] 2025-07-26 hour 20: 141070 events in 0 files, snapshot none (task 4597 ms: download 2915 ms overlapping gunzip 641 ms, parse 2699 ms, sort 0 ms, write 0 ms, index 460 ms: 4 candidates, 56014 repo-hours, 715 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:07:11Z [load_day 2025-07-26] 2025-07-26 hour 21: 138173 events in 0 files, snapshot none (task 4763 ms: download 2565 ms overlapping gunzip 658 ms, parse 2935 ms, sort 0 ms, write 0 ms, index 372 ms: 3 candidates, 52587 repo-hours, 837 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:07:15Z [load_day 2025-07-26] 2025-07-26 hour 22: 134509 events in 0 files, snapshot none (task 4336 ms: download 2526 ms overlapping gunzip 627 ms, parse 2502 ms, sort 0 ms, write 0 ms, index 375 ms: 5 candidates, 49029 repo-hours, 885 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:07:15Z [load_day 2025-07-26] 2025-07-26 hour 23: 129975 events in 0 files, snapshot none (task 4144 ms: download 2932 ms overlapping gunzip 576 ms, parse 2399 ms, sort 0 ms, write 0 ms, index 365 ms: 6 candidates, 46887 repo-hours, 1067 releases; waiting 486 ms; commit 0 ms)
2026-11-08T13:07:23Z [load_day 2025-07-26] 2025-07-26: repo_hour merged from 24 files to 1 (1512102 rows, 7105 ms)
2026-11-08T13:07:26Z [load_day 2025-07-26] 2025-07-26: index committed in 10601 ms (24 + 1 + 24 files)
2026-11-08T13:07:26Z [load_day 2025-07-26] 2025-07-26: 3461726 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:07:26Z [load_day 2025-07-26] attempt 1 succeeded