orcaLog in

Runs · run 4084

load_day 2025-06-29, attempt 1 succeeded

Host
73ccef5e07c2:333103
Started
2026-11-08T12:41:58Z
Ended
2026-11-08T12:43:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
615 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.9 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4084/load_day/2025-06-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:41:58Z [load_day 2025-06-29] attempt 1 started
2026-11-08T12:42:00Z [load_day 2025-06-29] 2025-06-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:42:06Z [load_day 2025-06-29] 2025-06-29 hour 0: 125954 events in 0 files, snapshot none (task 5640 ms: download 3228 ms overlapping gunzip 822 ms, parse 3431 ms, sort 0 ms, write 0 ms, index 554 ms: 7 candidates, 57180 repo-hours, 956 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:42:07Z [load_day 2025-06-29] 2025-06-29 hour 1: 142363 events in 0 files, snapshot none (task 5911 ms: download 3221 ms overlapping gunzip 829 ms, parse 3622 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 81092 repo-hours, 709 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:42:12Z [load_day 2025-06-29] 2025-06-29 hour 2: 130855 events in 0 files, snapshot none (task 4880 ms: download 2532 ms overlapping gunzip 644 ms, parse 2837 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 64010 repo-hours, 739 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:42:12Z [load_day 2025-06-29] 2025-06-29 hour 3: 132897 events in 0 files, snapshot none (task 5147 ms: download 2692 ms overlapping gunzip 795 ms, parse 3252 ms, sort 0 ms, write 0 ms, index 421 ms: 8 candidates, 57114 repo-hours, 825 releases; waiting 374 ms; commit 0 ms)
2026-11-08T12:42:17Z [load_day 2025-06-29] 2025-06-29 hour 4: 132218 events in 0 files, snapshot none (task 4858 ms: download 2669 ms overlapping gunzip 611 ms, parse 2667 ms, sort 0 ms, write 0 ms, index 746 ms: 3 candidates, 55515 repo-hours, 1850 releases; waiting 519 ms; commit 0 ms)
2026-11-08T12:42:18Z [load_day 2025-06-29] 2025-06-29 hour 5: 135073 events in 0 files, snapshot none (task 4836 ms: download 2045 ms overlapping gunzip 683 ms, parse 2814 ms, sort 0 ms, write 0 ms, index 528 ms: 5 candidates, 53614 repo-hours, 622 releases; waiting 200 ms; commit 0 ms)
2026-11-08T12:42:22Z [load_day 2025-06-29] 2025-06-29 hour 6: 145811 events in 0 files, snapshot none (task 4686 ms: download 2505 ms overlapping gunzip 592 ms, parse 2475 ms, sort 0 ms, write 0 ms, index 754 ms: 6 candidates, 66699 repo-hours, 687 releases; waiting 573 ms; commit 0 ms)
2026-11-08T12:42:23Z [load_day 2025-06-29] 2025-06-29 hour 7: 141956 events in 0 files, snapshot none (task 4457 ms: download 2174 ms overlapping gunzip 628 ms, parse 2514 ms, sort 0 ms, write 0 ms, index 570 ms: 7 candidates, 58095 repo-hours, 658 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:42:28Z [load_day 2025-06-29] 2025-06-29 hour 8: 141514 events in 0 files, snapshot none (task 4785 ms: download 2529 ms overlapping gunzip 618 ms, parse 2611 ms, sort 0 ms, write 0 ms, index 672 ms: 3 candidates, 61463 repo-hours, 628 releases; waiting 572 ms; commit 0 ms)
2026-11-08T12:42:28Z [load_day 2025-06-29] 2025-06-29 hour 9: 146221 events in 0 files, snapshot none (task 5026 ms: download 2921 ms overlapping gunzip 671 ms, parse 2934 ms, sort 0 ms, write 0 ms, index 621 ms: 9 candidates, 64030 repo-hours, 741 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:42:33Z [load_day 2025-06-29] 2025-06-29 hour 10: 146784 events in 0 files, snapshot none (task 4784 ms: download 2308 ms overlapping gunzip 703 ms, parse 2933 ms, sort 0 ms, write 0 ms, index 599 ms: 6 candidates, 62540 repo-hours, 619 releases; waiting 303 ms; commit 0 ms)
2026-11-08T12:42:34Z [load_day 2025-06-29] 2025-06-29 hour 11: 150050 events in 0 files, snapshot none (task 4506 ms: download 2528 ms overlapping gunzip 627 ms, parse 2625 ms, sort 0 ms, write 0 ms, index 479 ms: 2 candidates, 62616 repo-hours, 684 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:42:39Z [load_day 2025-06-29] 2025-06-29 hour 12: 165116 events in 0 files, snapshot none (task 4921 ms: download 2336 ms overlapping gunzip 654 ms, parse 2938 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 91887 repo-hours, 749 releases; waiting 451 ms; commit 0 ms)
2026-11-08T12:42:40Z [load_day 2025-06-29] 2025-06-29 hour 13: 154764 events in 0 files, snapshot none (task 5584 ms: download 3289 ms overlapping gunzip 662 ms, parse 2883 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 78409 repo-hours, 717 releases; waiting 1087 ms; commit 0 ms)
2026-11-08T12:42:44Z [load_day 2025-06-29] 2025-06-29 hour 14: 152011 events in 0 files, snapshot none (task 4777 ms: download 2231 ms overlapping gunzip 693 ms, parse 2948 ms, sort 0 ms, write 0 ms, index 529 ms: 9 candidates, 68783 repo-hours, 696 releases; waiting 261 ms; commit 0 ms)
2026-11-08T12:42:45Z [load_day 2025-06-29] 2025-06-29 hour 15: 155934 events in 0 files, snapshot none (task 5122 ms: download 2731 ms overlapping gunzip 728 ms, parse 2975 ms, sort 0 ms, write 0 ms, index 581 ms: 5 candidates, 72495 repo-hours, 815 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:42:50Z [load_day 2025-06-29] 2025-06-29 hour 16: 153510 events in 0 files, snapshot none (task 5215 ms: download 2808 ms overlapping gunzip 788 ms, parse 3071 ms, sort 0 ms, write 0 ms, index 564 ms: 2 candidates, 70558 repo-hours, 675 releases; waiting 568 ms; commit 0 ms)
2026-11-08T12:42:51Z [load_day 2025-06-29] 2025-06-29 hour 17: 148773 events in 0 files, snapshot none (task 4878 ms: download 2601 ms overlapping gunzip 676 ms, parse 2919 ms, sort 0 ms, write 0 ms, index 498 ms: 8 candidates, 66557 repo-hours, 673 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:42:56Z [load_day 2025-06-29] 2025-06-29 hour 18: 152118 events in 0 files, snapshot none (task 5307 ms: download 2970 ms overlapping gunzip 744 ms, parse 3175 ms, sort 0 ms, write 0 ms, index 596 ms: 4 candidates, 72922 repo-hours, 755 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:42:57Z [load_day 2025-06-29] 2025-06-29 hour 19: 144849 events in 0 files, snapshot none (task 5272 ms: download 3616 ms overlapping gunzip 661 ms, parse 2743 ms, sort 0 ms, write 0 ms, index 453 ms: 9 candidates, 60297 repo-hours, 770 releases; waiting 1133 ms; commit 0 ms)
2026-11-08T12:43:00Z [load_day 2025-06-29] 2025-06-29 hour 20: 148245 events in 0 files, snapshot none (task 4268 ms: download 2266 ms overlapping gunzip 570 ms, parse 2465 ms, sort 0 ms, write 0 ms, index 472 ms: 10 candidates, 63111 repo-hours, 823 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:43:01Z [load_day 2025-06-29] 2025-06-29 hour 21: 139650 events in 0 files, snapshot none (task 4098 ms: download 2324 ms overlapping gunzip 582 ms, parse 2470 ms, sort 0 ms, write 0 ms, index 452 ms: 7 candidates, 58850 repo-hours, 866 releases; waiting 331 ms; commit 0 ms)
2026-11-08T12:43:05Z [load_day 2025-06-29] 2025-06-29 hour 22: 137083 events in 0 files, snapshot none (task 4516 ms: download 2626 ms overlapping gunzip 624 ms, parse 2624 ms, sort 0 ms, write 0 ms, index 444 ms: 13 candidates, 54417 repo-hours, 816 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:43:06Z [load_day 2025-06-29] 2025-06-29 hour 23: 128843 events in 0 files, snapshot none (task 4631 ms: download 2657 ms overlapping gunzip 643 ms, parse 2606 ms, sort 0 ms, write 0 ms, index 393 ms: 13 candidates, 53331 repo-hours, 768 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:43:15Z [load_day 2025-06-29] 2025-06-29: repo_hour merged from 24 files to 1 (1555585 rows, 8343 ms)
2026-11-08T12:43:18Z [load_day 2025-06-29] 2025-06-29: index committed in 11385 ms (24 + 1 + 24 files)
2026-11-08T12:43:18Z [load_day 2025-06-29] 2025-06-29: 3452592 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:43:18Z [load_day 2025-06-29] attempt 1 succeeded