orcaLog in

Runs · run 4043

load_day 2025-06-20, attempt 1 succeeded

Host
73ccef5e07c2:326831
Started
2026-11-08T12:33:04Z
Ended
2026-11-08T12:34:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
669 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
138.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4043/load_day/2025-06-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:33:04Z [load_day 2025-06-20] attempt 1 started
2026-11-08T12:33:05Z [load_day 2025-06-20] 2025-06-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:33:11Z [load_day 2025-06-20] 2025-06-20 hour 0: 144915 events in 0 files, snapshot none (task 5231 ms: download 2774 ms overlapping gunzip 750 ms, parse 3378 ms, sort 0 ms, write 0 ms, index 548 ms: 7 candidates, 69262 repo-hours, 1047 releases; waiting 293 ms; commit 0 ms)
2026-11-08T12:33:11Z [load_day 2025-06-20] 2025-06-20 hour 1: 148809 events in 0 files, snapshot none (task 5238 ms: download 2953 ms overlapping gunzip 724 ms, parse 3121 ms, sort 0 ms, write 0 ms, index 612 ms: 10 candidates, 86390 repo-hours, 695 releases; waiting 475 ms; commit 0 ms)
2026-11-08T12:33:16Z [load_day 2025-06-20] 2025-06-20 hour 2: 142918 events in 0 files, snapshot none (task 4605 ms: download 2494 ms overlapping gunzip 664 ms, parse 2772 ms, sort 0 ms, write 0 ms, index 494 ms: 7 candidates, 68527 repo-hours, 807 releases; waiting 313 ms; commit 0 ms)
2026-11-08T12:33:16Z [load_day 2025-06-20] 2025-06-20 hour 3: 144639 events in 0 files, snapshot none (task 4573 ms: download 2773 ms overlapping gunzip 650 ms, parse 2669 ms, sort 0 ms, write 0 ms, index 550 ms: 8 candidates, 67070 repo-hours, 1938 releases; waiting 391 ms; commit 0 ms)
2026-11-08T12:33:22Z [load_day 2025-06-20] 2025-06-20 hour 4: 144391 events in 0 files, snapshot none (task 6031 ms: download 2874 ms overlapping gunzip 930 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 529 ms: 8 candidates, 62144 repo-hours, 700 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:33:23Z [load_day 2025-06-20] 2025-06-20 hour 5: 149721 events in 0 files, snapshot none (task 6245 ms: download 3333 ms overlapping gunzip 999 ms, parse 3983 ms, sort 0 ms, write 0 ms, index 522 ms: 3 candidates, 64130 repo-hours, 722 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:33:30Z [load_day 2025-06-20] 2025-06-20 hour 6: 158718 events in 0 files, snapshot none (task 7027 ms: download 3287 ms overlapping gunzip 1086 ms, parse 4531 ms, sort 0 ms, write 0 ms, index 868 ms: 8 candidates, 79532 repo-hours, 793 releases; waiting 274 ms; commit 0 ms)
2026-11-08T12:33:31Z [load_day 2025-06-20] 2025-06-20 hour 7: 157311 events in 0 files, snapshot none (task 7667 ms: download 4697 ms overlapping gunzip 1153 ms, parse 4902 ms, sort 0 ms, write 0 ms, index 656 ms: 3 candidates, 75596 repo-hours, 718 releases; waiting 640 ms; commit 0 ms)
2026-11-08T12:33:38Z [load_day 2025-06-20] 2025-06-20 hour 8: 162233 events in 0 files, snapshot none (task 7547 ms: download 5058 ms overlapping gunzip 1203 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 597 ms: 5 candidates, 78923 repo-hours, 914 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:33:39Z [load_day 2025-06-20] 2025-06-20 hour 9: 160074 events in 0 files, snapshot none (task 7208 ms: download 4608 ms overlapping gunzip 1179 ms, parse 4857 ms, sort 0 ms, write 0 ms, index 629 ms: 10 candidates, 79714 repo-hours, 930 releases; waiting 233 ms; commit 0 ms)
2026-11-08T12:33:45Z [load_day 2025-06-20] 2025-06-20 hour 10: 155383 events in 0 files, snapshot none (task 6574 ms: download 3376 ms overlapping gunzip 988 ms, parse 4064 ms, sort 0 ms, write 0 ms, index 892 ms: 8 candidates, 75305 repo-hours, 774 releases; waiting 11 ms; commit 0 ms)
2026-11-08T12:33:46Z [load_day 2025-06-20] 2025-06-20 hour 11: 153960 events in 0 files, snapshot none (task 6507 ms: download 3614 ms overlapping gunzip 975 ms, parse 3961 ms, sort 0 ms, write 0 ms, index 678 ms: 7 candidates, 70687 repo-hours, 743 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:33:53Z [load_day 2025-06-20] 2025-06-20 hour 12: 168666 events in 0 files, snapshot none (task 6799 ms: download 2946 ms overlapping gunzip 972 ms, parse 4173 ms, sort 0 ms, write 0 ms, index 760 ms: 11 candidates, 95516 repo-hours, 879 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:33:53Z [load_day 2025-06-20] 2025-06-20 hour 13: 166527 events in 0 files, snapshot none (task 6756 ms: download 3751 ms overlapping gunzip 998 ms, parse 4367 ms, sort 0 ms, write 0 ms, index 679 ms: 10 candidates, 89781 repo-hours, 854 releases; waiting 439 ms; commit 0 ms)
2026-11-08T12:34:00Z [load_day 2025-06-20] 2025-06-20 hour 14: 160652 events in 0 files, snapshot none (task 7143 ms: download 4593 ms overlapping gunzip 1144 ms, parse 4693 ms, sort 0 ms, write 0 ms, index 604 ms: 9 candidates, 79312 repo-hours, 933 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:34:01Z [load_day 2025-06-20] 2025-06-20 hour 15: 160638 events in 0 files, snapshot none (task 7407 ms: download 4582 ms overlapping gunzip 1095 ms, parse 4650 ms, sort 0 ms, write 0 ms, index 674 ms: 12 candidates, 80457 repo-hours, 986 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:34:09Z [load_day 2025-06-20] 2025-06-20 hour 16: 160693 events in 0 files, snapshot none (task 8294 ms: download 5490 ms overlapping gunzip 1274 ms, parse 5430 ms, sort 0 ms, write 0 ms, index 666 ms: 14 candidates, 78476 repo-hours, 1047 releases; waiting 561 ms; commit 0 ms)
2026-11-08T12:34:10Z [load_day 2025-06-20] 2025-06-20 hour 17: 158771 events in 0 files, snapshot none (task 7773 ms: download 4876 ms overlapping gunzip 1214 ms, parse 4905 ms, sort 0 ms, write 0 ms, index 925 ms: 8 candidates, 74792 repo-hours, 774 releases; waiting 491 ms; commit 0 ms)
2026-11-08T12:34:17Z [load_day 2025-06-20] 2025-06-20 hour 18: 152147 events in 0 files, snapshot none (task 7087 ms: download 4198 ms overlapping gunzip 1072 ms, parse 4566 ms, sort 0 ms, write 0 ms, index 725 ms: 4 candidates, 76000 repo-hours, 809 releases; waiting 352 ms; commit 0 ms)
2026-11-08T12:34:17Z [load_day 2025-06-20] 2025-06-20 hour 19: 151184 events in 0 files, snapshot none (task 6792 ms: download 4362 ms overlapping gunzip 1038 ms, parse 4445 ms, sort 0 ms, write 0 ms, index 525 ms: 9 candidates, 65280 repo-hours, 751 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:34:23Z [load_day 2025-06-20] 2025-06-20 hour 20: 151624 events in 0 files, snapshot none (task 6208 ms: download 3625 ms overlapping gunzip 969 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 629 ms: 6 candidates, 67191 repo-hours, 763 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:34:24Z [load_day 2025-06-20] 2025-06-20 hour 21: 148720 events in 0 files, snapshot none (task 6201 ms: download 3704 ms overlapping gunzip 935 ms, parse 3842 ms, sort 0 ms, write 0 ms, index 548 ms: 3 candidates, 62756 repo-hours, 919 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:34:30Z [load_day 2025-06-20] 2025-06-20 hour 22: 138310 events in 0 files, snapshot none (task 5896 ms: download 3014 ms overlapping gunzip 813 ms, parse 3345 ms, sort 0 ms, write 0 ms, index 881 ms: 2 candidates, 56449 repo-hours, 952 releases; waiting 487 ms; commit 0 ms)
2026-11-08T12:34:30Z [load_day 2025-06-20] 2025-06-20 hour 23: 132783 events in 0 files, snapshot none (task 5605 ms: download 3138 ms overlapping gunzip 813 ms, parse 3309 ms, sort 0 ms, write 0 ms, index 685 ms: 5 candidates, 54434 repo-hours, 894 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:34:38Z [load_day 2025-06-20] 2025-06-20: repo_hour merged from 24 files to 1 (1757724 rows, 8055 ms)
2026-11-08T12:34:41Z [load_day 2025-06-20] 2025-06-20: index committed in 10734 ms (24 + 1 + 24 files)
2026-11-08T12:34:41Z [load_day 2025-06-20] 2025-06-20: 3673787 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:34:41Z [load_day 2025-06-20] attempt 1 succeeded