orcaLog in

Runs · run 4126

load_day 2025-07-09, attempt 1 succeeded

Host
73ccef5e07c2:339677
Started
2026-11-08T12:51:44Z
Ended
2026-11-08T12:53:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
677 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
143.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4126/load_day/2025-07-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:51:44Z [load_day 2025-07-09] attempt 1 started
2026-11-08T12:51:45Z [load_day 2025-07-09] 2025-07-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:51:51Z [load_day 2025-07-09] 2025-07-09 hour 0: 142131 events in 0 files, snapshot none (task 5454 ms: download 2644 ms overlapping gunzip 812 ms, parse 3317 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 68635 repo-hours, 1568 releases; waiting 194 ms; commit 0 ms)
2026-11-08T12:51:52Z [load_day 2025-07-09] 2025-07-09 hour 1: 157226 events in 0 files, snapshot none (task 6020 ms: download 3416 ms overlapping gunzip 896 ms, parse 3640 ms, sort 0 ms, write 0 ms, index 634 ms: 6 candidates, 90806 repo-hours, 816 releases; waiting 472 ms; commit 0 ms)
2026-11-08T12:51:58Z [load_day 2025-07-09] 2025-07-09 hour 2: 151853 events in 0 files, snapshot none (task 6245 ms: download 4004 ms overlapping gunzip 954 ms, parse 3861 ms, sort 0 ms, write 0 ms, index 577 ms: 8 candidates, 75629 repo-hours, 870 releases; waiting 617 ms; commit 0 ms)
2026-11-08T12:51:58Z [load_day 2025-07-09] 2025-07-09 hour 3: 146814 events in 0 files, snapshot none (task 5511 ms: download 2921 ms overlapping gunzip 765 ms, parse 3193 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 69086 repo-hours, 1430 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:52:05Z [load_day 2025-07-09] 2025-07-09 hour 4: 150066 events in 0 files, snapshot none (task 6012 ms: download 3761 ms overlapping gunzip 911 ms, parse 3696 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 67982 repo-hours, 1405 releases; waiting 483 ms; commit 0 ms)
2026-11-08T12:52:05Z [load_day 2025-07-09] 2025-07-09 hour 5: 147688 events in 0 files, snapshot none (task 6703 ms: download 4240 ms overlapping gunzip 1032 ms, parse 4365 ms, sort 0 ms, write 0 ms, index 537 ms: 8 candidates, 67057 repo-hours, 788 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:52:12Z [load_day 2025-07-09] 2025-07-09 hour 6: 157362 events in 0 files, snapshot none (task 7012 ms: download 3672 ms overlapping gunzip 1053 ms, parse 4424 ms, sort 0 ms, write 0 ms, index 649 ms: 11 candidates, 80728 repo-hours, 887 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:52:13Z [load_day 2025-07-09] 2025-07-09 hour 7: 158103 events in 0 files, snapshot none (task 6709 ms: download 4065 ms overlapping gunzip 1079 ms, parse 4387 ms, sort 0 ms, write 0 ms, index 624 ms: 8 candidates, 77592 repo-hours, 802 releases; waiting 317 ms; commit 0 ms)
2026-11-08T12:52:18Z [load_day 2025-07-09] 2025-07-09 hour 8: 151461 events in 0 files, snapshot none (task 5581 ms: download 3196 ms overlapping gunzip 819 ms, parse 3302 ms, sort 0 ms, write 0 ms, index 606 ms: 8 candidates, 77953 repo-hours, 845 releases; waiting 581 ms; commit 0 ms)
2026-11-08T12:52:20Z [load_day 2025-07-09] 2025-07-09 hour 9: 157536 events in 0 files, snapshot none (task 6433 ms: download 3981 ms overlapping gunzip 785 ms, parse 3237 ms, sort 0 ms, write 0 ms, index 566 ms: 12 candidates, 81455 repo-hours, 924 releases; waiting 1523 ms; commit 0 ms)
2026-11-08T12:52:25Z [load_day 2025-07-09] 2025-07-09 hour 10: 162467 events in 0 files, snapshot none (task 6154 ms: download 4160 ms overlapping gunzip 845 ms, parse 3488 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 79994 repo-hours, 876 releases; waiting 951 ms; commit 0 ms)
2026-11-08T12:52:25Z [load_day 2025-07-09] 2025-07-09 hour 11: 160050 events in 0 files, snapshot none (task 5340 ms: download 3095 ms overlapping gunzip 790 ms, parse 3213 ms, sort 0 ms, write 0 ms, index 543 ms: 4 candidates, 75320 repo-hours, 859 releases; waiting 443 ms; commit 0 ms)
2026-11-08T12:52:32Z [load_day 2025-07-09] 2025-07-09 hour 12: 170857 events in 0 files, snapshot none (task 6799 ms: download 3440 ms overlapping gunzip 1036 ms, parse 4136 ms, sort 0 ms, write 0 ms, index 901 ms: 11 candidates, 99240 repo-hours, 853 releases; waiting 437 ms; commit 0 ms)
2026-11-08T12:52:33Z [load_day 2025-07-09] 2025-07-09 hour 13: 166497 events in 0 files, snapshot none (task 7366 ms: download 3855 ms overlapping gunzip 1124 ms, parse 4454 ms, sort 0 ms, write 0 ms, index 731 ms: 9 candidates, 92717 repo-hours, 795 releases; waiting 561 ms; commit 0 ms)
2026-11-08T12:52:41Z [load_day 2025-07-09] 2025-07-09 hour 14: 157967 events in 0 files, snapshot none (task 8430 ms: download 3956 ms overlapping gunzip 1110 ms, parse 4491 ms, sort 0 ms, write 0 ms, index 1978 ms: 7 candidates, 80907 repo-hours, 831 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:52:41Z [load_day 2025-07-09] 2025-07-09 hour 15: 165917 events in 0 files, snapshot none (task 7731 ms: download 4645 ms overlapping gunzip 1056 ms, parse 4795 ms, sort 0 ms, write 0 ms, index 1235 ms: 10 candidates, 85618 repo-hours, 887 releases; waiting 405 ms; commit 0 ms)
2026-11-08T12:52:49Z [load_day 2025-07-09] 2025-07-09 hour 16: 164407 events in 0 files, snapshot none (task 6956 ms: download 4463 ms overlapping gunzip 1021 ms, parse 4479 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 81380 repo-hours, 866 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:52:49Z [load_day 2025-07-09] 2025-07-09 hour 17: 160976 events in 0 files, snapshot none (task 7196 ms: download 4562 ms overlapping gunzip 1114 ms, parse 4590 ms, sort 0 ms, write 0 ms, index 572 ms: 8 candidates, 75999 repo-hours, 707 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:52:56Z [load_day 2025-07-09] 2025-07-09 hour 18: 166966 events in 0 files, snapshot none (task 7033 ms: download 4193 ms overlapping gunzip 1110 ms, parse 4652 ms, sort 0 ms, write 0 ms, index 692 ms: 12 candidates, 84384 repo-hours, 946 releases; waiting 213 ms; commit 0 ms)
2026-11-08T12:52:57Z [load_day 2025-07-09] 2025-07-09 hour 19: 155442 events in 0 files, snapshot none (task 7183 ms: download 4712 ms overlapping gunzip 1077 ms, parse 4784 ms, sort 0 ms, write 0 ms, index 506 ms: 6 candidates, 68952 repo-hours, 751 releases; waiting 497 ms; commit 0 ms)
2026-11-08T12:53:04Z [load_day 2025-07-09] 2025-07-09 hour 20: 156507 events in 0 files, snapshot none (task 7654 ms: download 4662 ms overlapping gunzip 1123 ms, parse 4849 ms, sort 0 ms, write 0 ms, index 686 ms: 10 candidates, 69407 repo-hours, 779 releases; waiting 712 ms; commit 0 ms)
2026-11-08T12:53:04Z [load_day 2025-07-09] 2025-07-09 hour 21: 151596 events in 0 files, snapshot none (task 7064 ms: download 4326 ms overlapping gunzip 1128 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 504 ms: 11 candidates, 66567 repo-hours, 807 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:53:13Z [load_day 2025-07-09] 2025-07-09 hour 22: 147624 events in 0 files, snapshot none (task 8253 ms: download 5173 ms overlapping gunzip 1297 ms, parse 5549 ms, sort 0 ms, write 0 ms, index 548 ms: 7 candidates, 59455 repo-hours, 883 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:53:13Z [load_day 2025-07-09] 2025-07-09 hour 23: 142769 events in 0 files, snapshot none (task 7894 ms: download 4644 ms overlapping gunzip 1323 ms, parse 5096 ms, sort 0 ms, write 0 ms, index 724 ms: 9 candidates, 59845 repo-hours, 864 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:53:21Z [load_day 2025-07-09] 2025-07-09: repo_hour merged from 24 files to 1 (1836708 rows, 8653 ms)
2026-11-08T12:53:24Z [load_day 2025-07-09] 2025-07-09: index committed in 11743 ms (24 + 1 + 24 files)
2026-11-08T12:53:24Z [load_day 2025-07-09] 2025-07-09: 3750282 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:53:24Z [load_day 2025-07-09] attempt 1 succeeded