orcaLog in

Runs · run 4216

load_day 2025-07-31, attempt 1 succeeded

Host
73ccef5e07c2:352773
Started
2026-11-08T13:10:30Z
Ended
2026-11-08T13:12:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4216/load_day/2025-07-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:10:30Z [load_day 2025-07-31] attempt 1 started
2026-11-08T13:10:31Z [load_day 2025-07-31] 2025-07-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:10:38Z [load_day 2025-07-31] 2025-07-31 hour 0: 142302 events in 0 files, snapshot none (task 6828 ms: download 3882 ms overlapping gunzip 1188 ms, parse 4379 ms, sort 0 ms, write 0 ms, index 515 ms: 12 candidates, 66921 repo-hours, 1001 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:10:38Z [load_day 2025-07-31] 2025-07-31 hour 1: 147245 events in 0 files, snapshot none (task 6320 ms: download 3401 ms overlapping gunzip 959 ms, parse 4200 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 84760 repo-hours, 745 releases; waiting 248 ms; commit 0 ms)
2026-11-08T13:10:45Z [load_day 2025-07-31] 2025-07-31 hour 2: 151960 events in 0 files, snapshot none (task 6877 ms: download 3659 ms overlapping gunzip 1118 ms, parse 4439 ms, sort 0 ms, write 0 ms, index 671 ms: 3 candidates, 76832 repo-hours, 876 releases; waiting 306 ms; commit 0 ms)
2026-11-08T13:10:45Z [load_day 2025-07-31] 2025-07-31 hour 3: 140445 events in 0 files, snapshot none (task 6454 ms: download 3607 ms overlapping gunzip 1038 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 63609 repo-hours, 825 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:10:53Z [load_day 2025-07-31] 2025-07-31 hour 4: 147790 events in 0 files, snapshot none (task 7072 ms: download 3903 ms overlapping gunzip 1087 ms, parse 4517 ms, sort 0 ms, write 0 ms, index 617 ms: 3 candidates, 67695 repo-hours, 1949 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:10:53Z [load_day 2025-07-31] 2025-07-31 hour 5: 148475 events in 0 files, snapshot none (task 7476 ms: download 4658 ms overlapping gunzip 1235 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 528 ms: 4 candidates, 66807 repo-hours, 682 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:10:59Z [load_day 2025-07-31] 2025-07-31 hour 6: 156932 events in 0 files, snapshot none (task 5308 ms: download 3199 ms overlapping gunzip 743 ms, parse 3002 ms, sort 0 ms, write 0 ms, index 609 ms: 1 candidates, 80108 repo-hours, 847 releases; waiting 627 ms; commit 0 ms)
2026-11-08T13:11:01Z [load_day 2025-07-31] 2025-07-31 hour 7: 158810 events in 0 files, snapshot none (task 7397 ms: download 4977 ms overlapping gunzip 929 ms, parse 3602 ms, sort 0 ms, write 0 ms, index 587 ms: 4 candidates, 75677 repo-hours, 828 releases; waiting 1925 ms; commit 0 ms)
2026-11-08T13:11:07Z [load_day 2025-07-31] 2025-07-31 hour 8: 161061 events in 0 files, snapshot none (task 7685 ms: download 5304 ms overlapping gunzip 966 ms, parse 3763 ms, sort 0 ms, write 0 ms, index 580 ms: 11 candidates, 80237 repo-hours, 928 releases; waiting 2112 ms; commit 0 ms)
2026-11-08T13:11:08Z [load_day 2025-07-31] 2025-07-31 hour 9: 163826 events in 0 files, snapshot none (task 5938 ms: download 3517 ms overlapping gunzip 849 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 81016 repo-hours, 1140 releases; waiting 661 ms; commit 0 ms)
2026-11-08T13:11:16Z [load_day 2025-07-31] 2025-07-31 hour 10: 159152 events in 0 files, snapshot none (task 8426 ms: download 5649 ms overlapping gunzip 1365 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 647 ms: 5 candidates, 77811 repo-hours, 966 releases; waiting 569 ms; commit 0 ms)
2026-11-08T13:11:16Z [load_day 2025-07-31] 2025-07-31 hour 11: 156608 events in 0 files, snapshot none (task 7359 ms: download 4558 ms overlapping gunzip 1221 ms, parse 4748 ms, sort 0 ms, write 0 ms, index 648 ms: 6 candidates, 73745 repo-hours, 945 releases; waiting 481 ms; commit 0 ms)
2026-11-08T13:11:25Z [load_day 2025-07-31] 2025-07-31 hour 12: 166557 events in 0 files, snapshot none (task 8533 ms: download 4897 ms overlapping gunzip 1433 ms, parse 5378 ms, sort 0 ms, write 0 ms, index 908 ms: 9 candidates, 95698 repo-hours, 990 releases; waiting 482 ms; commit 0 ms)
2026-11-08T13:11:25Z [load_day 2025-07-31] 2025-07-31 hour 13: 168325 events in 0 files, snapshot none (task 9029 ms: download 5758 ms overlapping gunzip 1517 ms, parse 6170 ms, sort 0 ms, write 0 ms, index 717 ms: 8 candidates, 92535 repo-hours, 931 releases; waiting 308 ms; commit 0 ms)
2026-11-08T13:11:35Z [load_day 2025-07-31] 2025-07-31 hour 14: 164204 events in 0 files, snapshot none (task 9794 ms: download 6646 ms overlapping gunzip 1595 ms, parse 6636 ms, sort 0 ms, write 0 ms, index 692 ms: 9 candidates, 82310 repo-hours, 927 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:11:35Z [load_day 2025-07-31] 2025-07-31 hour 15: 163577 events in 0 files, snapshot none (task 8973 ms: download 6030 ms overlapping gunzip 1555 ms, parse 5975 ms, sort 0 ms, write 0 ms, index 688 ms: 7 candidates, 82583 repo-hours, 992 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:11:44Z [load_day 2025-07-31] 2025-07-31 hour 16: 162159 events in 0 files, snapshot none (task 8121 ms: download 5546 ms overlapping gunzip 1337 ms, parse 5305 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 80995 repo-hours, 959 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:11:44Z [load_day 2025-07-31] 2025-07-31 hour 17: 162028 events in 0 files, snapshot none (task 7950 ms: download 5337 ms overlapping gunzip 1259 ms, parse 5193 ms, sort 0 ms, write 0 ms, index 593 ms: 8 candidates, 76273 repo-hours, 830 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:11:52Z [load_day 2025-07-31] 2025-07-31 hour 18: 156757 events in 0 files, snapshot none (task 8231 ms: download 4860 ms overlapping gunzip 1348 ms, parse 5534 ms, sort 0 ms, write 0 ms, index 736 ms: 17 candidates, 80132 repo-hours, 874 releases; waiting 296 ms; commit 0 ms)
2026-11-08T13:11:52Z [load_day 2025-07-31] 2025-07-31 hour 19: 152811 events in 0 files, snapshot none (task 7848 ms: download 4763 ms overlapping gunzip 1209 ms, parse 5087 ms, sort 0 ms, write 0 ms, index 737 ms: 8 candidates, 68855 repo-hours, 951 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:12:01Z [load_day 2025-07-31] 2025-07-31 hour 20: 154337 events in 0 files, snapshot none (task 7927 ms: download 4966 ms overlapping gunzip 1313 ms, parse 5140 ms, sort 0 ms, write 0 ms, index 589 ms: 7 candidates, 69082 repo-hours, 815 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:12:01Z [load_day 2025-07-31] 2025-07-31 hour 21: 151918 events in 0 files, snapshot none (task 7725 ms: download 4566 ms overlapping gunzip 1247 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 65017 repo-hours, 878 releases; waiting 557 ms; commit 0 ms)
2026-11-08T13:12:09Z [load_day 2025-07-31] 2025-07-31 hour 22: 146993 events in 0 files, snapshot none (task 7888 ms: download 5022 ms overlapping gunzip 1116 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 538 ms: 7 candidates, 60423 repo-hours, 887 releases; waiting 1301 ms; commit 0 ms)
2026-11-08T13:12:09Z [load_day 2025-07-31] 2025-07-31 hour 23: 141982 events in 0 files, snapshot none (task 8181 ms: download 5680 ms overlapping gunzip 1058 ms, parse 4295 ms, sort 0 ms, write 0 ms, index 432 ms: 8 candidates, 56721 repo-hours, 835 releases; waiting 2049 ms; commit 0 ms)
2026-11-08T13:12:18Z [load_day 2025-07-31] 2025-07-31: repo_hour merged from 24 files to 1 (1805842 rows, 8395 ms)
2026-11-08T13:12:21Z [load_day 2025-07-31] 2025-07-31: index committed in 11410 ms (24 + 1 + 24 files)
2026-11-08T13:12:21Z [load_day 2025-07-31] 2025-07-31: 3726254 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:12:21Z [load_day 2025-07-31] attempt 1 succeeded