orcaLog in

Runs · run 2655

load_day 2024-06-29, attempt 1 succeeded

Host
73ccef5e07c2:143174
Started
2026-11-08T06:46:04Z
Ended
2026-11-08T06:47:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
618 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2655/load_day/2024-06-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:46:04Z [load_day 2024-06-29] attempt 1 started
2026-11-08T06:46:05Z [load_day 2024-06-29] 2024-06-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:46:12Z [load_day 2024-06-29] 2024-06-29 hour 0: 157791 events in 0 files, snapshot none (task 5766 ms: download 3469 ms overlapping gunzip 862 ms, parse 3583 ms, sort 0 ms, write 0 ms, index 610 ms: 4 candidates, 81632 repo-hours, 2617 releases; waiting 413 ms; commit 0 ms)
2026-11-08T06:46:12Z [load_day 2024-06-29] 2024-06-29 hour 1: 158621 events in 0 files, snapshot none (task 5749 ms: download 3137 ms overlapping gunzip 879 ms, parse 3603 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 88106 repo-hours, 2308 releases; waiting 327 ms; commit 0 ms)
2026-11-08T06:46:18Z [load_day 2024-06-29] 2024-06-29 hour 2: 119676 events in 0 files, snapshot none (task 5519 ms: download 3417 ms overlapping gunzip 856 ms, parse 3238 ms, sort 0 ms, write 0 ms, index 496 ms: 2 candidates, 46085 repo-hours, 2085 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:46:18Z [load_day 2024-06-29] 2024-06-29 hour 3: 145084 events in 0 files, snapshot none (task 5415 ms: download 2690 ms overlapping gunzip 766 ms, parse 3208 ms, sort 0 ms, write 0 ms, index 436 ms: 6 candidates, 59087 repo-hours, 6696 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:46:21Z [load_day 2024-06-29] 2024-06-29 hour 4: 125870 events in 0 files, snapshot none (task 3563 ms: download 2256 ms overlapping gunzip 431 ms, parse 1890 ms, sort 0 ms, write 0 ms, index 354 ms: 6 candidates, 47220 repo-hours, 2115 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:46:22Z [load_day 2024-06-29] 2024-06-29 hour 5: 133964 events in 0 files, snapshot none (task 3977 ms: download 2063 ms overlapping gunzip 535 ms, parse 2324 ms, sort 0 ms, write 0 ms, index 360 ms: 3 candidates, 50306 repo-hours, 2219 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:46:26Z [load_day 2024-06-29] 2024-06-29 hour 6: 158604 events in 0 files, snapshot none (task 4202 ms: download 2218 ms overlapping gunzip 518 ms, parse 2366 ms, sort 0 ms, write 0 ms, index 502 ms: 11 candidates, 70897 repo-hours, 2631 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:46:27Z [load_day 2024-06-29] 2024-06-29 hour 7: 148864 events in 0 files, snapshot none (task 4668 ms: download 2989 ms overlapping gunzip 666 ms, parse 2689 ms, sort 0 ms, write 0 ms, index 417 ms: 6 candidates, 55962 repo-hours, 2262 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:46:31Z [load_day 2024-06-29] 2024-06-29 hour 8: 149533 events in 0 files, snapshot none (task 4533 ms: download 2952 ms overlapping gunzip 543 ms, parse 2412 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 59781 repo-hours, 2401 releases; waiting 625 ms; commit 0 ms)
2026-11-08T06:46:32Z [load_day 2024-06-29] 2024-06-29 hour 9: 157532 events in 0 files, snapshot none (task 4170 ms: download 2395 ms overlapping gunzip 531 ms, parse 2302 ms, sort 0 ms, write 0 ms, index 518 ms: 4 candidates, 67250 repo-hours, 2071 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:46:37Z [load_day 2024-06-29] 2024-06-29 hour 10: 151318 events in 0 files, snapshot none (task 5094 ms: download 2445 ms overlapping gunzip 703 ms, parse 3127 ms, sort 0 ms, write 0 ms, index 416 ms: 4 candidates, 60073 repo-hours, 3008 releases; waiting 553 ms; commit 0 ms)
2026-11-08T06:46:37Z [load_day 2024-06-29] 2024-06-29 hour 11: 162752 events in 0 files, snapshot none (task 4920 ms: download 2299 ms overlapping gunzip 639 ms, parse 2902 ms, sort 0 ms, write 0 ms, index 571 ms: 8 candidates, 70321 repo-hours, 2730 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:46:43Z [load_day 2024-06-29] 2024-06-29 hour 12: 226706 events in 0 files, snapshot none (task 6053 ms: download 3310 ms overlapping gunzip 735 ms, parse 3743 ms, sort 0 ms, write 0 ms, index 741 ms: 11 candidates, 103536 repo-hours, 2640 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:46:43Z [load_day 2024-06-29] 2024-06-29 hour 13: 183039 events in 0 files, snapshot none (task 5343 ms: download 2874 ms overlapping gunzip 688 ms, parse 3302 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 85453 repo-hours, 2626 releases; waiting 456 ms; commit 0 ms)
2026-11-08T06:46:49Z [load_day 2024-06-29] 2024-06-29 hour 14: 167898 events in 0 files, snapshot none (task 5245 ms: download 2929 ms overlapping gunzip 651 ms, parse 3015 ms, sort 0 ms, write 0 ms, index 738 ms: 3 candidates, 69232 repo-hours, 2597 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:46:49Z [load_day 2024-06-29] 2024-06-29 hour 15: 173641 events in 0 files, snapshot none (task 5451 ms: download 3772 ms overlapping gunzip 778 ms, parse 3288 ms, sort 0 ms, write 0 ms, index 640 ms: 1 candidates, 74902 repo-hours, 927 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:46:55Z [load_day 2024-06-29] 2024-06-29 hour 16: 156704 events in 0 files, snapshot none (task 5487 ms: download 2621 ms overlapping gunzip 779 ms, parse 3361 ms, sort 0 ms, write 0 ms, index 516 ms: 5 candidates, 63922 repo-hours, 744 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:46:55Z [load_day 2024-06-29] 2024-06-29 hour 17: 148030 events in 0 files, snapshot none (task 4895 ms: download 2642 ms overlapping gunzip 609 ms, parse 2796 ms, sort 0 ms, write 0 ms, index 654 ms: 5 candidates, 61104 repo-hours, 725 releases; waiting 525 ms; commit 0 ms)
2026-11-08T06:47:01Z [load_day 2024-06-29] 2024-06-29 hour 18: 160989 events in 0 files, snapshot none (task 5974 ms: download 2848 ms overlapping gunzip 800 ms, parse 3480 ms, sort 0 ms, write 0 ms, index 636 ms: 21 candidates, 74434 repo-hours, 902 releases; waiting 450 ms; commit 0 ms)
2026-11-08T06:47:01Z [load_day 2024-06-29] 2024-06-29 hour 19: 138382 events in 0 files, snapshot none (task 5618 ms: download 2739 ms overlapping gunzip 767 ms, parse 3476 ms, sort 0 ms, write 0 ms, index 536 ms: 10 candidates, 52287 repo-hours, 1514 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:47:07Z [load_day 2024-06-29] 2024-06-29 hour 20: 143162 events in 0 files, snapshot none (task 4844 ms: download 2423 ms overlapping gunzip 689 ms, parse 2942 ms, sort 0 ms, write 0 ms, index 373 ms: 12 candidates, 57021 repo-hours, 2501 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:47:07Z [load_day 2024-06-29] 2024-06-29 hour 21: 137974 events in 0 files, snapshot none (task 4511 ms: download 2077 ms overlapping gunzip 590 ms, parse 2702 ms, sort 0 ms, write 0 ms, index 436 ms: 20 candidates, 56980 repo-hours, 2709 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:47:12Z [load_day 2024-06-29] 2024-06-29 hour 22: 119339 events in 0 files, snapshot none (task 4345 ms: download 2446 ms overlapping gunzip 532 ms, parse 2211 ms, sort 0 ms, write 0 ms, index 324 ms: 6 candidates, 43594 repo-hours, 2502 releases; waiting 998 ms; commit 0 ms)
2026-11-08T06:47:12Z [load_day 2024-06-29] 2024-06-29 hour 23: 114337 events in 0 files, snapshot none (task 3692 ms: download 1722 ms overlapping gunzip 454 ms, parse 2041 ms, sort 0 ms, write 0 ms, index 419 ms: 5 candidates, 41343 repo-hours, 2316 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:47:18Z [load_day 2024-06-29] 2024-06-29: repo_hour merged from 24 files to 1 (1540528 rows, 6395 ms)
2026-11-08T06:47:20Z [load_day 2024-06-29] 2024-06-29: index committed in 8526 ms (24 + 1 + 24 files)
2026-11-08T06:47:20Z [load_day 2024-06-29] 2024-06-29: 3639810 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:47:20Z [load_day 2024-06-29] attempt 1 succeeded