orcaLog in

Runs · run 4861

load_day 2026-01-24, attempt 1 succeeded

Host
73ccef5e07c2:434249
Started
2026-11-08T15:07:30Z
Ended
2026-11-08T15:08:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
691 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.2 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4861/load_day/2026-01-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:07:30Z [load_day 2026-01-24] attempt 1 started
2026-11-08T15:07:31Z [load_day 2026-01-24] 2026-01-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:07:35Z [load_day 2026-01-24] 2026-01-24 hour 0: 141677 events in 0 files, snapshot none (task 3893 ms: download 2698 ms overlapping gunzip 567 ms, parse 1772 ms, sort 0 ms, write 0 ms, index 518 ms: 5 candidates, 67366 repo-hours, 946 releases; waiting 757 ms; commit 0 ms)
2026-11-08T15:07:35Z [load_day 2026-01-24] 2026-01-24 hour 1: 150030 events in 0 files, snapshot none (task 3472 ms: download 2079 ms overlapping gunzip 478 ms, parse 1525 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 86726 repo-hours, 690 releases; waiting 585 ms; commit 0 ms)
2026-11-08T15:07:39Z [load_day 2026-01-24] 2026-01-24 hour 2: 140700 events in 0 files, snapshot none (task 3250 ms: download 2228 ms overlapping gunzip 418 ms, parse 1346 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 70283 repo-hours, 613 releases; waiting 596 ms; commit 0 ms)
2026-11-08T15:07:39Z [load_day 2026-01-24] 2026-01-24 hour 3: 145380 events in 0 files, snapshot none (task 3273 ms: download 2250 ms overlapping gunzip 432 ms, parse 1430 ms, sort 0 ms, write 0 ms, index 506 ms: 4 candidates, 67211 repo-hours, 698 releases; waiting 590 ms; commit 0 ms)
2026-11-08T15:07:43Z [load_day 2026-01-24] 2026-01-24 hour 4: 147773 events in 0 files, snapshot none (task 3423 ms: download 1932 ms overlapping gunzip 515 ms, parse 1647 ms, sort 0 ms, write 0 ms, index 599 ms: 4 candidates, 65972 repo-hours, 1388 releases; waiting 296 ms; commit 0 ms)
2026-11-08T15:07:43Z [load_day 2026-01-24] 2026-01-24 hour 5: 145327 events in 0 files, snapshot none (task 3275 ms: download 1918 ms overlapping gunzip 527 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 66789 repo-hours, 578 releases; waiting 303 ms; commit 0 ms)
2026-11-08T15:07:47Z [load_day 2026-01-24] 2026-01-24 hour 6: 160381 events in 0 files, snapshot none (task 3757 ms: download 1783 ms overlapping gunzip 503 ms, parse 1684 ms, sort 0 ms, write 0 ms, index 733 ms: 8 candidates, 79162 repo-hours, 467 releases; waiting 588 ms; commit 0 ms)
2026-11-08T15:07:47Z [load_day 2026-01-24] 2026-01-24 hour 7: 160611 events in 0 files, snapshot none (task 3715 ms: download 1905 ms overlapping gunzip 500 ms, parse 1785 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 74926 repo-hours, 426 releases; waiting 472 ms; commit 0 ms)
2026-11-08T15:07:51Z [load_day 2026-01-24] 2026-01-24 hour 8: 157309 events in 0 files, snapshot none (task 3854 ms: download 2082 ms overlapping gunzip 457 ms, parse 1679 ms, sort 0 ms, write 0 ms, index 741 ms: 6 candidates, 78558 repo-hours, 459 releases; waiting 588 ms; commit 0 ms)
2026-11-08T15:07:51Z [load_day 2026-01-24] 2026-01-24 hour 9: 159954 events in 0 files, snapshot none (task 3622 ms: download 2097 ms overlapping gunzip 471 ms, parse 1659 ms, sort 0 ms, write 0 ms, index 712 ms: 3 candidates, 76784 repo-hours, 427 releases; waiting 517 ms; commit 0 ms)
2026-11-08T15:07:54Z [load_day 2026-01-24] 2026-01-24 hour 10: 159627 events in 0 files, snapshot none (task 2460 ms: download 1218 ms overlapping gunzip 268 ms, parse 1018 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 81993 repo-hours, 345 releases; waiting 275 ms; commit 0 ms)
2026-11-08T15:07:56Z [load_day 2026-01-24] 2026-01-24 hour 11: 147712 events in 0 files, snapshot none (task 3938 ms: download 2950 ms overlapping gunzip 370 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 70023 repo-hours, 692 releases; waiting 1580 ms; commit 0 ms)
2026-11-08T15:07:57Z [load_day 2026-01-24] 2026-01-24 hour 12: 157804 events in 0 files, snapshot none (task 2916 ms: download 1716 ms overlapping gunzip 304 ms, parse 998 ms, sort 0 ms, write 0 ms, index 645 ms: 9 candidates, 95285 repo-hours, 555 releases; waiting 631 ms; commit 0 ms)
2026-11-08T15:07:59Z [load_day 2026-01-24] 2026-01-24 hour 13: 154886 events in 0 files, snapshot none (task 2894 ms: download 1742 ms overlapping gunzip 308 ms, parse 1011 ms, sort 0 ms, write 0 ms, index 666 ms: 11 candidates, 85595 repo-hours, 673 releases; waiting 590 ms; commit 0 ms)
2026-11-08T15:08:01Z [load_day 2026-01-24] 2026-01-24 hour 14: 147062 events in 0 files, snapshot none (task 2962 ms: download 1855 ms overlapping gunzip 346 ms, parse 1085 ms, sort 0 ms, write 0 ms, index 588 ms: 9 candidates, 74391 repo-hours, 803 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:08:03Z [load_day 2026-01-24] 2026-01-24 hour 15: 152605 events in 0 files, snapshot none (task 3168 ms: download 1876 ms overlapping gunzip 365 ms, parse 1109 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 75953 repo-hours, 873 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:08:04Z [load_day 2026-01-24] 2026-01-24 hour 16: 154452 events in 0 files, snapshot none (task 2901 ms: download 1743 ms overlapping gunzip 357 ms, parse 1120 ms, sort 0 ms, write 0 ms, index 583 ms: 6 candidates, 73083 repo-hours, 891 releases; waiting 447 ms; commit 0 ms)
2026-11-08T15:08:07Z [load_day 2026-01-24] 2026-01-24 hour 17: 151184 events in 0 files, snapshot none (task 3218 ms: download 2023 ms overlapping gunzip 357 ms, parse 1126 ms, sort 0 ms, write 0 ms, index 673 ms: 13 candidates, 69527 repo-hours, 711 releases; waiting 769 ms; commit 0 ms)
2026-11-08T15:08:08Z [load_day 2026-01-24] 2026-01-24 hour 18: 152529 events in 0 files, snapshot none (task 3139 ms: download 2130 ms overlapping gunzip 398 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 78447 repo-hours, 751 releases; waiting 544 ms; commit 0 ms)
2026-11-08T15:08:11Z [load_day 2026-01-24] 2026-01-24 hour 19: 150341 events in 0 files, snapshot none (task 3381 ms: download 2092 ms overlapping gunzip 373 ms, parse 1151 ms, sort 0 ms, write 0 ms, index 807 ms: 7 candidates, 67740 repo-hours, 727 releases; waiting 741 ms; commit 0 ms)
2026-11-08T15:08:12Z [load_day 2026-01-24] 2026-01-24 hour 20: 151686 events in 0 files, snapshot none (task 3870 ms: download 2575 ms overlapping gunzip 455 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 529 ms: 9 candidates, 67434 repo-hours, 791 releases; waiting 1044 ms; commit 0 ms)
2026-11-08T15:08:15Z [load_day 2026-01-24] 2026-01-24 hour 21: 144458 events in 0 files, snapshot none (task 3132 ms: download 1818 ms overlapping gunzip 336 ms, parse 1065 ms, sort 0 ms, write 0 ms, index 753 ms: 13 candidates, 61967 repo-hours, 794 releases; waiting 599 ms; commit 0 ms)
2026-11-08T15:08:16Z [load_day 2026-01-24] 2026-01-24 hour 22: 142272 events in 0 files, snapshot none (task 3051 ms: download 2024 ms overlapping gunzip 401 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 550 ms: 6 candidates, 64199 repo-hours, 861 releases; waiting 521 ms; commit 0 ms)
2026-11-08T15:08:18Z [load_day 2026-01-24] 2026-01-24 hour 23: 137123 events in 0 files, snapshot none (task 2933 ms: download 1922 ms overlapping gunzip 357 ms, parse 1184 ms, sort 0 ms, write 0 ms, index 470 ms: 6 candidates, 61719 repo-hours, 1044 releases; waiting 448 ms; commit 0 ms)
2026-11-08T15:08:26Z [load_day 2026-01-24] 2026-01-24: repo_hour merged from 24 files to 1 (1761133 rows, 7957 ms)
2026-11-08T15:08:30Z [load_day 2026-01-24] 2026-01-24: index committed in 11403 ms (24 + 1 + 24 files)
2026-11-08T15:08:30Z [load_day 2026-01-24] 2026-01-24: 3612883 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:08:30Z [load_day 2026-01-24] attempt 1 succeeded