orcaLog in

Runs · run 4259

load_day 2025-08-11, attempt 1 succeeded

Host
73ccef5e07c2:358873
Started
2026-11-08T13:19:47Z
Ended
2026-11-08T13:21:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
700 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
172.0 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4259/load_day/2025-08-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:19:47Z [load_day 2025-08-11] attempt 1 started
2026-11-08T13:19:48Z [load_day 2025-08-11] 2025-08-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:19:57Z [load_day 2025-08-11] 2025-08-11 hour 0: 144690 events in 0 files, snapshot none (task 8173 ms: download 5571 ms overlapping gunzip 1569 ms, parse 5564 ms, sort 0 ms, write 0 ms, index 476 ms: 5 candidates, 61788 repo-hours, 1260 releases; waiting 322 ms; commit 0 ms)
2026-11-08T13:19:57Z [load_day 2025-08-11] 2025-08-11 hour 1: 158192 events in 0 files, snapshot none (task 7752 ms: download 4993 ms overlapping gunzip 1361 ms, parse 5071 ms, sort 0 ms, write 0 ms, index 615 ms: 10 candidates, 84904 repo-hours, 659 releases; waiting 352 ms; commit 0 ms)
2026-11-08T13:20:06Z [load_day 2025-08-11] 2025-08-11 hour 2: 151141 events in 0 files, snapshot none (task 8569 ms: download 5630 ms overlapping gunzip 1474 ms, parse 5449 ms, sort 0 ms, write 0 ms, index 881 ms: 7 candidates, 74209 repo-hours, 843 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:20:06Z [load_day 2025-08-11] 2025-08-11 hour 3: 148838 events in 0 files, snapshot none (task 8847 ms: download 6183 ms overlapping gunzip 1533 ms, parse 5474 ms, sort 0 ms, write 0 ms, index 576 ms: 9 candidates, 63337 repo-hours, 807 releases; waiting 979 ms; commit 0 ms)
2026-11-08T13:20:16Z [load_day 2025-08-11] 2025-08-11 hour 4: 152961 events in 0 files, snapshot none (task 9304 ms: download 6461 ms overlapping gunzip 1619 ms, parse 6168 ms, sort 0 ms, write 0 ms, index 635 ms: 3 candidates, 65635 repo-hours, 1887 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:20:16Z [load_day 2025-08-11] 2025-08-11 hour 5: 154079 events in 0 files, snapshot none (task 8380 ms: download 5279 ms overlapping gunzip 1495 ms, parse 5036 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 66207 repo-hours, 712 releases; waiting 461 ms; commit 0 ms)
2026-11-08T13:20:24Z [load_day 2025-08-11] 2025-08-11 hour 6: 157939 events in 0 files, snapshot none (task 8240 ms: download 5716 ms overlapping gunzip 1382 ms, parse 5046 ms, sort 0 ms, write 0 ms, index 543 ms: 8 candidates, 77325 repo-hours, 713 releases; waiting 973 ms; commit 0 ms)
2026-11-08T13:20:24Z [load_day 2025-08-11] 2025-08-11 hour 7: 158380 events in 0 files, snapshot none (task 7817 ms: download 4828 ms overlapping gunzip 1289 ms, parse 4893 ms, sort 0 ms, write 0 ms, index 767 ms: 4 candidates, 72773 repo-hours, 660 releases; waiting 559 ms; commit 0 ms)
2026-11-08T13:20:33Z [load_day 2025-08-11] 2025-08-11 hour 8: 165334 events in 0 files, snapshot none (task 8065 ms: download 5400 ms overlapping gunzip 1340 ms, parse 5035 ms, sort 0 ms, write 0 ms, index 563 ms: 7 candidates, 78216 repo-hours, 930 releases; waiting 560 ms; commit 0 ms)
2026-11-08T13:20:33Z [load_day 2025-08-11] 2025-08-11 hour 9: 164356 events in 0 files, snapshot none (task 8304 ms: download 5806 ms overlapping gunzip 1408 ms, parse 5350 ms, sort 0 ms, write 0 ms, index 744 ms: 4 candidates, 79525 repo-hours, 863 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:20:41Z [load_day 2025-08-11] 2025-08-11 hour 10: 164080 events in 0 files, snapshot none (task 8261 ms: download 5626 ms overlapping gunzip 1308 ms, parse 5006 ms, sort 0 ms, write 0 ms, index 576 ms: 9 candidates, 77786 repo-hours, 744 releases; waiting 1054 ms; commit 0 ms)
2026-11-08T13:20:41Z [load_day 2025-08-11] 2025-08-11 hour 11: 163128 events in 0 files, snapshot none (task 7534 ms: download 5087 ms overlapping gunzip 1306 ms, parse 4872 ms, sort 0 ms, write 0 ms, index 572 ms: 6 candidates, 75612 repo-hours, 778 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:20:48Z [load_day 2025-08-11] 2025-08-11 hour 12: 168585 events in 0 files, snapshot none (task 6398 ms: download 4348 ms overlapping gunzip 988 ms, parse 3765 ms, sort 0 ms, write 0 ms, index 656 ms: 6 candidates, 95473 repo-hours, 752 releases; waiting 641 ms; commit 0 ms)
2026-11-08T13:20:49Z [load_day 2025-08-11] 2025-08-11 hour 13: 169026 events in 0 files, snapshot none (task 6843 ms: download 4408 ms overlapping gunzip 1113 ms, parse 4202 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 94346 repo-hours, 880 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:20:56Z [load_day 2025-08-11] 2025-08-11 hour 14: 167804 events in 0 files, snapshot none (task 6939 ms: download 4406 ms overlapping gunzip 1136 ms, parse 4279 ms, sort 0 ms, write 0 ms, index 731 ms: 10 candidates, 85944 repo-hours, 868 releases; waiting 486 ms; commit 0 ms)
2026-11-08T13:20:56Z [load_day 2025-08-11] 2025-08-11 hour 15: 166595 events in 0 files, snapshot none (task 6817 ms: download 4188 ms overlapping gunzip 1072 ms, parse 4083 ms, sort 0 ms, write 0 ms, index 799 ms: 9 candidates, 86683 repo-hours, 943 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:21:05Z [load_day 2025-08-11] 2025-08-11 hour 16: 162428 events in 0 files, snapshot none (task 8595 ms: download 6151 ms overlapping gunzip 1509 ms, parse 5579 ms, sort 0 ms, write 0 ms, index 789 ms: 7 candidates, 82315 repo-hours, 865 releases; waiting 464 ms; commit 0 ms)
2026-11-08T13:21:05Z [load_day 2025-08-11] 2025-08-11 hour 17: 162221 events in 0 files, snapshot none (task 8242 ms: download 5523 ms overlapping gunzip 1426 ms, parse 5284 ms, sort 0 ms, write 0 ms, index 995 ms: 9 candidates, 79889 repo-hours, 799 releases; waiting 243 ms; commit 0 ms)
2026-11-08T13:21:14Z [load_day 2025-08-11] 2025-08-11 hour 18: 164728 events in 0 files, snapshot none (task 9070 ms: download 6115 ms overlapping gunzip 1507 ms, parse 5719 ms, sort 0 ms, write 0 ms, index 1078 ms: 3 candidates, 85223 repo-hours, 979 releases; waiting 458 ms; commit 0 ms)
2026-11-08T13:21:14Z [load_day 2025-08-11] 2025-08-11 hour 19: 160568 events in 0 files, snapshot none (task 8539 ms: download 5710 ms overlapping gunzip 1369 ms, parse 5408 ms, sort 0 ms, write 0 ms, index 823 ms: 6 candidates, 74602 repo-hours, 815 releases; waiting 532 ms; commit 0 ms)
2026-11-08T13:21:22Z [load_day 2025-08-11] 2025-08-11 hour 20: 157561 events in 0 files, snapshot none (task 7519 ms: download 4897 ms overlapping gunzip 1297 ms, parse 5016 ms, sort 0 ms, write 0 ms, index 747 ms: 5 candidates, 74700 repo-hours, 803 releases; waiting 222 ms; commit 0 ms)
2026-11-08T13:21:23Z [load_day 2025-08-11] 2025-08-11 hour 21: 156838 events in 0 files, snapshot none (task 7730 ms: download 4803 ms overlapping gunzip 1281 ms, parse 4795 ms, sort 0 ms, write 0 ms, index 874 ms: 13 candidates, 70099 repo-hours, 1016 releases; waiting 467 ms; commit 0 ms)
2026-11-08T13:21:31Z [load_day 2025-08-11] 2025-08-11 hour 22: 150592 events in 0 files, snapshot none (task 8188 ms: download 5232 ms overlapping gunzip 1289 ms, parse 5288 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 64450 repo-hours, 945 releases; waiting 482 ms; commit 0 ms)
2026-11-08T13:21:31Z [load_day 2025-08-11] 2025-08-11 hour 23: 148969 events in 0 files, snapshot none (task 7800 ms: download 5025 ms overlapping gunzip 1266 ms, parse 4887 ms, sort 0 ms, write 0 ms, index 901 ms: 3 candidates, 62791 repo-hours, 1034 releases; waiting 472 ms; commit 0 ms)
2026-11-08T13:21:40Z [load_day 2025-08-11] 2025-08-11: repo_hour merged from 24 files to 1 (1833832 rows, 8275 ms)
2026-11-08T13:21:42Z [load_day 2025-08-11] 2025-08-11: index committed in 11257 ms (24 + 1 + 24 files)
2026-11-08T13:21:42Z [load_day 2025-08-11] 2025-08-11: 3819033 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:21:42Z [load_day 2025-08-11] attempt 1 succeeded