orcaLog in

Runs · run 4864

load_day 2026-01-25, attempt 1 succeeded

Host
73ccef5e07c2:434677
Started
2026-11-08T15:08:04Z
Ended
2026-11-08T15:09:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
663 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
67.4 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4864/load_day/2026-01-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:08:04Z [load_day 2026-01-25] attempt 1 started
2026-11-08T15:08:05Z [load_day 2026-01-25] 2026-01-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:08:09Z [load_day 2026-01-25] 2026-01-25 hour 0: 136153 events in 0 files, snapshot none (task 3003 ms: download 1888 ms overlapping gunzip 382 ms, parse 1272 ms, sort 0 ms, write 0 ms, index 482 ms: 5 candidates, 61781 repo-hours, 888 releases; waiting 581 ms; commit 0 ms)
2026-11-08T15:08:09Z [load_day 2026-01-25] 2026-01-25 hour 1: 142250 events in 0 files, snapshot none (task 3016 ms: download 2051 ms overlapping gunzip 330 ms, parse 1059 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 81289 repo-hours, 673 releases; waiting 718 ms; commit 0 ms)
2026-11-08T15:08:12Z [load_day 2026-01-25] 2026-01-25 hour 2: 138157 events in 0 files, snapshot none (task 2840 ms: download 1525 ms overlapping gunzip 364 ms, parse 1212 ms, sort 0 ms, write 0 ms, index 574 ms: 7 candidates, 70824 repo-hours, 687 releases; waiting 352 ms; commit 0 ms)
2026-11-08T15:08:12Z [load_day 2026-01-25] 2026-01-25 hour 3: 137992 events in 0 files, snapshot none (task 2918 ms: download 1907 ms overlapping gunzip 397 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 500 ms: 9 candidates, 63658 repo-hours, 746 releases; waiting 622 ms; commit 0 ms)
2026-11-08T15:08:16Z [load_day 2026-01-25] 2026-01-25 hour 4: 133420 events in 0 files, snapshot none (task 3196 ms: download 2094 ms overlapping gunzip 405 ms, parse 1299 ms, sort 0 ms, write 0 ms, index 460 ms: 3 candidates, 61493 repo-hours, 1604 releases; waiting 719 ms; commit 0 ms)
2026-11-08T15:08:16Z [load_day 2026-01-25] 2026-01-25 hour 5: 135689 events in 0 files, snapshot none (task 3053 ms: download 1850 ms overlapping gunzip 379 ms, parse 1235 ms, sort 0 ms, write 0 ms, index 497 ms: 6 candidates, 62962 repo-hours, 600 releases; waiting 609 ms; commit 0 ms)
2026-11-08T15:08:19Z [load_day 2026-01-25] 2026-01-25 hour 6: 138431 events in 0 files, snapshot none (task 2928 ms: download 1907 ms overlapping gunzip 350 ms, parse 1066 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 69477 repo-hours, 700 releases; waiting 576 ms; commit 0 ms)
2026-11-08T15:08:19Z [load_day 2026-01-25] 2026-01-25 hour 7: 141229 events in 0 files, snapshot none (task 2807 ms: download 1737 ms overlapping gunzip 336 ms, parse 1023 ms, sort 0 ms, write 0 ms, index 521 ms: 6 candidates, 65657 repo-hours, 771 releases; waiting 591 ms; commit 0 ms)
2026-11-08T15:08:23Z [load_day 2026-01-25] 2026-01-25 hour 8: 137779 events in 0 files, snapshot none (task 2696 ms: download 1585 ms overlapping gunzip 312 ms, parse 948 ms, sort 0 ms, write 0 ms, index 506 ms: 10 candidates, 62714 repo-hours, 717 releases; waiting 434 ms; commit 0 ms)
2026-11-08T15:08:23Z [load_day 2026-01-25] 2026-01-25 hour 9: 142231 events in 0 files, snapshot none (task 3262 ms: download 2040 ms overlapping gunzip 364 ms, parse 1093 ms, sort 0 ms, write 0 ms, index 538 ms: 10 candidates, 69817 repo-hours, 690 releases; waiting 829 ms; commit 0 ms)
2026-11-08T15:08:26Z [load_day 2026-01-25] 2026-01-25 hour 10: 137340 events in 0 files, snapshot none (task 2676 ms: download 1555 ms overlapping gunzip 322 ms, parse 966 ms, sort 0 ms, write 0 ms, index 573 ms: 12 candidates, 68557 repo-hours, 685 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:08:27Z [load_day 2026-01-25] 2026-01-25 hour 11: 141594 events in 0 files, snapshot none (task 3008 ms: download 1820 ms overlapping gunzip 396 ms, parse 1113 ms, sort 0 ms, write 0 ms, index 566 ms: 5 candidates, 69287 repo-hours, 702 releases; waiting 460 ms; commit 0 ms)
2026-11-08T15:08:30Z [load_day 2026-01-25] 2026-01-25 hour 12: 147150 events in 0 files, snapshot none (task 3183 ms: download 2017 ms overlapping gunzip 309 ms, parse 1035 ms, sort 0 ms, write 0 ms, index 654 ms: 11 candidates, 87071 repo-hours, 637 releases; waiting 929 ms; commit 0 ms)
2026-11-08T15:08:30Z [load_day 2026-01-25] 2026-01-25 hour 13: 151626 events in 0 files, snapshot none (task 2983 ms: download 1720 ms overlapping gunzip 326 ms, parse 1087 ms, sort 0 ms, write 0 ms, index 710 ms: 4 candidates, 86486 repo-hours, 586 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:08:34Z [load_day 2026-01-25] 2026-01-25 hour 14: 148291 events in 0 files, snapshot none (task 3372 ms: download 2060 ms overlapping gunzip 388 ms, parse 1183 ms, sort 0 ms, write 0 ms, index 653 ms: 7 candidates, 74045 repo-hours, 746 releases; waiting 791 ms; commit 0 ms)
2026-11-08T15:08:35Z [load_day 2026-01-25] 2026-01-25 hour 15: 151166 events in 0 files, snapshot none (task 4027 ms: download 2743 ms overlapping gunzip 478 ms, parse 1425 ms, sort 0 ms, write 0 ms, index 893 ms: 9 candidates, 77562 repo-hours, 805 releases; waiting 918 ms; commit 0 ms)
2026-11-08T15:08:38Z [load_day 2026-01-25] 2026-01-25 hour 16: 146051 events in 0 files, snapshot none (task 3255 ms: download 1900 ms overlapping gunzip 391 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 803 ms: 9 candidates, 71921 repo-hours, 832 releases; waiting 640 ms; commit 0 ms)
2026-11-08T15:08:39Z [load_day 2026-01-25] 2026-01-25 hour 17: 147403 events in 0 files, snapshot none (task 3181 ms: download 1859 ms overlapping gunzip 386 ms, parse 1212 ms, sort 0 ms, write 0 ms, index 588 ms: 8 candidates, 72689 repo-hours, 632 releases; waiting 645 ms; commit 0 ms)
2026-11-08T15:08:42Z [load_day 2026-01-25] 2026-01-25 hour 18: 151134 events in 0 files, snapshot none (task 3128 ms: download 1830 ms overlapping gunzip 379 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 854 ms: 6 candidates, 78139 repo-hours, 773 releases; waiting 512 ms; commit 0 ms)
2026-11-08T15:08:43Z [load_day 2026-01-25] 2026-01-25 hour 19: 144750 events in 0 files, snapshot none (task 3814 ms: download 2343 ms overlapping gunzip 438 ms, parse 1415 ms, sort 0 ms, write 0 ms, index 794 ms: 12 candidates, 69009 repo-hours, 740 releases; waiting 833 ms; commit 0 ms)
2026-11-08T15:08:45Z [load_day 2026-01-25] 2026-01-25 hour 20: 139691 events in 0 files, snapshot none (task 2969 ms: download 1755 ms overlapping gunzip 438 ms, parse 1381 ms, sort 0 ms, write 0 ms, index 527 ms: 5 candidates, 65328 repo-hours, 823 releases; waiting 319 ms; commit 0 ms)
2026-11-08T15:08:48Z [load_day 2026-01-25] 2026-01-25 hour 21: 146393 events in 0 files, snapshot none (task 4037 ms: download 2399 ms overlapping gunzip 484 ms, parse 1492 ms, sort 0 ms, write 0 ms, index 831 ms: 10 candidates, 68785 repo-hours, 779 releases; waiting 882 ms; commit 0 ms)
2026-11-08T15:08:49Z [load_day 2026-01-25] 2026-01-25 hour 22: 142946 events in 0 files, snapshot none (task 3349 ms: download 1499 ms overlapping gunzip 541 ms, parse 1661 ms, sort 0 ms, write 0 ms, index 554 ms: 8 candidates, 65160 repo-hours, 778 releases; waiting 244 ms; commit 0 ms)
2026-11-08T15:08:52Z [load_day 2026-01-25] 2026-01-25 hour 23: 139997 events in 0 files, snapshot none (task 4110 ms: download 2308 ms overlapping gunzip 493 ms, parse 1615 ms, sort 0 ms, write 0 ms, index 647 ms: 5 candidates, 62537 repo-hours, 812 releases; waiting 1032 ms; commit 0 ms)
2026-11-08T15:09:00Z [load_day 2026-01-25] 2026-01-25: repo_hour merged from 24 files to 1 (1686248 rows, 7597 ms)
2026-11-08T15:09:04Z [load_day 2026-01-25] 2026-01-25: index committed in 11304 ms (24 + 1 + 24 files)
2026-11-08T15:09:04Z [load_day 2026-01-25] 2026-01-25: 3418863 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:09:04Z [load_day 2026-01-25] attempt 1 succeeded