orcaLog in

Runs · run 4736

load_day 2025-12-20, attempt 1 succeeded

Host
73ccef5e07c2:419492
Started
2026-11-08T14:48:41Z
Ended
2026-11-08T14:49:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
711 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
68.7 s, up to 1.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4736/load_day/2025-12-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:48:41Z [load_day 2025-12-20] attempt 1 started
2026-11-08T14:48:42Z [load_day 2025-12-20] 2025-12-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:48:46Z [load_day 2025-12-20] 2025-12-20 hour 0: 142986 events in 0 files, snapshot none (task 3343 ms: download 1741 ms overlapping gunzip 440 ms, parse 1380 ms, sort 0 ms, write 0 ms, index 659 ms: 5 candidates, 70473 repo-hours, 793 releases; waiting 517 ms; commit 0 ms)
2026-11-08T14:48:46Z [load_day 2025-12-20] 2025-12-20 hour 1: 152479 events in 0 files, snapshot none (task 3564 ms: download 1957 ms overlapping gunzip 477 ms, parse 1609 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 88214 repo-hours, 738 releases; waiting 459 ms; commit 0 ms)
2026-11-08T14:48:50Z [load_day 2025-12-20] 2025-12-20 hour 2: 139268 events in 0 files, snapshot none (task 3982 ms: download 2278 ms overlapping gunzip 602 ms, parse 1876 ms, sort 0 ms, write 0 ms, index 570 ms: 13 candidates, 68157 repo-hours, 651 releases; waiting 650 ms; commit 0 ms)
2026-11-08T14:48:50Z [load_day 2025-12-20] 2025-12-20 hour 3: 139599 events in 0 files, snapshot none (task 3745 ms: download 2251 ms overlapping gunzip 608 ms, parse 1791 ms, sort 0 ms, write 0 ms, index 583 ms: 10 candidates, 66870 repo-hours, 1687 releases; waiting 229 ms; commit 0 ms)
2026-11-08T14:48:54Z [load_day 2025-12-20] 2025-12-20 hour 4: 143382 events in 0 files, snapshot none (task 3213 ms: download 2167 ms overlapping gunzip 463 ms, parse 1236 ms, sort 0 ms, write 0 ms, index 594 ms: 6 candidates, 64308 repo-hours, 675 releases; waiting 627 ms; commit 0 ms)
2026-11-08T14:48:56Z [load_day 2025-12-20] 2025-12-20 hour 5: 142513 events in 0 files, snapshot none (task 4913 ms: download 4113 ms overlapping gunzip 798 ms, parse 1730 ms, sort 0 ms, write 0 ms, index 528 ms: 3 candidates, 59957 repo-hours, 561 releases; waiting 1606 ms; commit 0 ms)
2026-11-08T14:48:58Z [load_day 2025-12-20] 2025-12-20 hour 6: 141754 events in 0 files, snapshot none (task 2938 ms: download 1957 ms overlapping gunzip 374 ms, parse 1041 ms, sort 0 ms, write 0 ms, index 551 ms: 2 candidates, 70035 repo-hours, 742 releases; waiting 628 ms; commit 0 ms)
2026-11-08T14:49:00Z [load_day 2025-12-20] 2025-12-20 hour 7: 147601 events in 0 files, snapshot none (task 3306 ms: download 2307 ms overlapping gunzip 421 ms, parse 1126 ms, sort 0 ms, write 0 ms, index 478 ms: 7 candidates, 64647 repo-hours, 605 releases; waiting 930 ms; commit 0 ms)
2026-11-08T14:49:01Z [load_day 2025-12-20] 2025-12-20 hour 8: 142529 events in 0 files, snapshot none (task 3531 ms: download 2335 ms overlapping gunzip 389 ms, parse 1099 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 65813 repo-hours, 659 releases; waiting 1134 ms; commit 0 ms)
2026-11-08T14:49:04Z [load_day 2025-12-20] 2025-12-20 hour 9: 144767 events in 0 files, snapshot none (task 3601 ms: download 2149 ms overlapping gunzip 365 ms, parse 1112 ms, sort 0 ms, write 0 ms, index 521 ms: 6 candidates, 66554 repo-hours, 789 releases; waiting 1282 ms; commit 0 ms)
2026-11-08T14:49:06Z [load_day 2025-12-20] 2025-12-20 hour 10: 146778 events in 0 files, snapshot none (task 3667 ms: download 2375 ms overlapping gunzip 327 ms, parse 1034 ms, sort 0 ms, write 0 ms, index 784 ms: 4 candidates, 66816 repo-hours, 666 releases; waiting 1232 ms; commit 0 ms)
2026-11-08T14:49:07Z [load_day 2025-12-20] 2025-12-20 hour 11: 146201 events in 0 files, snapshot none (task 3096 ms: download 1930 ms overlapping gunzip 361 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 602 ms: 4 candidates, 66388 repo-hours, 589 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:49:10Z [load_day 2025-12-20] 2025-12-20 hour 12: 155987 events in 0 files, snapshot none (task 3394 ms: download 2086 ms overlapping gunzip 344 ms, parse 1166 ms, sort 0 ms, write 0 ms, index 866 ms: 5 candidates, 92517 repo-hours, 608 releases; waiting 685 ms; commit 0 ms)
2026-11-08T14:49:11Z [load_day 2025-12-20] 2025-12-20 hour 13: 154025 events in 0 files, snapshot none (task 3214 ms: download 2186 ms overlapping gunzip 365 ms, parse 1166 ms, sort 0 ms, write 0 ms, index 589 ms: 6 candidates, 82943 repo-hours, 541 releases; waiting 795 ms; commit 0 ms)
2026-11-08T14:49:14Z [load_day 2025-12-20] 2025-12-20 hour 14: 145421 events in 0 files, snapshot none (task 3552 ms: download 2358 ms overlapping gunzip 411 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 780 ms: 2 candidates, 69069 repo-hours, 654 releases; waiting 880 ms; commit 0 ms)
2026-11-08T14:49:15Z [load_day 2025-12-20] 2025-12-20 hour 15: 149481 events in 0 files, snapshot none (task 2928 ms: download 1842 ms overlapping gunzip 384 ms, parse 1143 ms, sort 0 ms, write 0 ms, index 568 ms: 3 candidates, 71560 repo-hours, 773 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:49:19Z [load_day 2025-12-20] 2025-12-20 hour 16: 149235 events in 0 files, snapshot none (task 3763 ms: download 2285 ms overlapping gunzip 545 ms, parse 1638 ms, sort 0 ms, write 0 ms, index 654 ms: 4 candidates, 73147 repo-hours, 642 releases; waiting 632 ms; commit 0 ms)
2026-11-08T14:49:19Z [load_day 2025-12-20] 2025-12-20 hour 17: 150385 events in 0 files, snapshot none (task 3653 ms: download 2080 ms overlapping gunzip 516 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 70965 repo-hours, 655 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:49:23Z [load_day 2025-12-20] 2025-12-20 hour 18: 147793 events in 0 files, snapshot none (task 3500 ms: download 2233 ms overlapping gunzip 468 ms, parse 1454 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 74928 repo-hours, 696 releases; waiting 655 ms; commit 0 ms)
2026-11-08T14:49:23Z [load_day 2025-12-20] 2025-12-20 hour 19: 143020 events in 0 files, snapshot none (task 3502 ms: download 2433 ms overlapping gunzip 452 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 474 ms: 6 candidates, 60738 repo-hours, 662 releases; waiting 849 ms; commit 0 ms)
2026-11-08T14:49:28Z [load_day 2025-12-20] 2025-12-20 hour 20: 143719 events in 0 files, snapshot none (task 4206 ms: download 2945 ms overlapping gunzip 341 ms, parse 1089 ms, sort 0 ms, write 0 ms, index 529 ms: 7 candidates, 65486 repo-hours, 599 releases; waiting 1764 ms; commit 0 ms)
2026-11-08T14:49:28Z [load_day 2025-12-20] 2025-12-20 hour 21: 142845 events in 0 files, snapshot none (task 3261 ms: download 2131 ms overlapping gunzip 387 ms, parse 1211 ms, sort 0 ms, write 0 ms, index 551 ms: 3 candidates, 62110 repo-hours, 650 releases; waiting 824 ms; commit 0 ms)
2026-11-08T14:49:32Z [load_day 2025-12-20] 2025-12-20 hour 22: 138830 events in 0 files, snapshot none (task 4201 ms: download 2715 ms overlapping gunzip 364 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 456 ms: 5 candidates, 59896 repo-hours, 740 releases; waiting 1826 ms; commit 0 ms)
2026-11-08T14:49:32Z [load_day 2025-12-20] 2025-12-20 hour 23: 135601 events in 0 files, snapshot none (task 3347 ms: download 2094 ms overlapping gunzip 409 ms, parse 1356 ms, sort 0 ms, write 0 ms, index 511 ms: 4 candidates, 58332 repo-hours, 701 releases; waiting 634 ms; commit 0 ms)
2026-11-08T14:49:40Z [load_day 2025-12-20] 2025-12-20: repo_hour merged from 24 files to 1 (1659923 rows, 7581 ms)
2026-11-08T14:49:43Z [load_day 2025-12-20] 2025-12-20: index committed in 10792 ms (24 + 1 + 24 files)
2026-11-08T14:49:43Z [load_day 2025-12-20] 2025-12-20: 3486199 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:49:43Z [load_day 2025-12-20] attempt 1 succeeded