orcaLog in

Runs · run 3535

load_day 2025-02-08, attempt 1 succeeded

Host
73ccef5e07c2:251518
Started
2026-11-08T10:13:40Z
Ended
2026-11-08T10:15:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
740 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3535/load_day/2025-02-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:13:40Z [load_day 2025-02-08] attempt 1 started
2026-11-08T10:13:41Z [load_day 2025-02-08] 2025-02-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:13:49Z [load_day 2025-02-08] 2025-02-08 hour 0: 195336 events in 0 files, snapshot none (task 7868 ms: download 4679 ms overlapping gunzip 1156 ms, parse 5141 ms, sort 0 ms, write 0 ms, index 760 ms: 4 candidates, 95380 repo-hours, 1233 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:13:50Z [load_day 2025-02-08] 2025-02-08 hour 1: 208347 events in 0 files, snapshot none (task 8645 ms: download 5088 ms overlapping gunzip 1355 ms, parse 5700 ms, sort 0 ms, write 0 ms, index 809 ms: 6 candidates, 111005 repo-hours, 935 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:13:56Z [load_day 2025-02-08] 2025-02-08 hour 2: 183338 events in 0 files, snapshot none (task 6156 ms: download 2523 ms overlapping gunzip 895 ms, parse 3823 ms, sort 0 ms, write 0 ms, index 906 ms: 9 candidates, 74741 repo-hours, 748 releases; waiting 252 ms; commit 0 ms)
2026-11-08T10:13:56Z [load_day 2025-02-08] 2025-02-08 hour 3: 184779 events in 0 files, snapshot none (task 5724 ms: download 2197 ms overlapping gunzip 800 ms, parse 3598 ms, sort 0 ms, write 0 ms, index 687 ms: 4 candidates, 73736 repo-hours, 3883 releases; waiting 368 ms; commit 0 ms)
2026-11-08T10:14:02Z [load_day 2025-02-08] 2025-02-08 hour 4: 174587 events in 0 files, snapshot none (task 5892 ms: download 2952 ms overlapping gunzip 917 ms, parse 3655 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 61716 repo-hours, 657 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:14:03Z [load_day 2025-02-08] 2025-02-08 hour 5: 183230 events in 0 files, snapshot none (task 6047 ms: download 3679 ms overlapping gunzip 882 ms, parse 3829 ms, sort 0 ms, write 0 ms, index 493 ms: 7 candidates, 65233 repo-hours, 720 releases; waiting 548 ms; commit 0 ms)
2026-11-08T10:14:11Z [load_day 2025-02-08] 2025-02-08 hour 6: 201111 events in 0 files, snapshot none (task 8204 ms: download 4675 ms overlapping gunzip 1243 ms, parse 5145 ms, sort 0 ms, write 0 ms, index 839 ms: 5 candidates, 86592 repo-hours, 1255 releases; waiting 583 ms; commit 0 ms)
2026-11-08T10:14:11Z [load_day 2025-02-08] 2025-02-08 hour 7: 188215 events in 0 files, snapshot none (task 6990 ms: download 3655 ms overlapping gunzip 1041 ms, parse 4489 ms, sort 0 ms, write 0 ms, index 845 ms: 7 candidates, 69320 repo-hours, 850 releases; waiting 282 ms; commit 0 ms)
2026-11-08T10:14:18Z [load_day 2025-02-08] 2025-02-08 hour 8: 193933 events in 0 files, snapshot none (task 6151 ms: download 3069 ms overlapping gunzip 849 ms, parse 3654 ms, sort 0 ms, write 0 ms, index 848 ms: 5 candidates, 74820 repo-hours, 1072 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:14:18Z [load_day 2025-02-08] 2025-02-08 hour 9: 203414 events in 0 files, snapshot none (task 6560 ms: download 3112 ms overlapping gunzip 926 ms, parse 4053 ms, sort 0 ms, write 0 ms, index 748 ms: 7 candidates, 80936 repo-hours, 1090 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:14:24Z [load_day 2025-02-08] 2025-02-08 hour 10: 194920 events in 0 files, snapshot none (task 5936 ms: download 3660 ms overlapping gunzip 815 ms, parse 3743 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 75434 repo-hours, 956 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:14:25Z [load_day 2025-02-08] 2025-02-08 hour 11: 193422 events in 0 files, snapshot none (task 6189 ms: download 3601 ms overlapping gunzip 900 ms, parse 3867 ms, sort 0 ms, write 0 ms, index 541 ms: 8 candidates, 70351 repo-hours, 934 releases; waiting 560 ms; commit 0 ms)
2026-11-08T10:14:33Z [load_day 2025-02-08] 2025-02-08 hour 12: 257092 events in 0 files, snapshot none (task 8157 ms: download 4671 ms overlapping gunzip 1085 ms, parse 5382 ms, sort 0 ms, write 0 ms, index 880 ms: 6 candidates, 122899 repo-hours, 1159 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:14:33Z [load_day 2025-02-08] 2025-02-08 hour 13: 227835 events in 0 files, snapshot none (task 7526 ms: download 4108 ms overlapping gunzip 1023 ms, parse 4753 ms, sort 0 ms, write 0 ms, index 986 ms: 8 candidates, 98668 repo-hours, 885 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:14:40Z [load_day 2025-02-08] 2025-02-08 hour 14: 212894 events in 0 files, snapshot none (task 6380 ms: download 2794 ms overlapping gunzip 943 ms, parse 4143 ms, sort 0 ms, write 0 ms, index 799 ms: 9 candidates, 81513 repo-hours, 923 releases; waiting 200 ms; commit 0 ms)
2026-11-08T10:14:41Z [load_day 2025-02-08] 2025-02-08 hour 15: 225583 events in 0 files, snapshot none (task 7442 ms: download 3881 ms overlapping gunzip 1078 ms, parse 4750 ms, sort 0 ms, write 0 ms, index 677 ms: 11 candidates, 91683 repo-hours, 1172 releases; waiting 678 ms; commit 0 ms)
2026-11-08T10:14:47Z [load_day 2025-02-08] 2025-02-08 hour 16: 215542 events in 0 files, snapshot none (task 6678 ms: download 3177 ms overlapping gunzip 860 ms, parse 3683 ms, sort 0 ms, write 0 ms, index 1348 ms: 12 candidates, 84875 repo-hours, 997 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:14:49Z [load_day 2025-02-08] 2025-02-08 hour 17: 215710 events in 0 files, snapshot none (task 7766 ms: download 3391 ms overlapping gunzip 1072 ms, parse 4388 ms, sort 0 ms, write 0 ms, index 1403 ms: 7 candidates, 80967 repo-hours, 937 releases; waiting 523 ms; commit 0 ms)
2026-11-08T10:14:54Z [load_day 2025-02-08] 2025-02-08 hour 18: 221143 events in 0 files, snapshot none (task 6594 ms: download 3435 ms overlapping gunzip 976 ms, parse 4326 ms, sort 0 ms, write 0 ms, index 737 ms: 8 candidates, 93528 repo-hours, 1292 releases; waiting 304 ms; commit 0 ms)
2026-11-08T10:14:55Z [load_day 2025-02-08] 2025-02-08 hour 19: 193146 events in 0 files, snapshot none (task 5419 ms: download 2951 ms overlapping gunzip 767 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 514 ms: 6 candidates, 70633 repo-hours, 884 releases; waiting 185 ms; commit 0 ms)
2026-11-08T10:14:59Z [load_day 2025-02-08] 2025-02-08 hour 20: 191220 events in 0 files, snapshot none (task 5108 ms: download 2703 ms overlapping gunzip 689 ms, parse 2971 ms, sort 0 ms, write 0 ms, index 607 ms: 4 candidates, 71046 repo-hours, 764 releases; waiting 559 ms; commit 0 ms)
2026-11-08T10:15:00Z [load_day 2025-02-08] 2025-02-08 hour 21: 189685 events in 0 files, snapshot none (task 4803 ms: download 2477 ms overlapping gunzip 668 ms, parse 2949 ms, sort 0 ms, write 0 ms, index 571 ms: 8 candidates, 72137 repo-hours, 952 releases; waiting 389 ms; commit 0 ms)
2026-11-08T10:15:04Z [load_day 2025-02-08] 2025-02-08 hour 22: 171704 events in 0 files, snapshot none (task 4356 ms: download 2644 ms overlapping gunzip 574 ms, parse 2495 ms, sort 0 ms, write 0 ms, index 461 ms: 12 candidates, 61698 repo-hours, 965 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:15:05Z [load_day 2025-02-08] 2025-02-08 hour 23: 160090 events in 0 files, snapshot none (task 4569 ms: download 2969 ms overlapping gunzip 549 ms, parse 2402 ms, sort 0 ms, write 0 ms, index 441 ms: 4 candidates, 58141 repo-hours, 754 releases; waiting 944 ms; commit 0 ms)
2026-11-08T10:15:14Z [load_day 2025-02-08] 2025-02-08: repo_hour merged from 24 files to 1 (1927052 rows, 8593 ms)
2026-11-08T10:15:17Z [load_day 2025-02-08] 2025-02-08: index committed in 11641 ms (24 + 1 + 24 files)
2026-11-08T10:15:17Z [load_day 2025-02-08] 2025-02-08: 4786276 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:15:17Z [load_day 2025-02-08] attempt 1 succeeded