orcaLog in

Runs · run 3781

load_day 2025-04-13, attempt 1 succeeded

Host
73ccef5e07c2:287048
Started
2026-11-08T11:23:52Z
Ended
2026-11-08T11:25:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
964 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
137.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3781/load_day/2025-04-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:23:52Z [load_day 2025-04-13] attempt 1 started
2026-11-08T11:23:54Z [load_day 2025-04-13] 2025-04-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:23:59Z [load_day 2025-04-13] 2025-04-13 hour 0: 128579 events in 0 files, snapshot none (task 5055 ms: download 3051 ms overlapping gunzip 688 ms, parse 3167 ms, sort 0 ms, write 0 ms, index 393 ms: 5 candidates, 49176 repo-hours, 1008 releases; waiting 467 ms; commit 0 ms)
2026-11-08T11:23:59Z [load_day 2025-04-13] 2025-04-13 hour 1: 122541 events in 0 files, snapshot none (task 4692 ms: download 2004 ms overlapping gunzip 697 ms, parse 3030 ms, sort 0 ms, write 0 ms, index 387 ms: 2 candidates, 45063 repo-hours, 575 releases; waiting 246 ms; commit 0 ms)
2026-11-08T11:24:06Z [load_day 2025-04-13] 2025-04-13 hour 2: 192759 events in 0 files, snapshot none (task 5563 ms: download 2885 ms overlapping gunzip 725 ms, parse 3213 ms, sort 0 ms, write 0 ms, index 791 ms: 7 candidates, 110474 repo-hours, 862 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:24:06Z [load_day 2025-04-13] 2025-04-13 hour 3: 166665 events in 0 files, snapshot none (task 5138 ms: download 2655 ms overlapping gunzip 709 ms, parse 3228 ms, sort 0 ms, write 0 ms, index 596 ms: 3 candidates, 78582 repo-hours, 1030 releases; waiting 381 ms; commit 0 ms)
2026-11-08T11:24:11Z [load_day 2025-04-13] 2025-04-13 hour 4: 160847 events in 0 files, snapshot none (task 4438 ms: download 2118 ms overlapping gunzip 578 ms, parse 2588 ms, sort 0 ms, write 0 ms, index 568 ms: 1 candidates, 68535 repo-hours, 2717 releases; waiting 407 ms; commit 0 ms)
2026-11-08T11:24:11Z [load_day 2025-04-13] 2025-04-13 hour 5: 160175 events in 0 files, snapshot none (task 4360 ms: download 2450 ms overlapping gunzip 558 ms, parse 2463 ms, sort 0 ms, write 0 ms, index 481 ms: 4 candidates, 60701 repo-hours, 830 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:24:17Z [load_day 2025-04-13] 2025-04-13 hour 6: 184874 events in 0 files, snapshot none (task 5738 ms: download 2767 ms overlapping gunzip 732 ms, parse 3221 ms, sort 0 ms, write 0 ms, index 1063 ms: 11 candidates, 78410 repo-hours, 835 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:24:17Z [load_day 2025-04-13] 2025-04-13 hour 7: 180155 events in 0 files, snapshot none (task 5794 ms: download 3085 ms overlapping gunzip 757 ms, parse 3253 ms, sort 0 ms, write 0 ms, index 1028 ms: 6 candidates, 66922 repo-hours, 711 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:24:24Z [load_day 2025-04-13] 2025-04-13 hour 8: 195353 events in 0 files, snapshot none (task 6404 ms: download 3794 ms overlapping gunzip 870 ms, parse 3963 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 73260 repo-hours, 803 releases; waiting 627 ms; commit 0 ms)
2026-11-08T11:24:24Z [load_day 2025-04-13] 2025-04-13 hour 9: 206188 events in 0 files, snapshot none (task 6828 ms: download 3956 ms overlapping gunzip 1011 ms, parse 4230 ms, sort 0 ms, write 0 ms, index 812 ms: 2 candidates, 80201 repo-hours, 983 releases; waiting 455 ms; commit 0 ms)
2026-11-08T11:24:32Z [load_day 2025-04-13] 2025-04-13 hour 10: 198586 events in 0 files, snapshot none (task 7272 ms: download 4366 ms overlapping gunzip 1029 ms, parse 4577 ms, sort 0 ms, write 0 ms, index 747 ms: 7 candidates, 78979 repo-hours, 807 releases; waiting 555 ms; commit 0 ms)
2026-11-08T11:24:32Z [load_day 2025-04-13] 2025-04-13 hour 11: 198501 events in 0 files, snapshot none (task 6291 ms: download 3741 ms overlapping gunzip 906 ms, parse 3997 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 73786 repo-hours, 852 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:24:41Z [load_day 2025-04-13] 2025-04-13 hour 12: 245615 events in 0 files, snapshot none (task 8562 ms: download 5484 ms overlapping gunzip 1022 ms, parse 4835 ms, sort 0 ms, write 0 ms, index 899 ms: 12 candidates, 124238 repo-hours, 1038 releases; waiting 1470 ms; commit 0 ms)
2026-11-08T11:24:41Z [load_day 2025-04-13] 2025-04-13 hour 13: 223869 events in 0 files, snapshot none (task 7228 ms: download 4213 ms overlapping gunzip 1110 ms, parse 4596 ms, sort 0 ms, write 0 ms, index 757 ms: 9 candidates, 102333 repo-hours, 1029 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:24:50Z [load_day 2025-04-13] 2025-04-13 hour 14: 217887 events in 0 files, snapshot none (task 8690 ms: download 5454 ms overlapping gunzip 1302 ms, parse 5760 ms, sort 0 ms, write 0 ms, index 814 ms: 4 candidates, 88154 repo-hours, 986 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:24:50Z [load_day 2025-04-13] 2025-04-13 hour 15: 221772 events in 0 files, snapshot none (task 8577 ms: download 5235 ms overlapping gunzip 1232 ms, parse 5651 ms, sort 0 ms, write 0 ms, index 922 ms: 3 candidates, 93991 repo-hours, 1087 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:24:59Z [load_day 2025-04-13] 2025-04-13 hour 16: 212550 events in 0 files, snapshot none (task 8308 ms: download 4775 ms overlapping gunzip 1256 ms, parse 5447 ms, sort 0 ms, write 0 ms, index 760 ms: 5 candidates, 87075 repo-hours, 1158 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:24:59Z [load_day 2025-04-13] 2025-04-13 hour 17: 210401 events in 0 files, snapshot none (task 7995 ms: download 4143 ms overlapping gunzip 1203 ms, parse 5077 ms, sort 0 ms, write 0 ms, index 929 ms: 4 candidates, 82410 repo-hours, 1002 releases; waiting 543 ms; commit 0 ms)
2026-11-08T11:25:07Z [load_day 2025-04-13] 2025-04-13 hour 18: 224683 events in 0 files, snapshot none (task 7329 ms: download 4102 ms overlapping gunzip 1046 ms, parse 4347 ms, sort 0 ms, write 0 ms, index 853 ms: 6 candidates, 98067 repo-hours, 1042 releases; waiting 669 ms; commit 0 ms)
2026-11-08T11:25:07Z [load_day 2025-04-13] 2025-04-13 hour 19: 202735 events in 0 files, snapshot none (task 7188 ms: download 3662 ms overlapping gunzip 1070 ms, parse 4527 ms, sort 0 ms, write 0 ms, index 1001 ms: 2 candidates, 75668 repo-hours, 946 releases; waiting 366 ms; commit 0 ms)
2026-11-08T11:25:14Z [load_day 2025-04-13] 2025-04-13 hour 20: 198592 events in 0 files, snapshot none (task 6724 ms: download 3745 ms overlapping gunzip 933 ms, parse 4316 ms, sort 0 ms, write 0 ms, index 654 ms: 2 candidates, 75631 repo-hours, 930 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:25:14Z [load_day 2025-04-13] 2025-04-13 hour 21: 187453 events in 0 files, snapshot none (task 6592 ms: download 3758 ms overlapping gunzip 939 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 72720 repo-hours, 1073 releases; waiting 457 ms; commit 0 ms)
2026-11-08T11:25:21Z [load_day 2025-04-13] 2025-04-13 hour 22: 168719 events in 0 files, snapshot none (task 6638 ms: download 3341 ms overlapping gunzip 1052 ms, parse 4093 ms, sort 0 ms, write 0 ms, index 691 ms: 4 candidates, 62382 repo-hours, 961 releases; waiting 498 ms; commit 0 ms)
2026-11-08T11:25:21Z [load_day 2025-04-13] 2025-04-13 hour 23: 157525 events in 0 files, snapshot none (task 6295 ms: download 3235 ms overlapping gunzip 876 ms, parse 3950 ms, sort 0 ms, write 0 ms, index 697 ms: 4 candidates, 58992 repo-hours, 747 releases; waiting 418 ms; commit 0 ms)
2026-11-08T11:25:29Z [load_day 2025-04-13] 2025-04-13: repo_hour merged from 24 files to 1 (1885750 rows, 8282 ms)
2026-11-08T11:25:32Z [load_day 2025-04-13] 2025-04-13: index committed in 10946 ms (24 + 1 + 24 files)
2026-11-08T11:25:32Z [load_day 2025-04-13] 2025-04-13: 4567024 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:25:32Z [load_day 2025-04-13] attempt 1 succeeded