orcaLog in

Runs · run 4633

load_day 2025-11-19, attempt 1 succeeded

Host
73ccef5e07c2:406612
Started
2026-11-08T14:31:09Z
Ended
2026-11-08T14:32:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
671 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.2 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4633/load_day/2025-11-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:31:09Z [load_day 2025-11-19] attempt 1 started
2026-11-08T14:31:09Z [load_day 2025-11-19] 2025-11-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:31:14Z [load_day 2025-11-19] 2025-11-19 hour 0: 149484 events in 0 files, snapshot none (task 3954 ms: download 2678 ms overlapping gunzip 437 ms, parse 1233 ms, sort 0 ms, write 0 ms, index 797 ms: 6 candidates, 77806 repo-hours, 763 releases; waiting 1199 ms; commit 0 ms)
2026-11-08T14:31:14Z [load_day 2025-11-19] 2025-11-19 hour 1: 155102 events in 0 files, snapshot none (task 4252 ms: download 2416 ms overlapping gunzip 409 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 826 ms: 5 candidates, 93000 repo-hours, 524 releases; waiting 1448 ms; commit 0 ms)
2026-11-08T14:31:18Z [load_day 2025-11-19] 2025-11-19 hour 2: 150586 events in 0 files, snapshot none (task 3241 ms: download 2177 ms overlapping gunzip 398 ms, parse 1223 ms, sort 0 ms, write 0 ms, index 536 ms: 5 candidates, 70613 repo-hours, 567 releases; waiting 766 ms; commit 0 ms)
2026-11-08T14:31:18Z [load_day 2025-11-19] 2025-11-19 hour 3: 156160 events in 0 files, snapshot none (task 3621 ms: download 2701 ms overlapping gunzip 390 ms, parse 1205 ms, sort 0 ms, write 0 ms, index 519 ms: 9 candidates, 65463 repo-hours, 1471 releases; waiting 1185 ms; commit 0 ms)
2026-11-08T14:31:21Z [load_day 2025-11-19] 2025-11-19 hour 4: 156016 events in 0 files, snapshot none (task 3345 ms: download 2456 ms overlapping gunzip 391 ms, parse 1218 ms, sort 0 ms, write 0 ms, index 477 ms: 9 candidates, 62856 repo-hours, 439 releases; waiting 949 ms; commit 0 ms)
2026-11-08T14:31:22Z [load_day 2025-11-19] 2025-11-19 hour 5: 151046 events in 0 files, snapshot none (task 3212 ms: download 2178 ms overlapping gunzip 350 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 487 ms: 11 candidates, 62899 repo-hours, 474 releases; waiting 780 ms; commit 0 ms)
2026-11-08T14:31:25Z [load_day 2025-11-19] 2025-11-19 hour 6: 160952 events in 0 files, snapshot none (task 3441 ms: download 2307 ms overlapping gunzip 410 ms, parse 1312 ms, sort 0 ms, write 0 ms, index 534 ms: 4 candidates, 72676 repo-hours, 555 releases; waiting 894 ms; commit 0 ms)
2026-11-08T14:31:26Z [load_day 2025-11-19] 2025-11-19 hour 7: 155690 events in 0 files, snapshot none (task 3305 ms: download 2093 ms overlapping gunzip 394 ms, parse 1210 ms, sort 0 ms, write 0 ms, index 614 ms: 4 candidates, 68071 repo-hours, 544 releases; waiting 701 ms; commit 0 ms)
2026-11-08T14:31:29Z [load_day 2025-11-19] 2025-11-19 hour 8: 153842 events in 0 files, snapshot none (task 3305 ms: download 2105 ms overlapping gunzip 403 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 602 ms: 7 candidates, 69035 repo-hours, 482 releases; waiting 769 ms; commit 0 ms)
2026-11-08T14:31:30Z [load_day 2025-11-19] 2025-11-19 hour 9: 156744 events in 0 files, snapshot none (task 3309 ms: download 1908 ms overlapping gunzip 393 ms, parse 1160 ms, sort 0 ms, write 0 ms, index 563 ms: 5 candidates, 71719 repo-hours, 429 releases; waiting 502 ms; commit 0 ms)
2026-11-08T14:31:33Z [load_day 2025-11-19] 2025-11-19 hour 10: 156998 events in 0 files, snapshot none (task 3186 ms: download 2233 ms overlapping gunzip 384 ms, parse 1209 ms, sort 0 ms, write 0 ms, index 592 ms: 1 candidates, 75448 repo-hours, 409 releases; waiting 712 ms; commit 0 ms)
2026-11-08T14:31:34Z [load_day 2025-11-19] 2025-11-19 hour 11: 153274 events in 0 files, snapshot none (task 3642 ms: download 2469 ms overlapping gunzip 404 ms, parse 1276 ms, sort 0 ms, write 0 ms, index 540 ms: 6 candidates, 70970 repo-hours, 458 releases; waiting 1138 ms; commit 0 ms)
2026-11-08T14:31:36Z [load_day 2025-11-19] 2025-11-19 hour 12: 167357 events in 0 files, snapshot none (task 2701 ms: download 1654 ms overlapping gunzip 250 ms, parse 865 ms, sort 0 ms, write 0 ms, index 624 ms: 5 candidates, 87070 repo-hours, 179 releases; waiting 609 ms; commit 0 ms)
2026-11-08T14:31:39Z [load_day 2025-11-19] 2025-11-19 hour 13: 164650 events in 0 files, snapshot none (task 3859 ms: download 2047 ms overlapping gunzip 262 ms, parse 872 ms, sort 0 ms, write 0 ms, index 1386 ms: 8 candidates, 84868 repo-hours, 176 releases; waiting 1056 ms; commit 0 ms)
2026-11-08T14:31:43Z [load_day 2025-11-19] 2025-11-19 hour 14: 161711 events in 0 files, snapshot none (task 3567 ms: download 1818 ms overlapping gunzip 350 ms, parse 1404 ms, sort 0 ms, write 0 ms, index 743 ms: 7 candidates, 76239 repo-hours, 240 releases; waiting 689 ms; commit 0 ms)
2026-11-08T14:31:43Z [load_day 2025-11-19] 2025-11-19 hour 15: 166854 events in 0 files, snapshot none (task 3280 ms: download 2030 ms overlapping gunzip 331 ms, parse 1173 ms, sort 0 ms, write 0 ms, index 862 ms: 3 candidates, 76988 repo-hours, 164 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:31:47Z [load_day 2025-11-19] 2025-11-19 hour 16: 162907 events in 0 files, snapshot none (task 3298 ms: download 2198 ms overlapping gunzip 297 ms, parse 975 ms, sort 0 ms, write 0 ms, index 641 ms: 8 candidates, 74124 repo-hours, 191 releases; waiting 1067 ms; commit 0 ms)
2026-11-08T14:31:47Z [load_day 2025-11-19] 2025-11-19 hour 17: 162163 events in 0 files, snapshot none (task 2849 ms: download 1725 ms overlapping gunzip 270 ms, parse 906 ms, sort 0 ms, write 0 ms, index 633 ms: 8 candidates, 69569 repo-hours, 184 releases; waiting 695 ms; commit 0 ms)
2026-11-08T14:31:50Z [load_day 2025-11-19] 2025-11-19 hour 18: 167659 events in 0 files, snapshot none (task 2716 ms: download 1669 ms overlapping gunzip 252 ms, parse 899 ms, sort 0 ms, write 0 ms, index 558 ms: 4 candidates, 74758 repo-hours, 185 releases; waiting 616 ms; commit 0 ms)
2026-11-08T14:31:50Z [load_day 2025-11-19] 2025-11-19 hour 19: 161136 events in 0 files, snapshot none (task 2192 ms: download 1166 ms overlapping gunzip 254 ms, parse 828 ms, sort 0 ms, write 0 ms, index 514 ms: 10 candidates, 64894 repo-hours, 217 releases; waiting 345 ms; commit 0 ms)
2026-11-08T14:31:54Z [load_day 2025-11-19] 2025-11-19 hour 20: 157720 events in 0 files, snapshot none (task 3184 ms: download 2101 ms overlapping gunzip 304 ms, parse 1027 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 66906 repo-hours, 258 releases; waiting 899 ms; commit 0 ms)
2026-11-08T14:31:54Z [load_day 2025-11-19] 2025-11-19 hour 21: 155970 events in 0 files, snapshot none (task 3446 ms: download 2314 ms overlapping gunzip 379 ms, parse 1188 ms, sort 0 ms, write 0 ms, index 605 ms: 11 candidates, 67211 repo-hours, 486 releases; waiting 918 ms; commit 0 ms)
2026-11-08T14:31:57Z [load_day 2025-11-19] 2025-11-19 hour 22: 151309 events in 0 files, snapshot none (task 3093 ms: download 1959 ms overlapping gunzip 406 ms, parse 1253 ms, sort 0 ms, write 0 ms, index 483 ms: 3 candidates, 63506 repo-hours, 651 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:31:57Z [load_day 2025-11-19] 2025-11-19 hour 23: 146631 events in 0 files, snapshot none (task 2725 ms: download 1653 ms overlapping gunzip 341 ms, parse 1112 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 60257 repo-hours, 564 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:32:07Z [load_day 2025-11-19] 2025-11-19: repo_hour merged from 24 files to 1 (1726946 rows, 9287 ms)
2026-11-08T14:32:10Z [load_day 2025-11-19] 2025-11-19: index committed in 12558 ms (24 + 1 + 24 files)
2026-11-08T14:32:10Z [load_day 2025-11-19] 2025-11-19: 3781961 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:32:10Z [load_day 2025-11-19] attempt 1 succeeded