orcaLog in

Runs · run 4694

load_day 2025-12-08, attempt 1 succeeded

Host
73ccef5e07c2:414283
Started
2026-11-08T14:41:45Z
Ended
2026-11-08T14:42:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
720 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.6 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4694/load_day/2025-12-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:41:45Z [load_day 2025-12-08] attempt 1 started
2026-11-08T14:41:46Z [load_day 2025-12-08] 2025-12-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:41:50Z [load_day 2025-12-08] 2025-12-08 hour 0: 146886 events in 0 files, snapshot none (task 3926 ms: download 2958 ms overlapping gunzip 416 ms, parse 1376 ms, sort 0 ms, write 0 ms, index 518 ms: 13 candidates, 70485 repo-hours, 1617 releases; waiting 1245 ms; commit 0 ms)
2026-11-08T14:41:50Z [load_day 2025-12-08] 2025-12-08 hour 1: 153271 events in 0 files, snapshot none (task 3187 ms: download 1695 ms overlapping gunzip 339 ms, parse 1162 ms, sort 0 ms, write 0 ms, index 920 ms: 7 candidates, 87909 repo-hours, 1336 releases; waiting 400 ms; commit 0 ms)
2026-11-08T14:41:54Z [load_day 2025-12-08] 2025-12-08 hour 2: 146170 events in 0 files, snapshot none (task 3455 ms: download 2377 ms overlapping gunzip 447 ms, parse 1357 ms, sort 0 ms, write 0 ms, index 558 ms: 7 candidates, 71449 repo-hours, 1193 releases; waiting 816 ms; commit 0 ms)
2026-11-08T14:41:54Z [load_day 2025-12-08] 2025-12-08 hour 3: 145440 events in 0 files, snapshot none (task 3526 ms: download 2269 ms overlapping gunzip 428 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 519 ms: 12 candidates, 68667 repo-hours, 1522 releases; waiting 842 ms; commit 0 ms)
2026-11-08T14:41:59Z [load_day 2025-12-08] 2025-12-08 hour 4: 148591 events in 0 files, snapshot none (task 3705 ms: download 2715 ms overlapping gunzip 507 ms, parse 1381 ms, sort 0 ms, write 0 ms, index 531 ms: 12 candidates, 67873 repo-hours, 1940 releases; waiting 999 ms; commit 0 ms)
2026-11-08T14:41:59Z [load_day 2025-12-08] 2025-12-08 hour 5: 148504 events in 0 files, snapshot none (task 3589 ms: download 2485 ms overlapping gunzip 445 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 519 ms: 5 candidates, 68238 repo-hours, 1222 releases; waiting 839 ms; commit 0 ms)
2026-11-08T14:42:03Z [load_day 2025-12-08] 2025-12-08 hour 6: 151474 events in 0 files, snapshot none (task 3500 ms: download 2151 ms overlapping gunzip 420 ms, parse 1303 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 75873 repo-hours, 1346 releases; waiting 765 ms; commit 0 ms)
2026-11-08T14:42:03Z [load_day 2025-12-08] 2025-12-08 hour 7: 151728 events in 0 files, snapshot none (task 3533 ms: download 2441 ms overlapping gunzip 416 ms, parse 1260 ms, sort 0 ms, write 0 ms, index 542 ms: 6 candidates, 71706 repo-hours, 1249 releases; waiting 972 ms; commit 0 ms)
2026-11-08T14:42:08Z [load_day 2025-12-08] 2025-12-08 hour 8: 145788 events in 0 files, snapshot none (task 4149 ms: download 2294 ms overlapping gunzip 662 ms, parse 1936 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 71468 repo-hours, 1153 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:42:08Z [load_day 2025-12-08] 2025-12-08 hour 9: 150375 events in 0 files, snapshot none (task 4037 ms: download 2546 ms overlapping gunzip 650 ms, parse 1894 ms, sort 0 ms, write 0 ms, index 740 ms: 6 candidates, 75142 repo-hours, 876 releases; waiting 446 ms; commit 0 ms)
2026-11-08T14:42:12Z [load_day 2025-12-08] 2025-12-08 hour 10: 150951 events in 0 files, snapshot none (task 3888 ms: download 2215 ms overlapping gunzip 641 ms, parse 1791 ms, sort 0 ms, write 0 ms, index 627 ms: 4 candidates, 75472 repo-hours, 871 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:42:12Z [load_day 2025-12-08] 2025-12-08 hour 11: 147941 events in 0 files, snapshot none (task 4317 ms: download 2926 ms overlapping gunzip 570 ms, parse 1711 ms, sort 0 ms, write 0 ms, index 616 ms: 5 candidates, 73173 repo-hours, 988 releases; waiting 1075 ms; commit 0 ms)
2026-11-08T14:42:16Z [load_day 2025-12-08] 2025-12-08 hour 12: 166533 events in 0 files, snapshot none (task 3878 ms: download 2261 ms overlapping gunzip 494 ms, parse 1665 ms, sort 0 ms, write 0 ms, index 812 ms: 7 candidates, 99141 repo-hours, 590 releases; waiting 634 ms; commit 0 ms)
2026-11-08T14:42:16Z [load_day 2025-12-08] 2025-12-08 hour 13: 160568 events in 0 files, snapshot none (task 3739 ms: download 1909 ms overlapping gunzip 540 ms, parse 1737 ms, sort 0 ms, write 0 ms, index 868 ms: 8 candidates, 92440 repo-hours, 615 releases; waiting 233 ms; commit 0 ms)
2026-11-08T14:42:21Z [load_day 2025-12-08] 2025-12-08 hour 14: 146722 events in 0 files, snapshot none (task 3698 ms: download 2005 ms overlapping gunzip 523 ms, parse 1560 ms, sort 0 ms, write 0 ms, index 944 ms: 9 candidates, 79916 repo-hours, 819 releases; waiting 375 ms; commit 0 ms)
2026-11-08T14:42:21Z [load_day 2025-12-08] 2025-12-08 hour 15: 153706 events in 0 files, snapshot none (task 3581 ms: download 1541 ms overlapping gunzip 544 ms, parse 1600 ms, sort 0 ms, write 0 ms, index 909 ms: 8 candidates, 84880 repo-hours, 877 releases; waiting 229 ms; commit 0 ms)
2026-11-08T14:42:25Z [load_day 2025-12-08] 2025-12-08 hour 16: 150115 events in 0 files, snapshot none (task 3872 ms: download 2410 ms overlapping gunzip 552 ms, parse 1664 ms, sort 0 ms, write 0 ms, index 671 ms: 7 candidates, 82014 repo-hours, 837 releases; waiting 673 ms; commit 0 ms)
2026-11-08T14:42:25Z [load_day 2025-12-08] 2025-12-08 hour 17: 152508 events in 0 files, snapshot none (task 3789 ms: download 2086 ms overlapping gunzip 561 ms, parse 1707 ms, sort 0 ms, write 0 ms, index 657 ms: 9 candidates, 80804 repo-hours, 866 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:42:30Z [load_day 2025-12-08] 2025-12-08 hour 18: 150039 events in 0 files, snapshot none (task 4139 ms: download 3067 ms overlapping gunzip 522 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 624 ms: 10 candidates, 81583 repo-hours, 1167 releases; waiting 1195 ms; commit 0 ms)
2026-11-08T14:42:30Z [load_day 2025-12-08] 2025-12-08 hour 19: 151207 events in 0 files, snapshot none (task 4129 ms: download 2686 ms overlapping gunzip 475 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 851 ms: 4 candidates, 76288 repo-hours, 1147 releases; waiting 1054 ms; commit 0 ms)
2026-11-08T14:42:34Z [load_day 2025-12-08] 2025-12-08 hour 20: 149652 events in 0 files, snapshot none (task 3686 ms: download 2260 ms overlapping gunzip 493 ms, parse 1550 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 75999 repo-hours, 1114 releases; waiting 674 ms; commit 0 ms)
2026-11-08T14:42:34Z [load_day 2025-12-08] 2025-12-08 hour 21: 147569 events in 0 files, snapshot none (task 4118 ms: download 2598 ms overlapping gunzip 574 ms, parse 1798 ms, sort 0 ms, write 0 ms, index 669 ms: 9 candidates, 71286 repo-hours, 1147 releases; waiting 808 ms; commit 0 ms)
2026-11-08T14:42:38Z [load_day 2025-12-08] 2025-12-08 hour 22: 148865 events in 0 files, snapshot none (task 3560 ms: download 1892 ms overlapping gunzip 499 ms, parse 1454 ms, sort 0 ms, write 0 ms, index 907 ms: 4 candidates, 68580 repo-hours, 1199 releases; waiting 339 ms; commit 0 ms)
2026-11-08T14:42:39Z [load_day 2025-12-08] 2025-12-08 hour 23: 150149 events in 0 files, snapshot none (task 4120 ms: download 2421 ms overlapping gunzip 604 ms, parse 1791 ms, sort 0 ms, write 0 ms, index 557 ms: 5 candidates, 66876 repo-hours, 1276 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:42:47Z [load_day 2025-12-08] 2025-12-08: repo_hour merged from 24 files to 1 (1837262 rows, 8066 ms)
2026-11-08T14:42:50Z [load_day 2025-12-08] 2025-12-08: index committed in 11285 ms (24 + 1 + 24 files)
2026-11-08T14:42:50Z [load_day 2025-12-08] 2025-12-08: 3614752 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:42:50Z [load_day 2025-12-08] attempt 1 succeeded