orcaLog in

Runs · run 4406

load_day 2025-09-19, attempt 1 succeeded

Host
73ccef5e07c2:381277
Started
2026-11-08T13:53:55Z
Ended
2026-11-08T13:55:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
685 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
150.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4406/load_day/2025-09-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:53:55Z [load_day 2025-09-19] attempt 1 started
2026-11-08T13:53:55Z [load_day 2025-09-19] 2025-09-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:54:03Z [load_day 2025-09-19] 2025-09-19 hour 0: 150420 events in 0 files, snapshot none (task 6828 ms: download 3628 ms overlapping gunzip 1096 ms, parse 4189 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 75585 repo-hours, 1023 releases; waiting 541 ms; commit 0 ms)
2026-11-08T13:54:03Z [load_day 2025-09-19] 2025-09-19 hour 1: 161999 events in 0 files, snapshot none (task 7283 ms: download 3824 ms overlapping gunzip 1038 ms, parse 4297 ms, sort 0 ms, write 0 ms, index 903 ms: 5 candidates, 95643 repo-hours, 738 releases; waiting 673 ms; commit 0 ms)
2026-11-08T13:54:11Z [load_day 2025-09-19] 2025-09-19 hour 2: 149074 events in 0 files, snapshot none (task 7980 ms: download 5015 ms overlapping gunzip 1152 ms, parse 4594 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 71575 repo-hours, 779 releases; waiting 1203 ms; commit 0 ms)
2026-11-08T13:54:11Z [load_day 2025-09-19] 2025-09-19 hour 3: 156023 events in 0 files, snapshot none (task 7447 ms: download 3770 ms overlapping gunzip 1181 ms, parse 4777 ms, sort 0 ms, write 0 ms, index 699 ms: 11 candidates, 68585 repo-hours, 2057 releases; waiting 497 ms; commit 0 ms)
2026-11-08T13:54:20Z [load_day 2025-09-19] 2025-09-19 hour 4: 151599 events in 0 files, snapshot none (task 7834 ms: download 4104 ms overlapping gunzip 1248 ms, parse 5360 ms, sort 0 ms, write 0 ms, index 514 ms: 10 candidates, 65507 repo-hours, 643 releases; waiting 398 ms; commit 0 ms)
2026-11-08T13:54:20Z [load_day 2025-09-19] 2025-09-19 hour 5: 153811 events in 0 files, snapshot none (task 7818 ms: download 4572 ms overlapping gunzip 1315 ms, parse 4903 ms, sort 0 ms, write 0 ms, index 700 ms: 5 candidates, 66764 repo-hours, 630 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:54:27Z [load_day 2025-09-19] 2025-09-19 hour 6: 159416 events in 0 files, snapshot none (task 7146 ms: download 3982 ms overlapping gunzip 1102 ms, parse 4502 ms, sort 0 ms, write 0 ms, index 710 ms: 9 candidates, 80763 repo-hours, 768 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:54:28Z [load_day 2025-09-19] 2025-09-19 hour 7: 163199 events in 0 files, snapshot none (task 7458 ms: download 4796 ms overlapping gunzip 1289 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 599 ms: 2 candidates, 75732 repo-hours, 707 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:54:35Z [load_day 2025-09-19] 2025-09-19 hour 8: 164768 events in 0 files, snapshot none (task 7519 ms: download 4815 ms overlapping gunzip 1175 ms, parse 4804 ms, sort 0 ms, write 0 ms, index 662 ms: 5 candidates, 80730 repo-hours, 761 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:54:35Z [load_day 2025-09-19] 2025-09-19 hour 9: 166853 events in 0 files, snapshot none (task 6779 ms: download 3869 ms overlapping gunzip 1116 ms, parse 4306 ms, sort 0 ms, write 0 ms, index 850 ms: 4 candidates, 80984 repo-hours, 874 releases; waiting 273 ms; commit 0 ms)
2026-11-08T13:54:45Z [load_day 2025-09-19] 2025-09-19 hour 10: 163020 events in 0 files, snapshot none (task 9344 ms: download 6721 ms overlapping gunzip 1113 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 77874 repo-hours, 763 releases; waiting 2660 ms; commit 0 ms)
2026-11-08T13:54:45Z [load_day 2025-09-19] 2025-09-19 hour 11: 162100 events in 0 files, snapshot none (task 7429 ms: download 3826 ms overlapping gunzip 1012 ms, parse 4304 ms, sort 0 ms, write 0 ms, index 942 ms: 9 candidates, 75460 repo-hours, 691 releases; waiting 919 ms; commit 0 ms)
2026-11-08T13:54:54Z [load_day 2025-09-19] 2025-09-19 hour 12: 172419 events in 0 files, snapshot none (task 8000 ms: download 4582 ms overlapping gunzip 1121 ms, parse 4852 ms, sort 0 ms, write 0 ms, index 1180 ms: 6 candidates, 100139 repo-hours, 761 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:54:54Z [load_day 2025-09-19] 2025-09-19 hour 13: 170190 events in 0 files, snapshot none (task 7912 ms: download 4960 ms overlapping gunzip 1245 ms, parse 4968 ms, sort 0 ms, write 0 ms, index 913 ms: 4 candidates, 91144 repo-hours, 731 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:55:02Z [load_day 2025-09-19] 2025-09-19 hour 14: 164571 events in 0 files, snapshot none (task 8401 ms: download 5349 ms overlapping gunzip 1311 ms, parse 5394 ms, sort 0 ms, write 0 ms, index 900 ms: 6 candidates, 83360 repo-hours, 815 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:55:02Z [load_day 2025-09-19] 2025-09-19 hour 15: 164650 events in 0 files, snapshot none (task 7606 ms: download 4850 ms overlapping gunzip 1176 ms, parse 4758 ms, sort 0 ms, write 0 ms, index 696 ms: 4 candidates, 80760 repo-hours, 844 releases; waiting 599 ms; commit 0 ms)
2026-11-08T13:55:11Z [load_day 2025-09-19] 2025-09-19 hour 16: 165711 events in 0 files, snapshot none (task 8091 ms: download 5060 ms overlapping gunzip 1265 ms, parse 5455 ms, sort 0 ms, write 0 ms, index 636 ms: 8 candidates, 81916 repo-hours, 708 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:55:11Z [load_day 2025-09-19] 2025-09-19 hour 17: 164221 events in 0 files, snapshot none (task 7576 ms: download 4236 ms overlapping gunzip 1238 ms, parse 4905 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 76239 repo-hours, 811 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:55:18Z [load_day 2025-09-19] 2025-09-19 hour 18: 166537 events in 0 files, snapshot none (task 6143 ms: download 3578 ms overlapping gunzip 899 ms, parse 3702 ms, sort 0 ms, write 0 ms, index 729 ms: 8 candidates, 82094 repo-hours, 941 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:55:19Z [load_day 2025-09-19] 2025-09-19 hour 19: 158375 events in 0 files, snapshot none (task 7932 ms: download 5687 ms overlapping gunzip 879 ms, parse 3655 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 69389 repo-hours, 752 releases; waiting 2540 ms; commit 0 ms)
2026-11-08T13:55:24Z [load_day 2025-09-19] 2025-09-19 hour 20: 155958 events in 0 files, snapshot none (task 5762 ms: download 3813 ms overlapping gunzip 868 ms, parse 3435 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 68331 repo-hours, 776 releases; waiting 650 ms; commit 0 ms)
2026-11-08T13:55:26Z [load_day 2025-09-19] 2025-09-19 hour 21: 154612 events in 0 files, snapshot none (task 5707 ms: download 3641 ms overlapping gunzip 889 ms, parse 3512 ms, sort 0 ms, write 0 ms, index 472 ms: 8 candidates, 65063 repo-hours, 925 releases; waiting 466 ms; commit 0 ms)
2026-11-08T13:55:30Z [load_day 2025-09-19] 2025-09-19 hour 22: 149007 events in 0 files, snapshot none (task 5135 ms: download 3553 ms overlapping gunzip 763 ms, parse 3039 ms, sort 0 ms, write 0 ms, index 434 ms: 10 candidates, 60854 repo-hours, 759 releases; waiting 577 ms; commit 0 ms)
2026-11-08T13:55:31Z [load_day 2025-09-19] 2025-09-19 hour 23: 143988 events in 0 files, snapshot none (task 4770 ms: download 2699 ms overlapping gunzip 672 ms, parse 2749 ms, sort 0 ms, write 0 ms, index 475 ms: 14 candidates, 52853 repo-hours, 732 releases; waiting 588 ms; commit 0 ms)
2026-11-08T13:55:39Z [load_day 2025-09-19] 2025-09-19: repo_hour merged from 24 files to 1 (1827344 rows, 8456 ms)
2026-11-08T13:55:42Z [load_day 2025-09-19] 2025-09-19: index committed in 11287 ms (24 + 1 + 24 files)
2026-11-08T13:55:42Z [load_day 2025-09-19] 2025-09-19: 3832521 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:55:42Z [load_day 2025-09-19] attempt 1 succeeded