orcaLog in

Runs · run 3363

load_day 2024-12-26, attempt 1 succeeded

Host
73ccef5e07c2:228269
Started
2026-11-08T09:32:49Z
Ended
2026-11-08T09:34:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
674 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3363/load_day/2024-12-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:32:49Z [load_day 2024-12-26] attempt 1 started
2026-11-08T09:32:50Z [load_day 2024-12-26] 2024-12-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:32:55Z [load_day 2024-12-26] 2024-12-26 hour 0: 148458 events in 0 files, snapshot none (task 4549 ms: download 1964 ms overlapping gunzip 662 ms, parse 2730 ms, sort 0 ms, write 0 ms, index 548 ms: 4 candidates, 73294 repo-hours, 1043 releases; waiting 372 ms; commit 0 ms)
2026-11-08T09:32:56Z [load_day 2024-12-26] 2024-12-26 hour 1: 173306 events in 0 files, snapshot none (task 5121 ms: download 2254 ms overlapping gunzip 717 ms, parse 3221 ms, sort 0 ms, write 0 ms, index 664 ms: 4 candidates, 98881 repo-hours, 788 releases; waiting 219 ms; commit 0 ms)
2026-11-08T09:33:00Z [load_day 2024-12-26] 2024-12-26 hour 2: 146243 events in 0 files, snapshot none (task 4909 ms: download 2301 ms overlapping gunzip 685 ms, parse 2779 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 66950 repo-hours, 757 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:33:01Z [load_day 2024-12-26] 2024-12-26 hour 3: 166900 events in 0 files, snapshot none (task 4791 ms: download 2667 ms overlapping gunzip 657 ms, parse 2817 ms, sort 0 ms, write 0 ms, index 485 ms: 2 candidates, 65820 repo-hours, 4305 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:33:06Z [load_day 2024-12-26] 2024-12-26 hour 4: 148273 events in 0 files, snapshot none (task 4885 ms: download 2681 ms overlapping gunzip 647 ms, parse 2782 ms, sort 0 ms, write 0 ms, index 441 ms: 7 candidates, 53017 repo-hours, 711 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:33:06Z [load_day 2024-12-26] 2024-12-26 hour 5: 163619 events in 0 files, snapshot none (task 5207 ms: download 2586 ms overlapping gunzip 831 ms, parse 3437 ms, sort 0 ms, write 0 ms, index 484 ms: 4 candidates, 58830 repo-hours, 949 releases; waiting 189 ms; commit 0 ms)
2026-11-08T09:33:11Z [load_day 2024-12-26] 2024-12-26 hour 6: 187351 events in 0 files, snapshot none (task 5153 ms: download 3235 ms overlapping gunzip 696 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 584 ms: 4 candidates, 82065 repo-hours, 1143 releases; waiting 544 ms; commit 0 ms)
2026-11-08T09:33:12Z [load_day 2024-12-26] 2024-12-26 hour 7: 181930 events in 0 files, snapshot none (task 5023 ms: download 2633 ms overlapping gunzip 713 ms, parse 3014 ms, sort 0 ms, write 0 ms, index 522 ms: 3 candidates, 68026 repo-hours, 925 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:33:17Z [load_day 2024-12-26] 2024-12-26 hour 8: 185059 events in 0 files, snapshot none (task 5052 ms: download 2619 ms overlapping gunzip 721 ms, parse 3037 ms, sort 0 ms, write 0 ms, index 538 ms: 12 candidates, 73281 repo-hours, 982 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:33:18Z [load_day 2024-12-26] 2024-12-26 hour 9: 196072 events in 0 files, snapshot none (task 5175 ms: download 3204 ms overlapping gunzip 734 ms, parse 3060 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 79039 repo-hours, 1093 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:33:23Z [load_day 2024-12-26] 2024-12-26 hour 10: 188914 events in 0 files, snapshot none (task 5282 ms: download 2757 ms overlapping gunzip 704 ms, parse 2981 ms, sort 0 ms, write 0 ms, index 720 ms: 0 candidates, 72705 repo-hours, 930 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:33:24Z [load_day 2024-12-26] 2024-12-26 hour 11: 185833 events in 0 files, snapshot none (task 5247 ms: download 2256 ms overlapping gunzip 786 ms, parse 3281 ms, sort 0 ms, write 0 ms, index 700 ms: 1 candidates, 68596 repo-hours, 852 releases; waiting 198 ms; commit 0 ms)
2026-11-08T09:33:30Z [load_day 2024-12-26] 2024-12-26 hour 12: 235682 events in 0 files, snapshot none (task 6522 ms: download 3145 ms overlapping gunzip 886 ms, parse 3943 ms, sort 0 ms, write 0 ms, index 876 ms: 7 candidates, 117191 repo-hours, 889 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:33:31Z [load_day 2024-12-26] 2024-12-26 hour 13: 207872 events in 0 files, snapshot none (task 6355 ms: download 3282 ms overlapping gunzip 938 ms, parse 3880 ms, sort 0 ms, write 0 ms, index 701 ms: 3 candidates, 93865 repo-hours, 904 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:33:37Z [load_day 2024-12-26] 2024-12-26 hour 14: 194210 events in 0 files, snapshot none (task 6167 ms: download 2507 ms overlapping gunzip 913 ms, parse 3884 ms, sort 0 ms, write 0 ms, index 760 ms: 9 candidates, 75905 repo-hours, 1018 releases; waiting 311 ms; commit 0 ms)
2026-11-08T09:33:38Z [load_day 2024-12-26] 2024-12-26 hour 15: 205067 events in 0 files, snapshot none (task 7016 ms: download 4983 ms overlapping gunzip 1022 ms, parse 4407 ms, sort 0 ms, write 0 ms, index 598 ms: 3 candidates, 84410 repo-hours, 1203 releases; waiting 613 ms; commit 0 ms)
2026-11-08T09:33:44Z [load_day 2024-12-26] 2024-12-26 hour 16: 190580 events in 0 files, snapshot none (task 7024 ms: download 3447 ms overlapping gunzip 1076 ms, parse 4630 ms, sort 0 ms, write 0 ms, index 559 ms: 6 candidates, 75214 repo-hours, 1042 releases; waiting 76 ms; commit 0 ms)
2026-11-08T09:33:45Z [load_day 2024-12-26] 2024-12-26 hour 17: 185798 events in 0 files, snapshot none (task 6603 ms: download 3861 ms overlapping gunzip 988 ms, parse 4193 ms, sort 0 ms, write 0 ms, index 528 ms: 7 candidates, 69195 repo-hours, 1022 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:33:51Z [load_day 2024-12-26] 2024-12-26 hour 18: 197299 events in 0 files, snapshot none (task 6542 ms: download 3710 ms overlapping gunzip 965 ms, parse 4115 ms, sort 0 ms, write 0 ms, index 587 ms: 3 candidates, 86740 repo-hours, 1023 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:33:52Z [load_day 2024-12-26] 2024-12-26 hour 19: 167150 events in 0 files, snapshot none (task 6214 ms: download 3583 ms overlapping gunzip 932 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 508 ms: 1 candidates, 60739 repo-hours, 785 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:33:58Z [load_day 2024-12-26] 2024-12-26 hour 20: 164587 events in 0 files, snapshot none (task 5963 ms: download 3346 ms overlapping gunzip 875 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 484 ms: 4 candidates, 61336 repo-hours, 722 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:33:58Z [load_day 2024-12-26] 2024-12-26 hour 21: 161097 events in 0 files, snapshot none (task 5384 ms: download 2975 ms overlapping gunzip 814 ms, parse 3542 ms, sort 0 ms, write 0 ms, index 479 ms: 9 candidates, 61372 repo-hours, 1037 releases; waiting 243 ms; commit 0 ms)
2026-11-08T09:34:04Z [load_day 2024-12-26] 2024-12-26 hour 22: 148688 events in 0 files, snapshot none (task 5021 ms: download 2450 ms overlapping gunzip 803 ms, parse 3268 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 52798 repo-hours, 1012 releases; waiting 209 ms; commit 0 ms)
2026-11-08T09:34:04Z [load_day 2024-12-26] 2024-12-26 hour 23: 145610 events in 0 files, snapshot none (task 5225 ms: download 2561 ms overlapping gunzip 822 ms, parse 3416 ms, sort 0 ms, write 0 ms, index 391 ms: 6 candidates, 52019 repo-hours, 777 releases; waiting 292 ms; commit 0 ms)
2026-11-08T09:34:12Z [load_day 2024-12-26] 2024-12-26: repo_hour merged from 24 files to 1 (1751288 rows, 7951 ms)
2026-11-08T09:34:14Z [load_day 2024-12-26] 2024-12-26: index committed in 10501 ms (23 + 1 + 24 files)
2026-11-08T09:34:14Z [load_day 2024-12-26] 2024-12-26: 4275598 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:34:14Z [load_day 2024-12-26] attempt 1 succeeded