orcaLog in

Runs · run 3730

load_day 2025-03-29, attempt 1 succeeded

Host
73ccef5e07c2:279505
Started
2026-11-08T11:07:10Z
Ended
2026-11-08T11:08:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
711 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.6 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3730/load_day/2025-03-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:07:10Z [load_day 2025-03-29] attempt 1 started
2026-11-08T11:07:11Z [load_day 2025-03-29] 2025-03-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:07:19Z [load_day 2025-03-29] 2025-03-29 hour 0: 190940 events in 0 files, snapshot none (task 7727 ms: download 3711 ms overlapping gunzip 1164 ms, parse 4868 ms, sort 0 ms, write 0 ms, index 847 ms: 8 candidates, 88269 repo-hours, 1298 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:07:19Z [load_day 2025-03-29] 2025-03-29 hour 1: 206684 events in 0 files, snapshot none (task 7383 ms: download 3281 ms overlapping gunzip 1020 ms, parse 4268 ms, sort 0 ms, write 0 ms, index 1331 ms: 4 candidates, 110693 repo-hours, 910 releases; waiting 461 ms; commit 0 ms)
2026-11-08T11:07:26Z [load_day 2025-03-29] 2025-03-29 hour 2: 173756 events in 0 files, snapshot none (task 6012 ms: download 3413 ms overlapping gunzip 923 ms, parse 3758 ms, sort 0 ms, write 0 ms, index 723 ms: 3 candidates, 74032 repo-hours, 792 releases; waiting 338 ms; commit 0 ms)
2026-11-08T11:07:26Z [load_day 2025-03-29] 2025-03-29 hour 3: 182030 events in 0 files, snapshot none (task 6113 ms: download 3124 ms overlapping gunzip 848 ms, parse 3530 ms, sort 0 ms, write 0 ms, index 882 ms: 2 candidates, 71263 repo-hours, 3029 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:07:33Z [load_day 2025-03-29] 2025-03-29 hour 4: 168300 events in 0 files, snapshot none (task 6302 ms: download 3599 ms overlapping gunzip 953 ms, parse 4061 ms, sort 0 ms, write 0 ms, index 501 ms: 5 candidates, 61865 repo-hours, 740 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:07:33Z [load_day 2025-03-29] 2025-03-29 hour 5: 179017 events in 0 files, snapshot none (task 6791 ms: download 4164 ms overlapping gunzip 1055 ms, parse 4471 ms, sort 0 ms, write 0 ms, index 507 ms: 4 candidates, 64087 repo-hours, 772 releases; waiting 483 ms; commit 0 ms)
2026-11-08T11:07:38Z [load_day 2025-03-29] 2025-03-29 hour 6: 198086 events in 0 files, snapshot none (task 5006 ms: download 2333 ms overlapping gunzip 748 ms, parse 3173 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 81163 repo-hours, 1081 releases; waiting 180 ms; commit 0 ms)
2026-11-08T11:07:39Z [load_day 2025-03-29] 2025-03-29 hour 7: 191634 events in 0 files, snapshot none (task 4938 ms: download 3147 ms overlapping gunzip 712 ms, parse 2931 ms, sort 0 ms, write 0 ms, index 516 ms: 5 candidates, 67451 repo-hours, 912 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:07:45Z [load_day 2025-03-29] 2025-03-29 hour 8: 193217 events in 0 files, snapshot none (task 5766 ms: download 3042 ms overlapping gunzip 823 ms, parse 3546 ms, sort 0 ms, write 0 ms, index 571 ms: 4 candidates, 72734 repo-hours, 922 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:07:45Z [load_day 2025-03-29] 2025-03-29 hour 9: 202840 events in 0 files, snapshot none (task 5612 ms: download 3174 ms overlapping gunzip 830 ms, parse 3405 ms, sort 0 ms, write 0 ms, index 561 ms: 4 candidates, 78218 repo-hours, 1204 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:07:51Z [load_day 2025-03-29] 2025-03-29 hour 10: 203670 events in 0 files, snapshot none (task 5347 ms: download 2969 ms overlapping gunzip 753 ms, parse 3247 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 76306 repo-hours, 988 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:07:51Z [load_day 2025-03-29] 2025-03-29 hour 11: 199903 events in 0 files, snapshot none (task 5340 ms: download 3548 ms overlapping gunzip 681 ms, parse 2939 ms, sort 0 ms, write 0 ms, index 538 ms: 9 candidates, 72769 repo-hours, 813 releases; waiting 917 ms; commit 0 ms)
2026-11-08T11:07:58Z [load_day 2025-03-29] 2025-03-29 hour 12: 250192 events in 0 files, snapshot none (task 7177 ms: download 4269 ms overlapping gunzip 1007 ms, parse 4544 ms, sort 0 ms, write 0 ms, index 924 ms: 10 candidates, 122164 repo-hours, 1080 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:07:58Z [load_day 2025-03-29] 2025-03-29 hour 13: 229518 events in 0 files, snapshot none (task 6471 ms: download 3708 ms overlapping gunzip 981 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 772 ms: 4 candidates, 100389 repo-hours, 930 releases; waiting 189 ms; commit 0 ms)
2026-11-08T11:08:06Z [load_day 2025-03-29] 2025-03-29 hour 14: 219033 events in 0 files, snapshot none (task 7425 ms: download 4078 ms overlapping gunzip 1186 ms, parse 4820 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 84314 repo-hours, 1096 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:08:06Z [load_day 2025-03-29] 2025-03-29 hour 15: 228967 events in 0 files, snapshot none (task 7037 ms: download 3814 ms overlapping gunzip 1035 ms, parse 4289 ms, sort 0 ms, write 0 ms, index 930 ms: 3 candidates, 92641 repo-hours, 1083 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:08:14Z [load_day 2025-03-29] 2025-03-29 hour 16: 223966 events in 0 files, snapshot none (task 7438 ms: download 4521 ms overlapping gunzip 1102 ms, parse 4728 ms, sort 0 ms, write 0 ms, index 722 ms: 7 candidates, 86722 repo-hours, 1213 releases; waiting 593 ms; commit 0 ms)
2026-11-08T11:08:14Z [load_day 2025-03-29] 2025-03-29 hour 17: 217770 events in 0 files, snapshot none (task 6914 ms: download 3973 ms overlapping gunzip 1070 ms, parse 4342 ms, sort 0 ms, write 0 ms, index 696 ms: 0 candidates, 80856 repo-hours, 969 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:08:22Z [load_day 2025-03-29] 2025-03-29 hour 18: 230502 events in 0 files, snapshot none (task 7331 ms: download 4570 ms overlapping gunzip 1106 ms, parse 4946 ms, sort 0 ms, write 0 ms, index 693 ms: 6 candidates, 96371 repo-hours, 1146 releases; waiting 287 ms; commit 0 ms)
2026-11-08T11:08:22Z [load_day 2025-03-29] 2025-03-29 hour 19: 204856 events in 0 files, snapshot none (task 6919 ms: download 4178 ms overlapping gunzip 1013 ms, parse 4570 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 73329 repo-hours, 939 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:08:29Z [load_day 2025-03-29] 2025-03-29 hour 20: 201315 events in 0 files, snapshot none (task 6368 ms: download 3619 ms overlapping gunzip 1006 ms, parse 4202 ms, sort 0 ms, write 0 ms, index 601 ms: 3 candidates, 72753 repo-hours, 950 releases; waiting 344 ms; commit 0 ms)
2026-11-08T11:08:29Z [load_day 2025-03-29] 2025-03-29 hour 21: 197610 events in 0 files, snapshot none (task 6737 ms: download 4035 ms overlapping gunzip 1004 ms, parse 4356 ms, sort 0 ms, write 0 ms, index 571 ms: 3 candidates, 72904 repo-hours, 1069 releases; waiting 486 ms; commit 0 ms)
2026-11-08T11:08:35Z [load_day 2025-03-29] 2025-03-29 hour 22: 178976 events in 0 files, snapshot none (task 6156 ms: download 3227 ms overlapping gunzip 933 ms, parse 3942 ms, sort 0 ms, write 0 ms, index 724 ms: 2 candidates, 64504 repo-hours, 1050 releases; waiting 306 ms; commit 0 ms)
2026-11-08T11:08:35Z [load_day 2025-03-29] 2025-03-29 hour 23: 170129 events in 0 files, snapshot none (task 5899 ms: download 3115 ms overlapping gunzip 869 ms, parse 3902 ms, sort 0 ms, write 0 ms, index 479 ms: 9 candidates, 59497 repo-hours, 1023 releases; waiting 282 ms; commit 0 ms)
2026-11-08T11:08:44Z [load_day 2025-03-29] 2025-03-29: repo_hour merged from 24 files to 1 (1925294 rows, 8277 ms)
2026-11-08T11:08:46Z [load_day 2025-03-29] 2025-03-29: index committed in 11021 ms (23 + 1 + 24 files)
2026-11-08T11:08:46Z [load_day 2025-03-29] 2025-03-29: 4842911 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:08:46Z [load_day 2025-03-29] attempt 1 succeeded