orcaLog in

Runs · run 3591

load_day 2025-02-22, attempt 1 succeeded

Host
73ccef5e07c2:259396
Started
2026-11-08T10:28:42Z
Ended
2026-11-08T10:30:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
750 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
150.8 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3591/load_day/2025-02-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:28:42Z [load_day 2025-02-22] attempt 1 started
2026-11-08T10:28:43Z [load_day 2025-02-22] 2025-02-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:28:51Z [load_day 2025-02-22] 2025-02-22 hour 0: 206865 events in 0 files, snapshot none (task 7374 ms: download 3703 ms overlapping gunzip 1123 ms, parse 4900 ms, sort 0 ms, write 0 ms, index 754 ms: 8 candidates, 96772 repo-hours, 1283 releases; waiting 331 ms; commit 0 ms)
2026-11-08T10:28:51Z [load_day 2025-02-22] 2025-02-22 hour 1: 217884 events in 0 files, snapshot none (task 6906 ms: download 3617 ms overlapping gunzip 975 ms, parse 4083 ms, sort 0 ms, write 0 ms, index 1131 ms: 13 candidates, 111428 repo-hours, 981 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:28:57Z [load_day 2025-02-22] 2025-02-22 hour 2: 189128 events in 0 files, snapshot none (task 5796 ms: download 3712 ms overlapping gunzip 822 ms, parse 3510 ms, sort 0 ms, write 0 ms, index 663 ms: 9 candidates, 76141 repo-hours, 853 releases; waiting 532 ms; commit 0 ms)
2026-11-08T10:28:58Z [load_day 2025-02-22] 2025-02-22 hour 3: 198922 events in 0 files, snapshot none (task 6518 ms: download 3430 ms overlapping gunzip 944 ms, parse 4014 ms, sort 0 ms, write 0 ms, index 800 ms: 12 candidates, 73818 repo-hours, 3888 releases; waiting 183 ms; commit 0 ms)
2026-11-08T10:29:05Z [load_day 2025-02-22] 2025-02-22 hour 4: 180621 events in 0 files, snapshot none (task 7341 ms: download 4432 ms overlapping gunzip 948 ms, parse 4047 ms, sort 0 ms, write 0 ms, index 474 ms: 7 candidates, 65178 repo-hours, 668 releases; waiting 1554 ms; commit 0 ms)
2026-11-08T10:29:05Z [load_day 2025-02-22] 2025-02-22 hour 5: 186822 events in 0 files, snapshot none (task 6330 ms: download 3280 ms overlapping gunzip 983 ms, parse 3938 ms, sort 0 ms, write 0 ms, index 621 ms: 5 candidates, 68711 repo-hours, 750 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:29:14Z [load_day 2025-02-22] 2025-02-22 hour 6: 196935 events in 0 files, snapshot none (task 8113 ms: download 4331 ms overlapping gunzip 1213 ms, parse 5241 ms, sort 0 ms, write 0 ms, index 805 ms: 4 candidates, 84544 repo-hours, 1172 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:29:14Z [load_day 2025-02-22] 2025-02-22 hour 7: 191891 events in 0 files, snapshot none (task 7754 ms: download 4304 ms overlapping gunzip 1142 ms, parse 4775 ms, sort 0 ms, write 0 ms, index 958 ms: 11 candidates, 70421 repo-hours, 929 releases; waiting 597 ms; commit 0 ms)
2026-11-08T10:29:21Z [load_day 2025-02-22] 2025-02-22 hour 8: 194896 events in 0 files, snapshot none (task 6523 ms: download 3219 ms overlapping gunzip 981 ms, parse 4115 ms, sort 0 ms, write 0 ms, index 673 ms: 6 candidates, 75043 repo-hours, 989 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:29:21Z [load_day 2025-02-22] 2025-02-22 hour 9: 207604 events in 0 files, snapshot none (task 6812 ms: download 3361 ms overlapping gunzip 978 ms, parse 4137 ms, sort 0 ms, write 0 ms, index 902 ms: 11 candidates, 82244 repo-hours, 1049 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:29:28Z [load_day 2025-02-22] 2025-02-22 hour 10: 204962 events in 0 files, snapshot none (task 6948 ms: download 4247 ms overlapping gunzip 927 ms, parse 4444 ms, sort 0 ms, write 0 ms, index 708 ms: 4 candidates, 78987 repo-hours, 942 releases; waiting 545 ms; commit 0 ms)
2026-11-08T10:29:28Z [load_day 2025-02-22] 2025-02-22 hour 11: 205880 events in 0 files, snapshot none (task 6405 ms: download 3653 ms overlapping gunzip 944 ms, parse 4044 ms, sort 0 ms, write 0 ms, index 630 ms: 8 candidates, 75078 repo-hours, 710 releases; waiting 441 ms; commit 0 ms)
2026-11-08T10:29:36Z [load_day 2025-02-22] 2025-02-22 hour 12: 266205 events in 0 files, snapshot none (task 7488 ms: download 4504 ms overlapping gunzip 1068 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 854 ms: 7 candidates, 126289 repo-hours, 1036 releases; waiting 345 ms; commit 0 ms)
2026-11-08T10:29:36Z [load_day 2025-02-22] 2025-02-22 hour 13: 232390 events in 0 files, snapshot none (task 6913 ms: download 4130 ms overlapping gunzip 1053 ms, parse 4589 ms, sort 0 ms, write 0 ms, index 765 ms: 15 candidates, 101923 repo-hours, 845 releases; waiting 185 ms; commit 0 ms)
2026-11-08T10:29:44Z [load_day 2025-02-22] 2025-02-22 hour 14: 222310 events in 0 files, snapshot none (task 6956 ms: download 4249 ms overlapping gunzip 1022 ms, parse 4511 ms, sort 0 ms, write 0 ms, index 678 ms: 7 candidates, 85402 repo-hours, 946 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:29:44Z [load_day 2025-02-22] 2025-02-22 hour 15: 231480 events in 0 files, snapshot none (task 7060 ms: download 4287 ms overlapping gunzip 1027 ms, parse 4512 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 92963 repo-hours, 1225 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:29:50Z [load_day 2025-02-22] 2025-02-22 hour 16: 222355 events in 0 files, snapshot none (task 5908 ms: download 3328 ms overlapping gunzip 823 ms, parse 3643 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 86765 repo-hours, 971 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:29:50Z [load_day 2025-02-22] 2025-02-22 hour 17: 217127 events in 0 files, snapshot none (task 5883 ms: download 3230 ms overlapping gunzip 810 ms, parse 3602 ms, sort 0 ms, write 0 ms, index 684 ms: 5 candidates, 83705 repo-hours, 942 releases; waiting 558 ms; commit 0 ms)
2026-11-08T10:29:57Z [load_day 2025-02-22] 2025-02-22 hour 18: 229271 events in 0 files, snapshot none (task 6177 ms: download 3565 ms overlapping gunzip 865 ms, parse 3850 ms, sort 0 ms, write 0 ms, index 749 ms: 7 candidates, 97749 repo-hours, 1104 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:29:57Z [load_day 2025-02-22] 2025-02-22 hour 19: 204200 events in 0 files, snapshot none (task 5099 ms: download 2517 ms overlapping gunzip 765 ms, parse 3228 ms, sort 0 ms, write 0 ms, index 633 ms: 6 candidates, 73361 repo-hours, 914 releases; waiting 187 ms; commit 0 ms)
2026-11-08T10:30:03Z [load_day 2025-02-22] 2025-02-22 hour 20: 200434 events in 0 files, snapshot none (task 5424 ms: download 2670 ms overlapping gunzip 771 ms, parse 3394 ms, sort 0 ms, write 0 ms, index 785 ms: 7 candidates, 74712 repo-hours, 817 releases; waiting 264 ms; commit 0 ms)
2026-11-08T10:30:09Z [load_day 2025-02-22] 2025-02-22 hour 21: 286577 events in 0 files, snapshot none (task 12157 ms: download 10330 ms overlapping gunzip 2351 ms, parse 6274 ms, sort 0 ms, write 0 ms, index 485 ms: 3 candidates, 68412 repo-hours, 701 releases; waiting 2778 ms; commit 0 ms)
2026-11-08T10:30:11Z [load_day 2025-02-22] 2025-02-22 hour 22: 211257 events in 0 files, snapshot none (task 7388 ms: download 4373 ms overlapping gunzip 1433 ms, parse 4789 ms, sort 0 ms, write 0 ms, index 599 ms: 6 candidates, 66831 repo-hours, 859 releases; waiting 196 ms; commit 0 ms)
2026-11-08T10:30:15Z [load_day 2025-02-22] 2025-02-22 hour 23: 172578 events in 0 files, snapshot none (task 5038 ms: download 2861 ms overlapping gunzip 737 ms, parse 3050 ms, sort 0 ms, write 0 ms, index 555 ms: 6 candidates, 63070 repo-hours, 861 releases; waiting 360 ms; commit 0 ms)
2026-11-08T10:30:24Z [load_day 2025-02-22] 2025-02-22: repo_hour merged from 24 files to 1 (1979547 rows, 9214 ms)
2026-11-08T10:30:27Z [load_day 2025-02-22] 2025-02-22: index committed in 12118 ms (24 + 1 + 24 files)
2026-11-08T10:30:27Z [load_day 2025-02-22] 2025-02-22: 5078594 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:30:27Z [load_day 2025-02-22] attempt 1 succeeded