orcaLog in

Runs · run 4177

load_day 2025-07-22, attempt 1 succeeded

Host
73ccef5e07c2:346851
Started
2026-11-08T13:02:27Z
Ended
2026-11-08T13:04:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
713 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
161.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4177/load_day/2025-07-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:02:27Z [load_day 2025-07-22] attempt 1 started
2026-11-08T13:02:27Z [load_day 2025-07-22] 2025-07-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:02:35Z [load_day 2025-07-22] 2025-07-22 hour 0: 149234 events in 0 files, snapshot none (task 6780 ms: download 4344 ms overlapping gunzip 1095 ms, parse 4203 ms, sort 0 ms, write 0 ms, index 705 ms: 4 candidates, 75011 repo-hours, 943 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:02:35Z [load_day 2025-07-22] 2025-07-22 hour 1: 157978 events in 0 files, snapshot none (task 6517 ms: download 4005 ms overlapping gunzip 1046 ms, parse 4149 ms, sort 0 ms, write 0 ms, index 754 ms: 5 candidates, 93256 repo-hours, 676 releases; waiting 281 ms; commit 0 ms)
2026-11-08T13:02:42Z [load_day 2025-07-22] 2025-07-22 hour 2: 156341 events in 0 files, snapshot none (task 6705 ms: download 3626 ms overlapping gunzip 983 ms, parse 3648 ms, sort 0 ms, write 0 ms, index 1249 ms: 5 candidates, 85315 repo-hours, 771 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:02:47Z [load_day 2025-07-22] 2025-07-22 hour 3: 151427 events in 0 files, snapshot none (task 11413 ms: download 8173 ms overlapping gunzip 1190 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 961 ms: 3 candidates, 72779 repo-hours, 924 releases; waiting 4083 ms; commit 0 ms)
2026-11-08T13:02:49Z [load_day 2025-07-22] 2025-07-22 hour 4: 149845 events in 0 files, snapshot none (task 6107 ms: download 3712 ms overlapping gunzip 994 ms, parse 3748 ms, sort 0 ms, write 0 ms, index 593 ms: 5 candidates, 69590 repo-hours, 1874 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:02:55Z [load_day 2025-07-22] 2025-07-22 hour 5: 154820 events in 0 files, snapshot none (task 7195 ms: download 3681 ms overlapping gunzip 1139 ms, parse 4478 ms, sort 0 ms, write 0 ms, index 790 ms: 6 candidates, 69949 repo-hours, 691 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:02:57Z [load_day 2025-07-22] 2025-07-22 hour 6: 158093 events in 0 files, snapshot none (task 6578 ms: download 4057 ms overlapping gunzip 1053 ms, parse 4066 ms, sort 0 ms, write 0 ms, index 637 ms: 7 candidates, 82144 repo-hours, 894 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:03:02Z [load_day 2025-07-22] 2025-07-22 hour 7: 156584 events in 0 files, snapshot none (task 6394 ms: download 3468 ms overlapping gunzip 904 ms, parse 3664 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 77528 repo-hours, 797 releases; waiting 583 ms; commit 0 ms)
2026-11-08T13:03:04Z [load_day 2025-07-22] 2025-07-22 hour 8: 163753 events in 0 files, snapshot none (task 6540 ms: download 4043 ms overlapping gunzip 997 ms, parse 4010 ms, sort 0 ms, write 0 ms, index 687 ms: 4 candidates, 82362 repo-hours, 978 releases; waiting 539 ms; commit 0 ms)
2026-11-08T13:03:08Z [load_day 2025-07-22] 2025-07-22 hour 9: 161477 events in 0 files, snapshot none (task 5855 ms: download 3331 ms overlapping gunzip 959 ms, parse 3676 ms, sort 0 ms, write 0 ms, index 699 ms: 6 candidates, 81370 repo-hours, 889 releases; waiting 233 ms; commit 0 ms)
2026-11-08T13:03:10Z [load_day 2025-07-22] 2025-07-22 hour 10: 160482 events in 0 files, snapshot none (task 5604 ms: download 3299 ms overlapping gunzip 895 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 78925 repo-hours, 777 releases; waiting 223 ms; commit 0 ms)
2026-11-08T13:03:16Z [load_day 2025-07-22] 2025-07-22 hour 11: 159673 events in 0 files, snapshot none (task 6947 ms: download 3705 ms overlapping gunzip 978 ms, parse 3864 ms, sort 0 ms, write 0 ms, index 1267 ms: 6 candidates, 77102 repo-hours, 735 releases; waiting 623 ms; commit 0 ms)
2026-11-08T13:03:19Z [load_day 2025-07-22] 2025-07-22 hour 12: 170295 events in 0 files, snapshot none (task 9238 ms: download 5256 ms overlapping gunzip 1316 ms, parse 5335 ms, sort 0 ms, write 0 ms, index 1254 ms: 5 candidates, 99467 repo-hours, 829 releases; waiting 872 ms; commit 0 ms)
2026-11-08T13:03:25Z [load_day 2025-07-22] 2025-07-22 hour 13: 168769 events in 0 files, snapshot none (task 8474 ms: download 4926 ms overlapping gunzip 1336 ms, parse 5121 ms, sort 0 ms, write 0 ms, index 1156 ms: 10 candidates, 93488 repo-hours, 898 releases; waiting 489 ms; commit 0 ms)
2026-11-08T13:03:28Z [load_day 2025-07-22] 2025-07-22 hour 14: 165355 events in 0 files, snapshot none (task 7638 ms: download 4824 ms overlapping gunzip 1179 ms, parse 4693 ms, sort 0 ms, write 0 ms, index 920 ms: 7 candidates, 85102 repo-hours, 938 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:03:33Z [load_day 2025-07-22] 2025-07-22 hour 15: 166641 events in 0 files, snapshot none (task 7655 ms: download 3810 ms overlapping gunzip 1140 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 866 ms: 6 candidates, 86000 repo-hours, 1063 releases; waiting 638 ms; commit 0 ms)
2026-11-08T13:03:36Z [load_day 2025-07-22] 2025-07-22 hour 16: 164469 events in 0 files, snapshot none (task 7476 ms: download 4944 ms overlapping gunzip 1271 ms, parse 4766 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 81187 repo-hours, 858 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:03:43Z [load_day 2025-07-22] 2025-07-22 hour 17: 162203 events in 0 files, snapshot none (task 9340 ms: download 6144 ms overlapping gunzip 1432 ms, parse 5613 ms, sort 0 ms, write 0 ms, index 797 ms: 8 candidates, 77667 repo-hours, 857 releases; waiting 1213 ms; commit 0 ms)
2026-11-08T13:03:44Z [load_day 2025-07-22] 2025-07-22 hour 18: 160521 events in 0 files, snapshot none (task 7675 ms: download 4857 ms overlapping gunzip 1236 ms, parse 4963 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 82123 repo-hours, 931 releases; waiting 453 ms; commit 0 ms)
2026-11-08T13:03:52Z [load_day 2025-07-22] 2025-07-22 hour 19: 156018 events in 0 files, snapshot none (task 8652 ms: download 5893 ms overlapping gunzip 1385 ms, parse 5824 ms, sort 0 ms, write 0 ms, index 580 ms: 12 candidates, 69537 repo-hours, 870 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:03:53Z [load_day 2025-07-22] 2025-07-22 hour 20: 157696 events in 0 files, snapshot none (task 8432 ms: download 6039 ms overlapping gunzip 1378 ms, parse 5733 ms, sort 0 ms, write 0 ms, index 568 ms: 10 candidates, 69923 repo-hours, 815 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:04:00Z [load_day 2025-07-22] 2025-07-22 hour 21: 154178 events in 0 files, snapshot none (task 7650 ms: download 5215 ms overlapping gunzip 1197 ms, parse 5181 ms, sort 0 ms, write 0 ms, index 505 ms: 8 candidates, 65948 repo-hours, 926 releases; waiting 532 ms; commit 0 ms)
2026-11-08T13:04:00Z [load_day 2025-07-22] 2025-07-22 hour 22: 146891 events in 0 files, snapshot none (task 6930 ms: download 4405 ms overlapping gunzip 1121 ms, parse 4567 ms, sort 0 ms, write 0 ms, index 456 ms: 4 candidates, 59395 repo-hours, 963 releases; waiting 457 ms; commit 0 ms)
2026-11-08T13:04:06Z [load_day 2025-07-22] 2025-07-22 hour 23: 143425 events in 0 files, snapshot none (task 5486 ms: download 3349 ms overlapping gunzip 885 ms, parse 3533 ms, sort 0 ms, write 0 ms, index 437 ms: 8 candidates, 57310 repo-hours, 1031 releases; waiting 388 ms; commit 0 ms)
2026-11-08T13:04:16Z [load_day 2025-07-22] 2025-07-22: repo_hour merged from 24 files to 1 (1872478 rows, 9258 ms)
2026-11-08T13:04:18Z [load_day 2025-07-22] 2025-07-22: index committed in 12221 ms (24 + 1 + 24 files)
2026-11-08T13:04:18Z [load_day 2025-07-22] 2025-07-22: 3796168 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:04:18Z [load_day 2025-07-22] attempt 1 succeeded