orcaLog in

Runs · run 3355

load_day 2024-12-23, attempt 1 succeeded

Host
73ccef5e07c2:226927
Started
2026-11-08T09:30:07Z
Ended
2026-11-08T09:32:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3355/load_day/2024-12-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:30:07Z [load_day 2024-12-23] attempt 1 started
2026-11-08T09:30:08Z [load_day 2024-12-23] 2024-12-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:30:16Z [load_day 2024-12-23] 2024-12-23 hour 0: 175144 events in 0 files, snapshot none (task 7315 ms: download 4761 ms overlapping gunzip 1242 ms, parse 4695 ms, sort 0 ms, write 0 ms, index 557 ms: 6 candidates, 78831 repo-hours, 1083 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:30:16Z [load_day 2024-12-23] 2024-12-23 hour 1: 194891 events in 0 files, snapshot none (task 7336 ms: download 4561 ms overlapping gunzip 1160 ms, parse 4605 ms, sort 0 ms, write 0 ms, index 774 ms: 7 candidates, 105195 repo-hours, 968 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:30:24Z [load_day 2024-12-23] 2024-12-23 hour 2: 171169 events in 0 files, snapshot none (task 7529 ms: download 4831 ms overlapping gunzip 1180 ms, parse 4760 ms, sort 0 ms, write 0 ms, index 785 ms: 6 candidates, 74275 repo-hours, 1087 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:30:24Z [load_day 2024-12-23] 2024-12-23 hour 3: 186312 events in 0 files, snapshot none (task 7784 ms: download 5005 ms overlapping gunzip 1226 ms, parse 4770 ms, sort 0 ms, write 0 ms, index 924 ms: 9 candidates, 72152 repo-hours, 4183 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:30:30Z [load_day 2024-12-23] 2024-12-23 hour 4: 170870 events in 0 files, snapshot none (task 5702 ms: download 3504 ms overlapping gunzip 949 ms, parse 3450 ms, sort 0 ms, write 0 ms, index 485 ms: 4 candidates, 61982 repo-hours, 667 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:30:30Z [load_day 2024-12-23] 2024-12-23 hour 5: 179038 events in 0 files, snapshot none (task 5723 ms: download 3486 ms overlapping gunzip 935 ms, parse 3505 ms, sort 0 ms, write 0 ms, index 549 ms: 8 candidates, 66750 repo-hours, 698 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:30:39Z [load_day 2024-12-23] 2024-12-23 hour 6: 203883 events in 0 files, snapshot none (task 8245 ms: download 4322 ms overlapping gunzip 1234 ms, parse 4571 ms, sort 0 ms, write 0 ms, index 1583 ms: 3 candidates, 87097 repo-hours, 962 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:30:41Z [load_day 2024-12-23] 2024-12-23 hour 7: 200907 events in 0 files, snapshot none (task 9815 ms: download 7107 ms overlapping gunzip 1490 ms, parse 5834 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 75296 repo-hours, 770 releases; waiting 1408 ms; commit 0 ms)
2026-11-08T09:30:49Z [load_day 2024-12-23] 2024-12-23 hour 8: 207588 events in 0 files, snapshot none (task 9006 ms: download 5951 ms overlapping gunzip 1490 ms, parse 5880 ms, sort 0 ms, write 0 ms, index 753 ms: 11 candidates, 82055 repo-hours, 903 releases; waiting 537 ms; commit 0 ms)
2026-11-08T09:30:50Z [load_day 2024-12-23] 2024-12-23 hour 9: 215999 events in 0 files, snapshot none (task 8815 ms: download 6276 ms overlapping gunzip 1395 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 716 ms: 4 candidates, 87995 repo-hours, 1144 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:30:58Z [load_day 2024-12-23] 2024-12-23 hour 10: 208857 events in 0 files, snapshot none (task 9091 ms: download 6143 ms overlapping gunzip 1451 ms, parse 5661 ms, sort 0 ms, write 0 ms, index 1021 ms: 7 candidates, 82037 repo-hours, 1100 releases; waiting 648 ms; commit 0 ms)
2026-11-08T09:30:59Z [load_day 2024-12-23] 2024-12-23 hour 11: 209673 events in 0 files, snapshot none (task 8297 ms: download 5341 ms overlapping gunzip 1461 ms, parse 5656 ms, sort 0 ms, write 0 ms, index 656 ms: 11 candidates, 78454 repo-hours, 948 releases; waiting 216 ms; commit 0 ms)
2026-11-08T09:31:07Z [load_day 2024-12-23] 2024-12-23 hour 12: 254974 events in 0 files, snapshot none (task 8668 ms: download 5281 ms overlapping gunzip 1316 ms, parse 5691 ms, sort 0 ms, write 0 ms, index 907 ms: 9 candidates, 126270 repo-hours, 1171 releases; waiting 381 ms; commit 0 ms)
2026-11-08T09:31:08Z [load_day 2024-12-23] 2024-12-23 hour 13: 230233 events in 0 files, snapshot none (task 8585 ms: download 6015 ms overlapping gunzip 1402 ms, parse 5750 ms, sort 0 ms, write 0 ms, index 741 ms: 2 candidates, 104334 repo-hours, 1018 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:31:16Z [load_day 2024-12-23] 2024-12-23 hour 14: 219294 events in 0 files, snapshot none (task 7901 ms: download 5493 ms overlapping gunzip 1269 ms, parse 4817 ms, sort 0 ms, write 0 ms, index 646 ms: 3 candidates, 87348 repo-hours, 1082 releases; waiting 776 ms; commit 0 ms)
2026-11-08T09:31:16Z [load_day 2024-12-23] 2024-12-23 hour 15: 231060 events in 0 files, snapshot none (task 7408 ms: download 4962 ms overlapping gunzip 1193 ms, parse 4665 ms, sort 0 ms, write 0 ms, index 683 ms: 7 candidates, 94063 repo-hours, 1406 releases; waiting 538 ms; commit 0 ms)
2026-11-08T09:31:24Z [load_day 2024-12-23] 2024-12-23 hour 16: 224109 events in 0 files, snapshot none (task 8156 ms: download 4907 ms overlapping gunzip 1364 ms, parse 5382 ms, sort 0 ms, write 0 ms, index 694 ms: 3 candidates, 86952 repo-hours, 1186 releases; waiting 387 ms; commit 0 ms)
2026-11-08T09:31:25Z [load_day 2024-12-23] 2024-12-23 hour 17: 207912 events in 0 files, snapshot none (task 8235 ms: download 5403 ms overlapping gunzip 1359 ms, parse 5479 ms, sort 0 ms, write 0 ms, index 614 ms: 3 candidates, 79783 repo-hours, 950 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:31:34Z [load_day 2024-12-23] 2024-12-23 hour 18: 218110 events in 0 files, snapshot none (task 8518 ms: download 5968 ms overlapping gunzip 1367 ms, parse 5562 ms, sort 0 ms, write 0 ms, index 736 ms: 1 candidates, 94681 repo-hours, 1085 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:31:34Z [load_day 2024-12-23] 2024-12-23 hour 19: 195502 events in 0 files, snapshot none (task 7897 ms: download 5123 ms overlapping gunzip 1370 ms, parse 5383 ms, sort 0 ms, write 0 ms, index 622 ms: 4 candidates, 71442 repo-hours, 880 releases; waiting 292 ms; commit 0 ms)
2026-11-08T09:31:42Z [load_day 2024-12-23] 2024-12-23 hour 20: 189401 events in 0 files, snapshot none (task 7600 ms: download 5028 ms overlapping gunzip 1312 ms, parse 5059 ms, sort 0 ms, write 0 ms, index 622 ms: 5 candidates, 69868 repo-hours, 905 releases; waiting 252 ms; commit 0 ms)
2026-11-08T09:31:43Z [load_day 2024-12-23] 2024-12-23 hour 21: 182630 events in 0 files, snapshot none (task 8714 ms: download 6064 ms overlapping gunzip 1373 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 658 ms: 5 candidates, 68728 repo-hours, 1047 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:31:49Z [load_day 2024-12-23] 2024-12-23 hour 22: 169789 events in 0 files, snapshot none (task 7187 ms: download 4619 ms overlapping gunzip 1226 ms, parse 4566 ms, sort 0 ms, write 0 ms, index 560 ms: 11 candidates, 58638 repo-hours, 1155 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:31:50Z [load_day 2024-12-23] 2024-12-23 hour 23: 167105 events in 0 files, snapshot none (task 6845 ms: download 4889 ms overlapping gunzip 1166 ms, parse 4275 ms, sort 0 ms, write 0 ms, index 458 ms: 8 candidates, 57406 repo-hours, 743 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:31:59Z [load_day 2024-12-23] 2024-12-23: repo_hour merged from 24 files to 1 (1951632 rows, 8329 ms)
2026-11-08T09:32:01Z [load_day 2024-12-23] 2024-12-23: index committed in 10924 ms (24 + 1 + 24 files)
2026-11-08T09:32:01Z [load_day 2024-12-23] 2024-12-23: 4814450 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:32:01Z [load_day 2024-12-23] attempt 1 succeeded