orcaLog in

Runs · run 3332

load_day 2024-12-17, attempt 1 succeeded

Host
73ccef5e07c2:224231
Started
2026-11-08T09:24:34Z
Ended
2026-11-08T09:26:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
715 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
186.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3332/load_day/2024-12-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:24:34Z [load_day 2024-12-17] attempt 1 started
2026-11-08T09:24:35Z [load_day 2024-12-17] 2024-12-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:24:43Z [load_day 2024-12-17] 2024-12-17 hour 0: 193351 events in 0 files, snapshot none (task 7140 ms: download 4319 ms overlapping gunzip 1014 ms, parse 4612 ms, sort 0 ms, write 0 ms, index 723 ms: 10 candidates, 84261 repo-hours, 1267 releases; waiting 472 ms; commit 0 ms)
2026-11-08T09:24:43Z [load_day 2024-12-17] 2024-12-17 hour 1: 209800 events in 0 files, snapshot none (task 7985 ms: download 3636 ms overlapping gunzip 1155 ms, parse 5003 ms, sort 0 ms, write 0 ms, index 895 ms: 9 candidates, 112132 repo-hours, 916 releases; waiting 545 ms; commit 0 ms)
2026-11-08T09:24:50Z [load_day 2024-12-17] 2024-12-17 hour 2: 189013 events in 0 files, snapshot none (task 6628 ms: download 4020 ms overlapping gunzip 1061 ms, parse 4201 ms, sort 0 ms, write 0 ms, index 537 ms: 9 candidates, 76136 repo-hours, 964 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:24:51Z [load_day 2024-12-17] 2024-12-17 hour 3: 204849 events in 0 files, snapshot none (task 6764 ms: download 4052 ms overlapping gunzip 972 ms, parse 4187 ms, sort 0 ms, write 0 ms, index 694 ms: 9 candidates, 78443 repo-hours, 3958 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:24:58Z [load_day 2024-12-17] 2024-12-17 hour 4: 186676 events in 0 files, snapshot none (task 7274 ms: download 4346 ms overlapping gunzip 1100 ms, parse 4677 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 64423 repo-hours, 704 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:24:59Z [load_day 2024-12-17] 2024-12-17 hour 5: 190339 events in 0 files, snapshot none (task 7328 ms: download 4203 ms overlapping gunzip 1074 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 70241 repo-hours, 731 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:25:06Z [load_day 2024-12-17] 2024-12-17 hour 6: 208075 events in 0 files, snapshot none (task 7904 ms: download 4015 ms overlapping gunzip 1212 ms, parse 4769 ms, sort 0 ms, write 0 ms, index 860 ms: 4 candidates, 92956 repo-hours, 1017 releases; waiting 537 ms; commit 0 ms)
2026-11-08T09:25:07Z [load_day 2024-12-17] 2024-12-17 hour 7: 191872 events in 0 files, snapshot none (task 7694 ms: download 4447 ms overlapping gunzip 1197 ms, parse 4784 ms, sort 0 ms, write 0 ms, index 790 ms: 4 candidates, 77709 repo-hours, 840 releases; waiting 538 ms; commit 0 ms)
2026-11-08T09:25:15Z [load_day 2024-12-17] 2024-12-17 hour 8: 218933 events in 0 files, snapshot none (task 7883 ms: download 4887 ms overlapping gunzip 1309 ms, parse 5135 ms, sort 0 ms, write 0 ms, index 882 ms: 13 candidates, 91163 repo-hours, 1082 releases; waiting 236 ms; commit 0 ms)
2026-11-08T09:25:15Z [load_day 2024-12-17] 2024-12-17 hour 9: 227060 events in 0 files, snapshot none (task 8366 ms: download 5558 ms overlapping gunzip 1293 ms, parse 5539 ms, sort 0 ms, write 0 ms, index 726 ms: 5 candidates, 97114 repo-hours, 1395 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:25:24Z [load_day 2024-12-17] 2024-12-17 hour 10: 218215 events in 0 files, snapshot none (task 8528 ms: download 5981 ms overlapping gunzip 1343 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 669 ms: 9 candidates, 91775 repo-hours, 1149 releases; waiting 450 ms; commit 0 ms)
2026-11-08T09:25:24Z [load_day 2024-12-17] 2024-12-17 hour 11: 215871 events in 0 files, snapshot none (task 8284 ms: download 5563 ms overlapping gunzip 1250 ms, parse 5680 ms, sort 0 ms, write 0 ms, index 812 ms: 5 candidates, 87914 repo-hours, 1149 releases; waiting 212 ms; commit 0 ms)
2026-11-08T09:25:33Z [load_day 2024-12-17] 2024-12-17 hour 12: 237241 events in 0 files, snapshot none (task 8486 ms: download 5283 ms overlapping gunzip 1234 ms, parse 5538 ms, sort 0 ms, write 0 ms, index 832 ms: 9 candidates, 121916 repo-hours, 1267 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:25:34Z [load_day 2024-12-17] 2024-12-17 hour 13: 235237 events in 0 files, snapshot none (task 9065 ms: download 6447 ms overlapping gunzip 1438 ms, parse 6105 ms, sort 0 ms, write 0 ms, index 769 ms: 9 candidates, 107755 repo-hours, 1162 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:25:43Z [load_day 2024-12-17] 2024-12-17 hour 14: 232447 events in 0 files, snapshot none (task 10031 ms: download 7489 ms overlapping gunzip 1625 ms, parse 6888 ms, sort 0 ms, write 0 ms, index 712 ms: 13 candidates, 98290 repo-hours, 1265 releases; waiting 530 ms; commit 0 ms)
2026-11-08T09:25:45Z [load_day 2024-12-17] 2024-12-17 hour 15: 255050 events in 0 files, snapshot none (task 10627 ms: download 7767 ms overlapping gunzip 1627 ms, parse 7209 ms, sort 0 ms, write 0 ms, index 745 ms: 19 candidates, 109564 repo-hours, 1369 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:25:52Z [load_day 2024-12-17] 2024-12-17 hour 16: 225748 events in 0 files, snapshot none (task 8218 ms: download 5627 ms overlapping gunzip 1266 ms, parse 5414 ms, sort 0 ms, write 0 ms, index 686 ms: 21 candidates, 99331 repo-hours, 1242 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:25:53Z [load_day 2024-12-17] 2024-12-17 hour 17: 221663 events in 0 files, snapshot none (task 7495 ms: download 4925 ms overlapping gunzip 1245 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 675 ms: 15 candidates, 91877 repo-hours, 1112 releases; waiting 170 ms; commit 0 ms)
2026-11-08T09:26:01Z [load_day 2024-12-17] 2024-12-17 hour 18: 221347 events in 0 files, snapshot none (task 8845 ms: download 5390 ms overlapping gunzip 1407 ms, parse 5781 ms, sort 0 ms, write 0 ms, index 830 ms: 18 candidates, 99031 repo-hours, 1279 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:26:02Z [load_day 2024-12-17] 2024-12-17 hour 19: 211531 events in 0 files, snapshot none (task 8522 ms: download 5744 ms overlapping gunzip 1334 ms, parse 5728 ms, sort 0 ms, write 0 ms, index 634 ms: 10 candidates, 86731 repo-hours, 1052 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:26:10Z [load_day 2024-12-17] 2024-12-17 hour 20: 203880 events in 0 files, snapshot none (task 8228 ms: download 5319 ms overlapping gunzip 1254 ms, parse 5510 ms, sort 0 ms, write 0 ms, index 639 ms: 7 candidates, 81063 repo-hours, 1078 releases; waiting 549 ms; commit 0 ms)
2026-11-08T09:26:11Z [load_day 2024-12-17] 2024-12-17 hour 21: 197266 events in 0 files, snapshot none (task 8353 ms: download 5587 ms overlapping gunzip 1275 ms, parse 5572 ms, sort 0 ms, write 0 ms, index 591 ms: 8 candidates, 78938 repo-hours, 1085 releases; waiting 574 ms; commit 0 ms)
2026-11-08T09:26:19Z [load_day 2024-12-17] 2024-12-17 hour 22: 190574 events in 0 files, snapshot none (task 8207 ms: download 5532 ms overlapping gunzip 1289 ms, parse 5439 ms, sort 0 ms, write 0 ms, index 569 ms: 3 candidates, 71360 repo-hours, 1296 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:26:19Z [load_day 2024-12-17] 2024-12-17 hour 23: 185666 events in 0 files, snapshot none (task 7910 ms: download 5203 ms overlapping gunzip 1164 ms, parse 5328 ms, sort 0 ms, write 0 ms, index 589 ms: 9 candidates, 70012 repo-hours, 1003 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:26:29Z [load_day 2024-12-17] 2024-12-17: repo_hour merged from 24 files to 1 (2140135 rows, 9474 ms)
2026-11-08T09:26:32Z [load_day 2024-12-17] 2024-12-17: index committed in 12530 ms (24 + 1 + 24 files)
2026-11-08T09:26:32Z [load_day 2024-12-17] 2024-12-17: 5071704 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:26:32Z [load_day 2024-12-17] attempt 1 succeeded