orcaLog in

Runs · run 2637

load_day 2024-06-25, attempt 1 succeeded

Host
73ccef5e07c2:141174
Started
2026-11-08T06:41:31Z
Ended
2026-11-08T06:43:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
786 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2637/load_day/2024-06-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:41:31Z [load_day 2024-06-25] attempt 1 started
2026-11-08T06:41:31Z [load_day 2024-06-25] 2024-06-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:41:41Z [load_day 2024-06-25] 2024-06-25 hour 0: 193895 events in 0 files, snapshot none (task 8458 ms: download 5260 ms overlapping gunzip 1377 ms, parse 5600 ms, sort 0 ms, write 0 ms, index 679 ms: 9 candidates, 99184 repo-hours, 1552 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:41:41Z [load_day 2024-06-25] 2024-06-25 hour 1: 200479 events in 0 files, snapshot none (task 8183 ms: download 5157 ms overlapping gunzip 1232 ms, parse 5303 ms, sort 0 ms, write 0 ms, index 861 ms: 9 candidates, 109691 repo-hours, 1302 releases; waiting 477 ms; commit 0 ms)
2026-11-08T06:41:50Z [load_day 2024-06-25] 2024-06-25 hour 2: 165596 events in 0 files, snapshot none (task 9020 ms: download 4661 ms overlapping gunzip 1352 ms, parse 5535 ms, sort 0 ms, write 0 ms, index 1188 ms: 7 candidates, 69171 repo-hours, 1300 releases; waiting 566 ms; commit 0 ms)
2026-11-08T06:41:51Z [load_day 2024-06-25] 2024-06-25 hour 3: 186429 events in 0 files, snapshot none (task 9388 ms: download 5209 ms overlapping gunzip 1466 ms, parse 6154 ms, sort 0 ms, write 0 ms, index 934 ms: 7 candidates, 78909 repo-hours, 5830 releases; waiting 564 ms; commit 0 ms)
2026-11-08T06:41:57Z [load_day 2024-06-25] 2024-06-25 hour 4: 161641 events in 0 files, snapshot none (task 6033 ms: download 2869 ms overlapping gunzip 888 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 604 ms: 3 candidates, 61857 repo-hours, 1118 releases; waiting 467 ms; commit 0 ms)
2026-11-08T06:42:00Z [load_day 2024-06-25] 2024-06-25 hour 5: 177364 events in 0 files, snapshot none (task 9056 ms: download 5106 ms overlapping gunzip 1201 ms, parse 4843 ms, sort 0 ms, write 0 ms, index 1148 ms: 6 candidates, 69248 repo-hours, 1344 releases; waiting 1548 ms; commit 0 ms)
2026-11-08T06:42:05Z [load_day 2024-06-25] 2024-06-25 hour 6: 213425 events in 0 files, snapshot none (task 8067 ms: download 4712 ms overlapping gunzip 1265 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 798 ms: 3 candidates, 95924 repo-hours, 1347 releases; waiting 383 ms; commit 0 ms)
2026-11-08T06:42:09Z [load_day 2024-06-25] 2024-06-25 hour 7: 216223 events in 0 files, snapshot none (task 8976 ms: download 4953 ms overlapping gunzip 1400 ms, parse 5706 ms, sort 0 ms, write 0 ms, index 1042 ms: 4 candidates, 88234 repo-hours, 1611 releases; waiting 195 ms; commit 0 ms)
2026-11-08T06:42:16Z [load_day 2024-06-25] 2024-06-25 hour 8: 229794 events in 0 files, snapshot none (task 9822 ms: download 6857 ms overlapping gunzip 1679 ms, parse 6780 ms, sort 0 ms, write 0 ms, index 691 ms: 7 candidates, 98375 repo-hours, 1731 releases; waiting 342 ms; commit 0 ms)
2026-11-08T06:42:19Z [load_day 2024-06-25] 2024-06-25 hour 9: 234799 events in 0 files, snapshot none (task 9277 ms: download 5589 ms overlapping gunzip 1397 ms, parse 5876 ms, sort 0 ms, write 0 ms, index 1244 ms: 12 candidates, 103532 repo-hours, 1808 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:42:26Z [load_day 2024-06-25] 2024-06-25 hour 10: 228492 events in 0 files, snapshot none (task 9532 ms: download 6809 ms overlapping gunzip 1422 ms, parse 6510 ms, sort 0 ms, write 0 ms, index 784 ms: 4 candidates, 97071 repo-hours, 1662 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:42:27Z [load_day 2024-06-25] 2024-06-25 hour 11: 216226 events in 0 files, snapshot none (task 7695 ms: download 4734 ms overlapping gunzip 1238 ms, parse 5083 ms, sort 0 ms, write 0 ms, index 852 ms: 8 candidates, 86583 repo-hours, 1505 releases; waiting 211 ms; commit 0 ms)
2026-11-08T06:42:35Z [load_day 2024-06-25] 2024-06-25 hour 12: 276681 events in 0 files, snapshot none (task 8955 ms: download 5809 ms overlapping gunzip 1320 ms, parse 5680 ms, sort 0 ms, write 0 ms, index 1097 ms: 19 candidates, 133721 repo-hours, 1800 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:42:37Z [load_day 2024-06-25] 2024-06-25 hour 13: 250387 events in 0 files, snapshot none (task 9304 ms: download 5862 ms overlapping gunzip 1374 ms, parse 5976 ms, sort 0 ms, write 0 ms, index 1106 ms: 9 candidates, 117106 repo-hours, 1719 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:42:44Z [load_day 2024-06-25] 2024-06-25 hour 14: 243205 events in 0 files, snapshot none (task 8565 ms: download 5818 ms overlapping gunzip 1355 ms, parse 5720 ms, sort 0 ms, write 0 ms, index 792 ms: 17 candidates, 102596 repo-hours, 1759 releases; waiting 375 ms; commit 0 ms)
2026-11-08T06:42:46Z [load_day 2024-06-25] 2024-06-25 hour 15: 247211 events in 0 files, snapshot none (task 8305 ms: download 5494 ms overlapping gunzip 1295 ms, parse 5206 ms, sort 0 ms, write 0 ms, index 870 ms: 17 candidates, 109712 repo-hours, 1906 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:42:52Z [load_day 2024-06-25] 2024-06-25 hour 16: 225496 events in 0 files, snapshot none (task 7685 ms: download 5042 ms overlapping gunzip 1162 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 702 ms: 16 candidates, 93209 repo-hours, 1681 releases; waiting 557 ms; commit 0 ms)
2026-11-08T06:42:53Z [load_day 2024-06-25] 2024-06-25 hour 17: 211980 events in 0 files, snapshot none (task 6584 ms: download 4131 ms overlapping gunzip 1012 ms, parse 4220 ms, sort 0 ms, write 0 ms, index 601 ms: 9 candidates, 84624 repo-hours, 1635 releases; waiting 467 ms; commit 0 ms)
2026-11-08T06:43:01Z [load_day 2024-06-25] 2024-06-25 hour 18: 225779 events in 0 files, snapshot none (task 9071 ms: download 5385 ms overlapping gunzip 1360 ms, parse 5864 ms, sort 0 ms, write 0 ms, index 870 ms: 20 candidates, 100418 repo-hours, 1574 releases; waiting 674 ms; commit 0 ms)
2026-11-08T06:43:02Z [load_day 2024-06-25] 2024-06-25 hour 19: 198271 events in 0 files, snapshot none (task 7829 ms: download 5327 ms overlapping gunzip 1165 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 635 ms: 12 candidates, 76788 repo-hours, 1500 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:43:10Z [load_day 2024-06-25] 2024-06-25 hour 20: 199500 events in 0 files, snapshot none (task 8733 ms: download 6312 ms overlapping gunzip 1378 ms, parse 5625 ms, sort 0 ms, write 0 ms, index 598 ms: 12 candidates, 77504 repo-hours, 1753 releases; waiting 833 ms; commit 0 ms)
2026-11-08T06:43:10Z [load_day 2024-06-25] 2024-06-25 hour 21: 193388 events in 0 files, snapshot none (task 8243 ms: download 5553 ms overlapping gunzip 1299 ms, parse 5586 ms, sort 0 ms, write 0 ms, index 570 ms: 7 candidates, 76197 repo-hours, 2836 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:43:18Z [load_day 2024-06-25] 2024-06-25 hour 22: 169629 events in 0 files, snapshot none (task 6843 ms: download 4440 ms overlapping gunzip 1051 ms, parse 4406 ms, sort 0 ms, write 0 ms, index 570 ms: 7 candidates, 66299 repo-hours, 2424 releases; waiting 576 ms; commit 0 ms)
2026-11-08T06:43:18Z [load_day 2024-06-25] 2024-06-25 hour 23: 171763 events in 0 files, snapshot none (task 6275 ms: download 3540 ms overlapping gunzip 907 ms, parse 3998 ms, sort 0 ms, write 0 ms, index 516 ms: 5 candidates, 76366 repo-hours, 1193 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:43:27Z [load_day 2024-06-25] 2024-06-25: repo_hour merged from 24 files to 1 (2172319 rows, 8892 ms)
2026-11-08T06:43:29Z [load_day 2024-06-25] 2024-06-25: index committed in 11751 ms (24 + 1 + 24 files)
2026-11-08T06:43:29Z [load_day 2024-06-25] 2024-06-25: 5037653 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:43:29Z [load_day 2024-06-25] attempt 1 succeeded