orcaLog in

Runs · run 3676

load_day 2025-03-17, attempt 1 succeeded

Host
73ccef5e07c2:271511
Started
2026-11-08T10:53:02Z
Ended
2026-11-08T10:55:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
866 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
235.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3676/load_day/2025-03-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:53:02Z [load_day 2025-03-17] attempt 1 started
2026-11-08T10:53:03Z [load_day 2025-03-17] 2025-03-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:53:11Z [load_day 2025-03-17] 2025-03-17 hour 0: 209107 events in 0 files, snapshot none (task 7235 ms: download 4270 ms overlapping gunzip 1110 ms, parse 4427 ms, sort 0 ms, write 0 ms, index 821 ms: 6 candidates, 90639 repo-hours, 1378 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:53:12Z [load_day 2025-03-17] 2025-03-17 hour 1: 245469 events in 0 files, snapshot none (task 8140 ms: download 5314 ms overlapping gunzip 1282 ms, parse 5151 ms, sort 0 ms, write 0 ms, index 876 ms: 7 candidates, 123839 repo-hours, 1093 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:53:19Z [load_day 2025-03-17] 2025-03-17 hour 2: 208654 events in 0 files, snapshot none (task 7520 ms: download 4434 ms overlapping gunzip 1246 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 831 ms: 9 candidates, 85951 repo-hours, 1017 releases; waiting 248 ms; commit 0 ms)
2026-11-08T10:53:20Z [load_day 2025-03-17] 2025-03-17 hour 3: 227127 events in 0 files, snapshot none (task 7681 ms: download 4881 ms overlapping gunzip 1237 ms, parse 4884 ms, sort 0 ms, write 0 ms, index 822 ms: 7 candidates, 90197 repo-hours, 3936 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:53:28Z [load_day 2025-03-17] 2025-03-17 hour 4: 209380 events in 0 files, snapshot none (task 8050 ms: download 4244 ms overlapping gunzip 1362 ms, parse 5393 ms, sort 0 ms, write 0 ms, index 712 ms: 2 candidates, 74308 repo-hours, 812 releases; waiting 335 ms; commit 0 ms)
2026-11-08T10:53:29Z [load_day 2025-03-17] 2025-03-17 hour 5: 214620 events in 0 files, snapshot none (task 8388 ms: download 5613 ms overlapping gunzip 1379 ms, parse 5402 ms, sort 0 ms, write 0 ms, index 673 ms: 3 candidates, 79862 repo-hours, 870 releases; waiting 614 ms; commit 0 ms)
2026-11-08T10:53:39Z [load_day 2025-03-17] 2025-03-17 hour 6: 246510 events in 0 files, snapshot none (task 10620 ms: download 6368 ms overlapping gunzip 1784 ms, parse 6778 ms, sort 0 ms, write 0 ms, index 1249 ms: 3 candidates, 104618 repo-hours, 1095 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:53:42Z [load_day 2025-03-17] 2025-03-17 hour 7: 246793 events in 0 files, snapshot none (task 12329 ms: download 8755 ms overlapping gunzip 2034 ms, parse 7769 ms, sort 0 ms, write 0 ms, index 1420 ms: 5 candidates, 95274 repo-hours, 1040 releases; waiting 821 ms; commit 0 ms)
2026-11-08T10:53:51Z [load_day 2025-03-17] 2025-03-17 hour 8: 260435 events in 0 files, snapshot none (task 12093 ms: download 8795 ms overlapping gunzip 2030 ms, parse 8165 ms, sort 0 ms, write 0 ms, index 1390 ms: 5 candidates, 103981 repo-hours, 1105 releases; waiting 210 ms; commit 0 ms)
2026-11-08T10:53:55Z [load_day 2025-03-17] 2025-03-17 hour 9: 274989 events in 0 files, snapshot none (task 12044 ms: download 8822 ms overlapping gunzip 2024 ms, parse 8569 ms, sort 0 ms, write 0 ms, index 939 ms: 5 candidates, 114064 repo-hours, 1467 releases; waiting 226 ms; commit 0 ms)
2026-11-08T10:54:02Z [load_day 2025-03-17] 2025-03-17 hour 10: 274406 events in 0 files, snapshot none (task 10181 ms: download 7426 ms overlapping gunzip 1696 ms, parse 6797 ms, sort 0 ms, write 0 ms, index 839 ms: 6 candidates, 109800 repo-hours, 1319 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:54:05Z [load_day 2025-03-17] 2025-03-17 hour 11: 258335 events in 0 files, snapshot none (task 10079 ms: download 7506 ms overlapping gunzip 1607 ms, parse 6554 ms, sort 0 ms, write 0 ms, index 789 ms: 5 candidates, 101889 repo-hours, 1425 releases; waiting 851 ms; commit 0 ms)
2026-11-08T10:54:14Z [load_day 2025-03-17] 2025-03-17 hour 12: 294063 events in 0 files, snapshot none (task 11412 ms: download 6168 ms overlapping gunzip 1441 ms, parse 5954 ms, sort 0 ms, write 0 ms, index 3254 ms: 11 candidates, 146467 repo-hours, 1266 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:54:16Z [load_day 2025-03-17] 2025-03-17 hour 13: 277357 events in 0 files, snapshot none (task 10749 ms: download 7232 ms overlapping gunzip 1667 ms, parse 6684 ms, sort 0 ms, write 0 ms, index 1629 ms: 5 candidates, 129989 repo-hours, 1385 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:54:26Z [load_day 2025-03-17] 2025-03-17 hour 14: 280742 events in 0 files, snapshot none (task 11915 ms: download 7963 ms overlapping gunzip 1882 ms, parse 8056 ms, sort 0 ms, write 0 ms, index 1144 ms: 6 candidates, 118685 repo-hours, 1457 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:54:30Z [load_day 2025-03-17] 2025-03-17 hour 15: 271032 events in 0 files, snapshot none (task 12673 ms: download 9112 ms overlapping gunzip 1949 ms, parse 8520 ms, sort 0 ms, write 0 ms, index 1461 ms: 11 candidates, 120039 repo-hours, 1517 releases; waiting 461 ms; commit 0 ms)
2026-11-08T10:54:41Z [load_day 2025-03-17] 2025-03-17 hour 16: 265951 events in 0 files, snapshot none (task 13864 ms: download 9352 ms overlapping gunzip 2226 ms, parse 9485 ms, sort 0 ms, write 0 ms, index 1476 ms: 9 candidates, 113900 repo-hours, 1346 releases; waiting 224 ms; commit 0 ms)
2026-11-08T10:54:44Z [load_day 2025-03-17] 2025-03-17 hour 17: 264396 events in 0 files, snapshot none (task 13125 ms: download 9892 ms overlapping gunzip 2158 ms, parse 8943 ms, sort 0 ms, write 0 ms, index 1280 ms: 7 candidates, 107836 repo-hours, 1148 releases; waiting 477 ms; commit 0 ms)
2026-11-08T10:54:52Z [load_day 2025-03-17] 2025-03-17 hour 18: 264294 events in 0 files, snapshot none (task 10520 ms: download 7751 ms overlapping gunzip 1696 ms, parse 6979 ms, sort 0 ms, write 0 ms, index 886 ms: 11 candidates, 116550 repo-hours, 1272 releases; waiting 663 ms; commit 0 ms)
2026-11-08T10:55:22Z [load_day 2025-03-17] 2025-03-17 hour 19: 246849 events in 0 files, snapshot none (task 37260 ms: download 35663 ms overlapping gunzip 2042 ms, parse 8465 ms, sort 0 ms, write 0 ms, index 721 ms: 11 candidates, 96805 repo-hours, 1200 releases; waiting 25551 ms; commit 0 ms)
2026-11-08T10:55:22Z [load_day 2025-03-17] 2025-03-17 hour 20: 247478 events in 0 files, snapshot none (task 9967 ms: download 6535 ms overlapping gunzip 1613 ms, parse 6492 ms, sort 0 ms, write 0 ms, index 793 ms: 12 candidates, 96847 repo-hours, 1114 releases; waiting 564 ms; commit 0 ms)
2026-11-08T10:55:35Z [load_day 2025-03-17] 2025-03-17 hour 21: 239528 events in 0 files, snapshot none (task 12865 ms: download 9087 ms overlapping gunzip 2330 ms, parse 8849 ms, sort 0 ms, write 0 ms, index 887 ms: 7 candidates, 93059 repo-hours, 1302 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:55:35Z [load_day 2025-03-17] 2025-03-17 hour 22: 225199 events in 0 files, snapshot none (task 12751 ms: download 8930 ms overlapping gunzip 2181 ms, parse 8632 ms, sort 0 ms, write 0 ms, index 1034 ms: 4 candidates, 83853 repo-hours, 1219 releases; waiting 563 ms; commit 0 ms)
2026-11-08T10:55:44Z [load_day 2025-03-17] 2025-03-17 hour 23: 209348 events in 0 files, snapshot none (task 8112 ms: download 5581 ms overlapping gunzip 1343 ms, parse 5319 ms, sort 0 ms, write 0 ms, index 618 ms: 5 candidates, 77210 repo-hours, 1095 releases; waiting 545 ms; commit 0 ms)
2026-11-08T10:55:55Z [load_day 2025-03-17] 2025-03-17: repo_hour merged from 24 files to 1 (2475662 rows, 10635 ms)
2026-11-08T10:55:58Z [load_day 2025-03-17] 2025-03-17: index committed in 13617 ms (24 + 1 + 24 files)
2026-11-08T10:55:58Z [load_day 2025-03-17] 2025-03-17: 5962062 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:55:58Z [load_day 2025-03-17] attempt 1 succeeded