orcaLog in

Runs · run 3270

load_day 2024-12-03, attempt 1 succeeded

Host
73ccef5e07c2:216078
Started
2026-11-08T09:10:50Z
Ended
2026-11-08T09:13:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
910 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3270/load_day/2024-12-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:10:50Z [load_day 2024-12-03] attempt 1 started
2026-11-08T09:10:51Z [load_day 2024-12-03] 2024-12-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:11:01Z [load_day 2024-12-03] 2024-12-03 hour 0: 205406 events in 0 files, snapshot none (task 9762 ms: download 6044 ms overlapping gunzip 1499 ms, parse 6472 ms, sort 0 ms, write 0 ms, index 1004 ms: 6 candidates, 93151 repo-hours, 1248 releases; waiting 471 ms; commit 0 ms)
2026-11-08T09:11:01Z [load_day 2024-12-03] 2024-12-03 hour 1: 227114 events in 0 files, snapshot none (task 9729 ms: download 5705 ms overlapping gunzip 1440 ms, parse 5891 ms, sort 0 ms, write 0 ms, index 1567 ms: 11 candidates, 119821 repo-hours, 896 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:11:09Z [load_day 2024-12-03] 2024-12-03 hour 2: 190576 events in 0 files, snapshot none (task 8036 ms: download 5030 ms overlapping gunzip 1263 ms, parse 5568 ms, sort 0 ms, write 0 ms, index 662 ms: 9 candidates, 82509 repo-hours, 817 releases; waiting 265 ms; commit 0 ms)
2026-11-08T09:11:09Z [load_day 2024-12-03] 2024-12-03 hour 3: 207202 events in 0 files, snapshot none (task 7954 ms: download 4912 ms overlapping gunzip 1190 ms, parse 5296 ms, sort 0 ms, write 0 ms, index 767 ms: 12 candidates, 87093 repo-hours, 3941 releases; waiting 426 ms; commit 0 ms)
2026-11-08T09:11:18Z [load_day 2024-12-03] 2024-12-03 hour 4: 189357 events in 0 files, snapshot none (task 8107 ms: download 5023 ms overlapping gunzip 1302 ms, parse 5268 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 73092 repo-hours, 825 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:11:18Z [load_day 2024-12-03] 2024-12-03 hour 5: 196714 events in 0 files, snapshot none (task 8413 ms: download 5437 ms overlapping gunzip 1395 ms, parse 5611 ms, sort 0 ms, write 0 ms, index 661 ms: 5 candidates, 78446 repo-hours, 828 releases; waiting 444 ms; commit 0 ms)
2026-11-08T09:11:27Z [load_day 2024-12-03] 2024-12-03 hour 6: 220361 events in 0 files, snapshot none (task 8979 ms: download 5756 ms overlapping gunzip 1339 ms, parse 5785 ms, sort 0 ms, write 0 ms, index 1079 ms: 9 candidates, 101183 repo-hours, 921 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:11:28Z [load_day 2024-12-03] 2024-12-03 hour 7: 216633 events in 0 files, snapshot none (task 9284 ms: download 6061 ms overlapping gunzip 1513 ms, parse 5903 ms, sort 0 ms, write 0 ms, index 1040 ms: 9 candidates, 88852 repo-hours, 827 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:11:38Z [load_day 2024-12-03] 2024-12-03 hour 8: 234059 events in 0 files, snapshot none (task 9879 ms: download 6665 ms overlapping gunzip 1633 ms, parse 6581 ms, sort 0 ms, write 0 ms, index 860 ms: 5 candidates, 99878 repo-hours, 1000 releases; waiting 529 ms; commit 0 ms)
2026-11-08T09:11:40Z [load_day 2024-12-03] 2024-12-03 hour 9: 251247 events in 0 files, snapshot none (task 11023 ms: download 7629 ms overlapping gunzip 1671 ms, parse 7315 ms, sort 0 ms, write 0 ms, index 1253 ms: 8 candidates, 107514 repo-hours, 1363 releases; waiting 466 ms; commit 0 ms)
2026-11-08T09:11:49Z [load_day 2024-12-03] 2024-12-03 hour 10: 240906 events in 0 files, snapshot none (task 10423 ms: download 7268 ms overlapping gunzip 1551 ms, parse 7201 ms, sort 0 ms, write 0 ms, index 861 ms: 12 candidates, 100676 repo-hours, 1328 releases; waiting 518 ms; commit 0 ms)
2026-11-08T09:11:50Z [load_day 2024-12-03] 2024-12-03 hour 11: 236353 events in 0 files, snapshot none (task 9714 ms: download 6919 ms overlapping gunzip 1572 ms, parse 6569 ms, sort 0 ms, write 0 ms, index 809 ms: 5 candidates, 95956 repo-hours, 1317 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:12:00Z [load_day 2024-12-03] 2024-12-03 hour 12: 280007 events in 0 files, snapshot none (task 10379 ms: download 7314 ms overlapping gunzip 1552 ms, parse 6949 ms, sort 0 ms, write 0 ms, index 1070 ms: 4 candidates, 141360 repo-hours, 1518 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:12:01Z [load_day 2024-12-03] 2024-12-03 hour 13: 270029 events in 0 files, snapshot none (task 10177 ms: download 7424 ms overlapping gunzip 1663 ms, parse 6832 ms, sort 0 ms, write 0 ms, index 880 ms: 7 candidates, 126025 repo-hours, 1372 releases; waiting 491 ms; commit 0 ms)
2026-11-08T09:12:09Z [load_day 2024-12-03] 2024-12-03 hour 14: 262429 events in 0 files, snapshot none (task 9006 ms: download 6407 ms overlapping gunzip 1374 ms, parse 5782 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 112375 repo-hours, 1412 releases; waiting 756 ms; commit 0 ms)
2026-11-08T09:12:11Z [load_day 2024-12-03] 2024-12-03 hour 15: 262435 events in 0 files, snapshot none (task 9115 ms: download 6278 ms overlapping gunzip 1399 ms, parse 5912 ms, sort 0 ms, write 0 ms, index 887 ms: 14 candidates, 117140 repo-hours, 1527 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:12:21Z [load_day 2024-12-03] 2024-12-03 hour 16: 257086 events in 0 files, snapshot none (task 12107 ms: download 8396 ms overlapping gunzip 1941 ms, parse 7744 ms, sort 0 ms, write 0 ms, index 1303 ms: 13 candidates, 110169 repo-hours, 1224 releases; waiting 891 ms; commit 0 ms)
2026-11-08T09:12:22Z [load_day 2024-12-03] 2024-12-03 hour 17: 250099 events in 0 files, snapshot none (task 11270 ms: download 8454 ms overlapping gunzip 1838 ms, parse 7722 ms, sort 0 ms, write 0 ms, index 695 ms: 15 candidates, 101406 repo-hours, 1166 releases; waiting 703 ms; commit 0 ms)
2026-11-08T09:12:32Z [load_day 2024-12-03] 2024-12-03 hour 18: 252604 events in 0 files, snapshot none (task 10569 ms: download 7512 ms overlapping gunzip 1650 ms, parse 7133 ms, sort 0 ms, write 0 ms, index 1080 ms: 5 candidates, 111458 repo-hours, 1310 releases; waiting 404 ms; commit 0 ms)
2026-11-08T09:12:32Z [load_day 2024-12-03] 2024-12-03 hour 19: 223349 events in 0 files, snapshot none (task 8781 ms: download 6047 ms overlapping gunzip 1425 ms, parse 5928 ms, sort 0 ms, write 0 ms, index 618 ms: 7 candidates, 88238 repo-hours, 995 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:12:43Z [load_day 2024-12-03] 2024-12-03 hour 20: 229059 events in 0 files, snapshot none (task 9765 ms: download 6072 ms overlapping gunzip 1588 ms, parse 6514 ms, sort 0 ms, write 0 ms, index 766 ms: 12 candidates, 90926 repo-hours, 1006 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:12:43Z [load_day 2024-12-03] 2024-12-03 hour 21: 222226 events in 0 files, snapshot none (task 9581 ms: download 5837 ms overlapping gunzip 1464 ms, parse 6334 ms, sort 0 ms, write 0 ms, index 970 ms: 4 candidates, 89590 repo-hours, 1244 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:12:52Z [load_day 2024-12-03] 2024-12-03 hour 22: 208607 events in 0 files, snapshot none (task 8603 ms: download 5232 ms overlapping gunzip 1410 ms, parse 5640 ms, sort 0 ms, write 0 ms, index 714 ms: 5 candidates, 81910 repo-hours, 1364 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:12:52Z [load_day 2024-12-03] 2024-12-03 hour 23: 195751 events in 0 files, snapshot none (task 7942 ms: download 4372 ms overlapping gunzip 1230 ms, parse 5112 ms, sort 0 ms, write 0 ms, index 759 ms: 4 candidates, 77438 repo-hours, 914 releases; waiting 541 ms; commit 0 ms)
2026-11-08T09:13:03Z [load_day 2024-12-03] 2024-12-03: repo_hour merged from 24 files to 1 (2376206 rows, 10554 ms)
2026-11-08T09:13:06Z [load_day 2024-12-03] 2024-12-03: index committed in 13177 ms (24 + 1 + 24 files)
2026-11-08T09:13:06Z [load_day 2024-12-03] 2024-12-03: 5529609 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:13:06Z [load_day 2024-12-03] attempt 1 succeeded