orcaLog in

Runs · run 3741

load_day 2025-04-01, attempt 1 succeeded

Host
73ccef5e07c2:280915
Started
2026-11-08T11:09:26Z
Ended
2026-11-08T11:11:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
750 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
237.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3741/load_day/2025-04-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:09:26Z [load_day 2025-04-01] attempt 1 started
2026-11-08T11:09:27Z [load_day 2025-04-01] 2025-04-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:09:37Z [load_day 2025-04-01] 2025-04-01 hour 0: 216230 events in 0 files, snapshot none (task 9686 ms: download 6551 ms overlapping gunzip 1488 ms, parse 6462 ms, sort 0 ms, write 0 ms, index 898 ms: 8 candidates, 91701 repo-hours, 1316 releases; waiting 560 ms; commit 0 ms)
2026-11-08T11:09:39Z [load_day 2025-04-01] 2025-04-01 hour 1: 246209 events in 0 files, snapshot none (task 11152 ms: download 7976 ms overlapping gunzip 1912 ms, parse 7411 ms, sort 0 ms, write 0 ms, index 1042 ms: 15 candidates, 126385 repo-hours, 1210 releases; waiting 449 ms; commit 0 ms)
2026-11-08T11:09:48Z [load_day 2025-04-01] 2025-04-01 hour 2: 225269 events in 0 files, snapshot none (task 9755 ms: download 7100 ms overlapping gunzip 1686 ms, parse 6627 ms, sort 0 ms, write 0 ms, index 756 ms: 8 candidates, 96255 repo-hours, 1318 releases; waiting 397 ms; commit 0 ms)
2026-11-08T11:09:49Z [load_day 2025-04-01] 2025-04-01 hour 3: 227567 events in 0 files, snapshot none (task 9909 ms: download 7299 ms overlapping gunzip 1711 ms, parse 6646 ms, sort 0 ms, write 0 ms, index 797 ms: 6 candidates, 90397 repo-hours, 3044 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:09:57Z [load_day 2025-04-01] 2025-04-01 hour 4: 203568 events in 0 files, snapshot none (task 8548 ms: download 5304 ms overlapping gunzip 1336 ms, parse 5474 ms, sort 0 ms, write 0 ms, index 753 ms: 6 candidates, 75220 repo-hours, 1011 releases; waiting 644 ms; commit 0 ms)
2026-11-08T11:10:00Z [load_day 2025-04-01] 2025-04-01 hour 5: 219045 events in 0 files, snapshot none (task 9526 ms: download 6763 ms overlapping gunzip 1687 ms, parse 6297 ms, sort 0 ms, write 0 ms, index 707 ms: 7 candidates, 81453 repo-hours, 1003 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:10:08Z [load_day 2025-04-01] 2025-04-01 hour 6: 249967 events in 0 files, snapshot none (task 10513 ms: download 6818 ms overlapping gunzip 1739 ms, parse 6846 ms, sort 0 ms, write 0 ms, index 1177 ms: 4 candidates, 108234 repo-hours, 1180 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:10:11Z [load_day 2025-04-01] 2025-04-01 hour 7: 252003 events in 0 files, snapshot none (task 10890 ms: download 7852 ms overlapping gunzip 1832 ms, parse 7029 ms, sort 0 ms, write 0 ms, index 1051 ms: 8 candidates, 100146 repo-hours, 1100 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:10:21Z [load_day 2025-04-01] 2025-04-01 hour 8: 265499 events in 0 files, snapshot none (task 12317 ms: download 8393 ms overlapping gunzip 2081 ms, parse 8200 ms, sort 0 ms, write 0 ms, index 1179 ms: 5 candidates, 107323 repo-hours, 1345 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:10:23Z [load_day 2025-04-01] 2025-04-01 hour 9: 267073 events in 0 files, snapshot none (task 11638 ms: download 8586 ms overlapping gunzip 1916 ms, parse 7917 ms, sort 0 ms, write 0 ms, index 967 ms: 9 candidates, 110828 repo-hours, 1489 releases; waiting 596 ms; commit 0 ms)
2026-11-08T11:10:33Z [load_day 2025-04-01] 2025-04-01 hour 10: 258641 events in 0 files, snapshot none (task 11436 ms: download 7849 ms overlapping gunzip 1877 ms, parse 7571 ms, sort 0 ms, write 0 ms, index 1050 ms: 8 candidates, 104465 repo-hours, 1317 releases; waiting 524 ms; commit 0 ms)
2026-11-08T11:10:35Z [load_day 2025-04-01] 2025-04-01 hour 11: 256600 events in 0 files, snapshot none (task 10827 ms: download 7985 ms overlapping gunzip 1846 ms, parse 7359 ms, sort 0 ms, write 0 ms, index 824 ms: 12 candidates, 100987 repo-hours, 1264 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:10:46Z [load_day 2025-04-01] 2025-04-01 hour 12: 280018 events in 0 files, snapshot none (task 11690 ms: download 7788 ms overlapping gunzip 1888 ms, parse 7714 ms, sort 0 ms, write 0 ms, index 1217 ms: 12 candidates, 140789 repo-hours, 1351 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:10:47Z [load_day 2025-04-01] 2025-04-01 hour 13: 260101 events in 0 files, snapshot none (task 11580 ms: download 8494 ms overlapping gunzip 1927 ms, parse 8040 ms, sort 0 ms, write 0 ms, index 924 ms: 13 candidates, 123378 repo-hours, 1202 releases; waiting 459 ms; commit 0 ms)
2026-11-08T11:10:56Z [load_day 2025-04-01] 2025-04-01 hour 14: 238971 events in 0 files, snapshot none (task 9601 ms: download 6337 ms overlapping gunzip 1572 ms, parse 6125 ms, sort 0 ms, write 0 ms, index 1068 ms: 10 candidates, 106551 repo-hours, 1187 releases; waiting 581 ms; commit 0 ms)
2026-11-08T11:10:59Z [load_day 2025-04-01] 2025-04-01 hour 15: 272545 events in 0 files, snapshot none (task 11548 ms: download 8531 ms overlapping gunzip 1969 ms, parse 8033 ms, sort 0 ms, write 0 ms, index 935 ms: 12 candidates, 119567 repo-hours, 1426 releases; waiting 338 ms; commit 0 ms)
2026-11-08T11:11:05Z [load_day 2025-04-01] 2025-04-01 hour 16: 266127 events in 0 files, snapshot none (task 9097 ms: download 6335 ms overlapping gunzip 1535 ms, parse 5984 ms, sort 0 ms, write 0 ms, index 886 ms: 9 candidates, 111551 repo-hours, 1307 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:11:08Z [load_day 2025-04-01] 2025-04-01 hour 17: 254873 events in 0 files, snapshot none (task 8599 ms: download 5966 ms overlapping gunzip 1410 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 743 ms: 20 candidates, 103975 repo-hours, 1180 releases; waiting 539 ms; commit 0 ms)
2026-11-08T11:11:15Z [load_day 2025-04-01] 2025-04-01 hour 18: 263924 events in 0 files, snapshot none (task 8898 ms: download 6084 ms overlapping gunzip 1428 ms, parse 5724 ms, sort 0 ms, write 0 ms, index 846 ms: 19 candidates, 115364 repo-hours, 1453 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:11:19Z [load_day 2025-04-01] 2025-04-01 hour 19: 245924 events in 0 files, snapshot none (task 9800 ms: download 5855 ms overlapping gunzip 1543 ms, parse 5887 ms, sort 0 ms, write 0 ms, index 1694 ms: 6 candidates, 96689 repo-hours, 1120 releases; waiting 430 ms; commit 0 ms)
2026-11-08T11:11:27Z [load_day 2025-04-01] 2025-04-01 hour 20: 242882 events in 0 files, snapshot none (task 11487 ms: download 7886 ms overlapping gunzip 1779 ms, parse 7369 ms, sort 0 ms, write 0 ms, index 1398 ms: 10 candidates, 92449 repo-hours, 1230 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:11:30Z [load_day 2025-04-01] 2025-04-01 hour 21: 234656 events in 0 files, snapshot none (task 11128 ms: download 7436 ms overlapping gunzip 1807 ms, parse 7425 ms, sort 0 ms, write 0 ms, index 1142 ms: 16 candidates, 87614 repo-hours, 1166 releases; waiting 498 ms; commit 0 ms)
2026-11-08T11:11:37Z [load_day 2025-04-01] 2025-04-01 hour 22: 210523 events in 0 files, snapshot none (task 9516 ms: download 5568 ms overlapping gunzip 1449 ms, parse 6149 ms, sort 0 ms, write 0 ms, index 1167 ms: 7 candidates, 76883 repo-hours, 1202 releases; waiting 462 ms; commit 0 ms)
2026-11-08T11:11:39Z [load_day 2025-04-01] 2025-04-01 hour 23: 194855 events in 0 files, snapshot none (task 8449 ms: download 5373 ms overlapping gunzip 1383 ms, parse 5588 ms, sort 0 ms, write 0 ms, index 628 ms: 8 candidates, 70357 repo-hours, 1120 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:11:51Z [load_day 2025-04-01] 2025-04-01: repo_hour merged from 24 files to 1 (2438561 rows, 11765 ms)
2026-11-08T11:11:54Z [load_day 2025-04-01] 2025-04-01: index committed in 14230 ms (24 + 1 + 24 files)
2026-11-08T11:11:54Z [load_day 2025-04-01] 2025-04-01: 5853070 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:11:54Z [load_day 2025-04-01] attempt 1 succeeded