orcaLog in

Runs · run 3861

load_day 2025-05-05, attempt 1 succeeded

Host
73ccef5e07c2:298755
Started
2026-11-08T11:46:12Z
Ended
2026-11-08T11:48:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
772 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
235.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3861/load_day/2025-05-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:46:12Z [load_day 2025-05-05] attempt 1 started
2026-11-08T11:46:13Z [load_day 2025-05-05] 2025-05-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:46:20Z [load_day 2025-05-05] 2025-05-05 hour 0: 185746 events in 0 files, snapshot none (task 7140 ms: download 4642 ms overlapping gunzip 1180 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 81568 repo-hours, 1452 releases; waiting 258 ms; commit 0 ms)
2026-11-08T11:46:22Z [load_day 2025-05-05] 2025-05-05 hour 1: 219620 events in 0 files, snapshot none (task 8627 ms: download 5572 ms overlapping gunzip 1355 ms, parse 5308 ms, sort 0 ms, write 0 ms, index 1167 ms: 14 candidates, 114511 repo-hours, 1016 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:46:30Z [load_day 2025-05-05] 2025-05-05 hour 2: 194762 events in 0 files, snapshot none (task 8812 ms: download 5413 ms overlapping gunzip 1367 ms, parse 5273 ms, sort 0 ms, write 0 ms, index 1340 ms: 11 candidates, 83620 repo-hours, 911 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:46:31Z [load_day 2025-05-05] 2025-05-05 hour 3: 206166 events in 0 files, snapshot none (task 8511 ms: download 5344 ms overlapping gunzip 1396 ms, parse 5610 ms, sort 0 ms, write 0 ms, index 695 ms: 11 candidates, 80637 repo-hours, 2956 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:46:39Z [load_day 2025-05-05] 2025-05-05 hour 4: 199278 events in 0 files, snapshot none (task 8620 ms: download 5097 ms overlapping gunzip 1499 ms, parse 5611 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 74254 repo-hours, 816 releases; waiting 532 ms; commit 0 ms)
2026-11-08T11:46:40Z [load_day 2025-05-05] 2025-05-05 hour 5: 207241 events in 0 files, snapshot none (task 8429 ms: download 5751 ms overlapping gunzip 1434 ms, parse 5599 ms, sort 0 ms, write 0 ms, index 601 ms: 5 candidates, 78638 repo-hours, 850 releases; waiting 450 ms; commit 0 ms)
2026-11-08T11:46:49Z [load_day 2025-05-05] 2025-05-05 hour 6: 230652 events in 0 files, snapshot none (task 9416 ms: download 6129 ms overlapping gunzip 1640 ms, parse 6401 ms, sort 0 ms, write 0 ms, index 759 ms: 5 candidates, 96762 repo-hours, 1131 releases; waiting 340 ms; commit 0 ms)
2026-11-08T11:46:51Z [load_day 2025-05-05] 2025-05-05 hour 7: 235854 events in 0 files, snapshot none (task 10754 ms: download 7937 ms overlapping gunzip 1804 ms, parse 7117 ms, sort 0 ms, write 0 ms, index 1004 ms: 4 candidates, 92055 repo-hours, 1068 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:46:59Z [load_day 2025-05-05] 2025-05-05 hour 8: 244965 events in 0 files, snapshot none (task 9427 ms: download 6912 ms overlapping gunzip 1577 ms, parse 6492 ms, sort 0 ms, write 0 ms, index 741 ms: 14 candidates, 100454 repo-hours, 1298 releases; waiting 370 ms; commit 0 ms)
2026-11-08T11:47:02Z [load_day 2025-05-05] 2025-05-05 hour 9: 254977 events in 0 files, snapshot none (task 9849 ms: download 6940 ms overlapping gunzip 1713 ms, parse 6441 ms, sort 0 ms, write 0 ms, index 1066 ms: 4 candidates, 105013 repo-hours, 1294 releases; waiting 370 ms; commit 0 ms)
2026-11-08T11:47:08Z [load_day 2025-05-05] 2025-05-05 hour 10: 246432 events in 0 files, snapshot none (task 8799 ms: download 6196 ms overlapping gunzip 1496 ms, parse 5765 ms, sort 0 ms, write 0 ms, index 774 ms: 5 candidates, 101040 repo-hours, 1164 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:47:11Z [load_day 2025-05-05] 2025-05-05 hour 11: 249130 events in 0 files, snapshot none (task 8412 ms: download 5770 ms overlapping gunzip 1324 ms, parse 5275 ms, sort 0 ms, write 0 ms, index 798 ms: 9 candidates, 100507 repo-hours, 1233 releases; waiting 691 ms; commit 0 ms)
2026-11-08T11:47:28Z [load_day 2025-05-05] 2025-05-05 hour 12: 283603 events in 0 files, snapshot none (task 19233 ms: download 17789 ms overlapping gunzip 2489 ms, parse 10865 ms, sort 0 ms, write 0 ms, index 1113 ms: 7 candidates, 143554 repo-hours, 1297 releases; waiting 4452 ms; commit 0 ms)
2026-11-08T11:47:28Z [load_day 2025-05-05] 2025-05-05 hour 13: 278678 events in 0 files, snapshot none (task 12507 ms: download 9142 ms overlapping gunzip 1958 ms, parse 8285 ms, sort 0 ms, write 0 ms, index 1428 ms: 7 candidates, 131878 repo-hours, 1234 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:47:42Z [load_day 2025-05-05] 2025-05-05 hour 14: 276488 events in 0 files, snapshot none (task 13423 ms: download 10236 ms overlapping gunzip 2138 ms, parse 8836 ms, sort 0 ms, write 0 ms, index 1177 ms: 9 candidates, 121125 repo-hours, 1415 releases; waiting 967 ms; commit 0 ms)
2026-11-08T11:47:42Z [load_day 2025-05-05] 2025-05-05 hour 15: 275786 events in 0 files, snapshot none (task 12630 ms: download 9443 ms overlapping gunzip 1967 ms, parse 8734 ms, sort 0 ms, write 0 ms, index 1259 ms: 8 candidates, 120986 repo-hours, 1490 releases; waiting 275 ms; commit 0 ms)
2026-11-08T11:47:55Z [load_day 2025-05-05] 2025-05-05 hour 16: 269256 events in 0 files, snapshot none (task 12316 ms: download 9159 ms overlapping gunzip 2039 ms, parse 7965 ms, sort 0 ms, write 0 ms, index 942 ms: 7 candidates, 115349 repo-hours, 1249 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T11:47:55Z [load_day 2025-05-05] 2025-05-05 hour 17: 261896 events in 0 files, snapshot none (task 11272 ms: download 7831 ms overlapping gunzip 1863 ms, parse 7287 ms, sort 0 ms, write 0 ms, index 1256 ms: 7 candidates, 107244 repo-hours, 1182 releases; waiting 567 ms; commit 0 ms)
2026-11-08T11:48:07Z [load_day 2025-05-05] 2025-05-05 hour 18: 267578 events in 0 files, snapshot none (task 11534 ms: download 8295 ms overlapping gunzip 1902 ms, parse 7861 ms, sort 0 ms, write 0 ms, index 920 ms: 14 candidates, 117255 repo-hours, 1274 releases; waiting 561 ms; commit 0 ms)
2026-11-08T11:48:08Z [load_day 2025-05-05] 2025-05-05 hour 19: 251469 events in 0 files, snapshot none (task 12325 ms: download 8882 ms overlapping gunzip 2153 ms, parse 8375 ms, sort 0 ms, write 0 ms, index 981 ms: 6 candidates, 98769 repo-hours, 1052 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:48:19Z [load_day 2025-05-05] 2025-05-05 hour 20: 244917 events in 0 files, snapshot none (task 10691 ms: download 7734 ms overlapping gunzip 1698 ms, parse 7407 ms, sort 0 ms, write 0 ms, index 724 ms: 10 candidates, 97945 repo-hours, 1297 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:48:19Z [load_day 2025-05-05] 2025-05-05 hour 21: 225663 events in 0 files, snapshot none (task 9469 ms: download 6388 ms overlapping gunzip 1527 ms, parse 6234 ms, sort 0 ms, write 0 ms, index 874 ms: 12 candidates, 88804 repo-hours, 1257 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:48:29Z [load_day 2025-05-05] 2025-05-05 hour 22: 213025 events in 0 files, snapshot none (task 9281 ms: download 6853 ms overlapping gunzip 1612 ms, parse 6232 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 80550 repo-hours, 1179 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:48:29Z [load_day 2025-05-05] 2025-05-05 hour 23: 207871 events in 0 files, snapshot none (task 8783 ms: download 5815 ms overlapping gunzip 1356 ms, parse 5653 ms, sort 0 ms, write 0 ms, index 850 ms: 14 candidates, 76558 repo-hours, 1145 releases; waiting 640 ms; commit 0 ms)
2026-11-08T11:48:40Z [load_day 2025-05-05] 2025-05-05: repo_hour merged from 24 files to 1 (2409076 rows, 11372 ms)
2026-11-08T11:48:43Z [load_day 2025-05-05] 2025-05-05: index committed in 14038 ms (24 + 1 + 24 files)
2026-11-08T11:48:43Z [load_day 2025-05-05] 2025-05-05: 5731053 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:48:43Z [load_day 2025-05-05] attempt 1 succeeded