orcaLog in

Runs · run 3910

load_day 2025-05-16, attempt 1 succeeded

Host
73ccef5e07c2:306277
Started
2026-11-08T11:58:25Z
Ended
2026-11-08T12:00:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
855 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
202.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3910/load_day/2025-05-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:58:25Z [load_day 2025-05-16] attempt 1 started
2026-11-08T11:58:26Z [load_day 2025-05-16] 2025-05-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:58:34Z [load_day 2025-05-16] 2025-05-16 hour 0: 195380 events in 0 files, snapshot none (task 7487 ms: download 4369 ms overlapping gunzip 1096 ms, parse 4416 ms, sort 0 ms, write 0 ms, index 912 ms: 20 candidates, 91449 repo-hours, 1457 releases; waiting 639 ms; commit 0 ms)
2026-11-08T11:58:34Z [load_day 2025-05-16] 2025-05-16 hour 1: 221278 events in 0 files, snapshot none (task 7598 ms: download 4114 ms overlapping gunzip 1100 ms, parse 4627 ms, sort 0 ms, write 0 ms, index 1055 ms: 10 candidates, 123001 repo-hours, 1112 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:58:43Z [load_day 2025-05-16] 2025-05-16 hour 2: 199209 events in 0 files, snapshot none (task 8191 ms: download 4665 ms overlapping gunzip 1216 ms, parse 5084 ms, sort 0 ms, write 0 ms, index 1064 ms: 11 candidates, 91411 repo-hours, 973 releases; waiting 553 ms; commit 0 ms)
2026-11-08T11:58:43Z [load_day 2025-05-16] 2025-05-16 hour 3: 205666 events in 0 files, snapshot none (task 8238 ms: download 4718 ms overlapping gunzip 1280 ms, parse 5397 ms, sort 0 ms, write 0 ms, index 684 ms: 6 candidates, 89820 repo-hours, 2859 releases; waiting 574 ms; commit 0 ms)
2026-11-08T11:58:51Z [load_day 2025-05-16] 2025-05-16 hour 4: 192220 events in 0 files, snapshot none (task 7615 ms: download 4533 ms overlapping gunzip 1060 ms, parse 4705 ms, sort 0 ms, write 0 ms, index 996 ms: 6 candidates, 75192 repo-hours, 1022 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:58:52Z [load_day 2025-05-16] 2025-05-16 hour 5: 204715 events in 0 files, snapshot none (task 7898 ms: download 4957 ms overlapping gunzip 1295 ms, parse 5323 ms, sort 0 ms, write 0 ms, index 652 ms: 7 candidates, 83212 repo-hours, 1045 releases; waiting 211 ms; commit 0 ms)
2026-11-08T11:59:02Z [load_day 2025-05-16] 2025-05-16 hour 6: 229907 events in 0 files, snapshot none (task 10270 ms: download 7028 ms overlapping gunzip 1656 ms, parse 6673 ms, sort 0 ms, write 0 ms, index 1076 ms: 7 candidates, 105017 repo-hours, 1162 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:59:02Z [load_day 2025-05-16] 2025-05-16 hour 7: 232310 events in 0 files, snapshot none (task 10238 ms: download 7319 ms overlapping gunzip 1754 ms, parse 7112 ms, sort 0 ms, write 0 ms, index 873 ms: 6 candidates, 97637 repo-hours, 1043 releases; waiting 189 ms; commit 0 ms)
2026-11-08T11:59:14Z [load_day 2025-05-16] 2025-05-16 hour 8: 235707 events in 0 files, snapshot none (task 11776 ms: download 8511 ms overlapping gunzip 1960 ms, parse 8034 ms, sort 0 ms, write 0 ms, index 904 ms: 10 candidates, 104099 repo-hours, 1235 releases; waiting 553 ms; commit 0 ms)
2026-11-08T11:59:14Z [load_day 2025-05-16] 2025-05-16 hour 9: 244487 events in 0 files, snapshot none (task 11304 ms: download 7965 ms overlapping gunzip 1814 ms, parse 8004 ms, sort 0 ms, write 0 ms, index 863 ms: 6 candidates, 106334 repo-hours, 1397 releases; waiting 177 ms; commit 0 ms)
2026-11-08T11:59:24Z [load_day 2025-05-16] 2025-05-16 hour 10: 235440 events in 0 files, snapshot none (task 9251 ms: download 5952 ms overlapping gunzip 1422 ms, parse 5973 ms, sort 0 ms, write 0 ms, index 1027 ms: 6 candidates, 101161 repo-hours, 1300 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:59:27Z [load_day 2025-05-16] 2025-05-16 hour 11: 232112 events in 0 files, snapshot none (task 12422 ms: download 8728 ms overlapping gunzip 1750 ms, parse 6841 ms, sort 0 ms, write 0 ms, index 888 ms: 6 candidates, 96620 repo-hours, 1054 releases; waiting 2523 ms; commit 0 ms)
2026-11-08T11:59:33Z [load_day 2025-05-16] 2025-05-16 hour 12: 266714 events in 0 files, snapshot none (task 8464 ms: download 5620 ms overlapping gunzip 1292 ms, parse 5734 ms, sort 0 ms, write 0 ms, index 985 ms: 10 candidates, 139425 repo-hours, 1306 releases; waiting 211 ms; commit 0 ms)
2026-11-08T11:59:35Z [load_day 2025-05-16] 2025-05-16 hour 13: 257515 events in 0 files, snapshot none (task 8057 ms: download 5276 ms overlapping gunzip 1268 ms, parse 5335 ms, sort 0 ms, write 0 ms, index 888 ms: 11 candidates, 124950 repo-hours, 1222 releases; waiting 206 ms; commit 0 ms)
2026-11-08T11:59:45Z [load_day 2025-05-16] 2025-05-16 hour 14: 254415 events in 0 files, snapshot none (task 11542 ms: download 8705 ms overlapping gunzip 1385 ms, parse 5729 ms, sort 0 ms, write 0 ms, index 789 ms: 5 candidates, 110247 repo-hours, 1379 releases; waiting 3175 ms; commit 0 ms)
2026-11-08T11:59:45Z [load_day 2025-05-16] 2025-05-16 hour 15: 252943 events in 0 files, snapshot none (task 7600 ms: download 5100 ms overlapping gunzip 1203 ms, parse 5098 ms, sort 0 ms, write 0 ms, index 765 ms: 12 candidates, 113169 repo-hours, 1340 releases; waiting 291 ms; commit 0 ms)
2026-11-08T11:59:56Z [load_day 2025-05-16] 2025-05-16 hour 16: 248934 events in 0 files, snapshot none (task 10859 ms: download 7764 ms overlapping gunzip 1773 ms, parse 7387 ms, sort 0 ms, write 0 ms, index 845 ms: 13 candidates, 105953 repo-hours, 1329 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:59:56Z [load_day 2025-05-16] 2025-05-16 hour 17: 234596 events in 0 files, snapshot none (task 10723 ms: download 7665 ms overlapping gunzip 1645 ms, parse 7431 ms, sort 0 ms, write 0 ms, index 833 ms: 16 candidates, 95105 repo-hours, 1156 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:00:09Z [load_day 2025-05-16] 2025-05-16 hour 18: 246948 events in 0 files, snapshot none (task 12083 ms: download 8439 ms overlapping gunzip 1796 ms, parse 7491 ms, sort 0 ms, write 0 ms, index 948 ms: 14 candidates, 112593 repo-hours, 1309 releases; waiting 1604 ms; commit 0 ms)
2026-11-08T12:00:09Z [load_day 2025-05-16] 2025-05-16 hour 19: 227641 events in 0 files, snapshot none (task 10701 ms: download 7035 ms overlapping gunzip 1694 ms, parse 7122 ms, sort 0 ms, write 0 ms, index 1133 ms: 2 candidates, 87703 repo-hours, 1206 releases; waiting 477 ms; commit 0 ms)
2026-11-08T12:00:18Z [load_day 2025-05-16] 2025-05-16 hour 20: 217532 events in 0 files, snapshot none (task 9320 ms: download 6667 ms overlapping gunzip 1463 ms, parse 6358 ms, sort 0 ms, write 0 ms, index 658 ms: 8 candidates, 87417 repo-hours, 1278 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:00:18Z [load_day 2025-05-16] 2025-05-16 hour 21: 205549 events in 0 files, snapshot none (task 9332 ms: download 6768 ms overlapping gunzip 1468 ms, parse 6182 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 81271 repo-hours, 1299 releases; waiting 796 ms; commit 0 ms)
2026-11-08T12:00:28Z [load_day 2025-05-16] 2025-05-16 hour 22: 186629 events in 0 files, snapshot none (task 8838 ms: download 6289 ms overlapping gunzip 1019 ms, parse 4465 ms, sort 0 ms, write 0 ms, index 671 ms: 8 candidates, 69491 repo-hours, 1074 releases; waiting 2351 ms; commit 0 ms)
2026-11-08T12:00:28Z [load_day 2025-05-16] 2025-05-16 hour 23: 180244 events in 0 files, snapshot none (task 6974 ms: download 4026 ms overlapping gunzip 1062 ms, parse 4512 ms, sort 0 ms, write 0 ms, index 575 ms: 20 candidates, 68633 repo-hours, 1220 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:00:38Z [load_day 2025-05-16] 2025-05-16: repo_hour merged from 24 files to 1 (2360910 rows, 10258 ms)
2026-11-08T12:00:41Z [load_day 2025-05-16] 2025-05-16: index committed in 13315 ms (24 + 1 + 24 files)
2026-11-08T12:00:41Z [load_day 2025-05-16] 2025-05-16: 5408091 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:00:41Z [load_day 2025-05-16] attempt 1 succeeded