orcaLog in

Runs · run 2245

load_day 2024-03-27, attempt 1 succeeded

Host
73ccef5e07c2:102277
Started
2026-11-08T05:19:24Z
Ended
2026-11-08T05:21:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
843 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
187.1 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2245/load_day/2024-03-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:19:24Z [load_day 2024-03-27] attempt 1 started
2026-11-08T05:19:24Z [load_day 2024-03-27] 2024-03-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:19:33Z [load_day 2024-03-27] 2024-03-27 hour 0: 215279 events in 0 files, snapshot none (task 7963 ms: download 4286 ms overlapping gunzip 1116 ms, parse 5132 ms, sort 0 ms, write 0 ms, index 983 ms: 8 candidates, 101983 repo-hours, 1112 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:19:33Z [load_day 2024-03-27] 2024-03-27 hour 1: 212102 events in 0 files, snapshot none (task 7808 ms: download 4030 ms overlapping gunzip 1044 ms, parse 4585 ms, sort 0 ms, write 0 ms, index 1279 ms: 11 candidates, 102949 repo-hours, 861 releases; waiting 585 ms; commit 0 ms)
2026-11-08T05:19:42Z [load_day 2024-03-27] 2024-03-27 hour 2: 190619 events in 0 files, snapshot none (task 8214 ms: download 4309 ms overlapping gunzip 1135 ms, parse 4632 ms, sort 0 ms, write 0 ms, index 1583 ms: 2 candidates, 69454 repo-hours, 816 releases; waiting 570 ms; commit 0 ms)
2026-11-08T05:19:42Z [load_day 2024-03-27] 2024-03-27 hour 3: 185115 events in 0 files, snapshot none (task 8574 ms: download 4005 ms overlapping gunzip 1043 ms, parse 4165 ms, sort 0 ms, write 0 ms, index 2594 ms: 7 candidates, 66874 repo-hours, 846 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:19:55Z [load_day 2024-03-27] 2024-03-27 hour 4: 180913 events in 0 files, snapshot none (task 7799 ms: download 4694 ms overlapping gunzip 1304 ms, parse 5055 ms, sort 0 ms, write 0 ms, index 683 ms: 7 candidates, 62657 repo-hours, 577 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:19:56Z [load_day 2024-03-27] 2024-03-27 hour 5: 194796 events in 0 files, snapshot none (task 8960 ms: download 5985 ms overlapping gunzip 1580 ms, parse 5976 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 66195 repo-hours, 680 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:20:02Z [load_day 2024-03-27] 2024-03-27 hour 6: 207096 events in 0 files, snapshot none (task 6857 ms: download 3897 ms overlapping gunzip 993 ms, parse 4106 ms, sort 0 ms, write 0 ms, index 914 ms: 4 candidates, 80575 repo-hours, 864 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:20:03Z [load_day 2024-03-27] 2024-03-27 hour 7: 207855 events in 0 files, snapshot none (task 7034 ms: download 4023 ms overlapping gunzip 1048 ms, parse 4429 ms, sort 0 ms, write 0 ms, index 751 ms: 4 candidates, 78276 repo-hours, 840 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:20:11Z [load_day 2024-03-27] 2024-03-27 hour 8: 234028 events in 0 files, snapshot none (task 8223 ms: download 5572 ms overlapping gunzip 1268 ms, parse 5356 ms, sort 0 ms, write 0 ms, index 824 ms: 9 candidates, 89709 repo-hours, 1023 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:20:12Z [load_day 2024-03-27] 2024-03-27 hour 9: 243374 events in 0 files, snapshot none (task 8609 ms: download 5773 ms overlapping gunzip 1381 ms, parse 5597 ms, sort 0 ms, write 0 ms, index 850 ms: 9 candidates, 92750 repo-hours, 1305 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:20:19Z [load_day 2024-03-27] 2024-03-27 hour 10: 243695 events in 0 files, snapshot none (task 8235 ms: download 5695 ms overlapping gunzip 1243 ms, parse 5494 ms, sort 0 ms, write 0 ms, index 650 ms: 10 candidates, 92004 repo-hours, 1905 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:20:22Z [load_day 2024-03-27] 2024-03-27 hour 11: 232959 events in 0 files, snapshot none (task 8945 ms: download 5862 ms overlapping gunzip 1277 ms, parse 5347 ms, sort 0 ms, write 0 ms, index 1220 ms: 6 candidates, 87018 repo-hours, 1104 releases; waiting 801 ms; commit 0 ms)
2026-11-08T05:20:29Z [load_day 2024-03-27] 2024-03-27 hour 12: 285539 events in 0 files, snapshot none (task 8703 ms: download 5893 ms overlapping gunzip 1303 ms, parse 5838 ms, sort 0 ms, write 0 ms, index 776 ms: 5 candidates, 120651 repo-hours, 1206 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:20:32Z [load_day 2024-03-27] 2024-03-27 hour 13: 265591 events in 0 files, snapshot none (task 9104 ms: download 5584 ms overlapping gunzip 1326 ms, parse 5381 ms, sort 0 ms, write 0 ms, index 1655 ms: 7 candidates, 118511 repo-hours, 1162 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:20:38Z [load_day 2024-03-27] 2024-03-27 hour 14: 264620 events in 0 files, snapshot none (task 8843 ms: download 6286 ms overlapping gunzip 1454 ms, parse 5758 ms, sort 0 ms, write 0 ms, index 791 ms: 5 candidates, 105203 repo-hours, 1376 releases; waiting 585 ms; commit 0 ms)
2026-11-08T05:20:41Z [load_day 2024-03-27] 2024-03-27 hour 15: 266373 events in 0 files, snapshot none (task 8490 ms: download 6004 ms overlapping gunzip 1389 ms, parse 5608 ms, sort 0 ms, write 0 ms, index 724 ms: 8 candidates, 105642 repo-hours, 1528 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:20:46Z [load_day 2024-03-27] 2024-03-27 hour 16: 256227 events in 0 files, snapshot none (task 7944 ms: download 5513 ms overlapping gunzip 1287 ms, parse 5171 ms, sort 0 ms, write 0 ms, index 720 ms: 4 candidates, 100235 repo-hours, 1334 releases; waiting 561 ms; commit 0 ms)
2026-11-08T05:20:48Z [load_day 2024-03-27] 2024-03-27 hour 17: 244377 events in 0 files, snapshot none (task 7451 ms: download 5015 ms overlapping gunzip 1235 ms, parse 4727 ms, sort 0 ms, write 0 ms, index 687 ms: 3 candidates, 92227 repo-hours, 1226 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:20:57Z [load_day 2024-03-27] 2024-03-27 hour 18: 243908 events in 0 files, snapshot none (task 9785 ms: download 6945 ms overlapping gunzip 1626 ms, parse 6475 ms, sort 0 ms, write 0 ms, index 787 ms: 7 candidates, 96813 repo-hours, 1279 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:20:58Z [load_day 2024-03-27] 2024-03-27 hour 19: 214391 events in 0 files, snapshot none (task 8843 ms: download 6191 ms overlapping gunzip 1369 ms, parse 5954 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 80757 repo-hours, 1133 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:21:06Z [load_day 2024-03-27] 2024-03-27 hour 20: 222196 events in 0 files, snapshot none (task 8899 ms: download 6330 ms overlapping gunzip 1422 ms, parse 5986 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 87766 repo-hours, 1160 releases; waiting 569 ms; commit 0 ms)
2026-11-08T05:21:07Z [load_day 2024-03-27] 2024-03-27 hour 21: 208372 events in 0 files, snapshot none (task 8557 ms: download 6221 ms overlapping gunzip 1385 ms, parse 5862 ms, sort 0 ms, write 0 ms, index 526 ms: 6 candidates, 73263 repo-hours, 1028 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:21:18Z [load_day 2024-03-27] 2024-03-27 hour 22: 196300 events in 0 files, snapshot none (task 7417 ms: download 5087 ms overlapping gunzip 1227 ms, parse 4811 ms, sort 0 ms, write 0 ms, index 514 ms: 12 candidates, 67197 repo-hours, 1072 releases; waiting 612 ms; commit 0 ms)
2026-11-08T05:21:18Z [load_day 2024-03-27] 2024-03-27 hour 23: 180549 events in 0 files, snapshot none (task 6887 ms: download 4397 ms overlapping gunzip 1118 ms, parse 4473 ms, sort 0 ms, write 0 ms, index 482 ms: 4 candidates, 61689 repo-hours, 725 releases; waiting 475 ms; commit 0 ms)
2026-11-08T05:21:27Z [load_day 2024-03-27] 2024-03-27: repo_hour merged from 24 files to 1 (2100398 rows, 9047 ms)
2026-11-08T05:21:29Z [load_day 2024-03-27] 2024-03-27: index committed in 11238 ms (24 + 1 + 24 files)
2026-11-08T05:21:29Z [load_day 2024-03-27] 2024-03-27: 5396274 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:21:29Z [load_day 2024-03-27] attempt 1 succeeded