orcaLog in

Runs · run 3747

load_day 2025-04-03, attempt 1 succeeded

Host
73ccef5e07c2:281944
Started
2026-11-08T11:11:55Z
Ended
2026-11-08T11:14:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
908 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
210.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3747/load_day/2025-04-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:11:55Z [load_day 2025-04-03] attempt 1 started
2026-11-08T11:11:56Z [load_day 2025-04-03] 2025-04-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:12:05Z [load_day 2025-04-03] 2025-04-03 hour 0: 206245 events in 0 files, snapshot none (task 8320 ms: download 5033 ms overlapping gunzip 1347 ms, parse 5337 ms, sort 0 ms, write 0 ms, index 819 ms: 5 candidates, 96838 repo-hours, 1242 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:12:05Z [load_day 2025-04-03] 2025-04-03 hour 1: 234271 events in 0 files, snapshot none (task 8265 ms: download 4886 ms overlapping gunzip 1199 ms, parse 5229 ms, sort 0 ms, write 0 ms, index 1057 ms: 9 candidates, 126494 repo-hours, 1039 releases; waiting 549 ms; commit 0 ms)
2026-11-08T11:12:13Z [load_day 2025-04-03] 2025-04-03 hour 2: 205789 events in 0 files, snapshot none (task 8291 ms: download 5542 ms overlapping gunzip 1305 ms, parse 5468 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 87990 repo-hours, 1012 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:12:14Z [load_day 2025-04-03] 2025-04-03 hour 3: 212250 events in 0 files, snapshot none (task 8765 ms: download 5538 ms overlapping gunzip 1307 ms, parse 5575 ms, sort 0 ms, write 0 ms, index 1022 ms: 4 candidates, 86522 repo-hours, 2971 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:12:22Z [load_day 2025-04-03] 2025-04-03 hour 4: 196728 events in 0 files, snapshot none (task 7995 ms: download 5111 ms overlapping gunzip 1256 ms, parse 5188 ms, sort 0 ms, write 0 ms, index 669 ms: 8 candidates, 74132 repo-hours, 820 releases; waiting 613 ms; commit 0 ms)
2026-11-08T11:12:23Z [load_day 2025-04-03] 2025-04-03 hour 5: 207152 events in 0 files, snapshot none (task 8050 ms: download 5181 ms overlapping gunzip 1228 ms, parse 5511 ms, sort 0 ms, write 0 ms, index 699 ms: 4 candidates, 82104 repo-hours, 902 releases; waiting 169 ms; commit 0 ms)
2026-11-08T11:12:32Z [load_day 2025-04-03] 2025-04-03 hour 6: 244567 events in 0 files, snapshot none (task 9635 ms: download 5456 ms overlapping gunzip 1359 ms, parse 5694 ms, sort 0 ms, write 0 ms, index 1693 ms: 4 candidates, 105703 repo-hours, 1281 releases; waiting 573 ms; commit 0 ms)
2026-11-08T11:12:34Z [load_day 2025-04-03] 2025-04-03 hour 7: 247413 events in 0 files, snapshot none (task 10788 ms: download 7741 ms overlapping gunzip 1721 ms, parse 7477 ms, sort 0 ms, write 0 ms, index 850 ms: 14 candidates, 99150 repo-hours, 1142 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:12:44Z [load_day 2025-04-03] 2025-04-03 hour 8: 260237 events in 0 files, snapshot none (task 11199 ms: download 7537 ms overlapping gunzip 1762 ms, parse 7404 ms, sort 0 ms, write 0 ms, index 1114 ms: 4 candidates, 108352 repo-hours, 1324 releases; waiting 642 ms; commit 0 ms)
2026-11-08T11:12:44Z [load_day 2025-04-03] 2025-04-03 hour 9: 264098 events in 0 files, snapshot none (task 10091 ms: download 6807 ms overlapping gunzip 1610 ms, parse 6758 ms, sort 0 ms, write 0 ms, index 1014 ms: 6 candidates, 110323 repo-hours, 1415 releases; waiting 482 ms; commit 0 ms)
2026-11-08T11:12:54Z [load_day 2025-04-03] 2025-04-03 hour 10: 251528 events in 0 files, snapshot none (task 9443 ms: download 6347 ms overlapping gunzip 1405 ms, parse 6115 ms, sort 0 ms, write 0 ms, index 1124 ms: 7 candidates, 103711 repo-hours, 1305 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:12:54Z [load_day 2025-04-03] 2025-04-03 hour 11: 248791 events in 0 files, snapshot none (task 9275 ms: download 6215 ms overlapping gunzip 1470 ms, parse 6185 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 101656 repo-hours, 1342 releases; waiting 466 ms; commit 0 ms)
2026-11-08T11:13:04Z [load_day 2025-04-03] 2025-04-03 hour 12: 283942 events in 0 files, snapshot none (task 10061 ms: download 6695 ms overlapping gunzip 1534 ms, parse 6370 ms, sort 0 ms, write 0 ms, index 1338 ms: 6 candidates, 143670 repo-hours, 1597 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:13:06Z [load_day 2025-04-03] 2025-04-03 hour 13: 280078 events in 0 files, snapshot none (task 10951 ms: download 7594 ms overlapping gunzip 1776 ms, parse 7204 ms, sort 0 ms, write 0 ms, index 1061 ms: 9 candidates, 130807 repo-hours, 1246 releases; waiting 457 ms; commit 0 ms)
2026-11-08T11:13:17Z [load_day 2025-04-03] 2025-04-03 hour 14: 273753 events in 0 files, snapshot none (task 12137 ms: download 9058 ms overlapping gunzip 1888 ms, parse 7982 ms, sort 0 ms, write 0 ms, index 851 ms: 12 candidates, 115868 repo-hours, 1472 releases; waiting 1097 ms; commit 0 ms)
2026-11-08T11:13:17Z [load_day 2025-04-03] 2025-04-03 hour 15: 274446 events in 0 files, snapshot none (task 11304 ms: download 7975 ms overlapping gunzip 1793 ms, parse 7692 ms, sort 0 ms, write 0 ms, index 923 ms: 10 candidates, 118119 repo-hours, 1492 releases; waiting 589 ms; commit 0 ms)
2026-11-08T11:13:26Z [load_day 2025-04-03] 2025-04-03 hour 16: 263546 events in 0 files, snapshot none (task 8610 ms: download 5894 ms overlapping gunzip 1315 ms, parse 5667 ms, sort 0 ms, write 0 ms, index 856 ms: 10 candidates, 110683 repo-hours, 1371 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:13:26Z [load_day 2025-04-03] 2025-04-03 hour 17: 253343 events in 0 files, snapshot none (task 8053 ms: download 5383 ms overlapping gunzip 1225 ms, parse 5243 ms, sort 0 ms, write 0 ms, index 779 ms: 18 candidates, 103363 repo-hours, 1199 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:13:35Z [load_day 2025-04-03] 2025-04-03 hour 18: 261072 events in 0 files, snapshot none (task 8323 ms: download 5668 ms overlapping gunzip 1273 ms, parse 5496 ms, sort 0 ms, write 0 ms, index 823 ms: 9 candidates, 116236 repo-hours, 1378 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:13:35Z [load_day 2025-04-03] 2025-04-03 hour 19: 242529 events in 0 files, snapshot none (task 7900 ms: download 5281 ms overlapping gunzip 1248 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 827 ms: 16 candidates, 94581 repo-hours, 1210 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:13:47Z [load_day 2025-04-03] 2025-04-03 hour 20: 231290 events in 0 files, snapshot none (task 11424 ms: download 8795 ms overlapping gunzip 1966 ms, parse 7896 ms, sort 0 ms, write 0 ms, index 768 ms: 17 candidates, 93114 repo-hours, 1167 releases; waiting 440 ms; commit 0 ms)
2026-11-08T11:13:47Z [load_day 2025-04-03] 2025-04-03 hour 21: 220303 events in 0 files, snapshot none (task 10348 ms: download 7235 ms overlapping gunzip 1727 ms, parse 7024 ms, sort 0 ms, write 0 ms, index 770 ms: 13 candidates, 87297 repo-hours, 1267 releases; waiting 543 ms; commit 0 ms)
2026-11-08T11:13:55Z [load_day 2025-04-03] 2025-04-03 hour 22: 201302 events in 0 files, snapshot none (task 7779 ms: download 5351 ms overlapping gunzip 1371 ms, parse 5423 ms, sort 0 ms, write 0 ms, index 561 ms: 11 candidates, 76515 repo-hours, 1145 releases; waiting 178 ms; commit 0 ms)
2026-11-08T11:13:55Z [load_day 2025-04-03] 2025-04-03 hour 23: 189844 events in 0 files, snapshot none (task 7785 ms: download 5206 ms overlapping gunzip 1208 ms, parse 5135 ms, sort 0 ms, write 0 ms, index 551 ms: 10 candidates, 71594 repo-hours, 1246 releases; waiting 474 ms; commit 0 ms)
2026-11-08T11:14:05Z [load_day 2025-04-03] 2025-04-03: repo_hour merged from 24 files to 1 (2444822 rows, 9878 ms)
2026-11-08T11:14:08Z [load_day 2025-04-03] 2025-04-03: index committed in 12657 ms (24 + 1 + 24 files)
2026-11-08T11:14:08Z [load_day 2025-04-03] 2025-04-03: 5754517 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:14:08Z [load_day 2025-04-03] attempt 1 succeeded