orcaLog in

Runs · run 4562

load_day 2025-10-31, attempt 1 succeeded

Host
73ccef5e07c2:399209
Started
2026-11-08T14:21:29Z
Ended
2026-11-08T14:22:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.5 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4562/load_day/2025-10-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:21:29Z [load_day 2025-10-31] attempt 1 started
2026-11-08T14:21:30Z [load_day 2025-10-31] 2025-10-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:21:34Z [load_day 2025-10-31] 2025-10-31 hour 0: 142136 events in 0 files, snapshot none (task 3421 ms: download 1958 ms overlapping gunzip 411 ms, parse 1422 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 73943 repo-hours, 798 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:21:34Z [load_day 2025-10-31] 2025-10-31 hour 1: 147535 events in 0 files, snapshot none (task 3725 ms: download 2203 ms overlapping gunzip 514 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 747 ms: 4 candidates, 90719 repo-hours, 627 releases; waiting 676 ms; commit 0 ms)
2026-11-08T14:21:38Z [load_day 2025-10-31] 2025-10-31 hour 2: 139811 events in 0 files, snapshot none (task 3682 ms: download 2734 ms overlapping gunzip 376 ms, parse 1226 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 69883 repo-hours, 614 releases; waiting 1230 ms; commit 0 ms)
2026-11-08T14:21:38Z [load_day 2025-10-31] 2025-10-31 hour 3: 143224 events in 0 files, snapshot none (task 3464 ms: download 2172 ms overlapping gunzip 390 ms, parse 1289 ms, sort 0 ms, write 0 ms, index 542 ms: 3 candidates, 69276 repo-hours, 1586 releases; waiting 934 ms; commit 0 ms)
2026-11-08T14:21:42Z [load_day 2025-10-31] 2025-10-31 hour 4: 142209 events in 0 files, snapshot none (task 2775 ms: download 1776 ms overlapping gunzip 325 ms, parse 1091 ms, sort 0 ms, write 0 ms, index 470 ms: 6 candidates, 62879 repo-hours, 517 releases; waiting 548 ms; commit 0 ms)
2026-11-08T14:21:42Z [load_day 2025-10-31] 2025-10-31 hour 5: 139621 events in 0 files, snapshot none (task 3205 ms: download 2300 ms overlapping gunzip 364 ms, parse 1151 ms, sort 0 ms, write 0 ms, index 514 ms: 8 candidates, 63867 repo-hours, 495 releases; waiting 856 ms; commit 0 ms)
2026-11-08T14:21:45Z [load_day 2025-10-31] 2025-10-31 hour 6: 146045 events in 0 files, snapshot none (task 3153 ms: download 2002 ms overlapping gunzip 324 ms, parse 1003 ms, sort 0 ms, write 0 ms, index 723 ms: 5 candidates, 74933 repo-hours, 562 releases; waiting 695 ms; commit 0 ms)
2026-11-08T14:21:46Z [load_day 2025-10-31] 2025-10-31 hour 7: 143975 events in 0 files, snapshot none (task 2892 ms: download 1948 ms overlapping gunzip 357 ms, parse 1125 ms, sort 0 ms, write 0 ms, index 505 ms: 2 candidates, 69297 repo-hours, 504 releases; waiting 672 ms; commit 0 ms)
2026-11-08T14:21:49Z [load_day 2025-10-31] 2025-10-31 hour 8: 142053 events in 0 files, snapshot none (task 3543 ms: download 2086 ms overlapping gunzip 405 ms, parse 1256 ms, sort 0 ms, write 0 ms, index 553 ms: 5 candidates, 70961 repo-hours, 641 releases; waiting 987 ms; commit 0 ms)
2026-11-08T14:21:49Z [load_day 2025-10-31] 2025-10-31 hour 9: 145117 events in 0 files, snapshot none (task 3094 ms: download 2073 ms overlapping gunzip 397 ms, parse 1188 ms, sort 0 ms, write 0 ms, index 589 ms: 4 candidates, 73493 repo-hours, 692 releases; waiting 609 ms; commit 0 ms)
2026-11-08T14:21:53Z [load_day 2025-10-31] 2025-10-31 hour 10: 144924 events in 0 files, snapshot none (task 3003 ms: download 1575 ms overlapping gunzip 473 ms, parse 1358 ms, sort 0 ms, write 0 ms, index 594 ms: 3 candidates, 74395 repo-hours, 684 releases; waiting 333 ms; commit 0 ms)
2026-11-08T14:21:53Z [load_day 2025-10-31] 2025-10-31 hour 11: 143946 events in 0 files, snapshot none (task 3469 ms: download 2199 ms overlapping gunzip 395 ms, parse 1270 ms, sort 0 ms, write 0 ms, index 662 ms: 5 candidates, 70469 repo-hours, 555 releases; waiting 761 ms; commit 0 ms)
2026-11-08T14:21:57Z [load_day 2025-10-31] 2025-10-31 hour 12: 152456 events in 0 files, snapshot none (task 3322 ms: download 1787 ms overlapping gunzip 418 ms, parse 1248 ms, sort 0 ms, write 0 ms, index 737 ms: 4 candidates, 93557 repo-hours, 548 releases; waiting 598 ms; commit 0 ms)
2026-11-08T14:21:57Z [load_day 2025-10-31] 2025-10-31 hour 13: 149073 events in 0 files, snapshot none (task 3465 ms: download 2290 ms overlapping gunzip 418 ms, parse 1256 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 86300 repo-hours, 597 releases; waiting 849 ms; commit 0 ms)
2026-11-08T14:22:00Z [load_day 2025-10-31] 2025-10-31 hour 14: 141553 events in 0 files, snapshot none (task 3218 ms: download 1902 ms overlapping gunzip 401 ms, parse 1188 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 75602 repo-hours, 713 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:22:01Z [load_day 2025-10-31] 2025-10-31 hour 15: 139869 events in 0 files, snapshot none (task 3134 ms: download 1077 ms overlapping gunzip 324 ms, parse 1011 ms, sort 0 ms, write 0 ms, index 645 ms: 2 candidates, 76160 repo-hours, 615 releases; waiting 130 ms; commit 0 ms)
2026-11-08T14:22:05Z [load_day 2025-10-31] 2025-10-31 hour 16: 141489 events in 0 files, snapshot none (task 3458 ms: download 2179 ms overlapping gunzip 430 ms, parse 1237 ms, sort 0 ms, write 0 ms, index 650 ms: 5 candidates, 74840 repo-hours, 610 releases; waiting 794 ms; commit 0 ms)
2026-11-08T14:22:05Z [load_day 2025-10-31] 2025-10-31 hour 17: 142407 events in 0 files, snapshot none (task 2767 ms: download 1651 ms overlapping gunzip 361 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 597 ms: 5 candidates, 71393 repo-hours, 573 releases; waiting 372 ms; commit 0 ms)
2026-11-08T14:22:09Z [load_day 2025-10-31] 2025-10-31 hour 18: 144941 events in 0 files, snapshot none (task 3292 ms: download 2102 ms overlapping gunzip 382 ms, parse 1192 ms, sort 0 ms, write 0 ms, index 812 ms: 4 candidates, 76278 repo-hours, 682 releases; waiting 673 ms; commit 0 ms)
2026-11-08T14:22:09Z [load_day 2025-10-31] 2025-10-31 hour 19: 143799 events in 0 files, snapshot none (task 3701 ms: download 2194 ms overlapping gunzip 427 ms, parse 1313 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 66562 repo-hours, 594 releases; waiting 965 ms; commit 0 ms)
2026-11-08T14:22:12Z [load_day 2025-10-31] 2025-10-31 hour 20: 141571 events in 0 files, snapshot none (task 2716 ms: download 1398 ms overlapping gunzip 364 ms, parse 1129 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 66709 repo-hours, 523 releases; waiting 369 ms; commit 0 ms)
2026-11-08T14:22:12Z [load_day 2025-10-31] 2025-10-31 hour 21: 137483 events in 0 files, snapshot none (task 2954 ms: download 1807 ms overlapping gunzip 417 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 438 ms: 9 candidates, 62685 repo-hours, 584 releases; waiting 642 ms; commit 0 ms)
2026-11-08T14:22:15Z [load_day 2025-10-31] 2025-10-31 hour 22: 139077 events in 0 files, snapshot none (task 2823 ms: download 1569 ms overlapping gunzip 449 ms, parse 1302 ms, sort 0 ms, write 0 ms, index 435 ms: 9 candidates, 60822 repo-hours, 631 releases; waiting 315 ms; commit 0 ms)
2026-11-08T14:22:16Z [load_day 2025-10-31] 2025-10-31 hour 23: 135162 events in 0 files, snapshot none (task 3438 ms: download 2331 ms overlapping gunzip 392 ms, parse 1211 ms, sort 0 ms, write 0 ms, index 461 ms: 2 candidates, 56897 repo-hours, 725 releases; waiting 990 ms; commit 0 ms)
2026-11-08T14:22:25Z [load_day 2025-10-31] 2025-10-31: repo_hour merged from 24 files to 1 (1731920 rows, 8547 ms)
2026-11-08T14:22:28Z [load_day 2025-10-31] 2025-10-31: index committed in 11410 ms (24 + 1 + 24 files)
2026-11-08T14:22:28Z [load_day 2025-10-31] 2025-10-31: 3429476 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:22:28Z [load_day 2025-10-31] attempt 1 succeeded