orcaLog in

Runs · run 4576

load_day 2025-11-04, attempt 1 succeeded

Host
73ccef5e07c2:400603
Started
2026-11-08T14:23:27Z
Ended
2026-11-08T14:24:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
698 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.5 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4576/load_day/2025-11-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:23:27Z [load_day 2025-11-04] attempt 1 started
2026-11-08T14:23:28Z [load_day 2025-11-04] 2025-11-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:23:33Z [load_day 2025-11-04] 2025-11-04 hour 0: 144768 events in 0 files, snapshot none (task 4225 ms: download 2506 ms overlapping gunzip 598 ms, parse 1729 ms, sort 0 ms, write 0 ms, index 778 ms: 8 candidates, 76490 repo-hours, 790 releases; waiting 702 ms; commit 0 ms)
2026-11-08T14:23:33Z [load_day 2025-11-04] 2025-11-04 hour 1: 154262 events in 0 files, snapshot none (task 4591 ms: download 2162 ms overlapping gunzip 693 ms, parse 2143 ms, sort 0 ms, write 0 ms, index 858 ms: 9 candidates, 93732 repo-hours, 594 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:23:39Z [load_day 2025-11-04] 2025-11-04 hour 2: 142021 events in 0 files, snapshot none (task 4889 ms: download 1812 ms overlapping gunzip 778 ms, parse 2392 ms, sort 0 ms, write 0 ms, index 858 ms: 5 candidates, 72573 repo-hours, 549 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:23:39Z [load_day 2025-11-04] 2025-11-04 hour 3: 139313 events in 0 files, snapshot none (task 4512 ms: download 2105 ms overlapping gunzip 696 ms, parse 2325 ms, sort 0 ms, write 0 ms, index 876 ms: 4 candidates, 68562 repo-hours, 1516 releases; waiting 308 ms; commit 0 ms)
2026-11-08T14:23:43Z [load_day 2025-11-04] 2025-11-04 hour 4: 143092 events in 0 files, snapshot none (task 3715 ms: download 2426 ms overlapping gunzip 399 ms, parse 1284 ms, sort 0 ms, write 0 ms, index 525 ms: 4 candidates, 65081 repo-hours, 474 releases; waiting 1154 ms; commit 0 ms)
2026-11-08T14:23:43Z [load_day 2025-11-04] 2025-11-04 hour 5: 143366 events in 0 files, snapshot none (task 3249 ms: download 2136 ms overlapping gunzip 456 ms, parse 1248 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 66974 repo-hours, 576 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:23:47Z [load_day 2025-11-04] 2025-11-04 hour 6: 148619 events in 0 files, snapshot none (task 3469 ms: download 2293 ms overlapping gunzip 380 ms, parse 1109 ms, sort 0 ms, write 0 ms, index 603 ms: 6 candidates, 77117 repo-hours, 673 releases; waiting 1093 ms; commit 0 ms)
2026-11-08T14:23:47Z [load_day 2025-11-04] 2025-11-04 hour 7: 145488 events in 0 files, snapshot none (task 3342 ms: download 2299 ms overlapping gunzip 431 ms, parse 1210 ms, sort 0 ms, write 0 ms, index 529 ms: 5 candidates, 71298 repo-hours, 579 releases; waiting 853 ms; commit 0 ms)
2026-11-08T14:23:51Z [load_day 2025-11-04] 2025-11-04 hour 8: 143960 events in 0 files, snapshot none (task 3363 ms: download 2358 ms overlapping gunzip 403 ms, parse 1238 ms, sort 0 ms, write 0 ms, index 521 ms: 6 candidates, 74428 repo-hours, 737 releases; waiting 838 ms; commit 0 ms)
2026-11-08T14:23:51Z [load_day 2025-11-04] 2025-11-04 hour 9: 145060 events in 0 files, snapshot none (task 3498 ms: download 2381 ms overlapping gunzip 420 ms, parse 1262 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 77546 repo-hours, 726 releases; waiting 810 ms; commit 0 ms)
2026-11-08T14:23:55Z [load_day 2025-11-04] 2025-11-04 hour 10: 145302 events in 0 files, snapshot none (task 4062 ms: download 2781 ms overlapping gunzip 475 ms, parse 1399 ms, sort 0 ms, write 0 ms, index 600 ms: 6 candidates, 76960 repo-hours, 628 releases; waiting 1268 ms; commit 0 ms)
2026-11-08T14:23:55Z [load_day 2025-11-04] 2025-11-04 hour 11: 148309 events in 0 files, snapshot none (task 3801 ms: download 2586 ms overlapping gunzip 469 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 712 ms: 5 candidates, 76051 repo-hours, 688 releases; waiting 938 ms; commit 0 ms)
2026-11-08T14:23:59Z [load_day 2025-11-04] 2025-11-04 hour 12: 153841 events in 0 files, snapshot none (task 3230 ms: download 2051 ms overlapping gunzip 320 ms, parse 1008 ms, sort 0 ms, write 0 ms, index 689 ms: 6 candidates, 95506 repo-hours, 537 releases; waiting 925 ms; commit 0 ms)
2026-11-08T14:23:59Z [load_day 2025-11-04] 2025-11-04 hour 13: 150045 events in 0 files, snapshot none (task 3200 ms: download 1927 ms overlapping gunzip 345 ms, parse 1141 ms, sort 0 ms, write 0 ms, index 626 ms: 2 candidates, 89215 repo-hours, 461 releases; waiting 806 ms; commit 0 ms)
2026-11-08T14:24:04Z [load_day 2025-11-04] 2025-11-04 hour 14: 141731 events in 0 files, snapshot none (task 3633 ms: download 1993 ms overlapping gunzip 497 ms, parse 1584 ms, sort 0 ms, write 0 ms, index 622 ms: 6 candidates, 78437 repo-hours, 509 releases; waiting 313 ms; commit 0 ms)
2026-11-08T14:24:04Z [load_day 2025-11-04] 2025-11-04 hour 15: 146069 events in 0 files, snapshot none (task 3806 ms: download 2365 ms overlapping gunzip 508 ms, parse 1648 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 81018 repo-hours, 603 releases; waiting 627 ms; commit 0 ms)
2026-11-08T14:24:08Z [load_day 2025-11-04] 2025-11-04 hour 16: 143555 events in 0 files, snapshot none (task 3597 ms: download 2017 ms overlapping gunzip 531 ms, parse 1494 ms, sort 0 ms, write 0 ms, index 683 ms: 12 candidates, 78488 repo-hours, 653 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:24:09Z [load_day 2025-11-04] 2025-11-04 hour 17: 146948 events in 0 files, snapshot none (task 4629 ms: download 2728 ms overlapping gunzip 460 ms, parse 1427 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 75601 repo-hours, 580 releases; waiting 1802 ms; commit 0 ms)
2026-11-08T14:24:12Z [load_day 2025-11-04] 2025-11-04 hour 18: 148340 events in 0 files, snapshot none (task 4131 ms: download 2897 ms overlapping gunzip 461 ms, parse 1456 ms, sort 0 ms, write 0 ms, index 573 ms: 1 candidates, 80140 repo-hours, 652 releases; waiting 1296 ms; commit 0 ms)
2026-11-08T14:24:12Z [load_day 2025-11-04] 2025-11-04 hour 19: 144104 events in 0 files, snapshot none (task 3112 ms: download 2011 ms overlapping gunzip 402 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 71481 repo-hours, 637 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:24:16Z [load_day 2025-11-04] 2025-11-04 hour 20: 145485 events in 0 files, snapshot none (task 3472 ms: download 2367 ms overlapping gunzip 500 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 619 ms: 5 candidates, 72848 repo-hours, 621 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:24:16Z [load_day 2025-11-04] 2025-11-04 hour 21: 144092 events in 0 files, snapshot none (task 3356 ms: download 2210 ms overlapping gunzip 454 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 524 ms: 5 candidates, 68353 repo-hours, 706 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:24:20Z [load_day 2025-11-04] 2025-11-04 hour 22: 145713 events in 0 files, snapshot none (task 3628 ms: download 2308 ms overlapping gunzip 494 ms, parse 1586 ms, sort 0 ms, write 0 ms, index 552 ms: 7 candidates, 66163 repo-hours, 693 releases; waiting 618 ms; commit 0 ms)
2026-11-08T14:24:20Z [load_day 2025-11-04] 2025-11-04 hour 23: 144686 events in 0 files, snapshot none (task 3349 ms: download 2320 ms overlapping gunzip 478 ms, parse 1556 ms, sort 0 ms, write 0 ms, index 467 ms: 9 candidates, 63198 repo-hours, 616 releases; waiting 522 ms; commit 0 ms)
2026-11-08T14:24:28Z [load_day 2025-11-04] 2025-11-04: repo_hour merged from 24 files to 1 (1817260 rows, 7881 ms)
2026-11-08T14:24:31Z [load_day 2025-11-04] 2025-11-04: index committed in 11032 ms (24 + 1 + 24 files)
2026-11-08T14:24:31Z [load_day 2025-11-04] 2025-11-04: 3498169 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:24:31Z [load_day 2025-11-04] attempt 1 succeeded