orcaLog in

Runs · run 4584

load_day 2025-11-06, attempt 1 succeeded

Host
73ccef5e07c2:401430
Started
2026-11-08T14:24:32Z
Ended
2026-11-08T14:25:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.4 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4584/load_day/2025-11-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:24:32Z [load_day 2025-11-06] attempt 1 started
2026-11-08T14:24:32Z [load_day 2025-11-06] 2025-11-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:24:37Z [load_day 2025-11-06] 2025-11-06 hour 0: 146110 events in 0 files, snapshot none (task 4244 ms: download 2730 ms overlapping gunzip 485 ms, parse 1408 ms, sort 0 ms, write 0 ms, index 918 ms: 6 candidates, 75578 repo-hours, 715 releases; waiting 1140 ms; commit 0 ms)
2026-11-08T14:24:37Z [load_day 2025-11-06] 2025-11-06 hour 1: 149131 events in 0 files, snapshot none (task 3280 ms: download 1989 ms overlapping gunzip 391 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 706 ms: 5 candidates, 90553 repo-hours, 713 releases; waiting 635 ms; commit 0 ms)
2026-11-08T14:24:41Z [load_day 2025-11-06] 2025-11-06 hour 2: 142993 events in 0 files, snapshot none (task 3325 ms: download 2107 ms overlapping gunzip 418 ms, parse 1340 ms, sort 0 ms, write 0 ms, index 595 ms: 8 candidates, 70533 repo-hours, 623 releases; waiting 617 ms; commit 0 ms)
2026-11-08T14:24:41Z [load_day 2025-11-06] 2025-11-06 hour 3: 141343 events in 0 files, snapshot none (task 3335 ms: download 2227 ms overlapping gunzip 434 ms, parse 1299 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 70600 repo-hours, 1525 releases; waiting 660 ms; commit 0 ms)
2026-11-08T14:24:45Z [load_day 2025-11-06] 2025-11-06 hour 4: 141446 events in 0 files, snapshot none (task 3472 ms: download 2327 ms overlapping gunzip 407 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 536 ms: 7 candidates, 67336 repo-hours, 569 releases; waiting 1081 ms; commit 0 ms)
2026-11-08T14:24:46Z [load_day 2025-11-06] 2025-11-06 hour 5: 145400 events in 0 files, snapshot none (task 4063 ms: download 2433 ms overlapping gunzip 340 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 560 ms: 5 candidates, 69027 repo-hours, 547 releases; waiting 1698 ms; commit 0 ms)
2026-11-08T14:24:49Z [load_day 2025-11-06] 2025-11-06 hour 6: 142673 events in 0 files, snapshot none (task 3114 ms: download 2055 ms overlapping gunzip 357 ms, parse 1090 ms, sort 0 ms, write 0 ms, index 615 ms: 3 candidates, 74835 repo-hours, 667 releases; waiting 734 ms; commit 0 ms)
2026-11-08T14:24:50Z [load_day 2025-11-06] 2025-11-06 hour 7: 142641 events in 0 files, snapshot none (task 3560 ms: download 2485 ms overlapping gunzip 411 ms, parse 1256 ms, sort 0 ms, write 0 ms, index 555 ms: 4 candidates, 70451 repo-hours, 541 releases; waiting 1041 ms; commit 0 ms)
2026-11-08T14:24:54Z [load_day 2025-11-06] 2025-11-06 hour 8: 142902 events in 0 files, snapshot none (task 4374 ms: download 3280 ms overlapping gunzip 410 ms, parse 1254 ms, sort 0 ms, write 0 ms, index 666 ms: 10 candidates, 74905 repo-hours, 667 releases; waiting 1662 ms; commit 0 ms)
2026-11-08T14:24:54Z [load_day 2025-11-06] 2025-11-06 hour 9: 142357 events in 0 files, snapshot none (task 3674 ms: download 2442 ms overlapping gunzip 446 ms, parse 1304 ms, sort 0 ms, write 0 ms, index 671 ms: 3 candidates, 76236 repo-hours, 710 releases; waiting 966 ms; commit 0 ms)
2026-11-08T14:24:56Z [load_day 2025-11-06] 2025-11-06 hour 10: 142875 events in 0 files, snapshot none (task 2357 ms: download 621 ms overlapping gunzip 377 ms, parse 1185 ms, sort 0 ms, write 0 ms, index 577 ms: 9 candidates, 75870 repo-hours, 709 releases; waiting 15 ms; commit 0 ms)
2026-11-08T14:24:58Z [load_day 2025-11-06] 2025-11-06 hour 11: 140514 events in 0 files, snapshot none (task 3449 ms: download 2228 ms overlapping gunzip 458 ms, parse 1290 ms, sort 0 ms, write 0 ms, index 600 ms: 6 candidates, 72903 repo-hours, 682 releases; waiting 720 ms; commit 0 ms)
2026-11-08T14:25:01Z [load_day 2025-11-06] 2025-11-06 hour 12: 153938 events in 0 files, snapshot none (task 3664 ms: download 1608 ms overlapping gunzip 357 ms, parse 1104 ms, sort 0 ms, write 0 ms, index 1191 ms: 5 candidates, 96229 repo-hours, 477 releases; waiting 650 ms; commit 0 ms)
2026-11-08T14:25:02Z [load_day 2025-11-06] 2025-11-06 hour 13: 151546 events in 0 files, snapshot none (task 3989 ms: download 2574 ms overlapping gunzip 526 ms, parse 1765 ms, sort 0 ms, write 0 ms, index 706 ms: 7 candidates, 88963 repo-hours, 578 releases; waiting 693 ms; commit 0 ms)
2026-11-08T14:25:06Z [load_day 2025-11-06] 2025-11-06 hour 14: 142832 events in 0 files, snapshot none (task 4151 ms: download 2306 ms overlapping gunzip 421 ms, parse 1338 ms, sort 0 ms, write 0 ms, index 925 ms: 4 candidates, 77918 repo-hours, 731 releases; waiting 1136 ms; commit 0 ms)
2026-11-08T14:25:06Z [load_day 2025-11-06] 2025-11-06 hour 15: 139861 events in 0 files, snapshot none (task 3611 ms: download 2148 ms overlapping gunzip 597 ms, parse 1587 ms, sort 0 ms, write 0 ms, index 569 ms: 10 candidates, 78263 repo-hours, 649 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:25:10Z [load_day 2025-11-06] 2025-11-06 hour 16: 143397 events in 0 files, snapshot none (task 3832 ms: download 1913 ms overlapping gunzip 536 ms, parse 1653 ms, sort 0 ms, write 0 ms, index 630 ms: 3 candidates, 79190 repo-hours, 756 releases; waiting 387 ms; commit 0 ms)
2026-11-08T14:25:11Z [load_day 2025-11-06] 2025-11-06 hour 17: 143501 events in 0 files, snapshot none (task 3770 ms: download 2228 ms overlapping gunzip 586 ms, parse 1700 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 75809 repo-hours, 754 releases; waiting 606 ms; commit 0 ms)
2026-11-08T14:25:14Z [load_day 2025-11-06] 2025-11-06 hour 18: 142318 events in 0 files, snapshot none (task 3672 ms: download 2161 ms overlapping gunzip 511 ms, parse 1597 ms, sort 0 ms, write 0 ms, index 627 ms: 2 candidates, 78275 repo-hours, 731 releases; waiting 600 ms; commit 0 ms)
2026-11-08T14:25:15Z [load_day 2025-11-06] 2025-11-06 hour 19: 147257 events in 0 files, snapshot none (task 3822 ms: download 2011 ms overlapping gunzip 584 ms, parse 1807 ms, sort 0 ms, write 0 ms, index 557 ms: 5 candidates, 68907 repo-hours, 646 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:25:19Z [load_day 2025-11-06] 2025-11-06 hour 20: 143883 events in 0 files, snapshot none (task 3644 ms: download 2260 ms overlapping gunzip 539 ms, parse 1656 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 71439 repo-hours, 740 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:25:19Z [load_day 2025-11-06] 2025-11-06 hour 21: 144151 events in 0 files, snapshot none (task 3795 ms: download 2246 ms overlapping gunzip 585 ms, parse 1836 ms, sort 0 ms, write 0 ms, index 533 ms: 6 candidates, 68891 repo-hours, 838 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:25:22Z [load_day 2025-11-06] 2025-11-06 hour 22: 146021 events in 0 files, snapshot none (task 3044 ms: download 1641 ms overlapping gunzip 434 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 68927 repo-hours, 850 releases; waiting 359 ms; commit 0 ms)
2026-11-08T14:25:23Z [load_day 2025-11-06] 2025-11-06 hour 23: 142293 events in 0 files, snapshot none (task 3249 ms: download 2156 ms overlapping gunzip 512 ms, parse 1534 ms, sort 0 ms, write 0 ms, index 502 ms: 8 candidates, 63126 repo-hours, 728 releases; waiting 424 ms; commit 0 ms)
2026-11-08T14:25:31Z [load_day 2025-11-06] 2025-11-06: repo_hour merged from 24 files to 1 (1804764 rows, 8008 ms)
2026-11-08T14:25:34Z [load_day 2025-11-06] 2025-11-06: index committed in 10733 ms (24 + 1 + 24 files)
2026-11-08T14:25:34Z [load_day 2025-11-06] 2025-11-06: 3461383 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:25:34Z [load_day 2025-11-06] attempt 1 succeeded