orcaLog in

Runs · run 4066

load_day 2025-06-25, attempt 1 succeeded

Host
73ccef5e07c2:330561
Started
2026-11-08T12:38:13Z
Ended
2026-11-08T12:40:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
687 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
158.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4066/load_day/2025-06-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:38:13Z [load_day 2025-06-25] attempt 1 started
2026-11-08T12:38:13Z [load_day 2025-06-25] 2025-06-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:38:24Z [load_day 2025-06-25] 2025-06-25 hour 0: 145915 events in 0 files, snapshot none (task 9377 ms: download 6636 ms overlapping gunzip 1805 ms, parse 6242 ms, sort 0 ms, write 0 ms, index 632 ms: 12 candidates, 71614 repo-hours, 985 releases; waiting 440 ms; commit 0 ms)
2026-11-08T12:38:24Z [load_day 2025-06-25] 2025-06-25 hour 1: 153434 events in 0 files, snapshot none (task 8980 ms: download 5868 ms overlapping gunzip 1620 ms, parse 5975 ms, sort 0 ms, write 0 ms, index 813 ms: 12 candidates, 87874 repo-hours, 718 releases; waiting 361 ms; commit 0 ms)
2026-11-08T12:38:32Z [load_day 2025-06-25] 2025-06-25 hour 2: 149470 events in 0 files, snapshot none (task 7938 ms: download 4553 ms overlapping gunzip 1212 ms, parse 4626 ms, sort 0 ms, write 0 ms, index 1347 ms: 7 candidates, 74973 repo-hours, 857 releases; waiting 473 ms; commit 0 ms)
2026-11-08T12:38:33Z [load_day 2025-06-25] 2025-06-25 hour 3: 145219 events in 0 files, snapshot none (task 8542 ms: download 4864 ms overlapping gunzip 1396 ms, parse 5205 ms, sort 0 ms, write 0 ms, index 1066 ms: 8 candidates, 69331 repo-hours, 1572 releases; waiting 597 ms; commit 0 ms)
2026-11-08T12:38:40Z [load_day 2025-06-25] 2025-06-25 hour 4: 145633 events in 0 files, snapshot none (task 7226 ms: download 4711 ms overlapping gunzip 1146 ms, parse 4528 ms, sort 0 ms, write 0 ms, index 553 ms: 8 candidates, 64986 repo-hours, 1220 releases; waiting 745 ms; commit 0 ms)
2026-11-08T12:38:41Z [load_day 2025-06-25] 2025-06-25 hour 5: 149992 events in 0 files, snapshot none (task 7296 ms: download 5080 ms overlapping gunzip 1250 ms, parse 4712 ms, sort 0 ms, write 0 ms, index 515 ms: 9 candidates, 66071 repo-hours, 671 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:38:49Z [load_day 2025-06-25] 2025-06-25 hour 6: 158992 events in 0 files, snapshot none (task 8376 ms: download 5391 ms overlapping gunzip 1480 ms, parse 5639 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 79325 repo-hours, 836 releases; waiting 249 ms; commit 0 ms)
2026-11-08T12:38:50Z [load_day 2025-06-25] 2025-06-25 hour 7: 156103 events in 0 files, snapshot none (task 8680 ms: download 6192 ms overlapping gunzip 1414 ms, parse 5803 ms, sort 0 ms, write 0 ms, index 611 ms: 9 candidates, 75829 repo-hours, 794 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:38:59Z [load_day 2025-06-25] 2025-06-25 hour 8: 156680 events in 0 files, snapshot none (task 9744 ms: download 7340 ms overlapping gunzip 1470 ms, parse 5477 ms, sort 0 ms, write 0 ms, index 652 ms: 13 candidates, 77870 repo-hours, 825 releases; waiting 1821 ms; commit 0 ms)
2026-11-08T12:38:59Z [load_day 2025-06-25] 2025-06-25 hour 9: 159030 events in 0 files, snapshot none (task 8212 ms: download 5709 ms overlapping gunzip 1363 ms, parse 5292 ms, sort 0 ms, write 0 ms, index 655 ms: 6 candidates, 80196 repo-hours, 845 releases; waiting 615 ms; commit 0 ms)
2026-11-08T12:39:09Z [load_day 2025-06-25] 2025-06-25 hour 10: 159061 events in 0 files, snapshot none (task 9402 ms: download 6836 ms overlapping gunzip 1563 ms, parse 6378 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 78321 repo-hours, 806 releases; waiting 584 ms; commit 0 ms)
2026-11-08T12:39:09Z [load_day 2025-06-25] 2025-06-25 hour 11: 161123 events in 0 files, snapshot none (task 8649 ms: download 5682 ms overlapping gunzip 1450 ms, parse 5860 ms, sort 0 ms, write 0 ms, index 609 ms: 11 candidates, 74700 repo-hours, 867 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:39:19Z [load_day 2025-06-25] 2025-06-25 hour 12: 167193 events in 0 files, snapshot none (task 9480 ms: download 5179 ms overlapping gunzip 1532 ms, parse 6077 ms, sort 0 ms, write 0 ms, index 985 ms: 8 candidates, 97634 repo-hours, 789 releases; waiting 540 ms; commit 0 ms)
2026-11-08T12:39:19Z [load_day 2025-06-25] 2025-06-25 hour 13: 164631 events in 0 files, snapshot none (task 9311 ms: download 6011 ms overlapping gunzip 1527 ms, parse 6011 ms, sort 0 ms, write 0 ms, index 1032 ms: 6 candidates, 91152 repo-hours, 765 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:39:29Z [load_day 2025-06-25] 2025-06-25 hour 14: 165551 events in 0 files, snapshot none (task 9889 ms: download 6808 ms overlapping gunzip 1611 ms, parse 6743 ms, sort 0 ms, write 0 ms, index 759 ms: 14 candidates, 83222 repo-hours, 881 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:39:29Z [load_day 2025-06-25] 2025-06-25 hour 15: 165824 events in 0 files, snapshot none (task 10033 ms: download 6626 ms overlapping gunzip 1669 ms, parse 6996 ms, sort 0 ms, write 0 ms, index 772 ms: 11 candidates, 84696 repo-hours, 970 releases; waiting 300 ms; commit 0 ms)
2026-11-08T12:39:39Z [load_day 2025-06-25] 2025-06-25 hour 16: 164529 events in 0 files, snapshot none (task 9131 ms: download 6179 ms overlapping gunzip 1455 ms, parse 6141 ms, sort 0 ms, write 0 ms, index 731 ms: 14 candidates, 82238 repo-hours, 799 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:39:39Z [load_day 2025-06-25] 2025-06-25 hour 17: 158438 events in 0 files, snapshot none (task 7818 ms: download 4391 ms overlapping gunzip 1314 ms, parse 5365 ms, sort 0 ms, write 0 ms, index 697 ms: 11 candidates, 76254 repo-hours, 738 releases; waiting 180 ms; commit 0 ms)
2026-11-08T12:39:47Z [load_day 2025-06-25] 2025-06-25 hour 18: 158772 events in 0 files, snapshot none (task 8123 ms: download 4630 ms overlapping gunzip 1204 ms, parse 5206 ms, sort 0 ms, write 0 ms, index 900 ms: 7 candidates, 80003 repo-hours, 882 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:39:47Z [load_day 2025-06-25] 2025-06-25 hour 19: 158194 events in 0 files, snapshot none (task 8126 ms: download 4770 ms overlapping gunzip 1308 ms, parse 5464 ms, sort 0 ms, write 0 ms, index 788 ms: 6 candidates, 71356 repo-hours, 839 releases; waiting 202 ms; commit 0 ms)
2026-11-08T12:39:55Z [load_day 2025-06-25] 2025-06-25 hour 20: 152046 events in 0 files, snapshot none (task 7572 ms: download 5156 ms overlapping gunzip 875 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 600 ms: 17 candidates, 70351 repo-hours, 829 releases; waiting 2228 ms; commit 0 ms)
2026-11-08T12:39:55Z [load_day 2025-06-25] 2025-06-25 hour 21: 150131 events in 0 files, snapshot none (task 5645 ms: download 3217 ms overlapping gunzip 842 ms, parse 3439 ms, sort 0 ms, write 0 ms, index 531 ms: 8 candidates, 66535 repo-hours, 853 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:40:01Z [load_day 2025-06-25] 2025-06-25 hour 22: 144158 events in 0 files, snapshot none (task 5114 ms: download 3248 ms overlapping gunzip 751 ms, parse 3052 ms, sort 0 ms, write 0 ms, index 439 ms: 4 candidates, 60025 repo-hours, 892 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:40:01Z [load_day 2025-06-25] 2025-06-25 hour 23: 141850 events in 0 files, snapshot none (task 4973 ms: download 2905 ms overlapping gunzip 736 ms, parse 2943 ms, sort 0 ms, write 0 ms, index 487 ms: 12 candidates, 59159 repo-hours, 880 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:40:09Z [load_day 2025-06-25] 2025-06-25: repo_hour merged from 24 files to 1 (1823715 rows, 8566 ms)
2026-11-08T12:40:13Z [load_day 2025-06-25] 2025-06-25: index committed in 11877 ms (24 + 1 + 24 files)
2026-11-08T12:40:13Z [load_day 2025-06-25] 2025-06-25: 3731969 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:40:13Z [load_day 2025-06-25] attempt 1 succeeded