orcaLog in

Runs · run 3482

load_day 2025-01-26, attempt 1 succeeded

Host
73ccef5e07c2:244198
Started
2026-11-08T10:00:51Z
Ended
2026-11-08T10:02:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
131.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3482/load_day/2025-01-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:00:52Z [load_day 2025-01-26] attempt 1 started
2026-11-08T10:00:53Z [load_day 2025-01-26] 2025-01-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:00:58Z [load_day 2025-01-26] 2025-01-26 hour 0: 174804 events in 0 files, snapshot none (task 5113 ms: download 2579 ms overlapping gunzip 744 ms, parse 3289 ms, sort 0 ms, write 0 ms, index 594 ms: 8 candidates, 82652 repo-hours, 1199 releases; waiting 227 ms; commit 0 ms)
2026-11-08T10:00:59Z [load_day 2025-01-26] 2025-01-26 hour 1: 188338 events in 0 files, snapshot none (task 5904 ms: download 3054 ms overlapping gunzip 792 ms, parse 3601 ms, sort 0 ms, write 0 ms, index 755 ms: 9 candidates, 101331 repo-hours, 978 releases; waiting 441 ms; commit 0 ms)
2026-11-08T10:01:03Z [load_day 2025-01-26] 2025-01-26 hour 2: 154064 events in 0 files, snapshot none (task 4677 ms: download 2580 ms overlapping gunzip 597 ms, parse 2730 ms, sort 0 ms, write 0 ms, index 576 ms: 11 candidates, 65744 repo-hours, 894 releases; waiting 515 ms; commit 0 ms)
2026-11-08T10:01:04Z [load_day 2025-01-26] 2025-01-26 hour 3: 172240 events in 0 files, snapshot none (task 4605 ms: download 2846 ms overlapping gunzip 592 ms, parse 2817 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 65843 repo-hours, 3956 releases; waiting 478 ms; commit 0 ms)
2026-11-08T10:01:08Z [load_day 2025-01-26] 2025-01-26 hour 4: 152639 events in 0 files, snapshot none (task 3967 ms: download 2232 ms overlapping gunzip 532 ms, parse 2271 ms, sort 0 ms, write 0 ms, index 401 ms: 6 candidates, 54319 repo-hours, 573 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:01:09Z [load_day 2025-01-26] 2025-01-26 hour 5: 156278 events in 0 files, snapshot none (task 4217 ms: download 2051 ms overlapping gunzip 561 ms, parse 2375 ms, sort 0 ms, write 0 ms, index 490 ms: 5 candidates, 56483 repo-hours, 643 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:01:14Z [load_day 2025-01-26] 2025-01-26 hour 6: 172049 events in 0 files, snapshot none (task 5662 ms: download 2529 ms overlapping gunzip 754 ms, parse 3295 ms, sort 0 ms, write 0 ms, index 831 ms: 7 candidates, 73450 repo-hours, 848 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:01:15Z [load_day 2025-01-26] 2025-01-26 hour 7: 159620 events in 0 files, snapshot none (task 5311 ms: download 2634 ms overlapping gunzip 767 ms, parse 3403 ms, sort 0 ms, write 0 ms, index 618 ms: 12 candidates, 57748 repo-hours, 573 releases; waiting 282 ms; commit 0 ms)
2026-11-08T10:01:20Z [load_day 2025-01-26] 2025-01-26 hour 8: 174385 events in 0 files, snapshot none (task 5821 ms: download 2859 ms overlapping gunzip 742 ms, parse 3260 ms, sort 0 ms, write 0 ms, index 1028 ms: 6 candidates, 65929 repo-hours, 756 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:01:22Z [load_day 2025-01-26] 2025-01-26 hour 9: 190668 events in 0 files, snapshot none (task 6599 ms: download 3315 ms overlapping gunzip 990 ms, parse 3988 ms, sort 0 ms, write 0 ms, index 841 ms: 7 candidates, 75126 repo-hours, 861 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:01:27Z [load_day 2025-01-26] 2025-01-26 hour 10: 183769 events in 0 files, snapshot none (task 5736 ms: download 3196 ms overlapping gunzip 832 ms, parse 3586 ms, sort 0 ms, write 0 ms, index 550 ms: 3 candidates, 69948 repo-hours, 669 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:01:27Z [load_day 2025-01-26] 2025-01-26 hour 11: 183005 events in 0 files, snapshot none (task 4845 ms: download 2405 ms overlapping gunzip 635 ms, parse 2939 ms, sort 0 ms, write 0 ms, index 571 ms: 3 candidates, 67485 repo-hours, 776 releases; waiting 466 ms; commit 0 ms)
2026-11-08T10:01:34Z [load_day 2025-01-26] 2025-01-26 hour 12: 250869 events in 0 files, snapshot none (task 7156 ms: download 4198 ms overlapping gunzip 945 ms, parse 4629 ms, sort 0 ms, write 0 ms, index 802 ms: 10 candidates, 118833 repo-hours, 1002 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:01:34Z [load_day 2025-01-26] 2025-01-26 hour 13: 216886 events in 0 files, snapshot none (task 6743 ms: download 4098 ms overlapping gunzip 980 ms, parse 4317 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 96953 repo-hours, 896 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:01:42Z [load_day 2025-01-26] 2025-01-26 hour 14: 203237 events in 0 files, snapshot none (task 7048 ms: download 4155 ms overlapping gunzip 1002 ms, parse 4631 ms, sort 0 ms, write 0 ms, index 620 ms: 16 candidates, 80570 repo-hours, 899 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:01:42Z [load_day 2025-01-26] 2025-01-26 hour 15: 213490 events in 0 files, snapshot none (task 7451 ms: download 4711 ms overlapping gunzip 1148 ms, parse 4900 ms, sort 0 ms, write 0 ms, index 640 ms: 11 candidates, 88322 repo-hours, 1171 releases; waiting 453 ms; commit 0 ms)
2026-11-08T10:01:50Z [load_day 2025-01-26] 2025-01-26 hour 16: 210714 events in 0 files, snapshot none (task 7383 ms: download 3985 ms overlapping gunzip 1061 ms, parse 4719 ms, sort 0 ms, write 0 ms, index 885 ms: 5 candidates, 85034 repo-hours, 1090 releases; waiting 446 ms; commit 0 ms)
2026-11-08T10:01:50Z [load_day 2025-01-26] 2025-01-26 hour 17: 206451 events in 0 files, snapshot none (task 7279 ms: download 4147 ms overlapping gunzip 1097 ms, parse 4610 ms, sort 0 ms, write 0 ms, index 803 ms: 6 candidates, 81031 repo-hours, 899 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:01:58Z [load_day 2025-01-26] 2025-01-26 hour 18: 217129 events in 0 files, snapshot none (task 7203 ms: download 4054 ms overlapping gunzip 1016 ms, parse 4551 ms, sort 0 ms, write 0 ms, index 791 ms: 8 candidates, 95844 repo-hours, 1099 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:01:58Z [load_day 2025-01-26] 2025-01-26 hour 19: 192828 events in 0 files, snapshot none (task 6386 ms: download 3116 ms overlapping gunzip 915 ms, parse 4048 ms, sort 0 ms, write 0 ms, index 869 ms: 9 candidates, 73814 repo-hours, 929 releases; waiting 293 ms; commit 0 ms)
2026-11-08T10:02:05Z [load_day 2025-01-26] 2025-01-26 hour 20: 192856 events in 0 files, snapshot none (task 6846 ms: download 3766 ms overlapping gunzip 920 ms, parse 4239 ms, sort 0 ms, write 0 ms, index 589 ms: 10 candidates, 75394 repo-hours, 1005 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:02:05Z [load_day 2025-01-26] 2025-01-26 hour 21: 192911 events in 0 files, snapshot none (task 6906 ms: download 3976 ms overlapping gunzip 1040 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 666 ms: 2 candidates, 73913 repo-hours, 1263 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:02:13Z [load_day 2025-01-26] 2025-01-26 hour 22: 172199 events in 0 files, snapshot none (task 6679 ms: download 3621 ms overlapping gunzip 954 ms, parse 4188 ms, sort 0 ms, write 0 ms, index 498 ms: 5 candidates, 62059 repo-hours, 1127 releases; waiting 757 ms; commit 0 ms)
2026-11-08T10:02:13Z [load_day 2025-01-26] 2025-01-26 hour 23: 160438 events in 0 files, snapshot none (task 6612 ms: download 2962 ms overlapping gunzip 1008 ms, parse 4141 ms, sort 0 ms, write 0 ms, index 632 ms: 8 candidates, 58232 repo-hours, 866 releases; waiting 590 ms; commit 0 ms)
2026-11-08T10:02:21Z [load_day 2025-01-26] 2025-01-26: repo_hour merged from 24 files to 1 (1826057 rows, 7822 ms)
2026-11-08T10:02:23Z [load_day 2025-01-26] 2025-01-26: index committed in 10433 ms (24 + 1 + 24 files)
2026-11-08T10:02:23Z [load_day 2025-01-26] 2025-01-26: 4491867 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:02:23Z [load_day 2025-01-26] attempt 1 succeeded