orcaLog in

Runs · run 4034

load_day 2025-06-17, attempt 1 succeeded

Host
73ccef5e07c2:324773
Started
2026-11-08T12:29:31Z
Ended
2026-11-08T12:31:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
149.9 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4034/load_day/2025-06-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:29:31Z [load_day 2025-06-17] attempt 1 started
2026-11-08T12:29:32Z [load_day 2025-06-17] 2025-06-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:29:40Z [load_day 2025-06-17] 2025-06-17 hour 0: 148966 events in 0 files, snapshot none (task 7184 ms: download 4298 ms overlapping gunzip 1106 ms, parse 4350 ms, sort 0 ms, write 0 ms, index 521 ms: 8 candidates, 69445 repo-hours, 971 releases; waiting 924 ms; commit 0 ms)
2026-11-08T12:29:40Z [load_day 2025-06-17] 2025-06-17 hour 1: 156510 events in 0 files, snapshot none (task 6408 ms: download 3222 ms overlapping gunzip 919 ms, parse 3637 ms, sort 0 ms, write 0 ms, index 839 ms: 12 candidates, 89967 repo-hours, 667 releases; waiting 709 ms; commit 0 ms)
2026-11-08T12:29:47Z [load_day 2025-06-17] 2025-06-17 hour 2: 148540 events in 0 files, snapshot none (task 6595 ms: download 3751 ms overlapping gunzip 1023 ms, parse 4054 ms, sort 0 ms, write 0 ms, index 619 ms: 5 candidates, 71680 repo-hours, 1127 releases; waiting 551 ms; commit 0 ms)
2026-11-08T12:29:47Z [load_day 2025-06-17] 2025-06-17 hour 3: 147200 events in 0 files, snapshot none (task 7001 ms: download 3976 ms overlapping gunzip 1018 ms, parse 4340 ms, sort 0 ms, write 0 ms, index 603 ms: 8 candidates, 68794 repo-hours, 1711 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:29:54Z [load_day 2025-06-17] 2025-06-17 hour 4: 145086 events in 0 files, snapshot none (task 6546 ms: download 3838 ms overlapping gunzip 1007 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 65874 repo-hours, 783 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:29:55Z [load_day 2025-06-17] 2025-06-17 hour 5: 147446 events in 0 files, snapshot none (task 6922 ms: download 4332 ms overlapping gunzip 1112 ms, parse 4560 ms, sort 0 ms, write 0 ms, index 460 ms: 6 candidates, 64700 repo-hours, 625 releases; waiting 490 ms; commit 0 ms)
2026-11-08T12:30:02Z [load_day 2025-06-17] 2025-06-17 hour 6: 158815 events in 0 files, snapshot none (task 7295 ms: download 4090 ms overlapping gunzip 1076 ms, parse 4456 ms, sort 0 ms, write 0 ms, index 839 ms: 4 candidates, 80298 repo-hours, 668 releases; waiting 587 ms; commit 0 ms)
2026-11-08T12:30:03Z [load_day 2025-06-17] 2025-06-17 hour 7: 155432 events in 0 files, snapshot none (task 7471 ms: download 4487 ms overlapping gunzip 1160 ms, parse 4614 ms, sort 0 ms, write 0 ms, index 841 ms: 8 candidates, 76430 repo-hours, 832 releases; waiting 487 ms; commit 0 ms)
2026-11-08T12:30:10Z [load_day 2025-06-17] 2025-06-17 hour 8: 159759 events in 0 files, snapshot none (task 7546 ms: download 4840 ms overlapping gunzip 1235 ms, parse 4918 ms, sort 0 ms, write 0 ms, index 688 ms: 8 candidates, 80815 repo-hours, 847 releases; waiting 468 ms; commit 0 ms)
2026-11-08T12:30:11Z [load_day 2025-06-17] 2025-06-17 hour 9: 161108 events in 0 files, snapshot none (task 7855 ms: download 5192 ms overlapping gunzip 1245 ms, parse 5138 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 82045 repo-hours, 972 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:30:19Z [load_day 2025-06-17] 2025-06-17 hour 10: 158803 events in 0 files, snapshot none (task 7699 ms: download 4643 ms overlapping gunzip 1226 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 734 ms: 3 candidates, 78217 repo-hours, 784 releases; waiting 272 ms; commit 0 ms)
2026-11-08T12:30:19Z [load_day 2025-06-17] 2025-06-17 hour 11: 159679 events in 0 files, snapshot none (task 7549 ms: download 4618 ms overlapping gunzip 1176 ms, parse 4789 ms, sort 0 ms, write 0 ms, index 733 ms: 8 candidates, 77597 repo-hours, 798 releases; waiting 503 ms; commit 0 ms)
2026-11-08T12:30:25Z [load_day 2025-06-17] 2025-06-17 hour 12: 165030 events in 0 files, snapshot none (task 6236 ms: download 3592 ms overlapping gunzip 924 ms, parse 3770 ms, sort 0 ms, write 0 ms, index 821 ms: 7 candidates, 96524 repo-hours, 803 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:30:29Z [load_day 2025-06-17] 2025-06-17 hour 13: 167353 events in 0 files, snapshot none (task 9231 ms: download 6204 ms overlapping gunzip 1103 ms, parse 4661 ms, sort 0 ms, write 0 ms, index 937 ms: 12 candidates, 93557 repo-hours, 841 releases; waiting 2166 ms; commit 0 ms)
2026-11-08T12:30:32Z [load_day 2025-06-17] 2025-06-17 hour 14: 163360 events in 0 files, snapshot none (task 5926 ms: download 3460 ms overlapping gunzip 936 ms, parse 3797 ms, sort 0 ms, write 0 ms, index 634 ms: 12 candidates, 84179 repo-hours, 885 releases; waiting 249 ms; commit 0 ms)
2026-11-08T12:30:37Z [load_day 2025-06-17] 2025-06-17 hour 15: 167146 events in 0 files, snapshot none (task 7661 ms: download 4527 ms overlapping gunzip 1172 ms, parse 4740 ms, sort 0 ms, write 0 ms, index 801 ms: 6 candidates, 86709 repo-hours, 995 releases; waiting 672 ms; commit 0 ms)
2026-11-08T12:30:39Z [load_day 2025-06-17] 2025-06-17 hour 16: 165994 events in 0 files, snapshot none (task 6450 ms: download 3830 ms overlapping gunzip 1041 ms, parse 4075 ms, sort 0 ms, write 0 ms, index 774 ms: 11 candidates, 83294 repo-hours, 1081 releases; waiting 222 ms; commit 0 ms)
2026-11-08T12:30:45Z [load_day 2025-06-17] 2025-06-17 hour 17: 159864 events in 0 files, snapshot none (task 6766 ms: download 4233 ms overlapping gunzip 1061 ms, parse 4324 ms, sort 0 ms, write 0 ms, index 575 ms: 6 candidates, 77596 repo-hours, 809 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:30:47Z [load_day 2025-06-17] 2025-06-17 hour 18: 164050 events in 0 files, snapshot none (task 7391 ms: download 4182 ms overlapping gunzip 1070 ms, parse 4461 ms, sort 0 ms, write 0 ms, index 946 ms: 7 candidates, 83544 repo-hours, 904 releases; waiting 556 ms; commit 0 ms)
2026-11-08T12:30:50Z [load_day 2025-06-17] 2025-06-17 hour 19: 108498 events in 0 files, snapshot none (task 4610 ms: download 2380 ms overlapping gunzip 622 ms, parse 2648 ms, sort 0 ms, write 0 ms, index 557 ms: 9 candidates, 57481 repo-hours, 429 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:30:56Z [load_day 2025-06-17] 2025-06-17 hour 20: 157653 events in 0 files, snapshot none (task 7900 ms: download 4987 ms overlapping gunzip 1262 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 752 ms: 7 candidates, 75857 repo-hours, 792 releases; waiting 542 ms; commit 0 ms)
2026-11-08T12:30:57Z [load_day 2025-06-17] 2025-06-17 hour 21: 150443 events in 0 files, snapshot none (task 6487 ms: download 3812 ms overlapping gunzip 1079 ms, parse 4330 ms, sort 0 ms, write 0 ms, index 553 ms: 15 candidates, 68468 repo-hours, 896 releases; waiting 202 ms; commit 0 ms)
2026-11-08T12:31:03Z [load_day 2025-06-17] 2025-06-17 hour 22: 144712 events in 0 files, snapshot none (task 6245 ms: download 3391 ms overlapping gunzip 997 ms, parse 4200 ms, sort 0 ms, write 0 ms, index 602 ms: 5 candidates, 60502 repo-hours, 862 releases; waiting 235 ms; commit 0 ms)
2026-11-08T12:31:04Z [load_day 2025-06-17] 2025-06-17 hour 23: 142667 events in 0 files, snapshot none (task 6723 ms: download 4439 ms overlapping gunzip 1066 ms, parse 4362 ms, sort 0 ms, write 0 ms, index 458 ms: 6 candidates, 60201 repo-hours, 849 releases; waiting 473 ms; commit 0 ms)
2026-11-08T12:31:13Z [load_day 2025-06-17] 2025-06-17: repo_hour merged from 24 files to 1 (1833774 rows, 8944 ms)
2026-11-08T12:31:16Z [load_day 2025-06-17] 2025-06-17: index committed in 11777 ms (24 + 1 + 24 files)
2026-11-08T12:31:16Z [load_day 2025-06-17] 2025-06-17: 3704114 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:31:16Z [load_day 2025-06-17] attempt 1 succeeded