orcaLog in

Runs · run 4300

load_day 2025-08-22, attempt 1 succeeded

Host
73ccef5e07c2:365335
Started
2026-11-08T13:30:06Z
Ended
2026-11-08T13:31:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
155.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4300/load_day/2025-08-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:30:06Z [load_day 2025-08-22] attempt 1 started
2026-11-08T13:30:07Z [load_day 2025-08-22] 2025-08-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:30:15Z [load_day 2025-08-22] 2025-08-22 hour 0: 149847 events in 0 files, snapshot none (task 7761 ms: download 4052 ms overlapping gunzip 1218 ms, parse 4723 ms, sort 0 ms, write 0 ms, index 959 ms: 5 candidates, 80204 repo-hours, 1038 releases; waiting 578 ms; commit 0 ms)
2026-11-08T13:30:16Z [load_day 2025-08-22] 2025-08-22 hour 1: 165484 events in 0 files, snapshot none (task 8664 ms: download 5191 ms overlapping gunzip 1372 ms, parse 5418 ms, sort 0 ms, write 0 ms, index 1030 ms: 10 candidates, 101687 repo-hours, 706 releases; waiting 478 ms; commit 0 ms)
2026-11-08T13:30:24Z [load_day 2025-08-22] 2025-08-22 hour 2: 153896 events in 0 files, snapshot none (task 7918 ms: download 5165 ms overlapping gunzip 1329 ms, parse 5021 ms, sort 0 ms, write 0 ms, index 685 ms: 7 candidates, 77455 repo-hours, 692 releases; waiting 572 ms; commit 0 ms)
2026-11-08T13:30:24Z [load_day 2025-08-22] 2025-08-22 hour 3: 150142 events in 0 files, snapshot none (task 6984 ms: download 4062 ms overlapping gunzip 1158 ms, parse 4449 ms, sort 0 ms, write 0 ms, index 593 ms: 10 candidates, 70471 repo-hours, 1840 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:30:29Z [load_day 2025-08-22] 2025-08-22 hour 4: 148509 events in 0 files, snapshot none (task 5375 ms: download 3087 ms overlapping gunzip 845 ms, parse 3254 ms, sort 0 ms, write 0 ms, index 511 ms: 8 candidates, 64761 repo-hours, 650 releases; waiting 492 ms; commit 0 ms)
2026-11-08T13:30:32Z [load_day 2025-08-22] 2025-08-22 hour 5: 152617 events in 0 files, snapshot none (task 7710 ms: download 5284 ms overlapping gunzip 858 ms, parse 3323 ms, sort 0 ms, write 0 ms, index 522 ms: 8 candidates, 67290 repo-hours, 742 releases; waiting 2657 ms; commit 0 ms)
2026-11-08T13:30:35Z [load_day 2025-08-22] 2025-08-22 hour 6: 157100 events in 0 files, snapshot none (task 5372 ms: download 3440 ms overlapping gunzip 777 ms, parse 3082 ms, sort 0 ms, write 0 ms, index 604 ms: 5 candidates, 77911 repo-hours, 868 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:30:39Z [load_day 2025-08-22] 2025-08-22 hour 7: 156266 events in 0 files, snapshot none (task 6859 ms: download 4467 ms overlapping gunzip 848 ms, parse 3359 ms, sort 0 ms, write 0 ms, index 572 ms: 8 candidates, 71525 repo-hours, 780 releases; waiting 1732 ms; commit 0 ms)
2026-11-08T13:30:43Z [load_day 2025-08-22] 2025-08-22 hour 8: 157734 events in 0 files, snapshot none (task 6912 ms: download 4452 ms overlapping gunzip 886 ms, parse 3429 ms, sort 0 ms, write 0 ms, index 615 ms: 4 candidates, 77181 repo-hours, 912 releases; waiting 1720 ms; commit 0 ms)
2026-11-08T13:30:47Z [load_day 2025-08-22] 2025-08-22 hour 9: 164789 events in 0 files, snapshot none (task 6425 ms: download 3552 ms overlapping gunzip 1032 ms, parse 3973 ms, sort 0 ms, write 0 ms, index 736 ms: 5 candidates, 77956 repo-hours, 1017 releases; waiting 453 ms; commit 0 ms)
2026-11-08T13:30:51Z [load_day 2025-08-22] 2025-08-22 hour 10: 157818 events in 0 files, snapshot none (task 7793 ms: download 5114 ms overlapping gunzip 1116 ms, parse 4447 ms, sort 0 ms, write 0 ms, index 815 ms: 2 candidates, 74776 repo-hours, 886 releases; waiting 1072 ms; commit 0 ms)
2026-11-08T13:30:54Z [load_day 2025-08-22] 2025-08-22 hour 11: 163938 events in 0 files, snapshot none (task 6981 ms: download 3793 ms overlapping gunzip 1039 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 1054 ms: 3 candidates, 71027 repo-hours, 701 releases; waiting 401 ms; commit 0 ms)
2026-11-08T13:31:00Z [load_day 2025-08-22] 2025-08-22 hour 12: 166640 events in 0 files, snapshot none (task 7817 ms: download 3413 ms overlapping gunzip 1134 ms, parse 4753 ms, sort 0 ms, write 0 ms, index 1105 ms: 7 candidates, 94815 repo-hours, 807 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:31:03Z [load_day 2025-08-22] 2025-08-22 hour 13: 166568 events in 0 files, snapshot none (task 7826 ms: download 4805 ms overlapping gunzip 1267 ms, parse 5267 ms, sort 0 ms, write 0 ms, index 704 ms: 6 candidates, 88046 repo-hours, 770 releases; waiting 283 ms; commit 0 ms)
2026-11-08T13:31:10Z [load_day 2025-08-22] 2025-08-22 hour 14: 161146 events in 0 files, snapshot none (task 9829 ms: download 7081 ms overlapping gunzip 1252 ms, parse 5565 ms, sort 0 ms, write 0 ms, index 568 ms: 11 candidates, 79437 repo-hours, 902 releases; waiting 2123 ms; commit 0 ms)
2026-11-08T13:31:11Z [load_day 2025-08-22] 2025-08-22 hour 15: 163802 events in 0 files, snapshot none (task 7805 ms: download 5420 ms overlapping gunzip 1256 ms, parse 5156 ms, sort 0 ms, write 0 ms, index 638 ms: 2 candidates, 80073 repo-hours, 903 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:31:17Z [load_day 2025-08-22] 2025-08-22 hour 16: 161615 events in 0 files, snapshot none (task 6467 ms: download 3899 ms overlapping gunzip 1018 ms, parse 4145 ms, sort 0 ms, write 0 ms, index 647 ms: 14 candidates, 78919 repo-hours, 810 releases; waiting 397 ms; commit 0 ms)
2026-11-08T13:31:22Z [load_day 2025-08-22] 2025-08-22 hour 17: 160366 events in 0 files, snapshot none (task 8217 ms: download 5284 ms overlapping gunzip 1081 ms, parse 4388 ms, sort 0 ms, write 0 ms, index 774 ms: 8 candidates, 75483 repo-hours, 840 releases; waiting 1650 ms; commit 0 ms)
2026-11-08T13:31:24Z [load_day 2025-08-22] 2025-08-22 hour 18: 157534 events in 0 files, snapshot none (task 6400 ms: download 3910 ms overlapping gunzip 976 ms, parse 3973 ms, sort 0 ms, write 0 ms, index 693 ms: 6 candidates, 79544 repo-hours, 757 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:31:33Z [load_day 2025-08-22] 2025-08-22 hour 19: 156590 events in 0 files, snapshot none (task 10175 ms: download 7034 ms overlapping gunzip 1148 ms, parse 4665 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 68264 repo-hours, 777 releases; waiting 3437 ms; commit 0 ms)
2026-11-08T13:31:33Z [load_day 2025-08-22] 2025-08-22 hour 20: 154462 events in 0 files, snapshot none (task 7308 ms: download 3711 ms overlapping gunzip 1090 ms, parse 4446 ms, sort 0 ms, write 0 ms, index 903 ms: 9 candidates, 68362 repo-hours, 712 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:31:41Z [load_day 2025-08-22] 2025-08-22 hour 21: 148446 events in 0 files, snapshot none (task 6316 ms: download 3924 ms overlapping gunzip 994 ms, parse 3830 ms, sort 0 ms, write 0 ms, index 459 ms: 7 candidates, 64600 repo-hours, 773 releases; waiting 726 ms; commit 0 ms)
2026-11-08T13:31:41Z [load_day 2025-08-22] 2025-08-22 hour 22: 146892 events in 0 files, snapshot none (task 6625 ms: download 4239 ms overlapping gunzip 989 ms, parse 3970 ms, sort 0 ms, write 0 ms, index 496 ms: 2 candidates, 60047 repo-hours, 899 releases; waiting 769 ms; commit 0 ms)
2026-11-08T13:31:46Z [load_day 2025-08-22] 2025-08-22 hour 23: 144293 events in 0 files, snapshot none (task 4845 ms: download 2756 ms overlapping gunzip 813 ms, parse 3227 ms, sort 0 ms, write 0 ms, index 401 ms: 5 candidates, 55784 repo-hours, 835 releases; waiting 190 ms; commit 0 ms)
2026-11-08T13:31:55Z [load_day 2025-08-22] 2025-08-22: repo_hour merged from 24 files to 1 (1805618 rows, 8597 ms)
2026-11-08T13:31:57Z [load_day 2025-08-22] 2025-08-22: index committed in 11021 ms (24 + 1 + 24 files)
2026-11-08T13:31:57Z [load_day 2025-08-22] 2025-08-22: 3766494 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:31:57Z [load_day 2025-08-22] attempt 1 succeeded