orcaLog in

Runs · run 4343

load_day 2025-09-02, attempt 1 succeeded

Host
73ccef5e07c2:371473
Started
2026-11-08T13:39:02Z
Ended
2026-11-08T13:41:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
704 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
169.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4343/load_day/2025-09-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:39:02Z [load_day 2025-09-02] attempt 1 started
2026-11-08T13:39:03Z [load_day 2025-09-02] 2025-09-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:39:12Z [load_day 2025-09-02] 2025-09-02 hour 0: 149544 events in 0 files, snapshot none (task 8326 ms: download 5080 ms overlapping gunzip 1359 ms, parse 5448 ms, sort 0 ms, write 0 ms, index 678 ms: 9 candidates, 76273 repo-hours, 1004 releases; waiting 485 ms; commit 0 ms)
2026-11-08T13:39:13Z [load_day 2025-09-02] 2025-09-02 hour 1: 157800 events in 0 files, snapshot none (task 8895 ms: download 6150 ms overlapping gunzip 1223 ms, parse 5068 ms, sort 0 ms, write 0 ms, index 819 ms: 2 candidates, 92975 repo-hours, 757 releases; waiting 1496 ms; commit 0 ms)
2026-11-08T13:39:21Z [load_day 2025-09-02] 2025-09-02 hour 2: 149902 events in 0 files, snapshot none (task 8164 ms: download 5502 ms overlapping gunzip 1397 ms, parse 5108 ms, sort 0 ms, write 0 ms, index 590 ms: 9 candidates, 69839 repo-hours, 676 releases; waiting 523 ms; commit 0 ms)
2026-11-08T13:39:21Z [load_day 2025-09-02] 2025-09-02 hour 3: 154284 events in 0 files, snapshot none (task 8054 ms: download 5135 ms overlapping gunzip 1306 ms, parse 5206 ms, sort 0 ms, write 0 ms, index 711 ms: 11 candidates, 72621 repo-hours, 1942 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:39:29Z [load_day 2025-09-02] 2025-09-02 hour 4: 150900 events in 0 files, snapshot none (task 7937 ms: download 4897 ms overlapping gunzip 1370 ms, parse 5228 ms, sort 0 ms, write 0 ms, index 709 ms: 4 candidates, 67822 repo-hours, 641 releases; waiting 394 ms; commit 0 ms)
2026-11-08T13:39:29Z [load_day 2025-09-02] 2025-09-02 hour 5: 150909 events in 0 files, snapshot none (task 7501 ms: download 4556 ms overlapping gunzip 1314 ms, parse 4685 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 68615 repo-hours, 649 releases; waiting 571 ms; commit 0 ms)
2026-11-08T13:39:37Z [load_day 2025-09-02] 2025-09-02 hour 6: 157352 events in 0 files, snapshot none (task 7747 ms: download 4634 ms overlapping gunzip 1353 ms, parse 4904 ms, sort 0 ms, write 0 ms, index 748 ms: 8 candidates, 81200 repo-hours, 850 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:39:37Z [load_day 2025-09-02] 2025-09-02 hour 7: 153281 events in 0 files, snapshot none (task 7798 ms: download 4627 ms overlapping gunzip 1356 ms, parse 5245 ms, sort 0 ms, write 0 ms, index 666 ms: 5 candidates, 73211 repo-hours, 686 releases; waiting 238 ms; commit 0 ms)
2026-11-08T13:39:46Z [load_day 2025-09-02] 2025-09-02 hour 8: 162732 events in 0 files, snapshot none (task 7991 ms: download 4938 ms overlapping gunzip 1360 ms, parse 5290 ms, sort 0 ms, write 0 ms, index 602 ms: 9 candidates, 79454 repo-hours, 772 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:39:46Z [load_day 2025-09-02] 2025-09-02 hour 9: 163580 events in 0 files, snapshot none (task 8364 ms: download 5098 ms overlapping gunzip 1353 ms, parse 5599 ms, sort 0 ms, write 0 ms, index 829 ms: 7 candidates, 83354 repo-hours, 877 releases; waiting 256 ms; commit 0 ms)
2026-11-08T13:39:53Z [load_day 2025-09-02] 2025-09-02 hour 10: 161054 events in 0 files, snapshot none (task 7249 ms: download 3703 ms overlapping gunzip 1221 ms, parse 4669 ms, sort 0 ms, write 0 ms, index 843 ms: 8 candidates, 81082 repo-hours, 795 releases; waiting 186 ms; commit 0 ms)
2026-11-08T13:39:55Z [load_day 2025-09-02] 2025-09-02 hour 11: 163006 events in 0 files, snapshot none (task 8210 ms: download 5796 ms overlapping gunzip 1341 ms, parse 5144 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 80089 repo-hours, 762 releases; waiting 822 ms; commit 0 ms)
2026-11-08T13:40:04Z [load_day 2025-09-02] 2025-09-02 hour 12: 169079 events in 0 files, snapshot none (task 10354 ms: download 6824 ms overlapping gunzip 1122 ms, parse 4252 ms, sort 0 ms, write 0 ms, index 1719 ms: 8 candidates, 100758 repo-hours, 863 releases; waiting 2968 ms; commit 0 ms)
2026-11-08T13:40:07Z [load_day 2025-09-02] 2025-09-02 hour 13: 166517 events in 0 files, snapshot none (task 8725 ms: download 6339 ms overlapping gunzip 1139 ms, parse 4360 ms, sort 0 ms, write 0 ms, index 700 ms: 6 candidates, 95044 repo-hours, 794 releases; waiting 2294 ms; commit 0 ms)
2026-11-08T13:40:15Z [load_day 2025-09-02] 2025-09-02 hour 14: 162299 events in 0 files, snapshot none (task 8408 ms: download 5688 ms overlapping gunzip 1412 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 748 ms: 5 candidates, 86410 repo-hours, 797 releases; waiting 216 ms; commit 0 ms)
2026-11-08T13:40:16Z [load_day 2025-09-02] 2025-09-02 hour 15: 161671 events in 0 files, snapshot none (task 8183 ms: download 5698 ms overlapping gunzip 1348 ms, parse 5327 ms, sort 0 ms, write 0 ms, index 642 ms: 9 candidates, 85702 repo-hours, 826 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:40:23Z [load_day 2025-09-02] 2025-09-02 hour 16: 162977 events in 0 files, snapshot none (task 7117 ms: download 4560 ms overlapping gunzip 1140 ms, parse 4188 ms, sort 0 ms, write 0 ms, index 652 ms: 15 candidates, 86269 repo-hours, 771 releases; waiting 849 ms; commit 0 ms)
2026-11-08T13:40:25Z [load_day 2025-09-02] 2025-09-02 hour 17: 162523 events in 0 files, snapshot none (task 8966 ms: download 6648 ms overlapping gunzip 1084 ms, parse 4114 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 80645 repo-hours, 751 releases; waiting 2906 ms; commit 0 ms)
2026-11-08T13:40:32Z [load_day 2025-09-02] 2025-09-02 hour 18: 163405 events in 0 files, snapshot none (task 8196 ms: download 5100 ms overlapping gunzip 1070 ms, parse 4050 ms, sort 0 ms, write 0 ms, index 1328 ms: 1 candidates, 84739 repo-hours, 882 releases; waiting 1483 ms; commit 0 ms)
2026-11-08T13:40:34Z [load_day 2025-09-02] 2025-09-02 hour 19: 159436 events in 0 files, snapshot none (task 8109 ms: download 5226 ms overlapping gunzip 1121 ms, parse 4406 ms, sort 0 ms, write 0 ms, index 933 ms: 4 candidates, 72691 repo-hours, 821 releases; waiting 1310 ms; commit 0 ms)
2026-11-08T13:40:39Z [load_day 2025-09-02] 2025-09-02 hour 20: 160576 events in 0 files, snapshot none (task 7290 ms: download 3687 ms overlapping gunzip 1114 ms, parse 4389 ms, sort 0 ms, write 0 ms, index 991 ms: 5 candidates, 73081 repo-hours, 855 releases; waiting 521 ms; commit 0 ms)
2026-11-08T13:40:41Z [load_day 2025-09-02] 2025-09-02 hour 21: 155389 events in 0 files, snapshot none (task 6092 ms: download 3426 ms overlapping gunzip 998 ms, parse 4013 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 66496 repo-hours, 898 releases; waiting 300 ms; commit 0 ms)
2026-11-08T13:40:46Z [load_day 2025-09-02] 2025-09-02 hour 22: 146780 events in 0 files, snapshot none (task 6255 ms: download 3702 ms overlapping gunzip 966 ms, parse 3776 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 60111 repo-hours, 884 releases; waiting 584 ms; commit 0 ms)
2026-11-08T13:40:47Z [load_day 2025-09-02] 2025-09-02 hour 23: 146280 events in 0 files, snapshot none (task 6437 ms: download 3977 ms overlapping gunzip 997 ms, parse 4143 ms, sort 0 ms, write 0 ms, index 406 ms: 10 candidates, 59335 repo-hours, 915 releases; waiting 616 ms; commit 0 ms)
2026-11-08T13:40:56Z [load_day 2025-09-02] 2025-09-02: repo_hour merged from 24 files to 1 (1877816 rows, 8887 ms)
2026-11-08T13:41:00Z [load_day 2025-09-02] 2025-09-02: index committed in 12144 ms (24 + 1 + 24 files)
2026-11-08T13:41:00Z [load_day 2025-09-02] 2025-09-02: 3791276 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:41:00Z [load_day 2025-09-02] attempt 1 succeeded