orcaLog in

Runs · run 4422

load_day 2025-09-21, attempt 1 succeeded

Host
73ccef5e07c2:382364
Started
2026-11-08T13:55:43Z
Ended
2026-11-08T13:57:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
637 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.3 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4422/load_day/2025-09-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:55:43Z [load_day 2025-09-21] attempt 1 started
2026-11-08T13:55:44Z [load_day 2025-09-21] 2025-09-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:55:51Z [load_day 2025-09-21] 2025-09-21 hour 0: 140536 events in 0 files, snapshot none (task 7011 ms: download 3770 ms overlapping gunzip 1179 ms, parse 4222 ms, sort 0 ms, write 0 ms, index 679 ms: 5 candidates, 65592 repo-hours, 1210 releases; waiting 572 ms; commit 0 ms)
2026-11-08T13:55:51Z [load_day 2025-09-21] 2025-09-21 hour 1: 154617 events in 0 files, snapshot none (task 6508 ms: download 2732 ms overlapping gunzip 820 ms, parse 3764 ms, sort 0 ms, write 0 ms, index 1058 ms: 7 candidates, 88207 repo-hours, 695 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:55:59Z [load_day 2025-09-21] 2025-09-21 hour 2: 136553 events in 0 files, snapshot none (task 7503 ms: download 3346 ms overlapping gunzip 1078 ms, parse 4518 ms, sort 0 ms, write 0 ms, index 809 ms: 10 candidates, 59578 repo-hours, 788 releases; waiting 766 ms; commit 0 ms)
2026-11-08T13:55:59Z [load_day 2025-09-21] 2025-09-21 hour 3: 144902 events in 0 files, snapshot none (task 7653 ms: download 3881 ms overlapping gunzip 1174 ms, parse 4604 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 60016 repo-hours, 2114 releases; waiting 907 ms; commit 0 ms)
2026-11-08T13:56:06Z [load_day 2025-09-21] 2025-09-21 hour 4: 143428 events in 0 files, snapshot none (task 5878 ms: download 3081 ms overlapping gunzip 859 ms, parse 3631 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 54387 repo-hours, 575 releases; waiting 494 ms; commit 0 ms)
2026-11-08T13:56:06Z [load_day 2025-09-21] 2025-09-21 hour 5: 146677 events in 0 files, snapshot none (task 5930 ms: download 3085 ms overlapping gunzip 907 ms, parse 3803 ms, sort 0 ms, write 0 ms, index 485 ms: 3 candidates, 56970 repo-hours, 582 releases; waiting 470 ms; commit 0 ms)
2026-11-08T13:56:13Z [load_day 2025-09-21] 2025-09-21 hour 6: 151687 events in 0 files, snapshot none (task 6390 ms: download 3370 ms overlapping gunzip 996 ms, parse 3847 ms, sort 0 ms, write 0 ms, index 697 ms: 5 candidates, 69011 repo-hours, 598 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:56:13Z [load_day 2025-09-21] 2025-09-21 hour 7: 153105 events in 0 files, snapshot none (task 6089 ms: download 3556 ms overlapping gunzip 931 ms, parse 3802 ms, sort 0 ms, write 0 ms, index 517 ms: 6 candidates, 60005 repo-hours, 575 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:56:19Z [load_day 2025-09-21] 2025-09-21 hour 8: 153812 events in 0 files, snapshot none (task 6047 ms: download 2878 ms overlapping gunzip 881 ms, parse 3607 ms, sort 0 ms, write 0 ms, index 730 ms: 4 candidates, 62684 repo-hours, 682 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:56:20Z [load_day 2025-09-21] 2025-09-21 hour 9: 154999 events in 0 files, snapshot none (task 6704 ms: download 3639 ms overlapping gunzip 1024 ms, parse 4285 ms, sort 0 ms, write 0 ms, index 551 ms: 9 candidates, 64024 repo-hours, 712 releases; waiting 533 ms; commit 0 ms)
2026-11-08T13:56:25Z [load_day 2025-09-21] 2025-09-21 hour 10: 158096 events in 0 files, snapshot none (task 5321 ms: download 2620 ms overlapping gunzip 699 ms, parse 3015 ms, sort 0 ms, write 0 ms, index 898 ms: 9 candidates, 66153 repo-hours, 650 releases; waiting 489 ms; commit 0 ms)
2026-11-08T13:56:26Z [load_day 2025-09-21] 2025-09-21 hour 11: 156575 events in 0 files, snapshot none (task 5801 ms: download 3102 ms overlapping gunzip 873 ms, parse 3455 ms, sort 0 ms, write 0 ms, index 533 ms: 4 candidates, 60936 repo-hours, 682 releases; waiting 616 ms; commit 0 ms)
2026-11-08T13:56:32Z [load_day 2025-09-21] 2025-09-21 hour 12: 166763 events in 0 files, snapshot none (task 6367 ms: download 3268 ms overlapping gunzip 804 ms, parse 3421 ms, sort 0 ms, write 0 ms, index 779 ms: 8 candidates, 90700 repo-hours, 701 releases; waiting 887 ms; commit 0 ms)
2026-11-08T13:56:32Z [load_day 2025-09-21] 2025-09-21 hour 13: 164073 events in 0 files, snapshot none (task 5823 ms: download 3473 ms overlapping gunzip 722 ms, parse 3015 ms, sort 0 ms, write 0 ms, index 1077 ms: 6 candidates, 81014 repo-hours, 754 releases; waiting 694 ms; commit 0 ms)
2026-11-08T13:56:38Z [load_day 2025-09-21] 2025-09-21 hour 14: 157000 events in 0 files, snapshot none (task 5630 ms: download 2804 ms overlapping gunzip 685 ms, parse 2849 ms, sort 0 ms, write 0 ms, index 1247 ms: 5 candidates, 70264 repo-hours, 938 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:56:41Z [load_day 2025-09-21] 2025-09-21 hour 15: 161934 events in 0 files, snapshot none (task 8142 ms: download 4924 ms overlapping gunzip 987 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 617 ms: 3 candidates, 71830 repo-hours, 992 releases; waiting 2119 ms; commit 0 ms)
2026-11-08T13:56:44Z [load_day 2025-09-21] 2025-09-21 hour 16: 162166 events in 0 files, snapshot none (task 5347 ms: download 2304 ms overlapping gunzip 693 ms, parse 2971 ms, sort 0 ms, write 0 ms, index 1088 ms: 2 candidates, 72003 repo-hours, 1036 releases; waiting 288 ms; commit 0 ms)
2026-11-08T13:56:47Z [load_day 2025-09-21] 2025-09-21 hour 17: 156019 events in 0 files, snapshot none (task 5722 ms: download 2897 ms overlapping gunzip 857 ms, parse 3435 ms, sort 0 ms, write 0 ms, index 585 ms: 11 candidates, 67162 repo-hours, 844 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:56:50Z [load_day 2025-09-21] 2025-09-21 hour 18: 161545 events in 0 files, snapshot none (task 5107 ms: download 2766 ms overlapping gunzip 743 ms, parse 3002 ms, sort 0 ms, write 0 ms, index 640 ms: 6 candidates, 76611 repo-hours, 931 releases; waiting 508 ms; commit 0 ms)
2026-11-08T13:56:52Z [load_day 2025-09-21] 2025-09-21 hour 19: 158143 events in 0 files, snapshot none (task 4938 ms: download 2692 ms overlapping gunzip 722 ms, parse 2879 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 63013 repo-hours, 824 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:56:55Z [load_day 2025-09-21] 2025-09-21 hour 20: 154844 events in 0 files, snapshot none (task 5205 ms: download 2706 ms overlapping gunzip 739 ms, parse 3044 ms, sort 0 ms, write 0 ms, index 458 ms: 8 candidates, 62093 repo-hours, 988 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:56:58Z [load_day 2025-09-21] 2025-09-21 hour 21: 153125 events in 0 files, snapshot none (task 5173 ms: download 3532 ms overlapping gunzip 755 ms, parse 2874 ms, sort 0 ms, write 0 ms, index 542 ms: 14 candidates, 60980 repo-hours, 930 releases; waiting 689 ms; commit 0 ms)
2026-11-08T13:57:01Z [load_day 2025-09-21] 2025-09-21 hour 22: 144698 events in 0 files, snapshot none (task 5079 ms: download 2669 ms overlapping gunzip 689 ms, parse 2701 ms, sort 0 ms, write 0 ms, index 512 ms: 9 candidates, 55903 repo-hours, 953 releases; waiting 870 ms; commit 0 ms)
2026-11-08T13:57:04Z [load_day 2025-09-21] 2025-09-21 hour 23: 142258 events in 0 files, snapshot none (task 5507 ms: download 3118 ms overlapping gunzip 902 ms, parse 3328 ms, sort 0 ms, write 0 ms, index 468 ms: 2 candidates, 51636 repo-hours, 821 releases; waiting 555 ms; commit 0 ms)
2026-11-08T13:57:12Z [load_day 2025-09-21] 2025-09-21: repo_hour merged from 24 files to 1 (1590772 rows, 8104 ms)
2026-11-08T13:57:15Z [load_day 2025-09-21] 2025-09-21: index committed in 11252 ms (24 + 1 + 24 files)
2026-11-08T13:57:15Z [load_day 2025-09-21] 2025-09-21: 3677555 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:57:15Z [load_day 2025-09-21] attempt 1 succeeded