orcaLog in

Runs · run 2629

load_day 2024-06-23, attempt 1 succeeded

Host
73ccef5e07c2:140397
Started
2026-11-08T06:40:10Z
Ended
2026-11-08T06:41:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
631 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2629/load_day/2024-06-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:40:10Z [load_day 2024-06-23] attempt 1 started
2026-11-08T06:40:11Z [load_day 2024-06-23] 2024-06-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:40:17Z [load_day 2024-06-23] 2024-06-23 hour 0: 153136 events in 0 files, snapshot none (task 6177 ms: download 2686 ms overlapping gunzip 898 ms, parse 3782 ms, sort 0 ms, write 0 ms, index 732 ms: 5 candidates, 81181 repo-hours, 2680 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:40:18Z [load_day 2024-06-23] 2024-06-23 hour 1: 175714 events in 0 files, snapshot none (task 6568 ms: download 2780 ms overlapping gunzip 952 ms, parse 4129 ms, sort 0 ms, write 0 ms, index 700 ms: 6 candidates, 104508 repo-hours, 3007 releases; waiting 480 ms; commit 0 ms)
2026-11-08T06:40:23Z [load_day 2024-06-23] 2024-06-23 hour 2: 126291 events in 0 files, snapshot none (task 5139 ms: download 1963 ms overlapping gunzip 734 ms, parse 3127 ms, sort 0 ms, write 0 ms, index 462 ms: 2 candidates, 49758 repo-hours, 2973 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:40:24Z [load_day 2024-06-23] 2024-06-23 hour 3: 150226 events in 0 files, snapshot none (task 5425 ms: download 2669 ms overlapping gunzip 782 ms, parse 3467 ms, sort 0 ms, write 0 ms, index 440 ms: 7 candidates, 58843 repo-hours, 7789 releases; waiting 465 ms; commit 0 ms)
2026-11-08T06:40:29Z [load_day 2024-06-23] 2024-06-23 hour 4: 128767 events in 0 files, snapshot none (task 4808 ms: download 2175 ms overlapping gunzip 704 ms, parse 2936 ms, sort 0 ms, write 0 ms, index 381 ms: 10 candidates, 45948 repo-hours, 2929 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:40:29Z [load_day 2024-06-23] 2024-06-23 hour 5: 134559 events in 0 files, snapshot none (task 4938 ms: download 2429 ms overlapping gunzip 681 ms, parse 2990 ms, sort 0 ms, write 0 ms, index 430 ms: 5 candidates, 48805 repo-hours, 3093 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:40:34Z [load_day 2024-06-23] 2024-06-23 hour 6: 156430 events in 0 files, snapshot none (task 5312 ms: download 2470 ms overlapping gunzip 697 ms, parse 3190 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 68474 repo-hours, 3099 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:40:35Z [load_day 2024-06-23] 2024-06-23 hour 7: 147039 events in 0 files, snapshot none (task 5027 ms: download 2924 ms overlapping gunzip 658 ms, parse 3028 ms, sort 0 ms, write 0 ms, index 410 ms: 3 candidates, 53634 repo-hours, 2839 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:40:40Z [load_day 2024-06-23] 2024-06-23 hour 8: 153919 events in 0 files, snapshot none (task 4815 ms: download 2510 ms overlapping gunzip 645 ms, parse 2877 ms, sort 0 ms, write 0 ms, index 488 ms: 10 candidates, 59167 repo-hours, 2961 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:40:41Z [load_day 2024-06-23] 2024-06-23 hour 9: 169936 events in 0 files, snapshot none (task 5421 ms: download 2907 ms overlapping gunzip 736 ms, parse 3296 ms, sort 0 ms, write 0 ms, index 516 ms: 6 candidates, 70631 repo-hours, 3101 releases; waiting 570 ms; commit 0 ms)
2026-11-08T06:40:44Z [load_day 2024-06-23] 2024-06-23 hour 10: 156703 events in 0 files, snapshot none (task 4348 ms: download 2129 ms overlapping gunzip 594 ms, parse 2551 ms, sort 0 ms, write 0 ms, index 449 ms: 4 candidates, 60469 repo-hours, 2950 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:40:46Z [load_day 2024-06-23] 2024-06-23 hour 11: 160926 events in 0 files, snapshot none (task 4982 ms: download 3762 ms overlapping gunzip 585 ms, parse 2465 ms, sort 0 ms, write 0 ms, index 444 ms: 5 candidates, 60825 repo-hours, 2929 releases; waiting 1183 ms; commit 0 ms)
2026-11-08T06:40:50Z [load_day 2024-06-23] 2024-06-23 hour 12: 239095 events in 0 files, snapshot none (task 5376 ms: download 3054 ms overlapping gunzip 654 ms, parse 3191 ms, sort 0 ms, write 0 ms, index 809 ms: 7 candidates, 107498 repo-hours, 3102 releases; waiting 372 ms; commit 0 ms)
2026-11-08T06:40:51Z [load_day 2024-06-23] 2024-06-23 hour 13: 190645 events in 0 files, snapshot none (task 4899 ms: download 2614 ms overlapping gunzip 630 ms, parse 2839 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 87458 repo-hours, 2986 releases; waiting 549 ms; commit 0 ms)
2026-11-08T06:40:57Z [load_day 2024-06-23] 2024-06-23 hour 14: 179194 events in 0 files, snapshot none (task 6484 ms: download 2975 ms overlapping gunzip 932 ms, parse 3939 ms, sort 0 ms, write 0 ms, index 811 ms: 5 candidates, 71404 repo-hours, 3166 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:40:58Z [load_day 2024-06-23] 2024-06-23 hour 15: 188766 events in 0 files, snapshot none (task 6443 ms: download 3480 ms overlapping gunzip 948 ms, parse 4038 ms, sort 0 ms, write 0 ms, index 628 ms: 7 candidates, 81683 repo-hours, 3346 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:41:04Z [load_day 2024-06-23] 2024-06-23 hour 16: 177314 events in 0 files, snapshot none (task 5872 ms: download 2415 ms overlapping gunzip 804 ms, parse 3457 ms, sort 0 ms, write 0 ms, index 816 ms: 8 candidates, 71106 repo-hours, 3330 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:41:05Z [load_day 2024-06-23] 2024-06-23 hour 17: 168931 events in 0 files, snapshot none (task 5912 ms: download 3015 ms overlapping gunzip 819 ms, parse 3708 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 64893 repo-hours, 3022 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:41:09Z [load_day 2024-06-23] 2024-06-23 hour 18: 182936 events in 0 files, snapshot none (task 5205 ms: download 2051 ms overlapping gunzip 700 ms, parse 2921 ms, sort 0 ms, write 0 ms, index 1067 ms: 8 candidates, 80910 repo-hours, 2989 releases; waiting 188 ms; commit 0 ms)
2026-11-08T06:41:10Z [load_day 2024-06-23] 2024-06-23 hour 19: 157492 events in 0 files, snapshot none (task 4872 ms: download 2749 ms overlapping gunzip 654 ms, parse 2987 ms, sort 0 ms, write 0 ms, index 526 ms: 7 candidates, 58559 repo-hours, 2902 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:41:15Z [load_day 2024-06-23] 2024-06-23 hour 20: 152011 events in 0 files, snapshot none (task 5094 ms: download 2839 ms overlapping gunzip 692 ms, parse 3022 ms, sort 0 ms, write 0 ms, index 545 ms: 2 candidates, 58966 repo-hours, 3029 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:41:15Z [load_day 2024-06-23] 2024-06-23 hour 21: 151904 events in 0 files, snapshot none (task 4411 ms: download 2122 ms overlapping gunzip 619 ms, parse 2811 ms, sort 0 ms, write 0 ms, index 531 ms: 4 candidates, 60630 repo-hours, 3207 releases; waiting 185 ms; commit 0 ms)
2026-11-08T06:41:20Z [load_day 2024-06-23] 2024-06-23 hour 22: 135387 events in 0 files, snapshot none (task 4954 ms: download 2509 ms overlapping gunzip 709 ms, parse 3072 ms, sort 0 ms, write 0 ms, index 404 ms: 11 candidates, 48845 repo-hours, 2923 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:41:21Z [load_day 2024-06-23] 2024-06-23 hour 23: 128331 events in 0 files, snapshot none (task 4711 ms: download 2535 ms overlapping gunzip 681 ms, parse 2900 ms, sort 0 ms, write 0 ms, index 424 ms: 4 candidates, 47142 repo-hours, 2903 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:41:27Z [load_day 2024-06-23] 2024-06-23: repo_hour merged from 24 files to 1 (1601337 rows, 6922 ms)
2026-11-08T06:41:30Z [load_day 2024-06-23] 2024-06-23: index committed in 9290 ms (24 + 1 + 24 files)
2026-11-08T06:41:30Z [load_day 2024-06-23] 2024-06-23: 3865652 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:41:30Z [load_day 2024-06-23] attempt 1 succeeded