orcaLog in

Runs · run 3070

load_day 2024-10-12, attempt 1 succeeded

Host
73ccef5e07c2:190771
Started
2026-11-08T08:18:43Z
Ended
2026-11-08T08:20:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
674 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
113.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3070/load_day/2024-10-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:18:43Z [load_day 2024-10-12] attempt 1 started
2026-11-08T08:18:44Z [load_day 2024-10-12] 2024-10-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:18:49Z [load_day 2024-10-12] 2024-10-12 hour 0: 162461 events in 0 files, snapshot none (task 4975 ms: download 3652 ms overlapping gunzip 646 ms, parse 2688 ms, sort 0 ms, write 0 ms, index 832 ms: 4 candidates, 80236 repo-hours, 1025 releases; waiting 478 ms; commit 0 ms)
2026-11-08T08:18:49Z [load_day 2024-10-12] 2024-10-12 hour 1: 177359 events in 0 files, snapshot none (task 5272 ms: download 2282 ms overlapping gunzip 695 ms, parse 2961 ms, sort 0 ms, write 0 ms, index 864 ms: 5 candidates, 94921 repo-hours, 746 releases; waiting 496 ms; commit 0 ms)
2026-11-08T08:18:55Z [load_day 2024-10-12] 2024-10-12 hour 2: 157235 events in 0 files, snapshot none (task 5190 ms: download 2226 ms overlapping gunzip 767 ms, parse 3052 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 66840 repo-hours, 798 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:18:55Z [load_day 2024-10-12] 2024-10-12 hour 3: 176328 events in 0 files, snapshot none (task 5167 ms: download 2514 ms overlapping gunzip 748 ms, parse 3042 ms, sort 0 ms, write 0 ms, index 602 ms: 2 candidates, 66089 repo-hours, 3844 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:19:00Z [load_day 2024-10-12] 2024-10-12 hour 4: 147873 events in 0 files, snapshot none (task 4789 ms: download 2238 ms overlapping gunzip 646 ms, parse 2626 ms, sort 0 ms, write 0 ms, index 666 ms: 3 candidates, 51204 repo-hours, 600 releases; waiting 555 ms; commit 0 ms)
2026-11-08T08:19:01Z [load_day 2024-10-12] 2024-10-12 hour 5: 159342 events in 0 files, snapshot none (task 5021 ms: download 3136 ms overlapping gunzip 740 ms, parse 2930 ms, sort 0 ms, write 0 ms, index 466 ms: 3 candidates, 55075 repo-hours, 730 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:19:07Z [load_day 2024-10-12] 2024-10-12 hour 6: 185225 events in 0 files, snapshot none (task 6166 ms: download 3351 ms overlapping gunzip 792 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 908 ms: 2 candidates, 77041 repo-hours, 986 releases; waiting 1011 ms; commit 0 ms)
2026-11-08T08:19:07Z [load_day 2024-10-12] 2024-10-12 hour 7: 179334 events in 0 files, snapshot none (task 5364 ms: download 2785 ms overlapping gunzip 776 ms, parse 3131 ms, sort 0 ms, write 0 ms, index 623 ms: 10 candidates, 63321 repo-hours, 888 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:19:14Z [load_day 2024-10-12] 2024-10-12 hour 8: 181503 events in 0 files, snapshot none (task 6637 ms: download 3750 ms overlapping gunzip 1043 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 547 ms: 6 candidates, 67783 repo-hours, 905 releases; waiting 474 ms; commit 0 ms)
2026-11-08T08:19:14Z [load_day 2024-10-12] 2024-10-12 hour 9: 192923 events in 0 files, snapshot none (task 6784 ms: download 3787 ms overlapping gunzip 1049 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 792 ms: 6 candidates, 73830 repo-hours, 1063 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:19:20Z [load_day 2024-10-12] 2024-10-12 hour 10: 180639 events in 0 files, snapshot none (task 5980 ms: download 2845 ms overlapping gunzip 880 ms, parse 3704 ms, sort 0 ms, write 0 ms, index 543 ms: 8 candidates, 66170 repo-hours, 776 releases; waiting 540 ms; commit 0 ms)
2026-11-08T08:19:20Z [load_day 2024-10-12] 2024-10-12 hour 11: 177819 events in 0 files, snapshot none (task 5750 ms: download 2939 ms overlapping gunzip 846 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 600 ms: 7 candidates, 62049 repo-hours, 769 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:19:27Z [load_day 2024-10-12] 2024-10-12 hour 12: 227194 events in 0 files, snapshot none (task 6400 ms: download 3623 ms overlapping gunzip 817 ms, parse 3507 ms, sort 0 ms, write 0 ms, index 998 ms: 7 candidates, 111930 repo-hours, 893 releases; waiting 818 ms; commit 0 ms)
2026-11-08T08:19:27Z [load_day 2024-10-12] 2024-10-12 hour 13: 209491 events in 0 files, snapshot none (task 5923 ms: download 3236 ms overlapping gunzip 861 ms, parse 3564 ms, sort 0 ms, write 0 ms, index 765 ms: 17 candidates, 89606 repo-hours, 803 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:19:34Z [load_day 2024-10-12] 2024-10-12 hour 14: 190873 events in 0 files, snapshot none (task 5915 ms: download 3096 ms overlapping gunzip 863 ms, parse 3576 ms, sort 0 ms, write 0 ms, index 711 ms: 11 candidates, 71335 repo-hours, 978 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:19:34Z [load_day 2024-10-12] 2024-10-12 hour 15: 201106 events in 0 files, snapshot none (task 6115 ms: download 3330 ms overlapping gunzip 928 ms, parse 3630 ms, sort 0 ms, write 0 ms, index 741 ms: 5 candidates, 79966 repo-hours, 1019 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:19:39Z [load_day 2024-10-12] 2024-10-12 hour 16: 186948 events in 0 files, snapshot none (task 5240 ms: download 3793 ms overlapping gunzip 722 ms, parse 3096 ms, sort 0 ms, write 0 ms, index 530 ms: 5 candidates, 72014 repo-hours, 845 releases; waiting 665 ms; commit 0 ms)
2026-11-08T08:19:39Z [load_day 2024-10-12] 2024-10-12 hour 17: 184632 events in 0 files, snapshot none (task 5110 ms: download 2677 ms overlapping gunzip 735 ms, parse 3029 ms, sort 0 ms, write 0 ms, index 513 ms: 5 candidates, 65989 repo-hours, 774 releases; waiting 585 ms; commit 0 ms)
2026-11-08T08:19:45Z [load_day 2024-10-12] 2024-10-12 hour 18: 198092 events in 0 files, snapshot none (task 5053 ms: download 2674 ms overlapping gunzip 672 ms, parse 2838 ms, sort 0 ms, write 0 ms, index 677 ms: 14 candidates, 82795 repo-hours, 969 releases; waiting 608 ms; commit 0 ms)
2026-11-08T08:19:45Z [load_day 2024-10-12] 2024-10-12 hour 19: 176898 events in 0 files, snapshot none (task 4375 ms: download 2581 ms overlapping gunzip 635 ms, parse 2624 ms, sort 0 ms, write 0 ms, index 457 ms: 6 candidates, 59654 repo-hours, 871 releases; waiting 350 ms; commit 0 ms)
2026-11-08T08:19:49Z [load_day 2024-10-12] 2024-10-12 hour 20: 168691 events in 0 files, snapshot none (task 4230 ms: download 2130 ms overlapping gunzip 598 ms, parse 2384 ms, sort 0 ms, write 0 ms, index 475 ms: 7 candidates, 58915 repo-hours, 726 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:19:49Z [load_day 2024-10-12] 2024-10-12 hour 21: 159446 events in 0 files, snapshot none (task 3953 ms: download 2239 ms overlapping gunzip 524 ms, parse 2198 ms, sort 0 ms, write 0 ms, index 454 ms: 6 candidates, 57805 repo-hours, 785 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:19:53Z [load_day 2024-10-12] 2024-10-12 hour 22: 143460 events in 0 files, snapshot none (task 3256 ms: download 1764 ms overlapping gunzip 440 ms, parse 1927 ms, sort 0 ms, write 0 ms, index 343 ms: 9 candidates, 47133 repo-hours, 807 releases; waiting 251 ms; commit 0 ms)
2026-11-08T08:19:54Z [load_day 2024-10-12] 2024-10-12 hour 23: 139424 events in 0 files, snapshot none (task 3725 ms: download 2038 ms overlapping gunzip 464 ms, parse 2003 ms, sort 0 ms, write 0 ms, index 340 ms: 4 candidates, 45140 repo-hours, 664 releases; waiting 565 ms; commit 0 ms)
2026-11-08T08:20:01Z [load_day 2024-10-12] 2024-10-12: repo_hour merged from 24 files to 1 (1666841 rows, 7393 ms)
2026-11-08T08:20:03Z [load_day 2024-10-12] 2024-10-12: index committed in 9901 ms (24 + 1 + 24 files)
2026-11-08T08:20:03Z [load_day 2024-10-12] 2024-10-12: 4264296 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:20:03Z [load_day 2024-10-12] attempt 1 succeeded