orcaLog in

Runs · run 3346

load_day 2024-12-21, attempt 1 succeeded

Host
73ccef5e07c2:225781
Started
2026-11-08T09:28:36Z
Ended
2026-11-08T09:30:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
646 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
118.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3346/load_day/2024-12-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:28:36Z [load_day 2024-12-21] attempt 1 started
2026-11-08T09:28:37Z [load_day 2024-12-21] 2024-12-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:28:44Z [load_day 2024-12-21] 2024-12-21 hour 0: 167895 events in 0 files, snapshot none (task 6808 ms: download 3479 ms overlapping gunzip 1020 ms, parse 4461 ms, sort 0 ms, write 0 ms, index 646 ms: 4 candidates, 80470 repo-hours, 1202 releases; waiting 366 ms; commit 0 ms)
2026-11-08T09:28:44Z [load_day 2024-12-21] 2024-12-21 hour 1: 176369 events in 0 files, snapshot none (task 6833 ms: download 3543 ms overlapping gunzip 1006 ms, parse 4260 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 95521 repo-hours, 953 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:28:50Z [load_day 2024-12-21] 2024-12-21 hour 2: 141531 events in 0 files, snapshot none (task 5338 ms: download 2787 ms overlapping gunzip 809 ms, parse 3270 ms, sort 0 ms, write 0 ms, index 474 ms: 4 candidates, 60868 repo-hours, 796 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:28:50Z [load_day 2024-12-21] 2024-12-21 hour 3: 158008 events in 0 files, snapshot none (task 5284 ms: download 2130 ms overlapping gunzip 707 ms, parse 3141 ms, sort 0 ms, write 0 ms, index 660 ms: 5 candidates, 59272 repo-hours, 3939 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:28:55Z [load_day 2024-12-21] 2024-12-21 hour 4: 145792 events in 0 files, snapshot none (task 4577 ms: download 2372 ms overlapping gunzip 641 ms, parse 2738 ms, sort 0 ms, write 0 ms, index 379 ms: 4 candidates, 51117 repo-hours, 637 releases; waiting 445 ms; commit 0 ms)
2026-11-08T09:28:56Z [load_day 2024-12-21] 2024-12-21 hour 5: 147764 events in 0 files, snapshot none (task 4949 ms: download 2496 ms overlapping gunzip 729 ms, parse 3009 ms, sort 0 ms, write 0 ms, index 376 ms: 5 candidates, 53229 repo-hours, 631 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:29:03Z [load_day 2024-12-21] 2024-12-21 hour 6: 170892 events in 0 files, snapshot none (task 7664 ms: download 3355 ms overlapping gunzip 1056 ms, parse 4916 ms, sort 0 ms, write 0 ms, index 901 ms: 6 candidates, 72380 repo-hours, 1049 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:29:04Z [load_day 2024-12-21] 2024-12-21 hour 7: 158615 events in 0 files, snapshot none (task 7244 ms: download 4022 ms overlapping gunzip 1091 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 618 ms: 9 candidates, 57095 repo-hours, 905 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:29:10Z [load_day 2024-12-21] 2024-12-21 hour 8: 162718 events in 0 files, snapshot none (task 6647 ms: download 2974 ms overlapping gunzip 952 ms, parse 4075 ms, sort 0 ms, write 0 ms, index 558 ms: 9 candidates, 62096 repo-hours, 834 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:29:10Z [load_day 2024-12-21] 2024-12-21 hour 9: 169134 events in 0 files, snapshot none (task 6148 ms: download 2875 ms overlapping gunzip 891 ms, parse 3786 ms, sort 0 ms, write 0 ms, index 734 ms: 4 candidates, 66837 repo-hours, 986 releases; waiting 464 ms; commit 0 ms)
2026-11-08T09:29:16Z [load_day 2024-12-21] 2024-12-21 hour 10: 163927 events in 0 files, snapshot none (task 5550 ms: download 2825 ms overlapping gunzip 780 ms, parse 3368 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 62442 repo-hours, 828 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:29:17Z [load_day 2024-12-21] 2024-12-21 hour 11: 165090 events in 0 files, snapshot none (task 5671 ms: download 2809 ms overlapping gunzip 852 ms, parse 3380 ms, sort 0 ms, write 0 ms, index 610 ms: 2 candidates, 58950 repo-hours, 700 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:29:25Z [load_day 2024-12-21] 2024-12-21 hour 12: 230565 events in 0 files, snapshot none (task 7593 ms: download 4036 ms overlapping gunzip 1024 ms, parse 5075 ms, sort 0 ms, write 0 ms, index 824 ms: 8 candidates, 111097 repo-hours, 846 releases; waiting 366 ms; commit 0 ms)
2026-11-08T09:29:25Z [load_day 2024-12-21] 2024-12-21 hour 13: 196552 events in 0 files, snapshot none (task 7238 ms: download 3889 ms overlapping gunzip 1018 ms, parse 4610 ms, sort 0 ms, write 0 ms, index 800 ms: 10 candidates, 87680 repo-hours, 761 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:29:32Z [load_day 2024-12-21] 2024-12-21 hour 14: 182527 events in 0 files, snapshot none (task 6837 ms: download 3989 ms overlapping gunzip 938 ms, parse 3962 ms, sort 0 ms, write 0 ms, index 578 ms: 2 candidates, 69502 repo-hours, 741 releases; waiting 967 ms; commit 0 ms)
2026-11-08T09:29:32Z [load_day 2024-12-21] 2024-12-21 hour 15: 194025 events in 0 files, snapshot none (task 6148 ms: download 3144 ms overlapping gunzip 883 ms, parse 3719 ms, sort 0 ms, write 0 ms, index 701 ms: 1 candidates, 77870 repo-hours, 978 releases; waiting 583 ms; commit 0 ms)
2026-11-08T09:29:38Z [load_day 2024-12-21] 2024-12-21 hour 16: 183367 events in 0 files, snapshot none (task 5445 ms: download 2237 ms overlapping gunzip 789 ms, parse 3416 ms, sort 0 ms, write 0 ms, index 734 ms: 0 candidates, 71040 repo-hours, 976 releases; waiting 174 ms; commit 0 ms)
2026-11-08T09:29:38Z [load_day 2024-12-21] 2024-12-21 hour 17: 175605 events in 0 files, snapshot none (task 5446 ms: download 2850 ms overlapping gunzip 663 ms, parse 3025 ms, sort 0 ms, write 0 ms, index 936 ms: 5 candidates, 65266 repo-hours, 791 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:29:43Z [load_day 2024-12-21] 2024-12-21 hour 18: 186293 events in 0 files, snapshot none (task 5123 ms: download 2594 ms overlapping gunzip 721 ms, parse 3113 ms, sort 0 ms, write 0 ms, index 568 ms: 4 candidates, 80782 repo-hours, 870 releases; waiting 351 ms; commit 0 ms)
2026-11-08T09:29:43Z [load_day 2024-12-21] 2024-12-21 hour 19: 162149 events in 0 files, snapshot none (task 4668 ms: download 2554 ms overlapping gunzip 645 ms, parse 2714 ms, sort 0 ms, write 0 ms, index 413 ms: 1 candidates, 56445 repo-hours, 819 releases; waiting 581 ms; commit 0 ms)
2026-11-08T09:29:48Z [load_day 2024-12-21] 2024-12-21 hour 20: 157487 events in 0 files, snapshot none (task 4373 ms: download 2635 ms overlapping gunzip 619 ms, parse 2530 ms, sort 0 ms, write 0 ms, index 397 ms: 4 candidates, 56659 repo-hours, 702 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:29:48Z [load_day 2024-12-21] 2024-12-21 hour 21: 157878 events in 0 files, snapshot none (task 4128 ms: download 2466 ms overlapping gunzip 582 ms, parse 2607 ms, sort 0 ms, write 0 ms, index 430 ms: 9 candidates, 57974 repo-hours, 924 releases; waiting 235 ms; commit 0 ms)
2026-11-08T09:29:53Z [load_day 2024-12-21] 2024-12-21 hour 22: 140658 events in 0 files, snapshot none (task 4048 ms: download 2664 ms overlapping gunzip 536 ms, parse 2318 ms, sort 0 ms, write 0 ms, index 347 ms: 6 candidates, 48381 repo-hours, 1025 releases; waiting 551 ms; commit 0 ms)
2026-11-08T09:29:53Z [load_day 2024-12-21] 2024-12-21 hour 23: 133107 events in 0 files, snapshot none (task 3568 ms: download 2373 ms overlapping gunzip 445 ms, parse 1929 ms, sort 0 ms, write 0 ms, index 401 ms: 14 candidates, 46192 repo-hours, 672 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:30:01Z [load_day 2024-12-21] 2024-12-21: repo_hour merged from 24 files to 1 (1609165 rows, 8275 ms)
2026-11-08T09:30:06Z [load_day 2024-12-21] 2024-12-21: index committed in 13250 ms (23 + 1 + 24 files)
2026-11-08T09:30:06Z [load_day 2024-12-21] 2024-12-21: 4027948 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:30:06Z [load_day 2024-12-21] attempt 1 succeeded