orcaLog in

Runs · run 3733

load_day 2025-03-30, attempt 1 succeeded

Host
73ccef5e07c2:279916
Started
2026-11-08T11:07:49Z
Ended
2026-11-08T11:09:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
736 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3733/load_day/2025-03-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:07:49Z [load_day 2025-03-30] attempt 1 started
2026-11-08T11:07:50Z [load_day 2025-03-30] 2025-03-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:07:56Z [load_day 2025-03-30] 2025-03-30 hour 0: 176106 events in 0 files, snapshot none (task 5935 ms: download 2890 ms overlapping gunzip 811 ms, parse 3729 ms, sort 0 ms, write 0 ms, index 594 ms: 13 candidates, 77818 repo-hours, 1226 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:07:56Z [load_day 2025-03-30] 2025-03-30 hour 1: 204275 events in 0 files, snapshot none (task 6210 ms: download 3052 ms overlapping gunzip 877 ms, parse 3757 ms, sort 0 ms, write 0 ms, index 777 ms: 7 candidates, 109623 repo-hours, 941 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:08:02Z [load_day 2025-03-30] 2025-03-30 hour 2: 168785 events in 0 files, snapshot none (task 5508 ms: download 2630 ms overlapping gunzip 728 ms, parse 3017 ms, sort 0 ms, write 0 ms, index 1040 ms: 4 candidates, 70491 repo-hours, 796 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:08:02Z [load_day 2025-03-30] 2025-03-30 hour 3: 180733 events in 0 files, snapshot none (task 5504 ms: download 2494 ms overlapping gunzip 698 ms, parse 3087 ms, sort 0 ms, write 0 ms, index 931 ms: 2 candidates, 69250 repo-hours, 2910 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:08:08Z [load_day 2025-03-30] 2025-03-30 hour 4: 164850 events in 0 files, snapshot none (task 4829 ms: download 2456 ms overlapping gunzip 694 ms, parse 2936 ms, sort 0 ms, write 0 ms, index 419 ms: 3 candidates, 58332 repo-hours, 735 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:08:08Z [load_day 2025-03-30] 2025-03-30 hour 5: 171462 events in 0 files, snapshot none (task 4496 ms: download 2115 ms overlapping gunzip 652 ms, parse 2900 ms, sort 0 ms, write 0 ms, index 446 ms: 3 candidates, 60600 repo-hours, 766 releases; waiting 184 ms; commit 0 ms)
2026-11-08T11:08:14Z [load_day 2025-03-30] 2025-03-30 hour 6: 188234 events in 0 files, snapshot none (task 6214 ms: download 3351 ms overlapping gunzip 914 ms, parse 3887 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 78071 repo-hours, 853 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:08:14Z [load_day 2025-03-30] 2025-03-30 hour 7: 183371 events in 0 files, snapshot none (task 5857 ms: download 3279 ms overlapping gunzip 881 ms, parse 3921 ms, sort 0 ms, write 0 ms, index 510 ms: 1 candidates, 64915 repo-hours, 696 releases; waiting 260 ms; commit 0 ms)
2026-11-08T11:08:21Z [load_day 2025-03-30] 2025-03-30 hour 8: 188611 events in 0 files, snapshot none (task 6121 ms: download 3244 ms overlapping gunzip 919 ms, parse 3739 ms, sort 0 ms, write 0 ms, index 714 ms: 3 candidates, 70482 repo-hours, 898 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:08:22Z [load_day 2025-03-30] 2025-03-30 hour 9: 199722 events in 0 files, snapshot none (task 7333 ms: download 4696 ms overlapping gunzip 1115 ms, parse 4828 ms, sort 0 ms, write 0 ms, index 601 ms: 14 candidates, 76759 repo-hours, 1011 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:08:28Z [load_day 2025-03-30] 2025-03-30 hour 10: 194956 events in 0 files, snapshot none (task 6605 ms: download 3791 ms overlapping gunzip 956 ms, parse 4252 ms, sort 0 ms, write 0 ms, index 641 ms: 5 candidates, 75259 repo-hours, 877 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:08:29Z [load_day 2025-03-30] 2025-03-30 hour 11: 192577 events in 0 files, snapshot none (task 6430 ms: download 3704 ms overlapping gunzip 909 ms, parse 4014 ms, sort 0 ms, write 0 ms, index 609 ms: 3 candidates, 71564 repo-hours, 922 releases; waiting 527 ms; commit 0 ms)
2026-11-08T11:08:36Z [load_day 2025-03-30] 2025-03-30 hour 12: 251101 events in 0 files, snapshot none (task 7206 ms: download 3932 ms overlapping gunzip 1033 ms, parse 4495 ms, sort 0 ms, write 0 ms, index 836 ms: 13 candidates, 121510 repo-hours, 1109 releases; waiting 526 ms; commit 0 ms)
2026-11-08T11:08:37Z [load_day 2025-03-30] 2025-03-30 hour 13: 229679 events in 0 files, snapshot none (task 7454 ms: download 4860 ms overlapping gunzip 1098 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 672 ms: 3 candidates, 101898 repo-hours, 956 releases; waiting 469 ms; commit 0 ms)
2026-11-08T11:08:42Z [load_day 2025-03-30] 2025-03-30 hour 14: 223335 events in 0 files, snapshot none (task 5955 ms: download 3259 ms overlapping gunzip 819 ms, parse 3632 ms, sort 0 ms, write 0 ms, index 660 ms: 7 candidates, 87172 repo-hours, 1006 releases; waiting 623 ms; commit 0 ms)
2026-11-08T11:08:43Z [load_day 2025-03-30] 2025-03-30 hour 15: 233525 events in 0 files, snapshot none (task 5985 ms: download 3459 ms overlapping gunzip 862 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 735 ms: 3 candidates, 93327 repo-hours, 1088 releases; waiting 562 ms; commit 0 ms)
2026-11-08T11:08:50Z [load_day 2025-03-30] 2025-03-30 hour 16: 221043 events in 0 files, snapshot none (task 7281 ms: download 4372 ms overlapping gunzip 859 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 800 ms: 2 candidates, 87090 repo-hours, 1151 releases; waiting 1627 ms; commit 0 ms)
2026-11-08T11:08:50Z [load_day 2025-03-30] 2025-03-30 hour 17: 216023 events in 0 files, snapshot none (task 5909 ms: download 3191 ms overlapping gunzip 827 ms, parse 3490 ms, sort 0 ms, write 0 ms, index 732 ms: 11 candidates, 81266 repo-hours, 931 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:08:58Z [load_day 2025-03-30] 2025-03-30 hour 18: 227950 events in 0 files, snapshot none (task 7327 ms: download 4663 ms overlapping gunzip 1067 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 747 ms: 13 candidates, 97035 repo-hours, 1274 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:08:58Z [load_day 2025-03-30] 2025-03-30 hour 19: 206165 events in 0 files, snapshot none (task 6546 ms: download 3722 ms overlapping gunzip 1033 ms, parse 4428 ms, sort 0 ms, write 0 ms, index 590 ms: 9 candidates, 75043 repo-hours, 1013 releases; waiting 249 ms; commit 0 ms)
2026-11-08T11:09:06Z [load_day 2025-03-30] 2025-03-30 hour 20: 206988 events in 0 files, snapshot none (task 7250 ms: download 4533 ms overlapping gunzip 1077 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 593 ms: 8 candidates, 76666 repo-hours, 1052 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:09:06Z [load_day 2025-03-30] 2025-03-30 hour 21: 198399 events in 0 files, snapshot none (task 7366 ms: download 4648 ms overlapping gunzip 1141 ms, parse 4872 ms, sort 0 ms, write 0 ms, index 569 ms: 8 candidates, 74503 repo-hours, 1079 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:09:14Z [load_day 2025-03-30] 2025-03-30 hour 22: 182717 events in 0 files, snapshot none (task 7716 ms: download 4232 ms overlapping gunzip 1062 ms, parse 5068 ms, sort 0 ms, write 0 ms, index 846 ms: 7 candidates, 65217 repo-hours, 1034 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:09:14Z [load_day 2025-03-30] 2025-03-30 hour 23: 169928 events in 0 files, snapshot none (task 7530 ms: download 4171 ms overlapping gunzip 1073 ms, parse 4951 ms, sort 0 ms, write 0 ms, index 725 ms: 1 candidates, 61075 repo-hours, 890 releases; waiting 467 ms; commit 0 ms)
2026-11-08T11:09:23Z [load_day 2025-03-30] 2025-03-30: repo_hour merged from 24 files to 1 (1904966 rows, 9098 ms)
2026-11-08T11:09:26Z [load_day 2025-03-30] 2025-03-30: index committed in 11779 ms (24 + 1 + 24 files)
2026-11-08T11:09:26Z [load_day 2025-03-30] 2025-03-30: 4780535 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:09:26Z [load_day 2025-03-30] attempt 1 succeeded