orcaLog in

Runs · run 3106

load_day 2024-10-20, attempt 1 succeeded

Host
73ccef5e07c2:195217
Started
2026-11-08T08:25:40Z
Ended
2026-11-08T08:27:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
661 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
115.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3106/load_day/2024-10-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:25:40Z [load_day 2024-10-20] attempt 1 started
2026-11-08T08:25:41Z [load_day 2024-10-20] 2024-10-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:25:46Z [load_day 2024-10-20] 2024-10-20 hour 0: 146505 events in 0 files, snapshot none (task 4219 ms: download 1761 ms overlapping gunzip 497 ms, parse 2022 ms, sort 0 ms, write 0 ms, index 951 ms: 6 candidates, 68153 repo-hours, 1011 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:25:46Z [load_day 2024-10-20] 2024-10-20 hour 1: 174291 events in 0 files, snapshot none (task 4495 ms: download 1931 ms overlapping gunzip 529 ms, parse 2212 ms, sort 0 ms, write 0 ms, index 1011 ms: 6 candidates, 92450 repo-hours, 807 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:25:51Z [load_day 2024-10-20] 2024-10-20 hour 2: 141462 events in 0 files, snapshot none (task 3937 ms: download 2262 ms overlapping gunzip 516 ms, parse 2073 ms, sort 0 ms, write 0 ms, index 395 ms: 4 candidates, 58151 repo-hours, 628 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:25:52Z [load_day 2024-10-20] 2024-10-20 hour 3: 176886 events in 0 files, snapshot none (task 4930 ms: download 2315 ms overlapping gunzip 685 ms, parse 2852 ms, sort 0 ms, write 0 ms, index 579 ms: 1 candidates, 61209 repo-hours, 3914 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:25:56Z [load_day 2024-10-20] 2024-10-20 hour 4: 159226 events in 0 files, snapshot none (task 5179 ms: download 2117 ms overlapping gunzip 729 ms, parse 3286 ms, sort 0 ms, write 0 ms, index 392 ms: 7 candidates, 51854 repo-hours, 528 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:25:57Z [load_day 2024-10-20] 2024-10-20 hour 5: 165862 events in 0 files, snapshot none (task 4785 ms: download 2417 ms overlapping gunzip 724 ms, parse 2884 ms, sort 0 ms, write 0 ms, index 434 ms: 1 candidates, 55480 repo-hours, 715 releases; waiting 462 ms; commit 0 ms)
2026-11-08T08:26:03Z [load_day 2024-10-20] 2024-10-20 hour 6: 182644 events in 0 files, snapshot none (task 5897 ms: download 2963 ms overlapping gunzip 799 ms, parse 3587 ms, sort 0 ms, write 0 ms, index 745 ms: 5 candidates, 72697 repo-hours, 733 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:26:03Z [load_day 2024-10-20] 2024-10-20 hour 7: 172729 events in 0 files, snapshot none (task 5592 ms: download 2752 ms overlapping gunzip 874 ms, parse 3480 ms, sort 0 ms, write 0 ms, index 414 ms: 1 candidates, 57247 repo-hours, 561 releases; waiting 486 ms; commit 0 ms)
2026-11-08T08:26:09Z [load_day 2024-10-20] 2024-10-20 hour 8: 173165 events in 0 files, snapshot none (task 5576 ms: download 3057 ms overlapping gunzip 885 ms, parse 3439 ms, sort 0 ms, write 0 ms, index 489 ms: 1 candidates, 62006 repo-hours, 702 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:26:10Z [load_day 2024-10-20] 2024-10-20 hour 9: 190033 events in 0 files, snapshot none (task 6026 ms: download 3333 ms overlapping gunzip 944 ms, parse 3955 ms, sort 0 ms, write 0 ms, index 536 ms: 3 candidates, 69213 repo-hours, 835 releases; waiting 307 ms; commit 0 ms)
2026-11-08T08:26:14Z [load_day 2024-10-20] 2024-10-20 hour 10: 181590 events in 0 files, snapshot none (task 4356 ms: download 2463 ms overlapping gunzip 589 ms, parse 2423 ms, sort 0 ms, write 0 ms, index 527 ms: 4 candidates, 66056 repo-hours, 719 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:26:15Z [load_day 2024-10-20] 2024-10-20 hour 11: 187995 events in 0 files, snapshot none (task 4455 ms: download 2493 ms overlapping gunzip 627 ms, parse 2562 ms, sort 0 ms, write 0 ms, index 463 ms: 4 candidates, 63370 repo-hours, 757 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:26:19Z [load_day 2024-10-20] 2024-10-20 hour 12: 239043 events in 0 files, snapshot none (task 5117 ms: download 2797 ms overlapping gunzip 649 ms, parse 2818 ms, sort 0 ms, write 0 ms, index 776 ms: 7 candidates, 113918 repo-hours, 961 releases; waiting 565 ms; commit 0 ms)
2026-11-08T08:26:21Z [load_day 2024-10-20] 2024-10-20 hour 13: 227769 events in 0 files, snapshot none (task 5078 ms: download 2679 ms overlapping gunzip 703 ms, parse 2978 ms, sort 0 ms, write 0 ms, index 653 ms: 4 candidates, 94691 repo-hours, 924 releases; waiting 493 ms; commit 0 ms)
2026-11-08T08:26:26Z [load_day 2024-10-20] 2024-10-20 hour 14: 213476 events in 0 files, snapshot none (task 5669 ms: download 2752 ms overlapping gunzip 770 ms, parse 2966 ms, sort 0 ms, write 0 ms, index 1060 ms: 4 candidates, 78238 repo-hours, 942 releases; waiting 636 ms; commit 0 ms)
2026-11-08T08:26:27Z [load_day 2024-10-20] 2024-10-20 hour 15: 219333 events in 0 files, snapshot none (task 5689 ms: download 2761 ms overlapping gunzip 803 ms, parse 3224 ms, sort 0 ms, write 0 ms, index 868 ms: 6 candidates, 87082 repo-hours, 1075 releases; waiting 483 ms; commit 0 ms)
2026-11-08T08:26:32Z [load_day 2024-10-20] 2024-10-20 hour 16: 210747 events in 0 files, snapshot none (task 5394 ms: download 2620 ms overlapping gunzip 759 ms, parse 2962 ms, sort 0 ms, write 0 ms, index 862 ms: 8 candidates, 83600 repo-hours, 957 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:26:33Z [load_day 2024-10-20] 2024-10-20 hour 17: 201511 events in 0 files, snapshot none (task 5665 ms: download 2671 ms overlapping gunzip 804 ms, parse 3289 ms, sort 0 ms, write 0 ms, index 728 ms: 5 candidates, 72870 repo-hours, 764 releases; waiting 554 ms; commit 0 ms)
2026-11-08T08:26:38Z [load_day 2024-10-20] 2024-10-20 hour 18: 215434 events in 0 files, snapshot none (task 5456 ms: download 2787 ms overlapping gunzip 746 ms, parse 3132 ms, sort 0 ms, write 0 ms, index 744 ms: 2 candidates, 90098 repo-hours, 1021 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:26:39Z [load_day 2024-10-20] 2024-10-20 hour 19: 197029 events in 0 files, snapshot none (task 5058 ms: download 2558 ms overlapping gunzip 704 ms, parse 2834 ms, sort 0 ms, write 0 ms, index 720 ms: 8 candidates, 66917 repo-hours, 863 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:26:43Z [load_day 2024-10-20] 2024-10-20 hour 20: 184068 events in 0 files, snapshot none (task 4929 ms: download 2345 ms overlapping gunzip 843 ms, parse 3132 ms, sort 0 ms, write 0 ms, index 467 ms: 4 candidates, 64078 repo-hours, 880 releases; waiting 212 ms; commit 0 ms)
2026-11-08T08:26:44Z [load_day 2024-10-20] 2024-10-20 hour 21: 187006 events in 0 files, snapshot none (task 5144 ms: download 2719 ms overlapping gunzip 721 ms, parse 3056 ms, sort 0 ms, write 0 ms, index 510 ms: 8 candidates, 65241 repo-hours, 864 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:26:49Z [load_day 2024-10-20] 2024-10-20 hour 22: 166183 events in 0 files, snapshot none (task 5296 ms: download 2369 ms overlapping gunzip 810 ms, parse 3218 ms, sort 0 ms, write 0 ms, index 551 ms: 13 candidates, 52981 repo-hours, 1036 releases; waiting 471 ms; commit 0 ms)
2026-11-08T08:26:50Z [load_day 2024-10-20] 2024-10-20 hour 23: 160295 events in 0 files, snapshot none (task 5503 ms: download 2538 ms overlapping gunzip 845 ms, parse 3597 ms, sort 0 ms, write 0 ms, index 516 ms: 1 candidates, 51441 repo-hours, 722 releases; waiting 261 ms; commit 0 ms)
2026-11-08T08:26:59Z [load_day 2024-10-20] 2024-10-20: repo_hour merged from 24 files to 1 (1699041 rows, 8956 ms)
2026-11-08T08:27:02Z [load_day 2024-10-20] 2024-10-20: index committed in 11501 ms (24 + 1 + 24 files)
2026-11-08T08:27:02Z [load_day 2024-10-20] 2024-10-20: 4474282 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:27:02Z [load_day 2024-10-20] attempt 1 succeeded