orcaLog in

Runs · run 4016

load_day 2025-06-13, attempt 1 succeeded

Host
73ccef5e07c2:321391
Started
2026-11-08T12:24:17Z
Ended
2026-11-08T12:26:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
662 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.3 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4016/load_day/2025-06-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:24:17Z [load_day 2025-06-13] attempt 1 started
2026-11-08T12:24:18Z [load_day 2025-06-13] 2025-06-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:24:25Z [load_day 2025-06-13] 2025-06-13 hour 0: 141327 events in 0 files, snapshot none (task 5946 ms: download 3552 ms overlapping gunzip 891 ms, parse 3674 ms, sort 0 ms, write 0 ms, index 622 ms: 13 candidates, 70295 repo-hours, 1121 releases; waiting 472 ms; commit 0 ms)
2026-11-08T12:24:25Z [load_day 2025-06-13] 2025-06-13 hour 1: 151655 events in 0 files, snapshot none (task 6466 ms: download 3677 ms overlapping gunzip 937 ms, parse 3984 ms, sort 0 ms, write 0 ms, index 730 ms: 11 candidates, 89964 repo-hours, 767 releases; waiting 532 ms; commit 0 ms)
2026-11-08T12:24:32Z [load_day 2025-06-13] 2025-06-13 hour 2: 144818 events in 0 files, snapshot none (task 6675 ms: download 3726 ms overlapping gunzip 1036 ms, parse 4168 ms, sort 0 ms, write 0 ms, index 637 ms: 3 candidates, 73337 repo-hours, 776 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:24:32Z [load_day 2025-06-13] 2025-06-13 hour 3: 148845 events in 0 files, snapshot none (task 6643 ms: download 3528 ms overlapping gunzip 983 ms, parse 4245 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 69160 repo-hours, 1829 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:24:38Z [load_day 2025-06-13] 2025-06-13 hour 4: 142553 events in 0 files, snapshot none (task 6119 ms: download 3023 ms overlapping gunzip 907 ms, parse 3669 ms, sort 0 ms, write 0 ms, index 668 ms: 6 candidates, 62534 repo-hours, 748 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:24:39Z [load_day 2025-06-13] 2025-06-13 hour 5: 148540 events in 0 files, snapshot none (task 6227 ms: download 3687 ms overlapping gunzip 958 ms, parse 3801 ms, sort 0 ms, write 0 ms, index 627 ms: 3 candidates, 64983 repo-hours, 734 releases; waiting 598 ms; commit 0 ms)
2026-11-08T12:24:46Z [load_day 2025-06-13] 2025-06-13 hour 6: 154707 events in 0 files, snapshot none (task 7590 ms: download 3110 ms overlapping gunzip 1229 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 746 ms: 13 candidates, 77850 repo-hours, 810 releases; waiting 348 ms; commit 0 ms)
2026-11-08T12:24:48Z [load_day 2025-06-13] 2025-06-13 hour 7: 156763 events in 0 files, snapshot none (task 8468 ms: download 5082 ms overlapping gunzip 1428 ms, parse 5585 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 72927 repo-hours, 812 releases; waiting 329 ms; commit 0 ms)
2026-11-08T12:24:55Z [load_day 2025-06-13] 2025-06-13 hour 8: 158906 events in 0 files, snapshot none (task 7948 ms: download 4378 ms overlapping gunzip 1200 ms, parse 4941 ms, sort 0 ms, write 0 ms, index 937 ms: 6 candidates, 78404 repo-hours, 895 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:24:56Z [load_day 2025-06-13] 2025-06-13 hour 9: 164225 events in 0 files, snapshot none (task 7780 ms: download 4888 ms overlapping gunzip 1216 ms, parse 5069 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 80780 repo-hours, 993 releases; waiting 426 ms; commit 0 ms)
2026-11-08T12:25:02Z [load_day 2025-06-13] 2025-06-13 hour 10: 156627 events in 0 files, snapshot none (task 6409 ms: download 3654 ms overlapping gunzip 903 ms, parse 3856 ms, sort 0 ms, write 0 ms, index 699 ms: 6 candidates, 75703 repo-hours, 834 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:25:03Z [load_day 2025-06-13] 2025-06-13 hour 11: 154380 events in 0 files, snapshot none (task 6212 ms: download 3651 ms overlapping gunzip 934 ms, parse 3830 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 73098 repo-hours, 838 releases; waiting 540 ms; commit 0 ms)
2026-11-08T12:25:10Z [load_day 2025-06-13] 2025-06-13 hour 12: 169906 events in 0 files, snapshot none (task 7900 ms: download 4864 ms overlapping gunzip 1094 ms, parse 4520 ms, sort 0 ms, write 0 ms, index 891 ms: 11 candidates, 97500 repo-hours, 855 releases; waiting 1059 ms; commit 0 ms)
2026-11-08T12:25:11Z [load_day 2025-06-13] 2025-06-13 hour 13: 160918 events in 0 files, snapshot none (task 7073 ms: download 4494 ms overlapping gunzip 1064 ms, parse 4493 ms, sort 0 ms, write 0 ms, index 694 ms: 10 candidates, 88414 repo-hours, 804 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:25:19Z [load_day 2025-06-13] 2025-06-13 hour 14: 161271 events in 0 files, snapshot none (task 7981 ms: download 5185 ms overlapping gunzip 1243 ms, parse 5121 ms, sort 0 ms, write 0 ms, index 715 ms: 7 candidates, 79452 repo-hours, 948 releases; waiting 531 ms; commit 0 ms)
2026-11-08T12:25:19Z [load_day 2025-06-13] 2025-06-13 hour 15: 163470 events in 0 files, snapshot none (task 7707 ms: download 5053 ms overlapping gunzip 1199 ms, parse 4993 ms, sort 0 ms, write 0 ms, index 727 ms: 8 candidates, 81981 repo-hours, 969 releases; waiting 495 ms; commit 0 ms)
2026-11-08T12:25:28Z [load_day 2025-06-13] 2025-06-13 hour 16: 160388 events in 0 files, snapshot none (task 8230 ms: download 4984 ms overlapping gunzip 1289 ms, parse 5103 ms, sort 0 ms, write 0 ms, index 958 ms: 9 candidates, 77858 repo-hours, 867 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:25:28Z [load_day 2025-06-13] 2025-06-13 hour 17: 153113 events in 0 files, snapshot none (task 6978 ms: download 3695 ms overlapping gunzip 1049 ms, parse 4353 ms, sort 0 ms, write 0 ms, index 755 ms: 20 candidates, 72787 repo-hours, 810 releases; waiting 506 ms; commit 0 ms)
2026-11-08T12:25:36Z [load_day 2025-06-13] 2025-06-13 hour 18: 157023 events in 0 files, snapshot none (task 7232 ms: download 4016 ms overlapping gunzip 1064 ms, parse 4644 ms, sort 0 ms, write 0 ms, index 730 ms: 9 candidates, 79122 repo-hours, 919 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:25:36Z [load_day 2025-06-13] 2025-06-13 hour 19: 149687 events in 0 files, snapshot none (task 7248 ms: download 4320 ms overlapping gunzip 1146 ms, parse 4620 ms, sort 0 ms, write 0 ms, index 626 ms: 5 candidates, 65341 repo-hours, 796 releases; waiting 545 ms; commit 0 ms)
2026-11-08T12:25:44Z [load_day 2025-06-13] 2025-06-13 hour 20: 149768 events in 0 files, snapshot none (task 7452 ms: download 4082 ms overlapping gunzip 1175 ms, parse 4860 ms, sort 0 ms, write 0 ms, index 619 ms: 10 candidates, 65757 repo-hours, 817 releases; waiting 434 ms; commit 0 ms)
2026-11-08T12:25:44Z [load_day 2025-06-13] 2025-06-13 hour 21: 147955 events in 0 files, snapshot none (task 7099 ms: download 4710 ms overlapping gunzip 1086 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 615 ms: 10 candidates, 61490 repo-hours, 873 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:25:51Z [load_day 2025-06-13] 2025-06-13 hour 22: 141111 events in 0 files, snapshot none (task 6839 ms: download 3811 ms overlapping gunzip 1026 ms, parse 4438 ms, sort 0 ms, write 0 ms, index 562 ms: 13 candidates, 56567 repo-hours, 931 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:25:51Z [load_day 2025-06-13] 2025-06-13 hour 23: 135119 events in 0 files, snapshot none (task 7155 ms: download 3717 ms overlapping gunzip 1104 ms, parse 4666 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 54598 repo-hours, 1160 releases; waiting 513 ms; commit 0 ms)
2026-11-08T12:26:00Z [load_day 2025-06-13] 2025-06-13: repo_hour merged from 24 files to 1 (1769902 rows, 9163 ms)
2026-11-08T12:26:03Z [load_day 2025-06-13] 2025-06-13: index committed in 12142 ms (24 + 1 + 24 files)
2026-11-08T12:26:03Z [load_day 2025-06-13] 2025-06-13: 3673075 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:26:03Z [load_day 2025-06-13] attempt 1 succeeded