orcaLog in

Runs · run 4884

load_day 2026-01-30, attempt 1 succeeded

Host
73ccef5e07c2:437027
Started
2026-11-08T15:11:00Z
Ended
2026-11-08T15:12:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
718 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.1 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4884/load_day/2026-01-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:11:00Z [load_day 2026-01-30] attempt 1 started
2026-11-08T15:11:01Z [load_day 2026-01-30] 2026-01-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:11:05Z [load_day 2026-01-30] 2026-01-30 hour 0: 143480 events in 0 files, snapshot none (task 3748 ms: download 2676 ms overlapping gunzip 454 ms, parse 1356 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 68834 repo-hours, 852 releases; waiting 1009 ms; commit 0 ms)
2026-11-08T15:11:05Z [load_day 2026-01-30] 2026-01-30 hour 1: 147319 events in 0 files, snapshot none (task 4142 ms: download 2759 ms overlapping gunzip 417 ms, parse 1275 ms, sort 0 ms, write 0 ms, index 712 ms: 7 candidates, 85671 repo-hours, 657 releases; waiting 1416 ms; commit 0 ms)
2026-11-08T15:11:09Z [load_day 2026-01-30] 2026-01-30 hour 2: 148994 events in 0 files, snapshot none (task 3245 ms: download 1985 ms overlapping gunzip 400 ms, parse 1192 ms, sort 0 ms, write 0 ms, index 587 ms: 2 candidates, 82664 repo-hours, 718 releases; waiting 750 ms; commit 0 ms)
2026-11-08T15:11:09Z [load_day 2026-01-30] 2026-01-30 hour 3: 142862 events in 0 files, snapshot none (task 3089 ms: download 1951 ms overlapping gunzip 399 ms, parse 1188 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 67687 repo-hours, 800 releases; waiting 521 ms; commit 0 ms)
2026-11-08T15:11:12Z [load_day 2026-01-30] 2026-01-30 hour 4: 146609 events in 0 files, snapshot none (task 2993 ms: download 1923 ms overlapping gunzip 378 ms, parse 1162 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 70387 repo-hours, 1682 releases; waiting 570 ms; commit 0 ms)
2026-11-08T15:11:13Z [load_day 2026-01-30] 2026-01-30 hour 5: 143846 events in 0 files, snapshot none (task 3412 ms: download 2234 ms overlapping gunzip 354 ms, parse 1105 ms, sort 0 ms, write 0 ms, index 569 ms: 5 candidates, 73764 repo-hours, 673 releases; waiting 1155 ms; commit 0 ms)
2026-11-08T15:11:17Z [load_day 2026-01-30] 2026-01-30 hour 6: 148160 events in 0 files, snapshot none (task 4651 ms: download 3279 ms overlapping gunzip 509 ms, parse 1545 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 77922 repo-hours, 715 releases; waiting 1679 ms; commit 0 ms)
2026-11-08T15:11:17Z [load_day 2026-01-30] 2026-01-30 hour 7: 148941 events in 0 files, snapshot none (task 3767 ms: download 2294 ms overlapping gunzip 584 ms, parse 1694 ms, sort 0 ms, write 0 ms, index 635 ms: 10 candidates, 77879 repo-hours, 738 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:11:22Z [load_day 2026-01-30] 2026-01-30 hour 8: 143910 events in 0 files, snapshot none (task 3638 ms: download 2509 ms overlapping gunzip 414 ms, parse 1185 ms, sort 0 ms, write 0 ms, index 630 ms: 9 candidates, 73983 repo-hours, 866 releases; waiting 1023 ms; commit 0 ms)
2026-11-08T15:11:23Z [load_day 2026-01-30] 2026-01-30 hour 9: 143666 events in 0 files, snapshot none (task 3903 ms: download 2694 ms overlapping gunzip 451 ms, parse 1287 ms, sort 0 ms, write 0 ms, index 635 ms: 5 candidates, 77510 repo-hours, 696 releases; waiting 1216 ms; commit 0 ms)
2026-11-08T15:11:28Z [load_day 2026-01-30] 2026-01-30 hour 10: 147029 events in 0 files, snapshot none (task 4823 ms: download 3219 ms overlapping gunzip 448 ms, parse 1260 ms, sort 0 ms, write 0 ms, index 744 ms: 4 candidates, 80427 repo-hours, 776 releases; waiting 2026 ms; commit 0 ms)
2026-11-08T15:11:28Z [load_day 2026-01-30] 2026-01-30 hour 11: 147213 events in 0 files, snapshot none (task 3311 ms: download 2158 ms overlapping gunzip 404 ms, parse 1181 ms, sort 0 ms, write 0 ms, index 700 ms: 8 candidates, 77694 repo-hours, 650 releases; waiting 766 ms; commit 0 ms)
2026-11-08T15:11:32Z [load_day 2026-01-30] 2026-01-30 hour 12: 151640 events in 0 files, snapshot none (task 3765 ms: download 2057 ms overlapping gunzip 434 ms, parse 1382 ms, sort 0 ms, write 0 ms, index 883 ms: 5 candidates, 90678 repo-hours, 522 releases; waiting 614 ms; commit 0 ms)
2026-11-08T15:11:32Z [load_day 2026-01-30] 2026-01-30 hour 13: 155190 events in 0 files, snapshot none (task 3946 ms: download 2386 ms overlapping gunzip 392 ms, parse 1288 ms, sort 0 ms, write 0 ms, index 958 ms: 10 candidates, 92896 repo-hours, 495 releases; waiting 928 ms; commit 0 ms)
2026-11-08T15:11:36Z [load_day 2026-01-30] 2026-01-30 hour 14: 147750 events in 0 files, snapshot none (task 3943 ms: download 2378 ms overlapping gunzip 491 ms, parse 1525 ms, sort 0 ms, write 0 ms, index 707 ms: 6 candidates, 81889 repo-hours, 513 releases; waiting 743 ms; commit 0 ms)
2026-11-08T15:11:36Z [load_day 2026-01-30] 2026-01-30 hour 15: 152152 events in 0 files, snapshot none (task 3656 ms: download 2436 ms overlapping gunzip 495 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 776 ms: 9 candidates, 82153 repo-hours, 492 releases; waiting 680 ms; commit 0 ms)
2026-11-08T15:11:41Z [load_day 2026-01-30] 2026-01-30 hour 16: 151114 events in 0 files, snapshot none (task 3898 ms: download 2211 ms overlapping gunzip 541 ms, parse 1691 ms, sort 0 ms, write 0 ms, index 677 ms: 6 candidates, 81647 repo-hours, 512 releases; waiting 623 ms; commit 0 ms)
2026-11-08T15:11:41Z [load_day 2026-01-30] 2026-01-30 hour 17: 152942 events in 0 files, snapshot none (task 3875 ms: download 2555 ms overlapping gunzip 559 ms, parse 1722 ms, sort 0 ms, write 0 ms, index 715 ms: 5 candidates, 78712 repo-hours, 573 releases; waiting 572 ms; commit 0 ms)
2026-11-08T15:11:45Z [load_day 2026-01-30] 2026-01-30 hour 18: 150277 events in 0 files, snapshot none (task 4361 ms: download 1936 ms overlapping gunzip 656 ms, parse 1996 ms, sort 0 ms, write 0 ms, index 827 ms: 5 candidates, 80204 repo-hours, 545 releases; waiting 574 ms; commit 0 ms)
2026-11-08T15:11:46Z [load_day 2026-01-30] 2026-01-30 hour 19: 143005 events in 0 files, snapshot none (task 4386 ms: download 2348 ms overlapping gunzip 659 ms, parse 2078 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 73566 repo-hours, 634 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:11:51Z [load_day 2026-01-30] 2026-01-30 hour 20: 143507 events in 0 files, snapshot none (task 4748 ms: download 2417 ms overlapping gunzip 685 ms, parse 2219 ms, sort 0 ms, write 0 ms, index 819 ms: 8 candidates, 70732 repo-hours, 708 releases; waiting 554 ms; commit 0 ms)
2026-11-08T15:11:51Z [load_day 2026-01-30] 2026-01-30 hour 21: 144403 events in 0 files, snapshot none (task 4760 ms: download 2507 ms overlapping gunzip 833 ms, parse 2365 ms, sort 0 ms, write 0 ms, index 734 ms: 6 candidates, 71177 repo-hours, 772 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:11:56Z [load_day 2026-01-30] 2026-01-30 hour 22: 146849 events in 0 files, snapshot none (task 4979 ms: download 2454 ms overlapping gunzip 875 ms, parse 2554 ms, sort 0 ms, write 0 ms, index 654 ms: 9 candidates, 68207 repo-hours, 807 releases; waiting 537 ms; commit 0 ms)
2026-11-08T15:11:56Z [load_day 2026-01-30] 2026-01-30 hour 23: 141509 events in 0 files, snapshot none (task 4489 ms: download 2873 ms overlapping gunzip 797 ms, parse 2280 ms, sort 0 ms, write 0 ms, index 668 ms: 6 candidates, 62506 repo-hours, 1004 releases; waiting 481 ms; commit 0 ms)
2026-11-08T15:12:05Z [load_day 2026-01-30] 2026-01-30: repo_hour merged from 24 files to 1 (1848789 rows, 8760 ms)
2026-11-08T15:12:08Z [load_day 2026-01-30] 2026-01-30: index committed in 11730 ms (24 + 1 + 24 files)
2026-11-08T15:12:08Z [load_day 2026-01-30] 2026-01-30: 3532367 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:12:08Z [load_day 2026-01-30] attempt 1 succeeded