orcaLog in

Runs · run 4741

load_day 2025-12-21, attempt 1 succeeded

Host
73ccef5e07c2:419990
Started
2026-11-08T14:49:02Z
Ended
2026-11-08T14:50:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
664 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
67.3 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4741/load_day/2025-12-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:49:02Z [load_day 2025-12-21] attempt 1 started
2026-11-08T14:49:03Z [load_day 2025-12-21] 2025-12-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:49:07Z [load_day 2025-12-21] 2025-12-21 hour 0: 133183 events in 0 files, snapshot none (task 3201 ms: download 2042 ms overlapping gunzip 395 ms, parse 1236 ms, sort 0 ms, write 0 ms, index 509 ms: 4 candidates, 62868 repo-hours, 1050 releases; waiting 727 ms; commit 0 ms)
2026-11-08T14:49:07Z [load_day 2025-12-21] 2025-12-21 hour 1: 143492 events in 0 files, snapshot none (task 3583 ms: download 1959 ms overlapping gunzip 374 ms, parse 1269 ms, sort 0 ms, write 0 ms, index 790 ms: 8 candidates, 86801 repo-hours, 721 releases; waiting 872 ms; commit 0 ms)
2026-11-08T14:49:10Z [load_day 2025-12-21] 2025-12-21 hour 2: 140232 events in 0 files, snapshot none (task 2841 ms: download 1424 ms overlapping gunzip 365 ms, parse 1202 ms, sort 0 ms, write 0 ms, index 731 ms: 5 candidates, 72998 repo-hours, 769 releases; waiting 238 ms; commit 0 ms)
2026-11-08T14:49:10Z [load_day 2025-12-21] 2025-12-21 hour 3: 132964 events in 0 files, snapshot none (task 2912 ms: download 1850 ms overlapping gunzip 361 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 483 ms: 8 candidates, 61773 repo-hours, 850 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:49:14Z [load_day 2025-12-21] 2025-12-21 hour 4: 143471 events in 0 files, snapshot none (task 3766 ms: download 2443 ms overlapping gunzip 424 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 62626 repo-hours, 1590 releases; waiting 804 ms; commit 0 ms)
2026-11-08T14:49:14Z [load_day 2025-12-21] 2025-12-21 hour 5: 142086 events in 0 files, snapshot none (task 3267 ms: download 1704 ms overlapping gunzip 498 ms, parse 1383 ms, sort 0 ms, write 0 ms, index 585 ms: 5 candidates, 62987 repo-hours, 616 releases; waiting 439 ms; commit 0 ms)
2026-11-08T14:49:20Z [load_day 2025-12-21] 2025-12-21 hour 6: 144980 events in 0 files, snapshot none (task 4020 ms: download 2826 ms overlapping gunzip 799 ms, parse 1876 ms, sort 0 ms, write 0 ms, index 488 ms: 4 candidates, 68275 repo-hours, 666 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:49:20Z [load_day 2025-12-21] 2025-12-21 hour 7: 144177 events in 0 files, snapshot none (task 3412 ms: download 2328 ms overlapping gunzip 538 ms, parse 1410 ms, sort 0 ms, write 0 ms, index 554 ms: 10 candidates, 64105 repo-hours, 490 releases; waiting 611 ms; commit 0 ms)
2026-11-08T14:49:23Z [load_day 2025-12-21] 2025-12-21 hour 8: 142865 events in 0 files, snapshot none (task 3083 ms: download 1704 ms overlapping gunzip 417 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 550 ms: 3 candidates, 62201 repo-hours, 665 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:49:23Z [load_day 2025-12-21] 2025-12-21 hour 9: 147344 events in 0 files, snapshot none (task 3163 ms: download 1886 ms overlapping gunzip 418 ms, parse 1279 ms, sort 0 ms, write 0 ms, index 582 ms: 2 candidates, 67989 repo-hours, 697 releases; waiting 532 ms; commit 0 ms)
2026-11-08T14:49:27Z [load_day 2025-12-21] 2025-12-21 hour 10: 148703 events in 0 files, snapshot none (task 3364 ms: download 1944 ms overlapping gunzip 354 ms, parse 1181 ms, sort 0 ms, write 0 ms, index 742 ms: 6 candidates, 70143 repo-hours, 678 releases; waiting 773 ms; commit 0 ms)
2026-11-08T14:49:28Z [load_day 2025-12-21] 2025-12-21 hour 11: 144361 events in 0 files, snapshot none (task 3611 ms: download 2344 ms overlapping gunzip 446 ms, parse 1333 ms, sort 0 ms, write 0 ms, index 623 ms: 2 candidates, 66745 repo-hours, 537 releases; waiting 921 ms; commit 0 ms)
2026-11-08T14:49:31Z [load_day 2025-12-21] 2025-12-21 hour 12: 154587 events in 0 files, snapshot none (task 3519 ms: download 1913 ms overlapping gunzip 332 ms, parse 1114 ms, sort 0 ms, write 0 ms, index 988 ms: 5 candidates, 91840 repo-hours, 747 releases; waiting 770 ms; commit 0 ms)
2026-11-08T14:49:32Z [load_day 2025-12-21] 2025-12-21 hour 13: 154500 events in 0 files, snapshot none (task 3599 ms: download 2356 ms overlapping gunzip 435 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 633 ms: 8 candidates, 83728 repo-hours, 638 releases; waiting 852 ms; commit 0 ms)
2026-11-08T14:49:35Z [load_day 2025-12-21] 2025-12-21 hour 14: 148941 events in 0 files, snapshot none (task 3358 ms: download 2183 ms overlapping gunzip 386 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 562 ms: 6 candidates, 72157 repo-hours, 696 releases; waiting 911 ms; commit 0 ms)
2026-11-08T14:49:35Z [load_day 2025-12-21] 2025-12-21 hour 15: 156129 events in 0 files, snapshot none (task 2923 ms: download 1940 ms overlapping gunzip 362 ms, parse 1123 ms, sort 0 ms, write 0 ms, index 585 ms: 4 candidates, 73994 repo-hours, 811 releases; waiting 548 ms; commit 0 ms)
2026-11-08T14:49:39Z [load_day 2025-12-21] 2025-12-21 hour 16: 152843 events in 0 files, snapshot none (task 3144 ms: download 2072 ms overlapping gunzip 380 ms, parse 1132 ms, sort 0 ms, write 0 ms, index 550 ms: 5 candidates, 71520 repo-hours, 766 releases; waiting 651 ms; commit 0 ms)
2026-11-08T14:49:39Z [load_day 2025-12-21] 2025-12-21 hour 17: 151195 events in 0 files, snapshot none (task 2885 ms: download 1842 ms overlapping gunzip 354 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 511 ms: 5 candidates, 65963 repo-hours, 662 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:49:42Z [load_day 2025-12-21] 2025-12-21 hour 18: 148975 events in 0 files, snapshot none (task 3172 ms: download 1827 ms overlapping gunzip 347 ms, parse 1157 ms, sort 0 ms, write 0 ms, index 566 ms: 3 candidates, 71422 repo-hours, 758 releases; waiting 690 ms; commit 0 ms)
2026-11-08T14:49:42Z [load_day 2025-12-21] 2025-12-21 hour 19: 151880 events in 0 files, snapshot none (task 2701 ms: download 1709 ms overlapping gunzip 344 ms, parse 1098 ms, sort 0 ms, write 0 ms, index 464 ms: 7 candidates, 64208 repo-hours, 697 releases; waiting 521 ms; commit 0 ms)
2026-11-08T14:49:46Z [load_day 2025-12-21] 2025-12-21 hour 20: 149099 events in 0 files, snapshot none (task 3275 ms: download 2349 ms overlapping gunzip 342 ms, parse 1108 ms, sort 0 ms, write 0 ms, index 486 ms: 7 candidates, 63692 repo-hours, 669 releases; waiting 1047 ms; commit 0 ms)
2026-11-08T14:49:46Z [load_day 2025-12-21] 2025-12-21 hour 21: 146447 events in 0 files, snapshot none (task 3076 ms: download 1791 ms overlapping gunzip 356 ms, parse 1126 ms, sort 0 ms, write 0 ms, index 694 ms: 6 candidates, 63826 repo-hours, 683 releases; waiting 599 ms; commit 0 ms)
2026-11-08T14:49:50Z [load_day 2025-12-21] 2025-12-21 hour 22: 139327 events in 0 files, snapshot none (task 3069 ms: download 2070 ms overlapping gunzip 407 ms, parse 1360 ms, sort 0 ms, write 0 ms, index 434 ms: 3 candidates, 57981 repo-hours, 781 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:49:50Z [load_day 2025-12-21] 2025-12-21 hour 23: 138679 events in 0 files, snapshot none (task 3417 ms: download 1880 ms overlapping gunzip 489 ms, parse 1539 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 61718 repo-hours, 641 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:49:58Z [load_day 2025-12-21] 2025-12-21: repo_hour merged from 24 files to 1 (1651560 rows, 8008 ms)
2026-11-08T14:50:02Z [load_day 2025-12-21] 2025-12-21: index committed in 11349 ms (24 + 1 + 24 files)
2026-11-08T14:50:02Z [load_day 2025-12-21] 2025-12-21: 3500460 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:50:02Z [load_day 2025-12-21] attempt 1 succeeded