orcaLog in

Runs · run 4955

load_day 2026-02-20, attempt 1 succeeded

Host
73ccef5e07c2:445392
Started
2026-11-08T15:22:11Z
Ended
2026-11-08T15:23:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.4 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4955/load_day/2026-02-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:22:11Z [load_day 2026-02-20] attempt 1 started
2026-11-08T15:22:12Z [load_day 2026-02-20] 2026-02-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:22:18Z [load_day 2026-02-20] 2026-02-20 hour 0: 150160 events in 0 files, snapshot none (task 4438 ms: download 2797 ms overlapping gunzip 735 ms, parse 2254 ms, sort 0 ms, write 0 ms, index 675 ms: 13 candidates, 72862 repo-hours, 2907 releases; waiting 482 ms; commit 0 ms)
2026-11-08T15:22:18Z [load_day 2026-02-20] 2026-02-20 hour 1: 153236 events in 0 files, snapshot none (task 4388 ms: download 2933 ms overlapping gunzip 612 ms, parse 2008 ms, sort 0 ms, write 0 ms, index 738 ms: 7 candidates, 87385 repo-hours, 1702 releases; waiting 745 ms; commit 0 ms)
2026-11-08T15:22:22Z [load_day 2026-02-20] 2026-02-20 hour 2: 143702 events in 0 files, snapshot none (task 4074 ms: download 2104 ms overlapping gunzip 581 ms, parse 1918 ms, sort 0 ms, write 0 ms, index 766 ms: 5 candidates, 81225 repo-hours, 1381 releases; waiting 466 ms; commit 0 ms)
2026-11-08T15:22:22Z [load_day 2026-02-20] 2026-02-20 hour 3: 145269 events in 0 files, snapshot none (task 3922 ms: download 2097 ms overlapping gunzip 626 ms, parse 1826 ms, sort 0 ms, write 0 ms, index 591 ms: 7 candidates, 71748 repo-hours, 984 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:22:27Z [load_day 2026-02-20] 2026-02-20 hour 4: 147252 events in 0 files, snapshot none (task 4686 ms: download 3239 ms overlapping gunzip 584 ms, parse 1802 ms, sort 0 ms, write 0 ms, index 549 ms: 2 candidates, 71344 repo-hours, 1939 releases; waiting 1364 ms; commit 0 ms)
2026-11-08T15:22:27Z [load_day 2026-02-20] 2026-02-20 hour 5: 146043 events in 0 files, snapshot none (task 3750 ms: download 2351 ms overlapping gunzip 490 ms, parse 1512 ms, sort 0 ms, write 0 ms, index 767 ms: 3 candidates, 74845 repo-hours, 1400 releases; waiting 707 ms; commit 0 ms)
2026-11-08T15:22:31Z [load_day 2026-02-20] 2026-02-20 hour 6: 147122 events in 0 files, snapshot none (task 3590 ms: download 2281 ms overlapping gunzip 525 ms, parse 1556 ms, sort 0 ms, write 0 ms, index 564 ms: 2 candidates, 76634 repo-hours, 1058 releases; waiting 633 ms; commit 0 ms)
2026-11-08T15:22:31Z [load_day 2026-02-20] 2026-02-20 hour 7: 144665 events in 0 files, snapshot none (task 3157 ms: download 1847 ms overlapping gunzip 501 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 76380 repo-hours, 933 releases; waiting 213 ms; commit 0 ms)
2026-11-08T15:22:36Z [load_day 2026-02-20] 2026-02-20 hour 8: 148166 events in 0 files, snapshot none (task 4431 ms: download 3073 ms overlapping gunzip 513 ms, parse 1502 ms, sort 0 ms, write 0 ms, index 607 ms: 7 candidates, 78676 repo-hours, 1024 releases; waiting 1509 ms; commit 0 ms)
2026-11-08T15:22:36Z [load_day 2026-02-20] 2026-02-20 hour 9: 147789 events in 0 files, snapshot none (task 3574 ms: download 2128 ms overlapping gunzip 468 ms, parse 1393 ms, sort 0 ms, write 0 ms, index 850 ms: 8 candidates, 78786 repo-hours, 1008 releases; waiting 589 ms; commit 0 ms)
2026-11-08T15:22:41Z [load_day 2026-02-20] 2026-02-20 hour 10: 149275 events in 0 files, snapshot none (task 3880 ms: download 2178 ms overlapping gunzip 571 ms, parse 1657 ms, sort 0 ms, write 0 ms, index 729 ms: 8 candidates, 81087 repo-hours, 1079 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:22:41Z [load_day 2026-02-20] 2026-02-20 hour 11: 148468 events in 0 files, snapshot none (task 4155 ms: download 2640 ms overlapping gunzip 558 ms, parse 1584 ms, sort 0 ms, write 0 ms, index 604 ms: 6 candidates, 80763 repo-hours, 842 releases; waiting 846 ms; commit 0 ms)
2026-11-08T15:22:45Z [load_day 2026-02-20] 2026-02-20 hour 12: 153209 events in 0 files, snapshot none (task 3719 ms: download 2331 ms overlapping gunzip 385 ms, parse 1263 ms, sort 0 ms, write 0 ms, index 705 ms: 12 candidates, 92394 repo-hours, 535 releases; waiting 1050 ms; commit 0 ms)
2026-11-08T15:22:45Z [load_day 2026-02-20] 2026-02-20 hour 13: 153066 events in 0 files, snapshot none (task 3588 ms: download 1960 ms overlapping gunzip 451 ms, parse 1217 ms, sort 0 ms, write 0 ms, index 738 ms: 9 candidates, 94663 repo-hours, 411 releases; waiting 600 ms; commit 0 ms)
2026-11-08T15:22:49Z [load_day 2026-02-20] 2026-02-20 hour 14: 149095 events in 0 files, snapshot none (task 3829 ms: download 2198 ms overlapping gunzip 476 ms, parse 1519 ms, sort 0 ms, write 0 ms, index 619 ms: 11 candidates, 84111 repo-hours, 667 releases; waiting 967 ms; commit 0 ms)
2026-11-08T15:22:49Z [load_day 2026-02-20] 2026-02-20 hour 15: 146956 events in 0 files, snapshot none (task 3540 ms: download 2071 ms overlapping gunzip 576 ms, parse 1696 ms, sort 0 ms, write 0 ms, index 642 ms: 6 candidates, 82447 repo-hours, 639 releases; waiting 339 ms; commit 0 ms)
2026-11-08T15:22:53Z [load_day 2026-02-20] 2026-02-20 hour 16: 149761 events in 0 files, snapshot none (task 2600 ms: download 1523 ms overlapping gunzip 329 ms, parse 986 ms, sort 0 ms, write 0 ms, index 711 ms: 9 candidates, 85304 repo-hours, 577 releases; waiting 340 ms; commit 0 ms)
2026-11-08T15:22:53Z [load_day 2026-02-20] 2026-02-20 hour 17: 150258 events in 0 files, snapshot none (task 3167 ms: download 2004 ms overlapping gunzip 416 ms, parse 1204 ms, sort 0 ms, write 0 ms, index 635 ms: 10 candidates, 83921 repo-hours, 575 releases; waiting 651 ms; commit 0 ms)
2026-11-08T15:22:56Z [load_day 2026-02-20] 2026-02-20 hour 18: 153289 events in 0 files, snapshot none (task 3280 ms: download 1486 ms overlapping gunzip 358 ms, parse 1082 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 87818 repo-hours, 683 releases; waiting 228 ms; commit 0 ms)
2026-11-08T15:22:57Z [load_day 2026-02-20] 2026-02-20 hour 19: 147731 events in 0 files, snapshot none (task 3893 ms: download 2407 ms overlapping gunzip 377 ms, parse 1132 ms, sort 0 ms, write 0 ms, index 637 ms: 11 candidates, 78222 repo-hours, 786 releases; waiting 1456 ms; commit 0 ms)
2026-11-08T15:23:00Z [load_day 2026-02-20] 2026-02-20 hour 20: 147512 events in 0 files, snapshot none (task 3690 ms: download 2501 ms overlapping gunzip 416 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 620 ms: 10 candidates, 76273 repo-hours, 923 releases; waiting 1091 ms; commit 0 ms)
2026-11-08T15:23:02Z [load_day 2026-02-20] 2026-02-20 hour 21: 149200 events in 0 files, snapshot none (task 4011 ms: download 2722 ms overlapping gunzip 458 ms, parse 1367 ms, sort 0 ms, write 0 ms, index 622 ms: 10 candidates, 74118 repo-hours, 891 releases; waiting 1275 ms; commit 0 ms)
2026-11-08T15:23:05Z [load_day 2026-02-20] 2026-02-20 hour 22: 147870 events in 0 files, snapshot none (task 3981 ms: download 2831 ms overlapping gunzip 422 ms, parse 1285 ms, sort 0 ms, write 0 ms, index 602 ms: 4 candidates, 70621 repo-hours, 832 releases; waiting 1348 ms; commit 0 ms)
2026-11-08T15:23:06Z [load_day 2026-02-20] 2026-02-20 hour 23: 150724 events in 0 files, snapshot none (task 3613 ms: download 2398 ms overlapping gunzip 520 ms, parse 1454 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 70906 repo-hours, 1005 releases; waiting 641 ms; commit 0 ms)
2026-11-08T15:23:15Z [load_day 2026-02-20] 2026-02-20: repo_hour merged from 24 files to 1 (1912533 rows, 9198 ms)
2026-11-08T15:23:19Z [load_day 2026-02-20] 2026-02-20: index committed in 12381 ms (24 + 1 + 24 files)
2026-11-08T15:23:19Z [load_day 2026-02-20] 2026-02-20: 3569818 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:23:19Z [load_day 2026-02-20] attempt 1 succeeded