orcaLog in

Runs · run 4700

load_day 2025-12-10, attempt 1 succeeded

Host
73ccef5e07c2:414883
Started
2026-11-08T14:42:51Z
Ended
2026-11-08T14:44:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
709 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.3 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4700/load_day/2025-12-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:42:51Z [load_day 2025-12-10] attempt 1 started
2026-11-08T14:42:52Z [load_day 2025-12-10] 2025-12-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:42:56Z [load_day 2025-12-10] 2025-12-10 hour 0: 143734 events in 0 files, snapshot none (task 3946 ms: download 2392 ms overlapping gunzip 630 ms, parse 1936 ms, sort 0 ms, write 0 ms, index 552 ms: 11 candidates, 73620 repo-hours, 1596 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:42:56Z [load_day 2025-12-10] 2025-12-10 hour 1: 147517 events in 0 files, snapshot none (task 3806 ms: download 2081 ms overlapping gunzip 564 ms, parse 1629 ms, sort 0 ms, write 0 ms, index 698 ms: 10 candidates, 90500 repo-hours, 1244 releases; waiting 428 ms; commit 0 ms)
2026-11-08T14:43:00Z [load_day 2025-12-10] 2025-12-10 hour 2: 146472 events in 0 files, snapshot none (task 3208 ms: download 2056 ms overlapping gunzip 412 ms, parse 1239 ms, sort 0 ms, write 0 ms, index 596 ms: 11 candidates, 80010 repo-hours, 1358 releases; waiting 624 ms; commit 0 ms)
2026-11-08T14:43:00Z [load_day 2025-12-10] 2025-12-10 hour 3: 146013 events in 0 files, snapshot none (task 3571 ms: download 2377 ms overlapping gunzip 402 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 575 ms: 8 candidates, 74591 repo-hours, 1643 releases; waiting 943 ms; commit 0 ms)
2026-11-08T14:43:03Z [load_day 2025-12-10] 2025-12-10 hour 4: 147270 events in 0 files, snapshot none (task 2704 ms: download 1673 ms overlapping gunzip 378 ms, parse 1138 ms, sort 0 ms, write 0 ms, index 568 ms: 6 candidates, 70162 repo-hours, 1975 releases; waiting 345 ms; commit 0 ms)
2026-11-08T14:43:04Z [load_day 2025-12-10] 2025-12-10 hour 5: 145553 events in 0 files, snapshot none (task 3173 ms: download 2039 ms overlapping gunzip 423 ms, parse 1241 ms, sort 0 ms, write 0 ms, index 562 ms: 10 candidates, 71252 repo-hours, 1364 releases; waiting 665 ms; commit 0 ms)
2026-11-08T14:43:06Z [load_day 2025-12-10] 2025-12-10 hour 6: 146853 events in 0 files, snapshot none (task 3184 ms: download 2001 ms overlapping gunzip 384 ms, parse 1177 ms, sort 0 ms, write 0 ms, index 670 ms: 7 candidates, 80012 repo-hours, 1256 releases; waiting 613 ms; commit 0 ms)
2026-11-08T14:43:08Z [load_day 2025-12-10] 2025-12-10 hour 7: 146856 events in 0 files, snapshot none (task 3607 ms: download 2627 ms overlapping gunzip 428 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 585 ms: 9 candidates, 75607 repo-hours, 1119 releases; waiting 1008 ms; commit 0 ms)
2026-11-08T14:43:11Z [load_day 2025-12-10] 2025-12-10 hour 8: 145672 events in 0 files, snapshot none (task 3554 ms: download 2236 ms overlapping gunzip 441 ms, parse 1378 ms, sort 0 ms, write 0 ms, index 684 ms: 6 candidates, 77294 repo-hours, 1232 releases; waiting 748 ms; commit 0 ms)
2026-11-08T14:43:18Z [load_day 2025-12-10] 2025-12-10 hour 9: 145952 events in 0 files, snapshot none (task 9807 ms: download 2235 ms overlapping gunzip 443 ms, parse 1296 ms, sort 0 ms, write 0 ms, index 7082 ms: 6 candidates, 79070 repo-hours, 1203 releases; waiting 636 ms; commit 0 ms)
2026-11-08T14:43:22Z [load_day 2025-12-10] 2025-12-10 hour 10: 148377 events in 0 files, snapshot none (task 3954 ms: download 2072 ms overlapping gunzip 558 ms, parse 1629 ms, sort 0 ms, write 0 ms, index 811 ms: 9 candidates, 80826 repo-hours, 1073 releases; waiting 548 ms; commit 0 ms)
2026-11-08T14:43:23Z [load_day 2025-12-10] 2025-12-10 hour 11: 148846 events in 0 files, snapshot none (task 3930 ms: download 2542 ms overlapping gunzip 575 ms, parse 1689 ms, sort 0 ms, write 0 ms, index 665 ms: 4 candidates, 79119 repo-hours, 1040 releases; waiting 699 ms; commit 0 ms)
2026-11-08T14:43:26Z [load_day 2025-12-10] 2025-12-10 hour 12: 157212 events in 0 files, snapshot none (task 3399 ms: download 1243 ms overlapping gunzip 428 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 874 ms: 9 candidates, 98327 repo-hours, 696 releases; waiting 235 ms; commit 0 ms)
2026-11-08T14:43:26Z [load_day 2025-12-10] 2025-12-10 hour 13: 156283 events in 0 files, snapshot none (task 3350 ms: download 2172 ms overlapping gunzip 463 ms, parse 1340 ms, sort 0 ms, write 0 ms, index 732 ms: 4 candidates, 92081 repo-hours, 579 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:43:40Z [load_day 2025-12-10] 2025-12-10 hour 14: 148793 events in 0 files, snapshot none (task 3911 ms: download 2406 ms overlapping gunzip 558 ms, parse 1665 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 82917 repo-hours, 961 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:43:40Z [load_day 2025-12-10] 2025-12-10 hour 15: 148152 events in 0 files, snapshot none (task 3919 ms: download 2758 ms overlapping gunzip 579 ms, parse 1774 ms, sort 0 ms, write 0 ms, index 635 ms: 6 candidates, 82767 repo-hours, 814 releases; waiting 583 ms; commit 0 ms)
2026-11-08T14:43:44Z [load_day 2025-12-10] 2025-12-10 hour 16: 143185 events in 0 files, snapshot none (task 3747 ms: download 2138 ms overlapping gunzip 509 ms, parse 1528 ms, sort 0 ms, write 0 ms, index 706 ms: 8 candidates, 79914 repo-hours, 838 releases; waiting 644 ms; commit 0 ms)
2026-11-08T14:43:45Z [load_day 2025-12-10] 2025-12-10 hour 17: 148542 events in 0 files, snapshot none (task 3953 ms: download 2651 ms overlapping gunzip 523 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 614 ms: 5 candidates, 79475 repo-hours, 908 releases; waiting 886 ms; commit 0 ms)
2026-11-08T14:43:49Z [load_day 2025-12-10] 2025-12-10 hour 18: 148912 events in 0 files, snapshot none (task 3901 ms: download 2430 ms overlapping gunzip 623 ms, parse 1844 ms, sort 0 ms, write 0 ms, index 683 ms: 3 candidates, 79831 repo-hours, 1015 releases; waiting 455 ms; commit 0 ms)
2026-11-08T14:43:49Z [load_day 2025-12-10] 2025-12-10 hour 19: 142942 events in 0 files, snapshot none (task 3717 ms: download 2444 ms overlapping gunzip 549 ms, parse 1722 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 72364 repo-hours, 940 releases; waiting 560 ms; commit 0 ms)
2026-11-08T14:43:54Z [load_day 2025-12-10] 2025-12-10 hour 20: 146244 events in 0 files, snapshot none (task 4401 ms: download 2698 ms overlapping gunzip 661 ms, parse 2031 ms, sort 0 ms, write 0 ms, index 843 ms: 5 candidates, 73271 repo-hours, 1144 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:43:54Z [load_day 2025-12-10] 2025-12-10 hour 21: 147998 events in 0 files, snapshot none (task 4546 ms: download 2551 ms overlapping gunzip 703 ms, parse 2235 ms, sort 0 ms, write 0 ms, index 760 ms: 7 candidates, 72213 repo-hours, 1379 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:43:58Z [load_day 2025-12-10] 2025-12-10 hour 22: 141748 events in 0 files, snapshot none (task 3502 ms: download 1815 ms overlapping gunzip 534 ms, parse 1566 ms, sort 0 ms, write 0 ms, index 822 ms: 11 candidates, 68883 repo-hours, 1331 releases; waiting 289 ms; commit 0 ms)
2026-11-08T14:43:59Z [load_day 2025-12-10] 2025-12-10 hour 23: 136965 events in 0 files, snapshot none (task 4096 ms: download 2342 ms overlapping gunzip 651 ms, parse 2071 ms, sort 0 ms, write 0 ms, index 515 ms: 5 candidates, 60449 repo-hours, 1391 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:44:08Z [load_day 2025-12-10] 2025-12-10: repo_hour merged from 24 files to 1 (1874555 rows, 8914 ms)
2026-11-08T14:44:11Z [load_day 2025-12-10] 2025-12-10: index committed in 11979 ms (24 + 1 + 24 files)
2026-11-08T14:44:11Z [load_day 2025-12-10] 2025-12-10: 3526091 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:44:11Z [load_day 2025-12-10] attempt 1 succeeded