orcaLog in

Runs · run 4940

load_day 2026-02-16, attempt 1 succeeded

Host
73ccef5e07c2:443523
Started
2026-11-08T15:19:49Z
Ended
2026-11-08T15:20:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
691 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.1 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4940/load_day/2026-02-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:19:49Z [load_day 2026-02-16] attempt 1 started
2026-11-08T15:19:50Z [load_day 2026-02-16] 2026-02-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:19:54Z [load_day 2026-02-16] 2026-02-16 hour 0: 146317 events in 0 files, snapshot none (task 4057 ms: download 2564 ms overlapping gunzip 546 ms, parse 1733 ms, sort 0 ms, write 0 ms, index 620 ms: 3 candidates, 65947 repo-hours, 1288 releases; waiting 868 ms; commit 0 ms)
2026-11-08T15:19:54Z [load_day 2026-02-16] 2026-02-16 hour 1: 153062 events in 0 files, snapshot none (task 3871 ms: download 2261 ms overlapping gunzip 539 ms, parse 1753 ms, sort 0 ms, write 0 ms, index 618 ms: 7 candidates, 82880 repo-hours, 847 releases; waiting 639 ms; commit 0 ms)
2026-11-08T15:19:58Z [load_day 2026-02-16] 2026-02-16 hour 2: 150693 events in 0 files, snapshot none (task 3704 ms: download 2075 ms overlapping gunzip 569 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 641 ms: 8 candidates, 82404 repo-hours, 706 releases; waiting 545 ms; commit 0 ms)
2026-11-08T15:19:59Z [load_day 2026-02-16] 2026-02-16 hour 3: 141062 events in 0 files, snapshot none (task 4051 ms: download 2696 ms overlapping gunzip 703 ms, parse 1890 ms, sort 0 ms, write 0 ms, index 543 ms: 4 candidates, 60021 repo-hours, 856 releases; waiting 587 ms; commit 0 ms)
2026-11-08T15:20:03Z [load_day 2026-02-16] 2026-02-16 hour 4: 143938 events in 0 files, snapshot none (task 4064 ms: download 2441 ms overlapping gunzip 688 ms, parse 1995 ms, sort 0 ms, write 0 ms, index 544 ms: 8 candidates, 66257 repo-hours, 902 releases; waiting 541 ms; commit 0 ms)
2026-11-08T15:20:03Z [load_day 2026-02-16] 2026-02-16 hour 5: 147009 events in 0 files, snapshot none (task 4193 ms: download 2793 ms overlapping gunzip 540 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 72665 repo-hours, 1633 releases; waiting 1185 ms; commit 0 ms)
2026-11-08T15:20:08Z [load_day 2026-02-16] 2026-02-16 hour 6: 147593 events in 0 files, snapshot none (task 4559 ms: download 3399 ms overlapping gunzip 503 ms, parse 1394 ms, sort 0 ms, write 0 ms, index 583 ms: 4 candidates, 72651 repo-hours, 975 releases; waiting 1660 ms; commit 0 ms)
2026-11-08T15:20:09Z [load_day 2026-02-16] 2026-02-16 hour 7: 149375 events in 0 files, snapshot none (task 5141 ms: download 3138 ms overlapping gunzip 443 ms, parse 1320 ms, sort 0 ms, write 0 ms, index 904 ms: 4 candidates, 77028 repo-hours, 981 releases; waiting 2134 ms; commit 0 ms)
2026-11-08T15:20:13Z [load_day 2026-02-16] 2026-02-16 hour 8: 142865 events in 0 files, snapshot none (task 4709 ms: download 2498 ms overlapping gunzip 638 ms, parse 1893 ms, sort 0 ms, write 0 ms, index 1188 ms: 7 candidates, 71994 repo-hours, 888 releases; waiting 684 ms; commit 0 ms)
2026-11-08T15:20:14Z [load_day 2026-02-16] 2026-02-16 hour 9: 146482 events in 0 files, snapshot none (task 4641 ms: download 2699 ms overlapping gunzip 766 ms, parse 2079 ms, sort 0 ms, write 0 ms, index 857 ms: 6 candidates, 77949 repo-hours, 813 releases; waiting 565 ms; commit 0 ms)
2026-11-08T15:20:19Z [load_day 2026-02-16] 2026-02-16 hour 10: 146012 events in 0 files, snapshot none (task 4780 ms: download 2422 ms overlapping gunzip 764 ms, parse 2201 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 80385 repo-hours, 849 releases; waiting 583 ms; commit 0 ms)
2026-11-08T15:20:19Z [load_day 2026-02-16] 2026-02-16 hour 11: 148226 events in 0 files, snapshot none (task 4484 ms: download 2428 ms overlapping gunzip 753 ms, parse 2110 ms, sort 0 ms, write 0 ms, index 816 ms: 4 candidates, 78324 repo-hours, 843 releases; waiting 483 ms; commit 0 ms)
2026-11-08T15:20:23Z [load_day 2026-02-16] 2026-02-16 hour 12: 154187 events in 0 files, snapshot none (task 3891 ms: download 2200 ms overlapping gunzip 500 ms, parse 1618 ms, sort 0 ms, write 0 ms, index 933 ms: 6 candidates, 90871 repo-hours, 510 releases; waiting 518 ms; commit 0 ms)
2026-11-08T15:20:24Z [load_day 2026-02-16] 2026-02-16 hour 13: 152976 events in 0 files, snapshot none (task 4084 ms: download 1914 ms overlapping gunzip 554 ms, parse 1876 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 91897 repo-hours, 410 releases; waiting 480 ms; commit 0 ms)
2026-11-08T15:20:27Z [load_day 2026-02-16] 2026-02-16 hour 14: 150356 events in 0 files, snapshot none (task 3771 ms: download 2423 ms overlapping gunzip 528 ms, parse 1518 ms, sort 0 ms, write 0 ms, index 740 ms: 5 candidates, 84918 repo-hours, 558 releases; waiting 664 ms; commit 0 ms)
2026-11-08T15:20:28Z [load_day 2026-02-16] 2026-02-16 hour 15: 157590 events in 0 files, snapshot none (task 3565 ms: download 2129 ms overlapping gunzip 488 ms, parse 1475 ms, sort 0 ms, write 0 ms, index 847 ms: 13 candidates, 88669 repo-hours, 449 releases; waiting 502 ms; commit 0 ms)
2026-11-08T15:20:31Z [load_day 2026-02-16] 2026-02-16 hour 16: 154611 events in 0 files, snapshot none (task 3352 ms: download 2154 ms overlapping gunzip 463 ms, parse 1320 ms, sort 0 ms, write 0 ms, index 760 ms: 8 candidates, 85544 repo-hours, 525 releases; waiting 586 ms; commit 0 ms)
2026-11-08T15:20:32Z [load_day 2026-02-16] 2026-02-16 hour 17: 156065 events in 0 files, snapshot none (task 3472 ms: download 2191 ms overlapping gunzip 430 ms, parse 1526 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 85918 repo-hours, 488 releases; waiting 519 ms; commit 0 ms)
2026-11-08T15:20:35Z [load_day 2026-02-16] 2026-02-16 hour 18: 154859 events in 0 files, snapshot none (task 3204 ms: download 2186 ms overlapping gunzip 465 ms, parse 1279 ms, sort 0 ms, write 0 ms, index 699 ms: 5 candidates, 85988 repo-hours, 594 releases; waiting 530 ms; commit 0 ms)
2026-11-08T15:20:35Z [load_day 2026-02-16] 2026-02-16 hour 19: 154758 events in 0 files, snapshot none (task 3374 ms: download 2220 ms overlapping gunzip 473 ms, parse 1419 ms, sort 0 ms, write 0 ms, index 560 ms: 4 candidates, 78895 repo-hours, 871 releases; waiting 576 ms; commit 0 ms)
2026-11-08T15:20:39Z [load_day 2026-02-16] 2026-02-16 hour 20: 150646 events in 0 files, snapshot none (task 3364 ms: download 1854 ms overlapping gunzip 437 ms, parse 1340 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 78302 repo-hours, 788 releases; waiting 645 ms; commit 0 ms)
2026-11-08T15:20:40Z [load_day 2026-02-16] 2026-02-16 hour 21: 148920 events in 0 files, snapshot none (task 3792 ms: download 2592 ms overlapping gunzip 424 ms, parse 1210 ms, sort 0 ms, write 0 ms, index 569 ms: 4 candidates, 74370 repo-hours, 952 releases; waiting 1232 ms; commit 0 ms)
2026-11-08T15:20:43Z [load_day 2026-02-16] 2026-02-16 hour 22: 146229 events in 0 files, snapshot none (task 3617 ms: download 2459 ms overlapping gunzip 477 ms, parse 1393 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 71190 repo-hours, 1020 releases; waiting 820 ms; commit 0 ms)
2026-11-08T15:20:44Z [load_day 2026-02-16] 2026-02-16 hour 23: 144477 events in 0 files, snapshot none (task 3407 ms: download 2256 ms overlapping gunzip 456 ms, parse 1328 ms, sort 0 ms, write 0 ms, index 534 ms: 8 candidates, 67806 repo-hours, 1124 releases; waiting 780 ms; commit 0 ms)
2026-11-08T15:20:52Z [load_day 2026-02-16] 2026-02-16: repo_hour merged from 24 files to 1 (1872873 rows, 8005 ms)
2026-11-08T15:20:54Z [load_day 2026-02-16] 2026-02-16: index committed in 10885 ms (24 + 1 + 24 files)
2026-11-08T15:20:54Z [load_day 2026-02-16] 2026-02-16: 3588308 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:20:54Z [load_day 2026-02-16] attempt 1 succeeded