orcaLog in

Runs · run 4932

load_day 2026-02-14, attempt 1 succeeded

Host
73ccef5e07c2:442527
Started
2026-11-08T15:18:44Z
Ended
2026-11-08T15:19:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.0 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4932/load_day/2026-02-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:18:44Z [load_day 2026-02-14] attempt 1 started
2026-11-08T15:18:44Z [load_day 2026-02-14] 2026-02-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:18:49Z [load_day 2026-02-14] 2026-02-14 hour 0: 145809 events in 0 files, snapshot none (task 3809 ms: download 2278 ms overlapping gunzip 575 ms, parse 1744 ms, sort 0 ms, write 0 ms, index 582 ms: 4 candidates, 70457 repo-hours, 887 releases; waiting 626 ms; commit 0 ms)
2026-11-08T15:18:49Z [load_day 2026-02-14] 2026-02-14 hour 1: 150791 events in 0 files, snapshot none (task 3763 ms: download 2210 ms overlapping gunzip 550 ms, parse 1715 ms, sort 0 ms, write 0 ms, index 613 ms: 5 candidates, 85513 repo-hours, 792 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:18:53Z [load_day 2026-02-14] 2026-02-14 hour 2: 149017 events in 0 files, snapshot none (task 3951 ms: download 2555 ms overlapping gunzip 558 ms, parse 1680 ms, sort 0 ms, write 0 ms, index 615 ms: 8 candidates, 81563 repo-hours, 715 releases; waiting 789 ms; commit 0 ms)
2026-11-08T15:18:53Z [load_day 2026-02-14] 2026-02-14 hour 3: 139390 events in 0 files, snapshot none (task 3664 ms: download 2191 ms overlapping gunzip 579 ms, parse 1709 ms, sort 0 ms, write 0 ms, index 468 ms: 7 candidates, 61152 repo-hours, 731 releases; waiting 491 ms; commit 0 ms)
2026-11-08T15:18:57Z [load_day 2026-02-14] 2026-02-14 hour 4: 145375 events in 0 files, snapshot none (task 4037 ms: download 2236 ms overlapping gunzip 548 ms, parse 1806 ms, sort 0 ms, write 0 ms, index 885 ms: 5 candidates, 71446 repo-hours, 1668 releases; waiting 505 ms; commit 0 ms)
2026-11-08T15:18:58Z [load_day 2026-02-14] 2026-02-14 hour 5: 145921 events in 0 files, snapshot none (task 4078 ms: download 2728 ms overlapping gunzip 495 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 694 ms: 3 candidates, 70751 repo-hours, 669 releases; waiting 892 ms; commit 0 ms)
2026-11-08T15:19:01Z [load_day 2026-02-14] 2026-02-14 hour 6: 149884 events in 0 files, snapshot none (task 3572 ms: download 1909 ms overlapping gunzip 566 ms, parse 1698 ms, sort 0 ms, write 0 ms, index 787 ms: 4 candidates, 76484 repo-hours, 963 releases; waiting 265 ms; commit 0 ms)
2026-11-08T15:19:02Z [load_day 2026-02-14] 2026-02-14 hour 7: 146403 events in 0 files, snapshot none (task 4150 ms: download 2467 ms overlapping gunzip 680 ms, parse 2020 ms, sort 0 ms, write 0 ms, index 583 ms: 8 candidates, 70536 repo-hours, 747 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:19:07Z [load_day 2026-02-14] 2026-02-14 hour 8: 146106 events in 0 files, snapshot none (task 4833 ms: download 3026 ms overlapping gunzip 661 ms, parse 2031 ms, sort 0 ms, write 0 ms, index 809 ms: 10 candidates, 69208 repo-hours, 898 releases; waiting 1051 ms; commit 0 ms)
2026-11-08T15:19:07Z [load_day 2026-02-14] 2026-02-14 hour 9: 146320 events in 0 files, snapshot none (task 3998 ms: download 2378 ms overlapping gunzip 507 ms, parse 1639 ms, sort 0 ms, write 0 ms, index 923 ms: 2 candidates, 71709 repo-hours, 843 releases; waiting 622 ms; commit 0 ms)
2026-11-08T15:19:12Z [load_day 2026-02-14] 2026-02-14 hour 10: 149381 events in 0 files, snapshot none (task 4340 ms: download 2057 ms overlapping gunzip 698 ms, parse 2136 ms, sort 0 ms, write 0 ms, index 950 ms: 6 candidates, 73757 repo-hours, 882 releases; waiting 213 ms; commit 0 ms)
2026-11-08T15:19:12Z [load_day 2026-02-14] 2026-02-14 hour 11: 146233 events in 0 files, snapshot none (task 4313 ms: download 1754 ms overlapping gunzip 667 ms, parse 2154 ms, sort 0 ms, write 0 ms, index 837 ms: 9 candidates, 70162 repo-hours, 847 releases; waiting 189 ms; commit 0 ms)
2026-11-08T15:19:17Z [load_day 2026-02-14] 2026-02-14 hour 12: 157771 events in 0 files, snapshot none (task 4597 ms: download 2567 ms overlapping gunzip 633 ms, parse 1967 ms, sort 0 ms, write 0 ms, index 789 ms: 9 candidates, 93837 repo-hours, 494 releases; waiting 930 ms; commit 0 ms)
2026-11-08T15:19:17Z [load_day 2026-02-14] 2026-02-14 hour 13: 152597 events in 0 files, snapshot none (task 4026 ms: download 2223 ms overlapping gunzip 541 ms, parse 1704 ms, sort 0 ms, write 0 ms, index 854 ms: 7 candidates, 88149 repo-hours, 641 releases; waiting 610 ms; commit 0 ms)
2026-11-08T15:19:21Z [load_day 2026-02-14] 2026-02-14 hour 14: 147450 events in 0 files, snapshot none (task 3726 ms: download 2503 ms overlapping gunzip 517 ms, parse 1421 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 73661 repo-hours, 879 releases; waiting 815 ms; commit 0 ms)
2026-11-08T15:19:21Z [load_day 2026-02-14] 2026-02-14 hour 15: 150871 events in 0 files, snapshot none (task 3835 ms: download 2145 ms overlapping gunzip 513 ms, parse 1630 ms, sort 0 ms, write 0 ms, index 757 ms: 3 candidates, 77705 repo-hours, 925 releases; waiting 643 ms; commit 0 ms)
2026-11-08T15:19:25Z [load_day 2026-02-14] 2026-02-14 hour 16: 150702 events in 0 files, snapshot none (task 3505 ms: download 2073 ms overlapping gunzip 533 ms, parse 1482 ms, sort 0 ms, write 0 ms, index 597 ms: 11 candidates, 76958 repo-hours, 897 releases; waiting 635 ms; commit 0 ms)
2026-11-08T15:19:26Z [load_day 2026-02-14] 2026-02-14 hour 17: 152964 events in 0 files, snapshot none (task 4080 ms: download 2819 ms overlapping gunzip 458 ms, parse 1416 ms, sort 0 ms, write 0 ms, index 604 ms: 15 candidates, 76996 repo-hours, 826 releases; waiting 1298 ms; commit 0 ms)
2026-11-08T15:19:30Z [load_day 2026-02-14] 2026-02-14 hour 18: 148175 events in 0 files, snapshot none (task 4156 ms: download 2666 ms overlapping gunzip 474 ms, parse 1505 ms, sort 0 ms, write 0 ms, index 797 ms: 8 candidates, 78576 repo-hours, 942 releases; waiting 1080 ms; commit 0 ms)
2026-11-08T15:19:30Z [load_day 2026-02-14] 2026-02-14 hour 19: 150740 events in 0 files, snapshot none (task 3191 ms: download 1809 ms overlapping gunzip 454 ms, parse 1371 ms, sort 0 ms, write 0 ms, index 579 ms: 11 candidates, 68266 repo-hours, 903 releases; waiting 544 ms; commit 0 ms)
2026-11-08T15:19:34Z [load_day 2026-02-14] 2026-02-14 hour 20: 147520 events in 0 files, snapshot none (task 3291 ms: download 2062 ms overlapping gunzip 425 ms, parse 1309 ms, sort 0 ms, write 0 ms, index 568 ms: 9 candidates, 70515 repo-hours, 882 releases; waiting 400 ms; commit 0 ms)
2026-11-08T15:19:34Z [load_day 2026-02-14] 2026-02-14 hour 21: 148954 events in 0 files, snapshot none (task 3231 ms: download 2156 ms overlapping gunzip 452 ms, parse 1325 ms, sort 0 ms, write 0 ms, index 531 ms: 6 candidates, 69972 repo-hours, 1057 releases; waiting 614 ms; commit 0 ms)
2026-11-08T15:19:37Z [load_day 2026-02-14] 2026-02-14 hour 22: 141267 events in 0 files, snapshot none (task 3145 ms: download 1823 ms overlapping gunzip 423 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 469 ms: 7 candidates, 65108 repo-hours, 1271 releases; waiting 634 ms; commit 0 ms)
2026-11-08T15:19:37Z [load_day 2026-02-14] 2026-02-14 hour 23: 141427 events in 0 files, snapshot none (task 3197 ms: download 2045 ms overlapping gunzip 429 ms, parse 1360 ms, sort 0 ms, write 0 ms, index 487 ms: 6 candidates, 64219 repo-hours, 1708 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:19:45Z [load_day 2026-02-14] 2026-02-14: repo_hour merged from 24 files to 1 (1776700 rows, 7703 ms)
2026-11-08T15:19:48Z [load_day 2026-02-14] 2026-02-14: index committed in 10279 ms (24 + 1 + 24 files)
2026-11-08T15:19:48Z [load_day 2026-02-14] 2026-02-14: 3551068 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:19:48Z [load_day 2026-02-14] attempt 1 succeeded