orcaLog in

Runs · run 4906

load_day 2026-02-06, attempt 1 succeeded

Host
73ccef5e07c2:439511
Started
2026-11-08T15:14:23Z
Ended
2026-11-08T15:15:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.3 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4906/load_day/2026-02-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:14:23Z [load_day 2026-02-06] attempt 1 started
2026-11-08T15:14:24Z [load_day 2026-02-06] 2026-02-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:14:28Z [load_day 2026-02-06] 2026-02-06 hour 0: 144201 events in 0 files, snapshot none (task 3692 ms: download 2427 ms overlapping gunzip 532 ms, parse 1700 ms, sort 0 ms, write 0 ms, index 548 ms: 5 candidates, 71940 repo-hours, 1008 releases; waiting 604 ms; commit 0 ms)
2026-11-08T15:14:28Z [load_day 2026-02-06] 2026-02-06 hour 1: 148811 events in 0 files, snapshot none (task 3645 ms: download 1860 ms overlapping gunzip 599 ms, parse 1744 ms, sort 0 ms, write 0 ms, index 788 ms: 5 candidates, 86928 repo-hours, 987 releases; waiting 278 ms; commit 0 ms)
2026-11-08T15:14:32Z [load_day 2026-02-06] 2026-02-06 hour 2: 148841 events in 0 files, snapshot none (task 3453 ms: download 1866 ms overlapping gunzip 503 ms, parse 1593 ms, sort 0 ms, write 0 ms, index 691 ms: 8 candidates, 85648 repo-hours, 792 releases; waiting 369 ms; commit 0 ms)
2026-11-08T15:14:32Z [load_day 2026-02-06] 2026-02-06 hour 3: 142952 events in 0 files, snapshot none (task 3615 ms: download 2062 ms overlapping gunzip 543 ms, parse 1626 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 69805 repo-hours, 793 releases; waiting 557 ms; commit 0 ms)
2026-11-08T15:14:36Z [load_day 2026-02-06] 2026-02-06 hour 4: 145266 events in 0 files, snapshot none (task 3559 ms: download 2091 ms overlapping gunzip 545 ms, parse 1600 ms, sort 0 ms, write 0 ms, index 659 ms: 7 candidates, 72056 repo-hours, 1559 releases; waiting 528 ms; commit 0 ms)
2026-11-08T15:14:36Z [load_day 2026-02-06] 2026-02-06 hour 5: 147815 events in 0 files, snapshot none (task 3567 ms: download 2107 ms overlapping gunzip 572 ms, parse 1700 ms, sort 0 ms, write 0 ms, index 688 ms: 2 candidates, 76875 repo-hours, 875 releases; waiting 256 ms; commit 0 ms)
2026-11-08T15:14:40Z [load_day 2026-02-06] 2026-02-06 hour 6: 146431 events in 0 files, snapshot none (task 4105 ms: download 2285 ms overlapping gunzip 637 ms, parse 1957 ms, sort 0 ms, write 0 ms, index 655 ms: 11 candidates, 78623 repo-hours, 813 releases; waiting 549 ms; commit 0 ms)
2026-11-08T15:14:40Z [load_day 2026-02-06] 2026-02-06 hour 7: 146804 events in 0 files, snapshot none (task 3935 ms: download 2338 ms overlapping gunzip 587 ms, parse 1742 ms, sort 0 ms, write 0 ms, index 696 ms: 5 candidates, 79509 repo-hours, 714 releases; waiting 617 ms; commit 0 ms)
2026-11-08T15:14:45Z [load_day 2026-02-06] 2026-02-06 hour 8: 142688 events in 0 files, snapshot none (task 3959 ms: download 1947 ms overlapping gunzip 673 ms, parse 1907 ms, sort 0 ms, write 0 ms, index 598 ms: 5 candidates, 76550 repo-hours, 794 releases; waiting 546 ms; commit 0 ms)
2026-11-08T15:14:45Z [load_day 2026-02-06] 2026-02-06 hour 9: 141078 events in 0 files, snapshot none (task 3830 ms: download 2580 ms overlapping gunzip 558 ms, parse 1623 ms, sort 0 ms, write 0 ms, index 751 ms: 14 candidates, 77593 repo-hours, 733 releases; waiting 667 ms; commit 0 ms)
2026-11-08T15:14:49Z [load_day 2026-02-06] 2026-02-06 hour 10: 142091 events in 0 files, snapshot none (task 3952 ms: download 2276 ms overlapping gunzip 635 ms, parse 1938 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 79148 repo-hours, 631 releases; waiting 549 ms; commit 0 ms)
2026-11-08T15:14:49Z [load_day 2026-02-06] 2026-02-06 hour 11: 141650 events in 0 files, snapshot none (task 3553 ms: download 2315 ms overlapping gunzip 521 ms, parse 1524 ms, sort 0 ms, write 0 ms, index 635 ms: 8 candidates, 77174 repo-hours, 761 releases; waiting 549 ms; commit 0 ms)
2026-11-08T15:14:53Z [load_day 2026-02-06] 2026-02-06 hour 12: 148920 events in 0 files, snapshot none (task 3272 ms: download 1877 ms overlapping gunzip 430 ms, parse 1356 ms, sort 0 ms, write 0 ms, index 660 ms: 3 candidates, 89818 repo-hours, 549 releases; waiting 521 ms; commit 0 ms)
2026-11-08T15:14:53Z [load_day 2026-02-06] 2026-02-06 hour 13: 151907 events in 0 files, snapshot none (task 3283 ms: download 2113 ms overlapping gunzip 365 ms, parse 1293 ms, sort 0 ms, write 0 ms, index 702 ms: 10 candidates, 93449 repo-hours, 436 releases; waiting 570 ms; commit 0 ms)
2026-11-08T15:14:57Z [load_day 2026-02-06] 2026-02-06 hour 14: 143121 events in 0 files, snapshot none (task 3672 ms: download 2442 ms overlapping gunzip 406 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 586 ms: 4 candidates, 80097 repo-hours, 605 releases; waiting 1188 ms; commit 0 ms)
2026-11-08T15:14:57Z [load_day 2026-02-06] 2026-02-06 hour 15: 145095 events in 0 files, snapshot none (task 3399 ms: download 2205 ms overlapping gunzip 429 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 82246 repo-hours, 641 releases; waiting 829 ms; commit 0 ms)
2026-11-08T15:15:01Z [load_day 2026-02-06] 2026-02-06 hour 16: 142372 events in 0 files, snapshot none (task 3420 ms: download 2224 ms overlapping gunzip 362 ms, parse 1046 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 81856 repo-hours, 561 releases; waiting 946 ms; commit 0 ms)
2026-11-08T15:15:01Z [load_day 2026-02-06] 2026-02-06 hour 17: 144604 events in 0 files, snapshot none (task 2752 ms: download 1585 ms overlapping gunzip 405 ms, parse 1059 ms, sort 0 ms, write 0 ms, index 588 ms: 2 candidates, 79665 repo-hours, 565 releases; waiting 454 ms; commit 0 ms)
2026-11-08T15:15:05Z [load_day 2026-02-06] 2026-02-06 hour 18: 150514 events in 0 files, snapshot none (task 3565 ms: download 1971 ms overlapping gunzip 386 ms, parse 1180 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 84704 repo-hours, 698 releases; waiting 991 ms; commit 0 ms)
2026-11-08T15:15:06Z [load_day 2026-02-06] 2026-02-06 hour 19: 147227 events in 0 files, snapshot none (task 4780 ms: download 2883 ms overlapping gunzip 449 ms, parse 1331 ms, sort 0 ms, write 0 ms, index 785 ms: 8 candidates, 76620 repo-hours, 876 releases; waiting 1883 ms; commit 0 ms)
2026-11-08T15:15:09Z [load_day 2026-02-06] 2026-02-06 hour 20: 141983 events in 0 files, snapshot none (task 3399 ms: download 2059 ms overlapping gunzip 396 ms, parse 1203 ms, sort 0 ms, write 0 ms, index 602 ms: 7 candidates, 70115 repo-hours, 922 releases; waiting 818 ms; commit 0 ms)
2026-11-08T15:15:10Z [load_day 2026-02-06] 2026-02-06 hour 21: 145548 events in 0 files, snapshot none (task 3057 ms: download 2029 ms overlapping gunzip 398 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 551 ms: 6 candidates, 73353 repo-hours, 933 releases; waiting 586 ms; commit 0 ms)
2026-11-08T15:15:13Z [load_day 2026-02-06] 2026-02-06 hour 22: 143767 events in 0 files, snapshot none (task 3198 ms: download 2043 ms overlapping gunzip 417 ms, parse 1218 ms, sort 0 ms, write 0 ms, index 540 ms: 5 candidates, 70703 repo-hours, 975 releases; waiting 780 ms; commit 0 ms)
2026-11-08T15:15:14Z [load_day 2026-02-06] 2026-02-06 hour 23: 143390 events in 0 files, snapshot none (task 3574 ms: download 2226 ms overlapping gunzip 439 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 533 ms: 9 candidates, 68202 repo-hours, 1017 releases; waiting 908 ms; commit 0 ms)
2026-11-08T15:15:22Z [load_day 2026-02-06] 2026-02-06: repo_hour merged from 24 files to 1 (1882677 rows, 8047 ms)
2026-11-08T15:15:26Z [load_day 2026-02-06] 2026-02-06: index committed in 11260 ms (24 + 1 + 24 files)
2026-11-08T15:15:26Z [load_day 2026-02-06] 2026-02-06: 3487076 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:15:26Z [load_day 2026-02-06] attempt 1 succeeded