orcaLog in

Runs · run 4291

load_day 2025-08-19, attempt 1 succeeded

Host
73ccef5e07c2:363733
Started
2026-11-08T13:27:01Z
Ended
2026-11-08T13:28:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
711 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
160.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4291/load_day/2025-08-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:27:01Z [load_day 2025-08-19] attempt 1 started
2026-11-08T13:27:02Z [load_day 2025-08-19] 2025-08-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:27:08Z [load_day 2025-08-19] 2025-08-19 hour 0: 143468 events in 0 files, snapshot none (task 5728 ms: download 3505 ms overlapping gunzip 931 ms, parse 3197 ms, sort 0 ms, write 0 ms, index 757 ms: 8 candidates, 71773 repo-hours, 924 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:27:09Z [load_day 2025-08-19] 2025-08-19 hour 1: 154931 events in 0 files, snapshot none (task 6135 ms: download 3293 ms overlapping gunzip 889 ms, parse 3319 ms, sort 0 ms, write 0 ms, index 972 ms: 10 candidates, 89317 repo-hours, 792 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:27:15Z [load_day 2025-08-19] 2025-08-19 hour 2: 152206 events in 0 files, snapshot none (task 6070 ms: download 3740 ms overlapping gunzip 989 ms, parse 3664 ms, sort 0 ms, write 0 ms, index 619 ms: 11 candidates, 71646 repo-hours, 928 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:27:16Z [load_day 2025-08-19] 2025-08-19 hour 3: 154460 events in 0 files, snapshot none (task 6466 ms: download 4121 ms overlapping gunzip 1031 ms, parse 3604 ms, sort 0 ms, write 0 ms, index 743 ms: 10 candidates, 70908 repo-hours, 2048 releases; waiting 796 ms; commit 0 ms)
2026-11-08T13:27:22Z [load_day 2025-08-19] 2025-08-19 hour 4: 146731 events in 0 files, snapshot none (task 6345 ms: download 3977 ms overlapping gunzip 1066 ms, parse 3949 ms, sort 0 ms, write 0 ms, index 526 ms: 3 candidates, 63255 repo-hours, 666 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:27:23Z [load_day 2025-08-19] 2025-08-19 hour 5: 150627 events in 0 files, snapshot none (task 6537 ms: download 4334 ms overlapping gunzip 1137 ms, parse 4145 ms, sort 0 ms, write 0 ms, index 477 ms: 7 candidates, 65511 repo-hours, 621 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:27:31Z [load_day 2025-08-19] 2025-08-19 hour 6: 156534 events in 0 files, snapshot none (task 8691 ms: download 6226 ms overlapping gunzip 1385 ms, parse 4942 ms, sort 0 ms, write 0 ms, index 620 ms: 9 candidates, 80212 repo-hours, 775 releases; waiting 1409 ms; commit 0 ms)
2026-11-08T13:27:32Z [load_day 2025-08-19] 2025-08-19 hour 7: 158192 events in 0 files, snapshot none (task 8259 ms: download 5882 ms overlapping gunzip 1539 ms, parse 5240 ms, sort 0 ms, write 0 ms, index 693 ms: 6 candidates, 74612 repo-hours, 782 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:27:40Z [load_day 2025-08-19] 2025-08-19 hour 8: 158558 events in 0 files, snapshot none (task 8230 ms: download 5722 ms overlapping gunzip 1509 ms, parse 5522 ms, sort 0 ms, write 0 ms, index 596 ms: 8 candidates, 78538 repo-hours, 830 releases; waiting 298 ms; commit 0 ms)
2026-11-08T13:27:41Z [load_day 2025-08-19] 2025-08-19 hour 9: 164625 events in 0 files, snapshot none (task 8197 ms: download 5840 ms overlapping gunzip 1477 ms, parse 5264 ms, sort 0 ms, write 0 ms, index 645 ms: 7 candidates, 79866 repo-hours, 891 releases; waiting 467 ms; commit 0 ms)
2026-11-08T13:27:48Z [load_day 2025-08-19] 2025-08-19 hour 10: 158453 events in 0 files, snapshot none (task 7871 ms: download 5324 ms overlapping gunzip 1280 ms, parse 5040 ms, sort 0 ms, write 0 ms, index 609 ms: 4 candidates, 79173 repo-hours, 798 releases; waiting 688 ms; commit 0 ms)
2026-11-08T13:27:49Z [load_day 2025-08-19] 2025-08-19 hour 11: 159860 events in 0 files, snapshot none (task 7654 ms: download 4979 ms overlapping gunzip 1359 ms, parse 5171 ms, sort 0 ms, write 0 ms, index 605 ms: 6 candidates, 75537 repo-hours, 758 releases; waiting 213 ms; commit 0 ms)
2026-11-08T13:27:56Z [load_day 2025-08-19] 2025-08-19 hour 12: 164133 events in 0 files, snapshot none (task 7186 ms: download 4388 ms overlapping gunzip 1076 ms, parse 4380 ms, sort 0 ms, write 0 ms, index 753 ms: 4 candidates, 94492 repo-hours, 877 releases; waiting 743 ms; commit 0 ms)
2026-11-08T13:27:58Z [load_day 2025-08-19] 2025-08-19 hour 13: 167871 events in 0 files, snapshot none (task 8467 ms: download 5824 ms overlapping gunzip 1215 ms, parse 4628 ms, sort 0 ms, write 0 ms, index 801 ms: 5 candidates, 90508 repo-hours, 783 releases; waiting 1418 ms; commit 0 ms)
2026-11-08T13:28:03Z [load_day 2025-08-19] 2025-08-19 hour 14: 168773 events in 0 files, snapshot none (task 6806 ms: download 4273 ms overlapping gunzip 1062 ms, parse 3894 ms, sort 0 ms, write 0 ms, index 699 ms: 9 candidates, 84328 repo-hours, 801 releases; waiting 879 ms; commit 0 ms)
2026-11-08T13:28:06Z [load_day 2025-08-19] 2025-08-19 hour 15: 167319 events in 0 files, snapshot none (task 6613 ms: download 4364 ms overlapping gunzip 949 ms, parse 3686 ms, sort 0 ms, write 0 ms, index 595 ms: 12 candidates, 83317 repo-hours, 836 releases; waiting 1159 ms; commit 0 ms)
2026-11-08T13:28:10Z [load_day 2025-08-19] 2025-08-19 hour 16: 162065 events in 0 files, snapshot none (task 6225 ms: download 4029 ms overlapping gunzip 954 ms, parse 3736 ms, sort 0 ms, write 0 ms, index 616 ms: 7 candidates, 81193 repo-hours, 837 releases; waiting 650 ms; commit 0 ms)
2026-11-08T13:28:12Z [load_day 2025-08-19] 2025-08-19 hour 17: 163387 events in 0 files, snapshot none (task 5580 ms: download 3940 ms overlapping gunzip 904 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 583 ms: 33 candidates, 78104 repo-hours, 701 releases; waiting 268 ms; commit 0 ms)
2026-11-08T13:28:17Z [load_day 2025-08-19] 2025-08-19 hour 18: 167612 events in 0 files, snapshot none (task 6594 ms: download 4165 ms overlapping gunzip 960 ms, parse 3867 ms, sort 0 ms, write 0 ms, index 647 ms: 6 candidates, 85689 repo-hours, 862 releases; waiting 867 ms; commit 0 ms)
2026-11-08T13:28:19Z [load_day 2025-08-19] 2025-08-19 hour 19: 159285 events in 0 files, snapshot none (task 6708 ms: download 4292 ms overlapping gunzip 955 ms, parse 3662 ms, sort 0 ms, write 0 ms, index 674 ms: 7 candidates, 72687 repo-hours, 768 releases; waiting 1188 ms; commit 0 ms)
2026-11-08T13:28:25Z [load_day 2025-08-19] 2025-08-19 hour 20: 155858 events in 0 files, snapshot none (task 7453 ms: download 4575 ms overlapping gunzip 1203 ms, parse 4842 ms, sort 0 ms, write 0 ms, index 545 ms: 3 candidates, 70471 repo-hours, 727 releases; waiting 501 ms; commit 0 ms)
2026-11-08T13:28:26Z [load_day 2025-08-19] 2025-08-19 hour 21: 150981 events in 0 files, snapshot none (task 6362 ms: download 4011 ms overlapping gunzip 1006 ms, parse 4323 ms, sort 0 ms, write 0 ms, index 510 ms: 10 candidates, 67126 repo-hours, 880 releases; waiting 201 ms; commit 0 ms)
2026-11-08T13:28:33Z [load_day 2025-08-19] 2025-08-19 hour 22: 150769 events in 0 files, snapshot none (task 7142 ms: download 4456 ms overlapping gunzip 1144 ms, parse 4675 ms, sort 0 ms, write 0 ms, index 449 ms: 6 candidates, 62689 repo-hours, 943 releases; waiting 279 ms; commit 0 ms)
2026-11-08T13:28:34Z [load_day 2025-08-19] 2025-08-19 hour 23: 149588 events in 0 files, snapshot none (task 6739 ms: download 4416 ms overlapping gunzip 1085 ms, parse 4439 ms, sort 0 ms, write 0 ms, index 429 ms: 6 candidates, 59961 repo-hours, 838 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:28:42Z [load_day 2025-08-19] 2025-08-19: repo_hour merged from 24 files to 1 (1830913 rows, 8071 ms)
2026-11-08T13:28:45Z [load_day 2025-08-19] 2025-08-19: index committed in 11270 ms (24 + 1 + 24 files)
2026-11-08T13:28:45Z [load_day 2025-08-19] 2025-08-19: 3786286 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:28:45Z [load_day 2025-08-19] attempt 1 succeeded