orcaLog in

Runs · run 4234

load_day 2025-08-04, attempt 1 succeeded

Host
73ccef5e07c2:355425
Started
2026-11-08T13:13:48Z
Ended
2026-11-08T13:15:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
694 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
160.1 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4234/load_day/2025-08-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:13:48Z [load_day 2025-08-04] attempt 1 started
2026-11-08T13:13:49Z [load_day 2025-08-04] 2025-08-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:13:57Z [load_day 2025-08-04] 2025-08-04 hour 0: 137389 events in 0 files, snapshot none (task 7081 ms: download 4664 ms overlapping gunzip 1104 ms, parse 4712 ms, sort 0 ms, write 0 ms, index 464 ms: 7 candidates, 58709 repo-hours, 1074 releases; waiting 458 ms; commit 0 ms)
2026-11-08T13:13:57Z [load_day 2025-08-04] 2025-08-04 hour 1: 155949 events in 0 files, snapshot none (task 7149 ms: download 4497 ms overlapping gunzip 1169 ms, parse 4678 ms, sort 0 ms, write 0 ms, index 658 ms: 9 candidates, 85388 repo-hours, 763 releases; waiting 328 ms; commit 0 ms)
2026-11-08T13:14:04Z [load_day 2025-08-04] 2025-08-04 hour 2: 150495 events in 0 files, snapshot none (task 7377 ms: download 4715 ms overlapping gunzip 1129 ms, parse 4674 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 75725 repo-hours, 789 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:14:04Z [load_day 2025-08-04] 2025-08-04 hour 3: 139110 events in 0 files, snapshot none (task 7127 ms: download 4865 ms overlapping gunzip 1211 ms, parse 4622 ms, sort 0 ms, write 0 ms, index 474 ms: 30 candidates, 62150 repo-hours, 837 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:14:12Z [load_day 2025-08-04] 2025-08-04 hour 4: 145941 events in 0 files, snapshot none (task 6732 ms: download 4050 ms overlapping gunzip 1043 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 626 ms: 30 candidates, 65711 repo-hours, 1985 releases; waiting 457 ms; commit 0 ms)
2026-11-08T13:14:12Z [load_day 2025-08-04] 2025-08-04 hour 5: 149690 events in 0 files, snapshot none (task 7159 ms: download 4617 ms overlapping gunzip 1150 ms, parse 4466 ms, sort 0 ms, write 0 ms, index 807 ms: 7 candidates, 66822 repo-hours, 686 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:14:18Z [load_day 2025-08-04] 2025-08-04 hour 6: 157785 events in 0 files, snapshot none (task 5715 ms: download 3281 ms overlapping gunzip 941 ms, parse 3636 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 76943 repo-hours, 772 releases; waiting 216 ms; commit 0 ms)
2026-11-08T13:14:19Z [load_day 2025-08-04] 2025-08-04 hour 7: 158453 events in 0 files, snapshot none (task 6241 ms: download 4391 ms overlapping gunzip 977 ms, parse 3815 ms, sort 0 ms, write 0 ms, index 574 ms: 6 candidates, 74443 repo-hours, 703 releases; waiting 546 ms; commit 0 ms)
2026-11-08T13:14:25Z [load_day 2025-08-04] 2025-08-04 hour 8: 162161 events in 0 files, snapshot none (task 6527 ms: download 3871 ms overlapping gunzip 972 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 733 ms: 5 candidates, 78792 repo-hours, 902 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:14:25Z [load_day 2025-08-04] 2025-08-04 hour 9: 158329 events in 0 files, snapshot none (task 5713 ms: download 3345 ms overlapping gunzip 954 ms, parse 3678 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 77815 repo-hours, 980 releases; waiting 174 ms; commit 0 ms)
2026-11-08T13:14:34Z [load_day 2025-08-04] 2025-08-04 hour 10: 159975 events in 0 files, snapshot none (task 8245 ms: download 5066 ms overlapping gunzip 1321 ms, parse 5531 ms, sort 0 ms, write 0 ms, index 668 ms: 9 candidates, 76988 repo-hours, 850 releases; waiting 487 ms; commit 0 ms)
2026-11-08T13:14:34Z [load_day 2025-08-04] 2025-08-04 hour 11: 157197 events in 0 files, snapshot none (task 7940 ms: download 4579 ms overlapping gunzip 1271 ms, parse 4941 ms, sort 0 ms, write 0 ms, index 787 ms: 5 candidates, 73850 repo-hours, 835 releases; waiting 640 ms; commit 0 ms)
2026-11-08T13:14:43Z [load_day 2025-08-04] 2025-08-04 hour 12: 165165 events in 0 files, snapshot none (task 8208 ms: download 5108 ms overlapping gunzip 1280 ms, parse 5077 ms, sort 0 ms, write 0 ms, index 853 ms: 7 candidates, 95706 repo-hours, 889 releases; waiting 667 ms; commit 0 ms)
2026-11-08T13:14:43Z [load_day 2025-08-04] 2025-08-04 hour 13: 169090 events in 0 files, snapshot none (task 8496 ms: download 4980 ms overlapping gunzip 1482 ms, parse 5691 ms, sort 0 ms, write 0 ms, index 857 ms: 9 candidates, 93078 repo-hours, 832 releases; waiting 184 ms; commit 0 ms)
2026-11-08T13:14:53Z [load_day 2025-08-04] 2025-08-04 hour 14: 163282 events in 0 files, snapshot none (task 10227 ms: download 7338 ms overlapping gunzip 1741 ms, parse 6546 ms, sort 0 ms, write 0 ms, index 679 ms: 16 candidates, 84002 repo-hours, 948 releases; waiting 959 ms; commit 0 ms)
2026-11-08T13:14:53Z [load_day 2025-08-04] 2025-08-04 hour 15: 168809 events in 0 files, snapshot none (task 9629 ms: download 6208 ms overlapping gunzip 1609 ms, parse 5987 ms, sort 0 ms, write 0 ms, index 1163 ms: 6 candidates, 86575 repo-hours, 904 releases; waiting 552 ms; commit 0 ms)
2026-11-08T13:15:03Z [load_day 2025-08-04] 2025-08-04 hour 16: 163324 events in 0 files, snapshot none (task 9060 ms: download 6467 ms overlapping gunzip 1501 ms, parse 6092 ms, sort 0 ms, write 0 ms, index 611 ms: 12 candidates, 82564 repo-hours, 818 releases; waiting 531 ms; commit 0 ms)
2026-11-08T13:15:03Z [load_day 2025-08-04] 2025-08-04 hour 17: 159521 events in 0 files, snapshot none (task 8778 ms: download 6214 ms overlapping gunzip 1488 ms, parse 5900 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 77763 repo-hours, 766 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:15:12Z [load_day 2025-08-04] 2025-08-04 hour 18: 158651 events in 0 files, snapshot none (task 8263 ms: download 5794 ms overlapping gunzip 1226 ms, parse 4730 ms, sort 0 ms, write 0 ms, index 594 ms: 13 candidates, 83357 repo-hours, 821 releases; waiting 1456 ms; commit 0 ms)
2026-11-08T13:15:12Z [load_day 2025-08-04] 2025-08-04 hour 19: 161195 events in 0 files, snapshot none (task 7821 ms: download 4855 ms overlapping gunzip 1274 ms, parse 5083 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 74616 repo-hours, 877 releases; waiting 492 ms; commit 0 ms)
2026-11-08T13:15:21Z [load_day 2025-08-04] 2025-08-04 hour 20: 155814 events in 0 files, snapshot none (task 8888 ms: download 6059 ms overlapping gunzip 1609 ms, parse 5884 ms, sort 0 ms, write 0 ms, index 539 ms: 10 candidates, 72173 repo-hours, 865 releases; waiting 535 ms; commit 0 ms)
2026-11-08T13:15:21Z [load_day 2025-08-04] 2025-08-04 hour 21: 150190 events in 0 files, snapshot none (task 9154 ms: download 6326 ms overlapping gunzip 1588 ms, parse 6057 ms, sort 0 ms, write 0 ms, index 599 ms: 3 candidates, 67560 repo-hours, 918 releases; waiting 522 ms; commit 0 ms)
2026-11-08T13:15:29Z [load_day 2025-08-04] 2025-08-04 hour 22: 142168 events in 0 files, snapshot none (task 8059 ms: download 5364 ms overlapping gunzip 1399 ms, parse 5282 ms, sort 0 ms, write 0 ms, index 535 ms: 10 candidates, 61376 repo-hours, 834 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:15:30Z [load_day 2025-08-04] 2025-08-04 hour 23: 140125 events in 0 files, snapshot none (task 8098 ms: download 5489 ms overlapping gunzip 1370 ms, parse 5411 ms, sort 0 ms, write 0 ms, index 465 ms: 9 candidates, 57947 repo-hours, 718 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:15:39Z [load_day 2025-08-04] 2025-08-04: repo_hour merged from 24 files to 1 (1810053 rows, 9111 ms)
2026-11-08T13:15:42Z [load_day 2025-08-04] 2025-08-04: index committed in 12027 ms (24 + 1 + 24 files)
2026-11-08T13:15:42Z [load_day 2025-08-04] 2025-08-04: 3729808 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:15:42Z [load_day 2025-08-04] attempt 1 succeeded