orcaLog in

Runs · run 4219

load_day 2025-08-01, attempt 1 succeeded

Host
73ccef5e07c2:353085
Started
2026-11-08T13:11:06Z
Ended
2026-11-08T13:12:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
673 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
157.8 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4219/load_day/2025-08-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:11:06Z [load_day 2025-08-01] attempt 1 started
2026-11-08T13:11:07Z [load_day 2025-08-01] 2025-08-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:11:16Z [load_day 2025-08-01] 2025-08-01 hour 0: 144469 events in 0 files, snapshot none (task 7894 ms: download 5430 ms overlapping gunzip 1357 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 482 ms: 10 candidates, 63805 repo-hours, 1158 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:11:16Z [load_day 2025-08-01] 2025-08-01 hour 1: 155437 events in 0 files, snapshot none (task 7854 ms: download 5271 ms overlapping gunzip 1226 ms, parse 5132 ms, sort 0 ms, write 0 ms, index 586 ms: 9 candidates, 85201 repo-hours, 905 releases; waiting 561 ms; commit 0 ms)
2026-11-08T13:11:24Z [load_day 2025-08-01] 2025-08-01 hour 2: 155068 events in 0 files, snapshot none (task 8260 ms: download 5061 ms overlapping gunzip 1381 ms, parse 5559 ms, sort 0 ms, write 0 ms, index 732 ms: 8 candidates, 77200 repo-hours, 905 releases; waiting 320 ms; commit 0 ms)
2026-11-08T13:11:25Z [load_day 2025-08-01] 2025-08-01 hour 3: 148748 events in 0 files, snapshot none (task 8552 ms: download 5218 ms overlapping gunzip 1428 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 753 ms: 8 candidates, 64390 repo-hours, 1221 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:11:34Z [load_day 2025-08-01] 2025-08-01 hour 4: 148358 events in 0 files, snapshot none (task 9057 ms: download 5605 ms overlapping gunzip 1423 ms, parse 5793 ms, sort 0 ms, write 0 ms, index 609 ms: 11 candidates, 66689 repo-hours, 2025 releases; waiting 949 ms; commit 0 ms)
2026-11-08T13:11:34Z [load_day 2025-08-01] 2025-08-01 hour 5: 150110 events in 0 files, snapshot none (task 8985 ms: download 5488 ms overlapping gunzip 1418 ms, parse 5573 ms, sort 0 ms, write 0 ms, index 827 ms: 8 candidates, 66408 repo-hours, 682 releases; waiting 795 ms; commit 0 ms)
2026-11-08T13:11:43Z [load_day 2025-08-01] 2025-08-01 hour 6: 156430 events in 0 files, snapshot none (task 8616 ms: download 5313 ms overlapping gunzip 1336 ms, parse 5391 ms, sort 0 ms, write 0 ms, index 667 ms: 2 candidates, 78847 repo-hours, 827 releases; waiting 876 ms; commit 0 ms)
2026-11-08T13:11:43Z [load_day 2025-08-01] 2025-08-01 hour 7: 158217 events in 0 files, snapshot none (task 7821 ms: download 4828 ms overlapping gunzip 1342 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 746 ms: 10 candidates, 73623 repo-hours, 767 releases; waiting 335 ms; commit 0 ms)
2026-11-08T13:11:53Z [load_day 2025-08-01] 2025-08-01 hour 8: 160371 events in 0 files, snapshot none (task 9725 ms: download 6871 ms overlapping gunzip 1672 ms, parse 6420 ms, sort 0 ms, write 0 ms, index 581 ms: 8 candidates, 77583 repo-hours, 813 releases; waiting 752 ms; commit 0 ms)
2026-11-08T13:11:53Z [load_day 2025-08-01] 2025-08-01 hour 9: 159884 events in 0 files, snapshot none (task 9035 ms: download 5934 ms overlapping gunzip 1526 ms, parse 5897 ms, sort 0 ms, write 0 ms, index 626 ms: 3 candidates, 77304 repo-hours, 998 releases; waiting 623 ms; commit 0 ms)
2026-11-08T13:12:02Z [load_day 2025-08-01] 2025-08-01 hour 10: 154685 events in 0 files, snapshot none (task 8226 ms: download 5689 ms overlapping gunzip 1339 ms, parse 5526 ms, sort 0 ms, write 0 ms, index 562 ms: 4 candidates, 74262 repo-hours, 828 releases; waiting 485 ms; commit 0 ms)
2026-11-08T13:12:02Z [load_day 2025-08-01] 2025-08-01 hour 11: 157198 events in 0 files, snapshot none (task 8183 ms: download 5503 ms overlapping gunzip 1377 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 71704 repo-hours, 698 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:12:10Z [load_day 2025-08-01] 2025-08-01 hour 12: 165970 events in 0 files, snapshot none (task 6987 ms: download 4309 ms overlapping gunzip 1126 ms, parse 4403 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 93336 repo-hours, 871 releases; waiting 538 ms; commit 0 ms)
2026-11-08T13:12:10Z [load_day 2025-08-01] 2025-08-01 hour 13: 165032 events in 0 files, snapshot none (task 7560 ms: download 4898 ms overlapping gunzip 1200 ms, parse 4876 ms, sort 0 ms, write 0 ms, index 642 ms: 16 candidates, 89332 repo-hours, 884 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:12:17Z [load_day 2025-08-01] 2025-08-01 hour 14: 159958 events in 0 files, snapshot none (task 6505 ms: download 3897 ms overlapping gunzip 1029 ms, parse 4140 ms, sort 0 ms, write 0 ms, index 611 ms: 9 candidates, 78015 repo-hours, 941 releases; waiting 404 ms; commit 0 ms)
2026-11-08T13:12:17Z [load_day 2025-08-01] 2025-08-01 hour 15: 165093 events in 0 files, snapshot none (task 6700 ms: download 4542 ms overlapping gunzip 1018 ms, parse 4013 ms, sort 0 ms, write 0 ms, index 612 ms: 10 candidates, 79731 repo-hours, 1031 releases; waiting 710 ms; commit 0 ms)
2026-11-08T13:12:23Z [load_day 2025-08-01] 2025-08-01 hour 16: 159757 events in 0 files, snapshot none (task 6347 ms: download 3817 ms overlapping gunzip 950 ms, parse 3602 ms, sort 0 ms, write 0 ms, index 673 ms: 9 candidates, 75878 repo-hours, 891 releases; waiting 818 ms; commit 0 ms)
2026-11-08T13:12:24Z [load_day 2025-08-01] 2025-08-01 hour 17: 158982 events in 0 files, snapshot none (task 6174 ms: download 3628 ms overlapping gunzip 929 ms, parse 3681 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 72876 repo-hours, 808 releases; waiting 480 ms; commit 0 ms)
2026-11-08T13:12:33Z [load_day 2025-08-01] 2025-08-01 hour 18: 156204 events in 0 files, snapshot none (task 8480 ms: download 5269 ms overlapping gunzip 1434 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 750 ms: 13 candidates, 77505 repo-hours, 858 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:12:34Z [load_day 2025-08-01] 2025-08-01 hour 19: 156053 events in 0 files, snapshot none (task 8768 ms: download 5729 ms overlapping gunzip 1435 ms, parse 5734 ms, sort 0 ms, write 0 ms, index 824 ms: 6 candidates, 66957 repo-hours, 819 releases; waiting 483 ms; commit 0 ms)
2026-11-08T13:12:41Z [load_day 2025-08-01] 2025-08-01 hour 20: 150250 events in 0 files, snapshot none (task 7319 ms: download 4407 ms overlapping gunzip 1064 ms, parse 4401 ms, sort 0 ms, write 0 ms, index 1034 ms: 4 candidates, 64907 repo-hours, 824 releases; waiting 570 ms; commit 0 ms)
2026-11-08T13:12:41Z [load_day 2025-08-01] 2025-08-01 hour 21: 153464 events in 0 files, snapshot none (task 7071 ms: download 4082 ms overlapping gunzip 1125 ms, parse 4576 ms, sort 0 ms, write 0 ms, index 637 ms: 8 candidates, 60768 repo-hours, 883 releases; waiting 419 ms; commit 0 ms)
2026-11-08T13:12:48Z [load_day 2025-08-01] 2025-08-01 hour 22: 144133 events in 0 files, snapshot none (task 6599 ms: download 3967 ms overlapping gunzip 1041 ms, parse 4159 ms, sort 0 ms, write 0 ms, index 607 ms: 10 candidates, 55453 repo-hours, 907 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:12:48Z [load_day 2025-08-01] 2025-08-01 hour 23: 137651 events in 0 files, snapshot none (task 6204 ms: download 3541 ms overlapping gunzip 998 ms, parse 4058 ms, sort 0 ms, write 0 ms, index 504 ms: 8 candidates, 52388 repo-hours, 740 releases; waiting 348 ms; commit 0 ms)
2026-11-08T13:12:57Z [load_day 2025-08-01] 2025-08-01: repo_hour merged from 24 files to 1 (1744162 rows, 8713 ms)
2026-11-08T13:12:59Z [load_day 2025-08-01] 2025-08-01: index committed in 11470 ms (24 + 1 + 24 files)
2026-11-08T13:12:59Z [load_day 2025-08-01] 2025-08-01: 3721522 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:12:59Z [load_day 2025-08-01] attempt 1 succeeded