orcaLog in

Runs · run 3338

load_day 2024-12-19, attempt 1 succeeded

Host
73ccef5e07c2:224989
Started
2026-11-08T09:26:32Z
Ended
2026-11-08T09:28:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
849 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3338/load_day/2024-12-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:26:32Z [load_day 2024-12-19] attempt 1 started
2026-11-08T09:26:33Z [load_day 2024-12-19] 2024-12-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:26:42Z [load_day 2024-12-19] 2024-12-19 hour 0: 185891 events in 0 files, snapshot none (task 7829 ms: download 4756 ms overlapping gunzip 1183 ms, parse 4921 ms, sort 0 ms, write 0 ms, index 898 ms: 11 candidates, 85711 repo-hours, 1266 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:26:42Z [load_day 2024-12-19] 2024-12-19 hour 1: 202878 events in 0 files, snapshot none (task 7646 ms: download 4364 ms overlapping gunzip 1150 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 759 ms: 13 candidates, 110198 repo-hours, 973 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:26:49Z [load_day 2024-12-19] 2024-12-19 hour 2: 178007 events in 0 files, snapshot none (task 6829 ms: download 4526 ms overlapping gunzip 949 ms, parse 4069 ms, sort 0 ms, write 0 ms, index 924 ms: 4 candidates, 77904 repo-hours, 910 releases; waiting 560 ms; commit 0 ms)
2026-11-08T09:26:49Z [load_day 2024-12-19] 2024-12-19 hour 3: 192402 events in 0 files, snapshot none (task 6541 ms: download 3835 ms overlapping gunzip 971 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 674 ms: 5 candidates, 77540 repo-hours, 4115 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:26:55Z [load_day 2024-12-19] 2024-12-19 hour 4: 178931 events in 0 files, snapshot none (task 6163 ms: download 3548 ms overlapping gunzip 928 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 497 ms: 4 candidates, 64805 repo-hours, 698 releases; waiting 462 ms; commit 0 ms)
2026-11-08T09:26:56Z [load_day 2024-12-19] 2024-12-19 hour 5: 189360 events in 0 files, snapshot none (task 6941 ms: download 4406 ms overlapping gunzip 1121 ms, parse 4646 ms, sort 0 ms, write 0 ms, index 537 ms: 1 candidates, 71719 repo-hours, 698 releases; waiting 276 ms; commit 0 ms)
2026-11-08T09:27:05Z [load_day 2024-12-19] 2024-12-19 hour 6: 216390 events in 0 files, snapshot none (task 9097 ms: download 5375 ms overlapping gunzip 1342 ms, parse 5968 ms, sort 0 ms, write 0 ms, index 1003 ms: 7 candidates, 94403 repo-hours, 982 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:27:05Z [load_day 2024-12-19] 2024-12-19 hour 7: 217402 events in 0 files, snapshot none (task 8907 ms: download 6034 ms overlapping gunzip 1517 ms, parse 5801 ms, sort 0 ms, write 0 ms, index 661 ms: 12 candidates, 84925 repo-hours, 957 releases; waiting 589 ms; commit 0 ms)
2026-11-08T09:27:15Z [load_day 2024-12-19] 2024-12-19 hour 8: 226308 events in 0 files, snapshot none (task 9631 ms: download 6346 ms overlapping gunzip 1613 ms, parse 6690 ms, sort 0 ms, write 0 ms, index 778 ms: 6 candidates, 92911 repo-hours, 1118 releases; waiting 230 ms; commit 0 ms)
2026-11-08T09:27:16Z [load_day 2024-12-19] 2024-12-19 hour 9: 237818 events in 0 files, snapshot none (task 9859 ms: download 6563 ms overlapping gunzip 1590 ms, parse 6899 ms, sort 0 ms, write 0 ms, index 784 ms: 4 candidates, 100480 repo-hours, 1384 releases; waiting 260 ms; commit 0 ms)
2026-11-08T09:27:26Z [load_day 2024-12-19] 2024-12-19 hour 10: 230816 events in 0 files, snapshot none (task 10210 ms: download 6081 ms overlapping gunzip 1450 ms, parse 6035 ms, sort 0 ms, write 0 ms, index 1777 ms: 4 candidates, 95080 repo-hours, 1265 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:27:26Z [load_day 2024-12-19] 2024-12-19 hour 11: 225672 events in 0 files, snapshot none (task 8860 ms: download 5690 ms overlapping gunzip 1465 ms, parse 5787 ms, sort 0 ms, write 0 ms, index 785 ms: 5 candidates, 88860 repo-hours, 1147 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:27:36Z [load_day 2024-12-19] 2024-12-19 hour 12: 266428 events in 0 files, snapshot none (task 9787 ms: download 6269 ms overlapping gunzip 1574 ms, parse 6457 ms, sort 0 ms, write 0 ms, index 1288 ms: 9 candidates, 134158 repo-hours, 1242 releases; waiting 269 ms; commit 0 ms)
2026-11-08T09:27:36Z [load_day 2024-12-19] 2024-12-19 hour 13: 253360 events in 0 files, snapshot none (task 9454 ms: download 6106 ms overlapping gunzip 1532 ms, parse 6315 ms, sort 0 ms, write 0 ms, index 1025 ms: 6 candidates, 117461 repo-hours, 1368 releases; waiting 290 ms; commit 0 ms)
2026-11-08T09:27:46Z [load_day 2024-12-19] 2024-12-19 hour 14: 246670 events in 0 files, snapshot none (task 10002 ms: download 7407 ms overlapping gunzip 1649 ms, parse 6774 ms, sort 0 ms, write 0 ms, index 729 ms: 3 candidates, 102781 repo-hours, 1494 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:27:47Z [load_day 2024-12-19] 2024-12-19 hour 15: 255862 events in 0 files, snapshot none (task 10354 ms: download 7420 ms overlapping gunzip 1770 ms, parse 6941 ms, sort 0 ms, write 0 ms, index 815 ms: 7 candidates, 110511 repo-hours, 1566 releases; waiting 236 ms; commit 0 ms)
2026-11-08T09:27:55Z [load_day 2024-12-19] 2024-12-19 hour 16: 244060 events in 0 files, snapshot none (task 7988 ms: download 5406 ms overlapping gunzip 1266 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 711 ms: 5 candidates, 100369 repo-hours, 1315 releases; waiting 449 ms; commit 0 ms)
2026-11-08T09:27:56Z [load_day 2024-12-19] 2024-12-19 hour 17: 229248 events in 0 files, snapshot none (task 8641 ms: download 6051 ms overlapping gunzip 1306 ms, parse 5332 ms, sort 0 ms, write 0 ms, index 667 ms: 3 candidates, 91933 repo-hours, 1304 releases; waiting 1039 ms; commit 0 ms)
2026-11-08T09:28:04Z [load_day 2024-12-19] 2024-12-19 hour 18: 237147 events in 0 files, snapshot none (task 8193 ms: download 4763 ms overlapping gunzip 1158 ms, parse 4897 ms, sort 0 ms, write 0 ms, index 1274 ms: 9 candidates, 103592 repo-hours, 1261 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:28:04Z [load_day 2024-12-19] 2024-12-19 hour 19: 212665 events in 0 files, snapshot none (task 7901 ms: download 4835 ms overlapping gunzip 1193 ms, parse 4816 ms, sort 0 ms, write 0 ms, index 899 ms: 6 candidates, 79162 repo-hours, 1114 releases; waiting 674 ms; commit 0 ms)
2026-11-08T09:28:12Z [load_day 2024-12-19] 2024-12-19 hour 20: 210208 events in 0 files, snapshot none (task 7946 ms: download 4624 ms overlapping gunzip 1283 ms, parse 5335 ms, sort 0 ms, write 0 ms, index 742 ms: 13 candidates, 82054 repo-hours, 1043 releases; waiting 175 ms; commit 0 ms)
2026-11-08T09:28:13Z [load_day 2024-12-19] 2024-12-19 hour 21: 203461 events in 0 files, snapshot none (task 8428 ms: download 5398 ms overlapping gunzip 1248 ms, parse 5550 ms, sort 0 ms, write 0 ms, index 783 ms: 9 candidates, 78348 repo-hours, 1172 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:28:22Z [load_day 2024-12-19] 2024-12-19 hour 22: 190415 events in 0 files, snapshot none (task 8863 ms: download 6374 ms overlapping gunzip 1329 ms, parse 5161 ms, sort 0 ms, write 0 ms, index 550 ms: 6 candidates, 67248 repo-hours, 1303 releases; waiting 1416 ms; commit 0 ms)
2026-11-08T09:28:22Z [load_day 2024-12-19] 2024-12-19 hour 23: 181632 events in 0 files, snapshot none (task 8090 ms: download 5377 ms overlapping gunzip 1368 ms, parse 5187 ms, sort 0 ms, write 0 ms, index 484 ms: 3 candidates, 62478 repo-hours, 1039 releases; waiting 583 ms; commit 0 ms)
2026-11-08T09:28:32Z [load_day 2024-12-19] 2024-12-19: repo_hour merged from 24 files to 1 (2174631 rows, 9825 ms)
2026-11-08T09:28:35Z [load_day 2024-12-19] 2024-12-19: index committed in 12819 ms (24 + 1 + 24 files)
2026-11-08T09:28:35Z [load_day 2024-12-19] 2024-12-19: 5213031 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:28:35Z [load_day 2024-12-19] attempt 1 succeeded