orcaLog in

Runs · run 3445

load_day 2025-01-17, attempt 1 succeeded

Host
73ccef5e07c2:239144
Started
2026-11-08T09:51:53Z
Ended
2026-11-08T09:53:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
731 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3445/load_day/2025-01-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:51:53Z [load_day 2025-01-17] attempt 1 started
2026-11-08T09:51:54Z [load_day 2025-01-17] 2025-01-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:52:03Z [load_day 2025-01-17] 2025-01-17 hour 0: 199582 events in 0 files, snapshot none (task 8268 ms: download 5420 ms overlapping gunzip 1230 ms, parse 5457 ms, sort 0 ms, write 0 ms, index 860 ms: 9 candidates, 94219 repo-hours, 1381 releases; waiting 472 ms; commit 0 ms)
2026-11-08T09:52:03Z [load_day 2025-01-17] 2025-01-17 hour 1: 209069 events in 0 files, snapshot none (task 8130 ms: download 5146 ms overlapping gunzip 1188 ms, parse 5240 ms, sort 0 ms, write 0 ms, index 973 ms: 12 candidates, 109926 repo-hours, 1012 releases; waiting 458 ms; commit 0 ms)
2026-11-08T09:52:11Z [load_day 2025-01-17] 2025-01-17 hour 2: 180447 events in 0 files, snapshot none (task 7572 ms: download 4715 ms overlapping gunzip 1136 ms, parse 5004 ms, sort 0 ms, write 0 ms, index 690 ms: 5 candidates, 79173 repo-hours, 964 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:52:12Z [load_day 2025-01-17] 2025-01-17 hour 3: 195000 events in 0 files, snapshot none (task 8037 ms: download 5098 ms overlapping gunzip 1267 ms, parse 5378 ms, sort 0 ms, write 0 ms, index 621 ms: 5 candidates, 77310 repo-hours, 3979 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:52:18Z [load_day 2025-01-17] 2025-01-17 hour 4: 176351 events in 0 files, snapshot none (task 5657 ms: download 3093 ms overlapping gunzip 875 ms, parse 3530 ms, sort 0 ms, write 0 ms, index 490 ms: 7 candidates, 64448 repo-hours, 637 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:52:18Z [load_day 2025-01-17] 2025-01-17 hour 5: 187371 events in 0 files, snapshot none (task 6087 ms: download 3341 ms overlapping gunzip 886 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 695 ms: 4 candidates, 69882 repo-hours, 891 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:52:26Z [load_day 2025-01-17] 2025-01-17 hour 6: 214009 events in 0 files, snapshot none (task 7901 ms: download 5171 ms overlapping gunzip 1278 ms, parse 5404 ms, sort 0 ms, write 0 ms, index 739 ms: 3 candidates, 93116 repo-hours, 1071 releases; waiting 193 ms; commit 0 ms)
2026-11-08T09:52:26Z [load_day 2025-01-17] 2025-01-17 hour 7: 209284 events in 0 files, snapshot none (task 7067 ms: download 4643 ms overlapping gunzip 1135 ms, parse 4582 ms, sort 0 ms, write 0 ms, index 600 ms: 7 candidates, 79951 repo-hours, 934 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:52:35Z [load_day 2025-01-17] 2025-01-17 hour 8: 229731 events in 0 files, snapshot none (task 8695 ms: download 5477 ms overlapping gunzip 1340 ms, parse 5734 ms, sort 0 ms, write 0 ms, index 712 ms: 3 candidates, 91155 repo-hours, 1025 releases; waiting 263 ms; commit 0 ms)
2026-11-08T09:52:36Z [load_day 2025-01-17] 2025-01-17 hour 9: 240719 events in 0 files, snapshot none (task 10061 ms: download 7461 ms overlapping gunzip 1502 ms, parse 7095 ms, sort 0 ms, write 0 ms, index 714 ms: 6 candidates, 99235 repo-hours, 1367 releases; waiting 462 ms; commit 0 ms)
2026-11-08T09:52:45Z [load_day 2025-01-17] 2025-01-17 hour 10: 233273 events in 0 files, snapshot none (task 9560 ms: download 7017 ms overlapping gunzip 1599 ms, parse 6527 ms, sort 0 ms, write 0 ms, index 677 ms: 11 candidates, 93775 repo-hours, 1423 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:52:45Z [load_day 2025-01-17] 2025-01-17 hour 11: 218415 events in 0 files, snapshot none (task 8524 ms: download 6071 ms overlapping gunzip 1351 ms, parse 5845 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 85455 repo-hours, 1088 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:52:54Z [load_day 2025-01-17] 2025-01-17 hour 12: 272116 events in 0 files, snapshot none (task 8550 ms: download 5480 ms overlapping gunzip 1288 ms, parse 5448 ms, sort 0 ms, write 0 ms, index 1031 ms: 11 candidates, 133266 repo-hours, 1242 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:52:55Z [load_day 2025-01-17] 2025-01-17 hour 13: 251419 events in 0 files, snapshot none (task 8754 ms: download 5945 ms overlapping gunzip 1395 ms, parse 5981 ms, sort 0 ms, write 0 ms, index 788 ms: 6 candidates, 113708 repo-hours, 1254 releases; waiting 319 ms; commit 0 ms)
2026-11-08T09:53:04Z [load_day 2025-01-17] 2025-01-17 hour 14: 246369 events in 0 files, snapshot none (task 9231 ms: download 5455 ms overlapping gunzip 1397 ms, parse 5846 ms, sort 0 ms, write 0 ms, index 1189 ms: 6 candidates, 99034 repo-hours, 1317 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:53:04Z [load_day 2025-01-17] 2025-01-17 hour 15: 256399 events in 0 files, snapshot none (task 9168 ms: download 5806 ms overlapping gunzip 1399 ms, parse 6163 ms, sort 0 ms, write 0 ms, index 814 ms: 16 candidates, 107291 repo-hours, 1339 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:53:13Z [load_day 2025-01-17] 2025-01-17 hour 16: 245100 events in 0 files, snapshot none (task 8820 ms: download 5757 ms overlapping gunzip 1486 ms, parse 6042 ms, sort 0 ms, write 0 ms, index 771 ms: 5 candidates, 99573 repo-hours, 1294 releases; waiting 245 ms; commit 0 ms)
2026-11-08T09:53:14Z [load_day 2025-01-17] 2025-01-17 hour 17: 232249 events in 0 files, snapshot none (task 8579 ms: download 5813 ms overlapping gunzip 1321 ms, parse 5757 ms, sort 0 ms, write 0 ms, index 734 ms: 8 candidates, 91888 repo-hours, 1186 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:53:22Z [load_day 2025-01-17] 2025-01-17 hour 18: 233874 events in 0 files, snapshot none (task 8483 ms: download 5516 ms overlapping gunzip 1288 ms, parse 5539 ms, sort 0 ms, write 0 ms, index 1123 ms: 9 candidates, 102741 repo-hours, 1128 releases; waiting 249 ms; commit 0 ms)
2026-11-08T09:53:23Z [load_day 2025-01-17] 2025-01-17 hour 19: 208545 events in 0 files, snapshot none (task 8767 ms: download 5797 ms overlapping gunzip 1442 ms, parse 5690 ms, sort 0 ms, write 0 ms, index 851 ms: 11 candidates, 77310 repo-hours, 1207 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:53:30Z [load_day 2025-01-17] 2025-01-17 hour 20: 205212 events in 0 files, snapshot none (task 7306 ms: download 4158 ms overlapping gunzip 1161 ms, parse 4887 ms, sort 0 ms, write 0 ms, index 831 ms: 8 candidates, 77227 repo-hours, 1110 releases; waiting 185 ms; commit 0 ms)
2026-11-08T09:53:31Z [load_day 2025-01-17] 2025-01-17 hour 21: 201787 events in 0 files, snapshot none (task 7622 ms: download 5090 ms overlapping gunzip 1144 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 587 ms: 11 candidates, 77882 repo-hours, 1187 releases; waiting 610 ms; commit 0 ms)
2026-11-08T09:53:37Z [load_day 2025-01-17] 2025-01-17 hour 22: 179206 events in 0 files, snapshot none (task 6632 ms: download 4160 ms overlapping gunzip 1104 ms, parse 4517 ms, sort 0 ms, write 0 ms, index 487 ms: 10 candidates, 65383 repo-hours, 1102 releases; waiting 225 ms; commit 0 ms)
2026-11-08T09:53:38Z [load_day 2025-01-17] 2025-01-17 hour 23: 167116 events in 0 files, snapshot none (task 5970 ms: download 3550 ms overlapping gunzip 923 ms, parse 3770 ms, sort 0 ms, write 0 ms, index 543 ms: 6 candidates, 58797 repo-hours, 933 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:53:47Z [load_day 2025-01-17] 2025-01-17: repo_hour merged from 24 files to 1 (2141745 rows, 9295 ms)
2026-11-08T09:53:49Z [load_day 2025-01-17] 2025-01-17: index committed in 11863 ms (24 + 1 + 24 files)
2026-11-08T09:53:49Z [load_day 2025-01-17] 2025-01-17: 5192643 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:53:49Z [load_day 2025-01-17] attempt 1 succeeded