orcaLog in

Runs · run 3659

load_day 2025-03-12, attempt 1 succeeded

Host
73ccef5e07c2:269111
Started
2026-11-08T10:47:56Z
Ended
2026-11-08T10:50:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
950 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
218.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3659/load_day/2025-03-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:47:56Z [load_day 2025-03-12] attempt 1 started
2026-11-08T10:47:56Z [load_day 2025-03-12] 2025-03-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:48:06Z [load_day 2025-03-12] 2025-03-12 hour 0: 218885 events in 0 files, snapshot none (task 9326 ms: download 5752 ms overlapping gunzip 1512 ms, parse 6114 ms, sort 0 ms, write 0 ms, index 940 ms: 7 candidates, 100526 repo-hours, 1320 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:48:07Z [load_day 2025-03-12] 2025-03-12 hour 1: 250968 events in 0 files, snapshot none (task 10321 ms: download 6210 ms overlapping gunzip 1698 ms, parse 6803 ms, sort 0 ms, write 0 ms, index 1170 ms: 8 candidates, 131341 repo-hours, 1002 releases; waiting 355 ms; commit 0 ms)
2026-11-08T10:48:15Z [load_day 2025-03-12] 2025-03-12 hour 2: 211255 events in 0 files, snapshot none (task 8103 ms: download 4903 ms overlapping gunzip 1235 ms, parse 5167 ms, sort 0 ms, write 0 ms, index 857 ms: 8 candidates, 93629 repo-hours, 1025 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:48:15Z [load_day 2025-03-12] 2025-03-12 hour 3: 228402 events in 0 files, snapshot none (task 7597 ms: download 4825 ms overlapping gunzip 1144 ms, parse 5018 ms, sort 0 ms, write 0 ms, index 676 ms: 8 candidates, 92191 repo-hours, 3854 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:48:24Z [load_day 2025-03-12] 2025-03-12 hour 4: 212565 events in 0 files, snapshot none (task 8657 ms: download 5521 ms overlapping gunzip 1346 ms, parse 5535 ms, sort 0 ms, write 0 ms, index 802 ms: 3 candidates, 77125 repo-hours, 777 releases; waiting 666 ms; commit 0 ms)
2026-11-08T10:48:24Z [load_day 2025-03-12] 2025-03-12 hour 5: 221069 events in 0 files, snapshot none (task 8272 ms: download 5459 ms overlapping gunzip 1277 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 688 ms: 3 candidates, 81193 repo-hours, 918 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:48:34Z [load_day 2025-03-12] 2025-03-12 hour 6: 243541 events in 0 files, snapshot none (task 9494 ms: download 6328 ms overlapping gunzip 1451 ms, parse 6492 ms, sort 0 ms, write 0 ms, index 840 ms: 5 candidates, 104279 repo-hours, 1086 releases; waiting 392 ms; commit 0 ms)
2026-11-08T10:48:34Z [load_day 2025-03-12] 2025-03-12 hour 7: 244271 events in 0 files, snapshot none (task 9506 ms: download 6740 ms overlapping gunzip 1594 ms, parse 6395 ms, sort 0 ms, write 0 ms, index 743 ms: 3 candidates, 95000 repo-hours, 1169 releases; waiting 478 ms; commit 0 ms)
2026-11-08T10:48:45Z [load_day 2025-03-12] 2025-03-12 hour 8: 261301 events in 0 files, snapshot none (task 10870 ms: download 7858 ms overlapping gunzip 1659 ms, parse 6854 ms, sort 0 ms, write 0 ms, index 817 ms: 7 candidates, 107787 repo-hours, 1156 releases; waiting 1208 ms; commit 0 ms)
2026-11-08T10:48:45Z [load_day 2025-03-12] 2025-03-12 hour 9: 271971 events in 0 files, snapshot none (task 10270 ms: download 7284 ms overlapping gunzip 1611 ms, parse 6923 ms, sort 0 ms, write 0 ms, index 882 ms: 2 candidates, 112859 repo-hours, 2276 releases; waiting 599 ms; commit 0 ms)
2026-11-08T10:48:56Z [load_day 2025-03-12] 2025-03-12 hour 10: 266210 events in 0 files, snapshot none (task 10357 ms: download 7742 ms overlapping gunzip 1694 ms, parse 6905 ms, sort 0 ms, write 0 ms, index 792 ms: 6 candidates, 107814 repo-hours, 1263 releases; waiting 713 ms; commit 0 ms)
2026-11-08T10:48:56Z [load_day 2025-03-12] 2025-03-12 hour 11: 261682 events in 0 files, snapshot none (task 9937 ms: download 7252 ms overlapping gunzip 1643 ms, parse 6759 ms, sort 0 ms, write 0 ms, index 770 ms: 11 candidates, 101190 repo-hours, 1134 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:49:05Z [load_day 2025-03-12] 2025-03-12 hour 12: 291314 events in 0 files, snapshot none (task 8774 ms: download 5733 ms overlapping gunzip 1299 ms, parse 5566 ms, sort 0 ms, write 0 ms, index 1097 ms: 9 candidates, 145100 repo-hours, 1434 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:49:06Z [load_day 2025-03-12] 2025-03-12 hour 13: 284464 events in 0 files, snapshot none (task 9202 ms: download 6392 ms overlapping gunzip 1385 ms, parse 5779 ms, sort 0 ms, write 0 ms, index 951 ms: 6 candidates, 129927 repo-hours, 1297 releases; waiting 791 ms; commit 0 ms)
2026-11-08T10:49:16Z [load_day 2025-03-12] 2025-03-12 hour 14: 280259 events in 0 files, snapshot none (task 9968 ms: download 6430 ms overlapping gunzip 1480 ms, parse 6049 ms, sort 0 ms, write 0 ms, index 1478 ms: 11 candidates, 118562 repo-hours, 1499 releases; waiting 647 ms; commit 0 ms)
2026-11-08T10:49:16Z [load_day 2025-03-12] 2025-03-12 hour 15: 283110 events in 0 files, snapshot none (task 10087 ms: download 6397 ms overlapping gunzip 1554 ms, parse 6415 ms, sort 0 ms, write 0 ms, index 1252 ms: 7 candidates, 124704 repo-hours, 1515 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:49:29Z [load_day 2025-03-12] 2025-03-12 hour 16: 278342 events in 0 files, snapshot none (task 12696 ms: download 9213 ms overlapping gunzip 1980 ms, parse 8782 ms, sort 0 ms, write 0 ms, index 1200 ms: 3 candidates, 117946 repo-hours, 1343 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:49:29Z [load_day 2025-03-12] 2025-03-12 hour 17: 270283 events in 0 files, snapshot none (task 11680 ms: download 7468 ms overlapping gunzip 1832 ms, parse 7802 ms, sort 0 ms, write 0 ms, index 1240 ms: 11 candidates, 109004 repo-hours, 1223 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:49:42Z [load_day 2025-03-12] 2025-03-12 hour 18: 262135 events in 0 files, snapshot none (task 11919 ms: download 8604 ms overlapping gunzip 1918 ms, parse 8332 ms, sort 0 ms, write 0 ms, index 920 ms: 8 candidates, 116361 repo-hours, 1274 releases; waiting 453 ms; commit 0 ms)
2026-11-08T10:49:42Z [load_day 2025-03-12] 2025-03-12 hour 19: 253891 events in 0 files, snapshot none (task 12070 ms: download 9227 ms overlapping gunzip 2049 ms, parse 8607 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 97170 repo-hours, 1094 releases; waiting 463 ms; commit 0 ms)
2026-11-08T10:49:52Z [load_day 2025-03-12] 2025-03-12 hour 20: 244161 events in 0 files, snapshot none (task 9956 ms: download 7288 ms overlapping gunzip 1615 ms, parse 6906 ms, sort 0 ms, write 0 ms, index 747 ms: 4 candidates, 94857 repo-hours, 1135 releases; waiting 437 ms; commit 0 ms)
2026-11-08T10:49:52Z [load_day 2025-03-12] 2025-03-12 hour 21: 236157 events in 0 files, snapshot none (task 10227 ms: download 7111 ms overlapping gunzip 1667 ms, parse 7218 ms, sort 0 ms, write 0 ms, index 810 ms: 9 candidates, 92106 repo-hours, 1279 releases; waiting 3 ms; commit 0 ms)
2026-11-08T10:50:04Z [load_day 2025-03-12] 2025-03-12 hour 22: 219835 events in 0 files, snapshot none (task 11306 ms: download 8758 ms overlapping gunzip 1257 ms, parse 5531 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 80332 repo-hours, 1241 releases; waiting 3629 ms; commit 0 ms)
2026-11-08T10:50:04Z [load_day 2025-03-12] 2025-03-12 hour 23: 209120 events in 0 files, snapshot none (task 8474 ms: download 5116 ms overlapping gunzip 1410 ms, parse 5546 ms, sort 0 ms, write 0 ms, index 691 ms: 8 candidates, 76255 repo-hours, 1110 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:50:15Z [load_day 2025-03-12] 2025-03-12: repo_hour merged from 24 files to 1 (2507258 rows, 10926 ms)
2026-11-08T10:50:17Z [load_day 2025-03-12] 2025-03-12: index committed in 13680 ms (24 + 1 + 24 files)
2026-11-08T10:50:17Z [load_day 2025-03-12] 2025-03-12: 6005191 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:50:17Z [load_day 2025-03-12] attempt 1 succeeded