orcaLog in

Runs · run 3413

load_day 2025-01-09, attempt 1 succeeded

Host
73ccef5e07c2:234904
Started
2026-11-08T09:43:53Z
Ended
2026-11-08T09:45:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
818 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
184.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3413/load_day/2025-01-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:43:53Z [load_day 2025-01-09] attempt 1 started
2026-11-08T09:43:54Z [load_day 2025-01-09] 2025-01-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:44:03Z [load_day 2025-01-09] 2025-01-09 hour 0: 192270 events in 0 files, snapshot none (task 8907 ms: download 5440 ms overlapping gunzip 1425 ms, parse 6150 ms, sort 0 ms, write 0 ms, index 836 ms: 8 candidates, 89663 repo-hours, 1224 releases; waiting 178 ms; commit 0 ms)
2026-11-08T09:44:03Z [load_day 2025-01-09] 2025-01-09 hour 1: 217317 events in 0 files, snapshot none (task 8207 ms: download 4334 ms overlapping gunzip 1210 ms, parse 5422 ms, sort 0 ms, write 0 ms, index 850 ms: 4 candidates, 74019 repo-hours, 464 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:44:13Z [load_day 2025-01-09] 2025-01-09 hour 2: 198942 events in 0 files, snapshot none (task 9066 ms: download 4735 ms overlapping gunzip 1245 ms, parse 5354 ms, sort 0 ms, write 0 ms, index 1682 ms: 2 candidates, 94306 repo-hours, 928 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:44:13Z [load_day 2025-01-09] 2025-01-09 hour 3: 210444 events in 0 files, snapshot none (task 7942 ms: download 4865 ms overlapping gunzip 1269 ms, parse 5119 ms, sort 0 ms, write 0 ms, index 838 ms: 2 candidates, 79383 repo-hours, 3973 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:44:19Z [load_day 2025-01-09] 2025-01-09 hour 4: 186367 events in 0 files, snapshot none (task 5842 ms: download 3098 ms overlapping gunzip 831 ms, parse 3564 ms, sort 0 ms, write 0 ms, index 691 ms: 0 candidates, 63698 repo-hours, 953 releases; waiting 529 ms; commit 0 ms)
2026-11-08T09:44:20Z [load_day 2025-01-09] 2025-01-09 hour 5: 197971 events in 0 files, snapshot none (task 7133 ms: download 3489 ms overlapping gunzip 1097 ms, parse 4576 ms, sort 0 ms, write 0 ms, index 654 ms: 4 candidates, 69428 repo-hours, 946 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:44:26Z [load_day 2025-01-09] 2025-01-09 hour 6: 216901 events in 0 files, snapshot none (task 6874 ms: download 4049 ms overlapping gunzip 1051 ms, parse 4420 ms, sort 0 ms, write 0 ms, index 646 ms: 1 candidates, 93367 repo-hours, 1025 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:44:28Z [load_day 2025-01-09] 2025-01-09 hour 7: 207639 events in 0 files, snapshot none (task 6763 ms: download 4404 ms overlapping gunzip 1031 ms, parse 4338 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 80989 repo-hours, 910 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:44:35Z [load_day 2025-01-09] 2025-01-09 hour 8: 219046 events in 0 files, snapshot none (task 8205 ms: download 5105 ms overlapping gunzip 1343 ms, parse 5218 ms, sort 0 ms, write 0 ms, index 831 ms: 7 candidates, 91072 repo-hours, 1125 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:44:37Z [load_day 2025-01-09] 2025-01-09 hour 9: 232927 events in 0 files, snapshot none (task 8567 ms: download 6050 ms overlapping gunzip 1357 ms, parse 5810 ms, sort 0 ms, write 0 ms, index 705 ms: 5 candidates, 100261 repo-hours, 1499 releases; waiting 448 ms; commit 0 ms)
2026-11-08T09:44:45Z [load_day 2025-01-09] 2025-01-09 hour 10: 232180 events in 0 files, snapshot none (task 10004 ms: download 6910 ms overlapping gunzip 1594 ms, parse 6790 ms, sort 0 ms, write 0 ms, index 810 ms: 3 candidates, 95756 repo-hours, 1654 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:44:46Z [load_day 2025-01-09] 2025-01-09 hour 11: 233735 events in 0 files, snapshot none (task 9366 ms: download 6447 ms overlapping gunzip 1423 ms, parse 6447 ms, sort 0 ms, write 0 ms, index 666 ms: 7 candidates, 89025 repo-hours, 1337 releases; waiting 463 ms; commit 0 ms)
2026-11-08T09:44:55Z [load_day 2025-01-09] 2025-01-09 hour 12: 267019 events in 0 files, snapshot none (task 9565 ms: download 6472 ms overlapping gunzip 1390 ms, parse 6117 ms, sort 0 ms, write 0 ms, index 1009 ms: 9 candidates, 135082 repo-hours, 1421 releases; waiting 766 ms; commit 0 ms)
2026-11-08T09:44:56Z [load_day 2025-01-09] 2025-01-09 hour 13: 253143 events in 0 files, snapshot none (task 9320 ms: download 6638 ms overlapping gunzip 1478 ms, parse 6282 ms, sort 0 ms, write 0 ms, index 849 ms: 9 candidates, 118084 repo-hours, 1154 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:45:04Z [load_day 2025-01-09] 2025-01-09 hour 14: 244423 events in 0 files, snapshot none (task 8038 ms: download 5348 ms overlapping gunzip 1299 ms, parse 5298 ms, sort 0 ms, write 0 ms, index 839 ms: 4 candidates, 102895 repo-hours, 1657 releases; waiting 327 ms; commit 0 ms)
2026-11-08T09:45:05Z [load_day 2025-01-09] 2025-01-09 hour 15: 250593 events in 0 files, snapshot none (task 8196 ms: download 5645 ms overlapping gunzip 1281 ms, parse 5259 ms, sort 0 ms, write 0 ms, index 835 ms: 4 candidates, 110612 repo-hours, 1883 releases; waiting 620 ms; commit 0 ms)
2026-11-08T09:45:17Z [load_day 2025-01-09] 2025-01-09 hour 16: 237593 events in 0 files, snapshot none (task 12469 ms: download 9505 ms overlapping gunzip 1453 ms, parse 6202 ms, sort 0 ms, write 0 ms, index 738 ms: 7 candidates, 101295 repo-hours, 1528 releases; waiting 3788 ms; commit 0 ms)
2026-11-08T09:45:17Z [load_day 2025-01-09] 2025-01-09 hour 17: 228936 events in 0 files, snapshot none (task 8705 ms: download 4958 ms overlapping gunzip 1322 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 906 ms: 6 candidates, 92437 repo-hours, 1354 releases; waiting 673 ms; commit 0 ms)
2026-11-08T09:45:27Z [load_day 2025-01-09] 2025-01-09 hour 18: 235847 events in 0 files, snapshot none (task 9927 ms: download 6931 ms overlapping gunzip 1480 ms, parse 6618 ms, sort 0 ms, write 0 ms, index 945 ms: 8 candidates, 104809 repo-hours, 1267 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:45:27Z [load_day 2025-01-09] 2025-01-09 hour 19: 210498 events in 0 files, snapshot none (task 9249 ms: download 6520 ms overlapping gunzip 1504 ms, parse 6212 ms, sort 0 ms, write 0 ms, index 688 ms: 9 candidates, 81894 repo-hours, 1085 releases; waiting 568 ms; commit 0 ms)
2026-11-08T09:45:37Z [load_day 2025-01-09] 2025-01-09 hour 20: 203122 events in 0 files, snapshot none (task 8589 ms: download 5486 ms overlapping gunzip 1387 ms, parse 5656 ms, sort 0 ms, write 0 ms, index 702 ms: 10 candidates, 80521 repo-hours, 1113 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:45:37Z [load_day 2025-01-09] 2025-01-09 hour 21: 202750 events in 0 files, snapshot none (task 8893 ms: download 5640 ms overlapping gunzip 1426 ms, parse 5789 ms, sort 0 ms, write 0 ms, index 881 ms: 4 candidates, 80619 repo-hours, 1197 releases; waiting 545 ms; commit 0 ms)
2026-11-08T09:45:45Z [load_day 2025-01-09] 2025-01-09 hour 22: 187979 events in 0 files, snapshot none (task 7455 ms: download 4098 ms overlapping gunzip 1189 ms, parse 4740 ms, sort 0 ms, write 0 ms, index 640 ms: 6 candidates, 69848 repo-hours, 1308 releases; waiting 229 ms; commit 0 ms)
2026-11-08T09:45:45Z [load_day 2025-01-09] 2025-01-09 hour 23: 171008 events in 0 files, snapshot none (task 6884 ms: download 3922 ms overlapping gunzip 958 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 832 ms: 5 candidates, 63627 repo-hours, 948 releases; waiting 606 ms; commit 0 ms)
2026-11-08T09:45:54Z [load_day 2025-01-09] 2025-01-09: repo_hour merged from 24 files to 1 (2162690 rows, 9597 ms)
2026-11-08T09:45:57Z [load_day 2025-01-09] 2025-01-09: index committed in 12299 ms (23 + 1 + 24 files)
2026-11-08T09:45:57Z [load_day 2025-01-09] 2025-01-09: 5238650 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:45:57Z [load_day 2025-01-09] attempt 1 succeeded