orcaLog in

Runs · run 3725

load_day 2025-03-28, attempt 1 succeeded

Host
73ccef5e07c2:278732
Started
2026-11-08T11:05:35Z
Ended
2026-11-08T11:07:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
889 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
198.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3725/load_day/2025-03-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:05:35Z [load_day 2025-03-28] attempt 1 started
2026-11-08T11:05:36Z [load_day 2025-03-28] 2025-03-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:05:46Z [load_day 2025-03-28] 2025-03-28 hour 0: 211411 events in 0 files, snapshot none (task 9020 ms: download 5969 ms overlapping gunzip 1515 ms, parse 6026 ms, sort 0 ms, write 0 ms, index 752 ms: 7 candidates, 97991 repo-hours, 1361 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:05:46Z [load_day 2025-03-28] 2025-03-28 hour 1: 232740 events in 0 files, snapshot none (task 8914 ms: download 5437 ms overlapping gunzip 1327 ms, parse 5802 ms, sort 0 ms, write 0 ms, index 1017 ms: 8 candidates, 125291 repo-hours, 985 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:05:54Z [load_day 2025-03-28] 2025-03-28 hour 2: 198404 events in 0 files, snapshot none (task 7677 ms: download 4409 ms overlapping gunzip 1192 ms, parse 4877 ms, sort 0 ms, write 0 ms, index 775 ms: 5 candidates, 87181 repo-hours, 969 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:05:55Z [load_day 2025-03-28] 2025-03-28 hour 3: 214681 events in 0 files, snapshot none (task 8458 ms: download 5241 ms overlapping gunzip 1234 ms, parse 5571 ms, sort 0 ms, write 0 ms, index 830 ms: 4 candidates, 88133 repo-hours, 3345 releases; waiting 564 ms; commit 0 ms)
2026-11-08T11:06:02Z [load_day 2025-03-28] 2025-03-28 hour 4: 193316 events in 0 files, snapshot none (task 7484 ms: download 4024 ms overlapping gunzip 1072 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 1125 ms: 5 candidates, 72765 repo-hours, 748 releases; waiting 571 ms; commit 0 ms)
2026-11-08T11:06:03Z [load_day 2025-03-28] 2025-03-28 hour 5: 197888 events in 0 files, snapshot none (task 7583 ms: download 4087 ms overlapping gunzip 1110 ms, parse 4886 ms, sort 0 ms, write 0 ms, index 811 ms: 1 candidates, 76769 repo-hours, 802 releases; waiting 429 ms; commit 0 ms)
2026-11-08T11:06:12Z [load_day 2025-03-28] 2025-03-28 hour 6: 227215 events in 0 files, snapshot none (task 9212 ms: download 6028 ms overlapping gunzip 1440 ms, parse 6115 ms, sort 0 ms, write 0 ms, index 760 ms: 2 candidates, 98992 repo-hours, 1026 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:06:12Z [load_day 2025-03-28] 2025-03-28 hour 7: 225031 events in 0 files, snapshot none (task 8885 ms: download 6255 ms overlapping gunzip 1380 ms, parse 6068 ms, sort 0 ms, write 0 ms, index 683 ms: 3 candidates, 88869 repo-hours, 1071 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:06:24Z [load_day 2025-03-28] 2025-03-28 hour 8: 240596 events in 0 files, snapshot none (task 11089 ms: download 8286 ms overlapping gunzip 1819 ms, parse 7321 ms, sort 0 ms, write 0 ms, index 713 ms: 4 candidates, 100399 repo-hours, 1162 releases; waiting 1012 ms; commit 0 ms)
2026-11-08T11:06:24Z [load_day 2025-03-28] 2025-03-28 hour 9: 256116 events in 0 files, snapshot none (task 11247 ms: download 8350 ms overlapping gunzip 1758 ms, parse 7818 ms, sort 0 ms, write 0 ms, index 827 ms: 10 candidates, 106507 repo-hours, 1409 releases; waiting 529 ms; commit 0 ms)
2026-11-08T11:06:35Z [load_day 2025-03-28] 2025-03-28 hour 10: 253268 events in 0 files, snapshot none (task 10447 ms: download 7656 ms overlapping gunzip 1715 ms, parse 7152 ms, sort 0 ms, write 0 ms, index 820 ms: 7 candidates, 103676 repo-hours, 1331 releases; waiting 529 ms; commit 0 ms)
2026-11-08T11:06:35Z [load_day 2025-03-28] 2025-03-28 hour 11: 246722 events in 0 files, snapshot none (task 10740 ms: download 7894 ms overlapping gunzip 1715 ms, parse 7591 ms, sort 0 ms, write 0 ms, index 682 ms: 11 candidates, 95985 repo-hours, 1165 releases; waiting 487 ms; commit 0 ms)
2026-11-08T11:06:45Z [load_day 2025-03-28] 2025-03-28 hour 12: 282948 events in 0 files, snapshot none (task 10390 ms: download 7118 ms overlapping gunzip 1562 ms, parse 7022 ms, sort 0 ms, write 0 ms, index 978 ms: 8 candidates, 139821 repo-hours, 1409 releases; waiting 531 ms; commit 0 ms)
2026-11-08T11:06:46Z [load_day 2025-03-28] 2025-03-28 hour 13: 273079 events in 0 files, snapshot none (task 10515 ms: download 7651 ms overlapping gunzip 1690 ms, parse 7110 ms, sort 0 ms, write 0 ms, index 917 ms: 14 candidates, 123648 repo-hours, 1438 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:06:57Z [load_day 2025-03-28] 2025-03-28 hour 14: 268942 events in 0 files, snapshot none (task 10579 ms: download 7943 ms overlapping gunzip 1572 ms, parse 7196 ms, sort 0 ms, write 0 ms, index 777 ms: 16 candidates, 110419 repo-hours, 1507 releases; waiting 721 ms; commit 0 ms)
2026-11-08T11:06:57Z [load_day 2025-03-28] 2025-03-28 hour 15: 270791 events in 0 files, snapshot none (task 10368 ms: download 7614 ms overlapping gunzip 1651 ms, parse 7095 ms, sort 0 ms, write 0 ms, index 827 ms: 7 candidates, 115840 repo-hours, 1557 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:07:05Z [load_day 2025-03-28] 2025-03-28 hour 16: 257428 events in 0 files, snapshot none (task 8232 ms: download 5639 ms overlapping gunzip 1311 ms, parse 5377 ms, sort 0 ms, write 0 ms, index 740 ms: 6 candidates, 106366 repo-hours, 1358 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:07:05Z [load_day 2025-03-28] 2025-03-28 hour 17: 243841 events in 0 files, snapshot none (task 7596 ms: download 5056 ms overlapping gunzip 1221 ms, parse 4859 ms, sort 0 ms, write 0 ms, index 690 ms: 13 candidates, 96891 repo-hours, 1206 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:07:14Z [load_day 2025-03-28] 2025-03-28 hour 18: 244230 events in 0 files, snapshot none (task 8304 ms: download 5208 ms overlapping gunzip 1234 ms, parse 4943 ms, sort 0 ms, write 0 ms, index 1124 ms: 5 candidates, 108366 repo-hours, 1213 releases; waiting 759 ms; commit 0 ms)
2026-11-08T11:07:14Z [load_day 2025-03-28] 2025-03-28 hour 19: 225343 events in 0 files, snapshot none (task 7330 ms: download 4526 ms overlapping gunzip 1105 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 911 ms: 12 candidates, 85652 repo-hours, 1097 releases; waiting 603 ms; commit 0 ms)
2026-11-08T11:07:24Z [load_day 2025-03-28] 2025-03-28 hour 20: 217648 events in 0 files, snapshot none (task 9310 ms: download 5538 ms overlapping gunzip 1403 ms, parse 6178 ms, sort 0 ms, write 0 ms, index 965 ms: 16 candidates, 84966 repo-hours, 1088 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:07:24Z [load_day 2025-03-28] 2025-03-28 hour 21: 213524 events in 0 files, snapshot none (task 9413 ms: download 5469 ms overlapping gunzip 1459 ms, parse 6265 ms, sort 0 ms, write 0 ms, index 821 ms: 8 candidates, 82412 repo-hours, 1065 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:07:34Z [load_day 2025-03-28] 2025-03-28 hour 22: 209719 events in 0 files, snapshot none (task 9254 ms: download 6500 ms overlapping gunzip 1529 ms, parse 6296 ms, sort 0 ms, write 0 ms, index 672 ms: 5 candidates, 78006 repo-hours, 1066 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:07:34Z [load_day 2025-03-28] 2025-03-28 hour 23: 191310 events in 0 files, snapshot none (task 8079 ms: download 4939 ms overlapping gunzip 1257 ms, parse 5364 ms, sort 0 ms, write 0 ms, index 645 ms: 13 candidates, 68604 repo-hours, 1063 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:07:45Z [load_day 2025-03-28] 2025-03-28: repo_hour merged from 24 files to 1 (2343549 rows, 11299 ms)
2026-11-08T11:07:48Z [load_day 2025-03-28] 2025-03-28: index committed in 14061 ms (24 + 1 + 24 files)
2026-11-08T11:07:48Z [load_day 2025-03-28] 2025-03-28: 5596191 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:07:48Z [load_day 2025-03-28] attempt 1 succeeded