orcaLog in

Runs · run 3067

load_day 2024-10-11, attempt 1 succeeded

Host
73ccef5e07c2:190458
Started
2026-11-08T08:18:14Z
Ended
2026-11-08T08:19:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
722 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
155.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3067/load_day/2024-10-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:18:14Z [load_day 2024-10-11] attempt 1 started
2026-11-08T08:18:15Z [load_day 2024-10-11] 2024-10-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:18:21Z [load_day 2024-10-11] 2024-10-11 hour 0: 189958 events in 0 files, snapshot none (task 6088 ms: download 2968 ms overlapping gunzip 966 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 736 ms: 6 candidates, 85289 repo-hours, 1153 releases; waiting 368 ms; commit 0 ms)
2026-11-08T08:18:22Z [load_day 2024-10-11] 2024-10-11 hour 1: 213209 events in 0 files, snapshot none (task 6514 ms: download 3588 ms overlapping gunzip 1006 ms, parse 4044 ms, sort 0 ms, write 0 ms, index 742 ms: 2 candidates, 100458 repo-hours, 814 releases; waiting 471 ms; commit 0 ms)
2026-11-08T08:18:28Z [load_day 2024-10-11] 2024-10-11 hour 2: 188880 events in 0 files, snapshot none (task 6312 ms: download 3290 ms overlapping gunzip 992 ms, parse 3686 ms, sort 0 ms, write 0 ms, index 694 ms: 7 candidates, 78865 repo-hours, 834 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:18:30Z [load_day 2024-10-11] 2024-10-11 hour 3: 201393 events in 0 files, snapshot none (task 7292 ms: download 4665 ms overlapping gunzip 1203 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 632 ms: 3 candidates, 78047 repo-hours, 3979 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:18:33Z [load_day 2024-10-11] 2024-10-11 hour 4: 173153 events in 0 files, snapshot none (task 4326 ms: download 2158 ms overlapping gunzip 641 ms, parse 2404 ms, sort 0 ms, write 0 ms, index 506 ms: 1 candidates, 61084 repo-hours, 694 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:18:35Z [load_day 2024-10-11] 2024-10-11 hour 5: 187330 events in 0 files, snapshot none (task 5080 ms: download 2830 ms overlapping gunzip 758 ms, parse 2844 ms, sort 0 ms, write 0 ms, index 563 ms: 7 candidates, 67448 repo-hours, 1028 releases; waiting 620 ms; commit 0 ms)
2026-11-08T08:18:39Z [load_day 2024-10-11] 2024-10-11 hour 6: 219031 events in 0 files, snapshot none (task 5664 ms: download 3192 ms overlapping gunzip 867 ms, parse 3281 ms, sort 0 ms, write 0 ms, index 701 ms: 16 candidates, 92821 repo-hours, 1038 releases; waiting 554 ms; commit 0 ms)
2026-11-08T08:18:42Z [load_day 2024-10-11] 2024-10-11 hour 7: 221844 events in 0 files, snapshot none (task 5962 ms: download 3685 ms overlapping gunzip 965 ms, parse 3626 ms, sort 0 ms, write 0 ms, index 620 ms: 7 candidates, 84916 repo-hours, 994 releases; waiting 496 ms; commit 0 ms)
2026-11-08T08:18:46Z [load_day 2024-10-11] 2024-10-11 hour 8: 234145 events in 0 files, snapshot none (task 6744 ms: download 3764 ms overlapping gunzip 1039 ms, parse 3796 ms, sort 0 ms, write 0 ms, index 1159 ms: 20 candidates, 95921 repo-hours, 1343 releases; waiting 474 ms; commit 0 ms)
2026-11-08T08:18:49Z [load_day 2024-10-11] 2024-10-11 hour 9: 239067 events in 0 files, snapshot none (task 7209 ms: download 4427 ms overlapping gunzip 1123 ms, parse 4320 ms, sort 0 ms, write 0 ms, index 1078 ms: 9 candidates, 98055 repo-hours, 1425 releases; waiting 440 ms; commit 0 ms)
2026-11-08T08:18:54Z [load_day 2024-10-11] 2024-10-11 hour 10: 221394 events in 0 files, snapshot none (task 6906 ms: download 3798 ms overlapping gunzip 1109 ms, parse 4239 ms, sort 0 ms, write 0 ms, index 745 ms: 12 candidates, 87277 repo-hours, 1231 releases; waiting 557 ms; commit 0 ms)
2026-11-08T08:18:58Z [load_day 2024-10-11] 2024-10-11 hour 11: 227129 events in 0 files, snapshot none (task 7653 ms: download 4608 ms overlapping gunzip 1233 ms, parse 4388 ms, sort 0 ms, write 0 ms, index 1171 ms: 6 candidates, 84870 repo-hours, 1051 releases; waiting 492 ms; commit 0 ms)
2026-11-08T08:19:02Z [load_day 2024-10-11] 2024-10-11 hour 12: 271745 events in 0 files, snapshot none (task 8168 ms: download 4567 ms overlapping gunzip 1217 ms, parse 4533 ms, sort 0 ms, write 0 ms, index 1455 ms: 13 candidates, 134401 repo-hours, 1209 releases; waiting 542 ms; commit 0 ms)
2026-11-08T08:19:06Z [load_day 2024-10-11] 2024-10-11 hour 13: 264225 events in 0 files, snapshot none (task 7620 ms: download 4711 ms overlapping gunzip 1188 ms, parse 4704 ms, sort 0 ms, write 0 ms, index 938 ms: 11 candidates, 114642 repo-hours, 1237 releases; waiting 499 ms; commit 0 ms)
2026-11-08T08:19:12Z [load_day 2024-10-11] 2024-10-11 hour 14: 254647 events in 0 files, snapshot none (task 9330 ms: download 5046 ms overlapping gunzip 1589 ms, parse 5840 ms, sort 0 ms, write 0 ms, index 1043 ms: 8 candidates, 99640 repo-hours, 1327 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:19:16Z [load_day 2024-10-11] 2024-10-11 hour 15: 252178 events in 0 files, snapshot none (task 9739 ms: download 6444 ms overlapping gunzip 1537 ms, parse 6136 ms, sort 0 ms, write 0 ms, index 1395 ms: 12 candidates, 103668 repo-hours, 1449 releases; waiting 425 ms; commit 0 ms)
2026-11-08T08:19:20Z [load_day 2024-10-11] 2024-10-11 hour 16: 242096 events in 0 files, snapshot none (task 7395 ms: download 4280 ms overlapping gunzip 1148 ms, parse 4336 ms, sort 0 ms, write 0 ms, index 900 ms: 10 candidates, 90315 repo-hours, 1236 releases; waiting 556 ms; commit 0 ms)
2026-11-08T08:19:24Z [load_day 2024-10-11] 2024-10-11 hour 17: 231140 events in 0 files, snapshot none (task 7546 ms: download 3762 ms overlapping gunzip 1136 ms, parse 4288 ms, sort 0 ms, write 0 ms, index 1167 ms: 14 candidates, 80165 repo-hours, 1126 releases; waiting 490 ms; commit 0 ms)
2026-11-08T08:19:28Z [load_day 2024-10-11] 2024-10-11 hour 18: 228267 events in 0 files, snapshot none (task 7097 ms: download 4399 ms overlapping gunzip 1173 ms, parse 4557 ms, sort 0 ms, write 0 ms, index 747 ms: 13 candidates, 97671 repo-hours, 1143 releases; waiting 332 ms; commit 0 ms)
2026-11-08T08:19:32Z [load_day 2024-10-11] 2024-10-11 hour 19: 206090 events in 0 files, snapshot none (task 7088 ms: download 3677 ms overlapping gunzip 1185 ms, parse 4417 ms, sort 0 ms, write 0 ms, index 741 ms: 5 candidates, 74612 repo-hours, 979 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:19:34Z [load_day 2024-10-11] 2024-10-11 hour 20: 192611 events in 0 files, snapshot none (task 6285 ms: download 3949 ms overlapping gunzip 1126 ms, parse 4097 ms, sort 0 ms, write 0 ms, index 569 ms: 14 candidates, 72522 repo-hours, 889 releases; waiting 256 ms; commit 0 ms)
2026-11-08T08:19:39Z [load_day 2024-10-11] 2024-10-11 hour 21: 187317 events in 0 files, snapshot none (task 6128 ms: download 2683 ms overlapping gunzip 959 ms, parse 3606 ms, sort 0 ms, write 0 ms, index 878 ms: 22 candidates, 69318 repo-hours, 1274 releases; waiting 385 ms; commit 0 ms)
2026-11-08T08:19:40Z [load_day 2024-10-11] 2024-10-11 hour 22: 169129 events in 0 files, snapshot none (task 5429 ms: download 3102 ms overlapping gunzip 848 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 512 ms: 21 candidates, 56502 repo-hours, 937 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:19:44Z [load_day 2024-10-11] 2024-10-11 hour 23: 163176 events in 0 files, snapshot none (task 4899 ms: download 2441 ms overlapping gunzip 748 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 438 ms: 6 candidates, 51943 repo-hours, 696 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:19:53Z [load_day 2024-10-11] 2024-10-11: repo_hour merged from 24 files to 1 (2060450 rows, 8892 ms)
2026-11-08T08:19:55Z [load_day 2024-10-11] 2024-10-11: index committed in 11304 ms (24 + 1 + 24 files)
2026-11-08T08:19:55Z [load_day 2024-10-11] 2024-10-11: 5179154 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:19:55Z [load_day 2024-10-11] attempt 1 succeeded