orcaLog in

Runs · run 3631

load_day 2025-03-04, attempt 1 succeeded

Host
73ccef5e07c2:265088
Started
2026-11-08T10:38:58Z
Ended
2026-11-08T10:41:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
879 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
213.6 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3631/load_day/2025-03-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:38:58Z [load_day 2025-03-04] attempt 1 started
2026-11-08T10:38:59Z [load_day 2025-03-04] 2025-03-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:39:08Z [load_day 2025-03-04] 2025-03-04 hour 0: 211693 events in 0 files, snapshot none (task 8607 ms: download 5437 ms overlapping gunzip 1388 ms, parse 5603 ms, sort 0 ms, write 0 ms, index 874 ms: 12 candidates, 98678 repo-hours, 1380 releases; waiting 482 ms; commit 0 ms)
2026-11-08T10:39:09Z [load_day 2025-03-04] 2025-03-04 hour 1: 236643 events in 0 files, snapshot none (task 9392 ms: download 6087 ms overlapping gunzip 1439 ms, parse 6106 ms, sort 0 ms, write 0 ms, index 982 ms: 10 candidates, 123783 repo-hours, 1096 releases; waiting 558 ms; commit 0 ms)
2026-11-08T10:39:17Z [load_day 2025-03-04] 2025-03-04 hour 2: 207794 events in 0 files, snapshot none (task 8157 ms: download 4811 ms overlapping gunzip 1237 ms, parse 5131 ms, sort 0 ms, write 0 ms, index 997 ms: 8 candidates, 91267 repo-hours, 957 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:39:18Z [load_day 2025-03-04] 2025-03-04 hour 3: 228488 events in 0 files, snapshot none (task 8092 ms: download 4513 ms overlapping gunzip 1240 ms, parse 5095 ms, sort 0 ms, write 0 ms, index 872 ms: 8 candidates, 92496 repo-hours, 4044 releases; waiting 546 ms; commit 0 ms)
2026-11-08T10:39:26Z [load_day 2025-03-04] 2025-03-04 hour 4: 212831 events in 0 files, snapshot none (task 8197 ms: download 5197 ms overlapping gunzip 1295 ms, parse 5413 ms, sort 0 ms, write 0 ms, index 655 ms: 9 candidates, 77950 repo-hours, 889 releases; waiting 465 ms; commit 0 ms)
2026-11-08T10:39:27Z [load_day 2025-03-04] 2025-03-04 hour 5: 217734 events in 0 files, snapshot none (task 8496 ms: download 5483 ms overlapping gunzip 1300 ms, parse 5782 ms, sort 0 ms, write 0 ms, index 818 ms: 3 candidates, 83688 repo-hours, 903 releases; waiting 280 ms; commit 0 ms)
2026-11-08T10:39:36Z [load_day 2025-03-04] 2025-03-04 hour 6: 244663 events in 0 files, snapshot none (task 9649 ms: download 5771 ms overlapping gunzip 1630 ms, parse 6542 ms, sort 0 ms, write 0 ms, index 1014 ms: 4 candidates, 107229 repo-hours, 1203 releases; waiting 229 ms; commit 0 ms)
2026-11-08T10:39:37Z [load_day 2025-03-04] 2025-03-04 hour 7: 245232 events in 0 files, snapshot none (task 10217 ms: download 7041 ms overlapping gunzip 1700 ms, parse 6886 ms, sort 0 ms, write 0 ms, index 877 ms: 7 candidates, 96689 repo-hours, 1152 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:39:47Z [load_day 2025-03-04] 2025-03-04 hour 8: 255020 events in 0 files, snapshot none (task 10655 ms: download 6819 ms overlapping gunzip 1599 ms, parse 6992 ms, sort 0 ms, write 0 ms, index 1339 ms: 10 candidates, 105833 repo-hours, 1152 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:39:49Z [load_day 2025-03-04] 2025-03-04 hour 9: 267265 events in 0 files, snapshot none (task 11090 ms: download 7819 ms overlapping gunzip 1750 ms, parse 7503 ms, sort 0 ms, write 0 ms, index 1081 ms: 8 candidates, 111297 repo-hours, 2052 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:39:58Z [load_day 2025-03-04] 2025-03-04 hour 10: 255001 events in 0 files, snapshot none (task 9959 ms: download 6230 ms overlapping gunzip 1496 ms, parse 6575 ms, sort 0 ms, write 0 ms, index 1150 ms: 10 candidates, 107080 repo-hours, 1388 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:39:59Z [load_day 2025-03-04] 2025-03-04 hour 11: 249175 events in 0 files, snapshot none (task 9051 ms: download 6264 ms overlapping gunzip 1478 ms, parse 6123 ms, sort 0 ms, write 0 ms, index 765 ms: 10 candidates, 99952 repo-hours, 1169 releases; waiting 460 ms; commit 0 ms)
2026-11-08T10:40:09Z [load_day 2025-03-04] 2025-03-04 hour 12: 281449 events in 0 files, snapshot none (task 11204 ms: download 6823 ms overlapping gunzip 1686 ms, parse 7277 ms, sort 0 ms, write 0 ms, index 1499 ms: 10 candidates, 142630 repo-hours, 1441 releases; waiting 454 ms; commit 0 ms)
2026-11-08T10:40:11Z [load_day 2025-03-04] 2025-03-04 hour 13: 274585 events in 0 files, snapshot none (task 11408 ms: download 8239 ms overlapping gunzip 1777 ms, parse 7233 ms, sort 0 ms, write 0 ms, index 964 ms: 13 candidates, 126156 repo-hours, 1302 releases; waiting 1198 ms; commit 0 ms)
2026-11-08T10:40:18Z [load_day 2025-03-04] 2025-03-04 hour 14: 271232 events in 0 files, snapshot none (task 8446 ms: download 5651 ms overlapping gunzip 1326 ms, parse 5418 ms, sort 0 ms, write 0 ms, index 844 ms: 13 candidates, 113437 repo-hours, 1506 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:40:21Z [load_day 2025-03-04] 2025-03-04 hour 15: 275049 events in 0 files, snapshot none (task 9138 ms: download 6305 ms overlapping gunzip 1382 ms, parse 5974 ms, sort 0 ms, write 0 ms, index 965 ms: 10 candidates, 121912 repo-hours, 1626 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:40:27Z [load_day 2025-03-04] 2025-03-04 hour 16: 258220 events in 0 files, snapshot none (task 8128 ms: download 5517 ms overlapping gunzip 1295 ms, parse 5268 ms, sort 0 ms, write 0 ms, index 830 ms: 11 candidates, 112228 repo-hours, 1214 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:40:32Z [load_day 2025-03-04] 2025-03-04 hour 17: 252940 events in 0 files, snapshot none (task 9249 ms: download 5321 ms overlapping gunzip 1291 ms, parse 5463 ms, sort 0 ms, write 0 ms, index 1601 ms: 5 candidates, 103657 repo-hours, 1159 releases; waiting 545 ms; commit 0 ms)
2026-11-08T10:40:37Z [load_day 2025-03-04] 2025-03-04 hour 18: 253188 events in 0 files, snapshot none (task 10034 ms: download 6081 ms overlapping gunzip 1578 ms, parse 6590 ms, sort 0 ms, write 0 ms, index 1233 ms: 8 candidates, 113110 repo-hours, 1362 releases; waiting 366 ms; commit 0 ms)
2026-11-08T10:40:43Z [load_day 2025-03-04] 2025-03-04 hour 19: 239793 events in 0 files, snapshot none (task 9538 ms: download 5331 ms overlapping gunzip 1513 ms, parse 6395 ms, sort 0 ms, write 0 ms, index 1080 ms: 6 candidates, 93299 repo-hours, 1069 releases; waiting 224 ms; commit 0 ms)
2026-11-08T10:40:47Z [load_day 2025-03-04] 2025-03-04 hour 20: 227454 events in 0 files, snapshot none (task 9210 ms: download 5945 ms overlapping gunzip 1464 ms, parse 6035 ms, sort 0 ms, write 0 ms, index 809 ms: 7 candidates, 92160 repo-hours, 1062 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:40:52Z [load_day 2025-03-04] 2025-03-04 hour 21: 226903 events in 0 files, snapshot none (task 9080 ms: download 5408 ms overlapping gunzip 1437 ms, parse 5821 ms, sort 0 ms, write 0 ms, index 1085 ms: 5 candidates, 92183 repo-hours, 1256 releases; waiting 422 ms; commit 0 ms)
2026-11-08T10:40:56Z [load_day 2025-03-04] 2025-03-04 hour 22: 214618 events in 0 files, snapshot none (task 8962 ms: download 6074 ms overlapping gunzip 1426 ms, parse 6026 ms, sort 0 ms, write 0 ms, index 644 ms: 15 candidates, 83139 repo-hours, 1289 releases; waiting 536 ms; commit 0 ms)
2026-11-08T10:41:01Z [load_day 2025-03-04] 2025-03-04 hour 23: 206955 events in 0 files, snapshot none (task 7618 ms: download 4793 ms overlapping gunzip 1184 ms, parse 4905 ms, sort 0 ms, write 0 ms, index 708 ms: 7 candidates, 79124 repo-hours, 1116 releases; waiting 482 ms; commit 0 ms)
2026-11-08T10:41:11Z [load_day 2025-03-04] 2025-03-04: repo_hour merged from 24 files to 1 (2468977 rows, 10879 ms)
2026-11-08T10:41:14Z [load_day 2025-03-04] 2025-03-04: index committed in 13517 ms (24 + 1 + 24 files)
2026-11-08T10:41:14Z [load_day 2025-03-04] 2025-03-04: 5813925 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:41:14Z [load_day 2025-03-04] attempt 1 succeeded