orcaLog in

Runs · run 3792

load_day 2025-04-16, attempt 1 succeeded

Host
73ccef5e07c2:288635
Started
2026-11-08T11:26:36Z
Ended
2026-11-08T11:28:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
836 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
195.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3792/load_day/2025-04-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:26:36Z [load_day 2025-04-16] attempt 1 started
2026-11-08T11:26:37Z [load_day 2025-04-16] 2025-04-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:26:47Z [load_day 2025-04-16] 2025-04-16 hour 0: 195923 events in 0 files, snapshot none (task 9053 ms: download 5251 ms overlapping gunzip 1428 ms, parse 6054 ms, sort 0 ms, write 0 ms, index 836 ms: 5 candidates, 93793 repo-hours, 1197 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:26:48Z [load_day 2025-04-16] 2025-04-16 hour 1: 227965 events in 0 files, snapshot none (task 10057 ms: download 5543 ms overlapping gunzip 1444 ms, parse 6488 ms, sort 0 ms, write 0 ms, index 1386 ms: 6 candidates, 125022 repo-hours, 1017 releases; waiting 472 ms; commit 0 ms)
2026-11-08T11:26:56Z [load_day 2025-04-16] 2025-04-16 hour 2: 198765 events in 0 files, snapshot none (task 8413 ms: download 4709 ms overlapping gunzip 1219 ms, parse 5394 ms, sort 0 ms, write 0 ms, index 889 ms: 4 candidates, 87750 repo-hours, 869 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:26:57Z [load_day 2025-04-16] 2025-04-16 hour 3: 211741 events in 0 files, snapshot none (task 8797 ms: download 5887 ms overlapping gunzip 1196 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 727 ms: 1 candidates, 89216 repo-hours, 3089 releases; waiting 1387 ms; commit 0 ms)
2026-11-08T11:27:04Z [load_day 2025-04-16] 2025-04-16 hour 4: 198296 events in 0 files, snapshot none (task 7444 ms: download 3670 ms overlapping gunzip 1076 ms, parse 4773 ms, sort 0 ms, write 0 ms, index 778 ms: 6 candidates, 76067 repo-hours, 875 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:27:05Z [load_day 2025-04-16] 2025-04-16 hour 5: 203745 events in 0 files, snapshot none (task 7812 ms: download 5098 ms overlapping gunzip 1176 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 741 ms: 6 candidates, 82123 repo-hours, 976 releases; waiting 546 ms; commit 0 ms)
2026-11-08T11:27:14Z [load_day 2025-04-16] 2025-04-16 hour 6: 226031 events in 0 files, snapshot none (task 9836 ms: download 6145 ms overlapping gunzip 1414 ms, parse 6382 ms, sort 0 ms, write 0 ms, index 1079 ms: 8 candidates, 103396 repo-hours, 1074 releases; waiting 732 ms; commit 0 ms)
2026-11-08T11:27:15Z [load_day 2025-04-16] 2025-04-16 hour 7: 225854 events in 0 files, snapshot none (task 9243 ms: download 6253 ms overlapping gunzip 1484 ms, parse 6193 ms, sort 0 ms, write 0 ms, index 725 ms: 7 candidates, 96167 repo-hours, 1024 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:27:25Z [load_day 2025-04-16] 2025-04-16 hour 8: 235328 events in 0 files, snapshot none (task 10220 ms: download 6921 ms overlapping gunzip 1650 ms, parse 6896 ms, sort 0 ms, write 0 ms, index 929 ms: 8 candidates, 104080 repo-hours, 1199 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:27:26Z [load_day 2025-04-16] 2025-04-16 hour 9: 240618 events in 0 files, snapshot none (task 10130 ms: download 7250 ms overlapping gunzip 1628 ms, parse 6912 ms, sort 0 ms, write 0 ms, index 799 ms: 11 candidates, 107391 repo-hours, 1526 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:27:34Z [load_day 2025-04-16] 2025-04-16 hour 10: 230340 events in 0 files, snapshot none (task 8930 ms: download 6181 ms overlapping gunzip 1416 ms, parse 5970 ms, sort 0 ms, write 0 ms, index 728 ms: 8 candidates, 99756 repo-hours, 1242 releases; waiting 526 ms; commit 0 ms)
2026-11-08T11:27:35Z [load_day 2025-04-16] 2025-04-16 hour 11: 235401 events in 0 files, snapshot none (task 8933 ms: download 6414 ms overlapping gunzip 1387 ms, parse 6141 ms, sort 0 ms, write 0 ms, index 692 ms: 5 candidates, 97825 repo-hours, 1203 releases; waiting 403 ms; commit 0 ms)
2026-11-08T11:27:42Z [load_day 2025-04-16] 2025-04-16 hour 12: 261671 events in 0 files, snapshot none (task 7892 ms: download 4988 ms overlapping gunzip 1140 ms, parse 5143 ms, sort 0 ms, write 0 ms, index 1014 ms: 10 candidates, 136560 repo-hours, 1353 releases; waiting 373 ms; commit 0 ms)
2026-11-08T11:27:43Z [load_day 2025-04-16] 2025-04-16 hour 13: 251503 events in 0 files, snapshot none (task 7650 ms: download 4976 ms overlapping gunzip 1147 ms, parse 4865 ms, sort 0 ms, write 0 ms, index 877 ms: 6 candidates, 123520 repo-hours, 1248 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:27:51Z [load_day 2025-04-16] 2025-04-16 hour 14: 245476 events in 0 files, snapshot none (task 8182 ms: download 5450 ms overlapping gunzip 1249 ms, parse 5293 ms, sort 0 ms, write 0 ms, index 833 ms: 4 candidates, 109965 repo-hours, 1415 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:27:51Z [load_day 2025-04-16] 2025-04-16 hour 15: 246737 events in 0 files, snapshot none (task 7663 ms: download 4954 ms overlapping gunzip 1227 ms, parse 5009 ms, sort 0 ms, write 0 ms, index 815 ms: 4 candidates, 113130 repo-hours, 1416 releases; waiting 219 ms; commit 0 ms)
2026-11-08T11:28:02Z [load_day 2025-04-16] 2025-04-16 hour 16: 237955 events in 0 files, snapshot none (task 10111 ms: download 7190 ms overlapping gunzip 1666 ms, parse 6921 ms, sort 0 ms, write 0 ms, index 832 ms: 8 candidates, 106512 repo-hours, 1529 releases; waiting 315 ms; commit 0 ms)
2026-11-08T11:28:02Z [load_day 2025-04-16] 2025-04-16 hour 17: 233870 events in 0 files, snapshot none (task 9268 ms: download 6593 ms overlapping gunzip 1431 ms, parse 6425 ms, sort 0 ms, write 0 ms, index 736 ms: 7 candidates, 99722 repo-hours, 1380 releases; waiting 463 ms; commit 0 ms)
2026-11-08T11:28:12Z [load_day 2025-04-16] 2025-04-16 hour 18: 233471 events in 0 files, snapshot none (task 10116 ms: download 6267 ms overlapping gunzip 1535 ms, parse 6383 ms, sort 0 ms, write 0 ms, index 1428 ms: 6 candidates, 109431 repo-hours, 1284 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:28:12Z [load_day 2025-04-16] 2025-04-16 hour 19: 222586 events in 0 files, snapshot none (task 9906 ms: download 6278 ms overlapping gunzip 1546 ms, parse 6538 ms, sort 0 ms, write 0 ms, index 884 ms: 7 candidates, 89496 repo-hours, 1142 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:28:21Z [load_day 2025-04-16] 2025-04-16 hour 20: 219308 events in 0 files, snapshot none (task 8678 ms: download 5435 ms overlapping gunzip 1349 ms, parse 5850 ms, sort 0 ms, write 0 ms, index 738 ms: 11 candidates, 89494 repo-hours, 1137 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:28:22Z [load_day 2025-04-16] 2025-04-16 hour 21: 214294 events in 0 files, snapshot none (task 9401 ms: download 6459 ms overlapping gunzip 1517 ms, parse 6343 ms, sort 0 ms, write 0 ms, index 804 ms: 7 candidates, 85798 repo-hours, 1226 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:28:31Z [load_day 2025-04-16] 2025-04-16 hour 22: 204416 events in 0 files, snapshot none (task 8669 ms: download 5671 ms overlapping gunzip 1391 ms, parse 5910 ms, sort 0 ms, write 0 ms, index 726 ms: 4 candidates, 76368 repo-hours, 1030 releases; waiting 389 ms; commit 0 ms)
2026-11-08T11:28:31Z [load_day 2025-04-16] 2025-04-16 hour 23: 199058 events in 0 files, snapshot none (task 8164 ms: download 5380 ms overlapping gunzip 1352 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 726 ms: 12 candidates, 77356 repo-hours, 1019 releases; waiting 199 ms; commit 0 ms)
2026-11-08T11:28:41Z [load_day 2025-04-16] 2025-04-16: repo_hour merged from 24 files to 1 (2379938 rows, 10471 ms)
2026-11-08T11:28:44Z [load_day 2025-04-16] 2025-04-16: index committed in 13332 ms (24 + 1 + 24 files)
2026-11-08T11:28:44Z [load_day 2025-04-16] 2025-04-16: 5400352 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:28:44Z [load_day 2025-04-16] attempt 1 succeeded