orcaLog in

Runs · run 3488

load_day 2025-01-28, attempt 1 succeeded

Host
73ccef5e07c2:244986
Started
2026-11-08T10:02:25Z
Ended
2026-11-08T10:04:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
736 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
197.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3488/load_day/2025-01-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:02:25Z [load_day 2025-01-28] attempt 1 started
2026-11-08T10:02:26Z [load_day 2025-01-28] 2025-01-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:02:34Z [load_day 2025-01-28] 2025-01-28 hour 0: 201731 events in 0 files, snapshot none (task 8447 ms: download 4704 ms overlapping gunzip 1306 ms, parse 5699 ms, sort 0 ms, write 0 ms, index 939 ms: 13 candidates, 98016 repo-hours, 1293 releases; waiting 270 ms; commit 0 ms)
2026-11-08T10:02:35Z [load_day 2025-01-28] 2025-01-28 hour 1: 207233 events in 0 files, snapshot none (task 9155 ms: download 5921 ms overlapping gunzip 1235 ms, parse 5507 ms, sort 0 ms, write 0 ms, index 838 ms: 13 candidates, 110578 repo-hours, 859 releases; waiting 1309 ms; commit 0 ms)
2026-11-08T10:02:41Z [load_day 2025-01-28] 2025-01-28 hour 2: 176376 events in 0 files, snapshot none (task 6269 ms: download 3440 ms overlapping gunzip 872 ms, parse 3763 ms, sort 0 ms, write 0 ms, index 763 ms: 8 candidates, 75704 repo-hours, 792 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:02:42Z [load_day 2025-01-28] 2025-01-28 hour 3: 187137 events in 0 files, snapshot none (task 6226 ms: download 3383 ms overlapping gunzip 895 ms, parse 4050 ms, sort 0 ms, write 0 ms, index 668 ms: 11 candidates, 73133 repo-hours, 3832 releases; waiting 367 ms; commit 0 ms)
2026-11-08T10:02:48Z [load_day 2025-01-28] 2025-01-28 hour 4: 177249 events in 0 files, snapshot none (task 6661 ms: download 3369 ms overlapping gunzip 1017 ms, parse 4303 ms, sort 0 ms, write 0 ms, index 715 ms: 10 candidates, 67183 repo-hours, 689 releases; waiting 412 ms; commit 0 ms)
2026-11-08T10:02:51Z [load_day 2025-01-28] 2025-01-28 hour 5: 194317 events in 0 files, snapshot none (task 8216 ms: download 5619 ms overlapping gunzip 1176 ms, parse 5061 ms, sort 0 ms, write 0 ms, index 683 ms: 8 candidates, 72206 repo-hours, 820 releases; waiting 956 ms; commit 0 ms)
2026-11-08T10:02:58Z [load_day 2025-01-28] 2025-01-28 hour 6: 209893 events in 0 files, snapshot none (task 8721 ms: download 4787 ms overlapping gunzip 1349 ms, parse 5531 ms, sort 0 ms, write 0 ms, index 1113 ms: 8 candidates, 89789 repo-hours, 911 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:03:00Z [load_day 2025-01-28] 2025-01-28 hour 7: 203741 events in 0 files, snapshot none (task 8323 ms: download 5131 ms overlapping gunzip 1310 ms, parse 5321 ms, sort 0 ms, write 0 ms, index 833 ms: 6 candidates, 76460 repo-hours, 773 releases; waiting 447 ms; commit 0 ms)
2026-11-08T10:03:07Z [load_day 2025-01-28] 2025-01-28 hour 8: 217840 events in 0 files, snapshot none (task 8303 ms: download 5096 ms overlapping gunzip 1324 ms, parse 5365 ms, sort 0 ms, write 0 ms, index 946 ms: 6 candidates, 86574 repo-hours, 1076 releases; waiting 405 ms; commit 0 ms)
2026-11-08T10:03:10Z [load_day 2025-01-28] 2025-01-28 hour 9: 241365 events in 0 files, snapshot none (task 10062 ms: download 6845 ms overlapping gunzip 1511 ms, parse 6852 ms, sort 0 ms, write 0 ms, index 873 ms: 3 candidates, 98733 repo-hours, 1267 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:03:15Z [load_day 2025-01-28] 2025-01-28 hour 10: 240296 events in 0 files, snapshot none (task 8013 ms: download 5413 ms overlapping gunzip 1295 ms, parse 5267 ms, sort 0 ms, write 0 ms, index 665 ms: 6 candidates, 96801 repo-hours, 1183 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:03:18Z [load_day 2025-01-28] 2025-01-28 hour 11: 233060 events in 0 files, snapshot none (task 7406 ms: download 4781 ms overlapping gunzip 1129 ms, parse 4714 ms, sort 0 ms, write 0 ms, index 739 ms: 12 candidates, 90615 repo-hours, 1202 releases; waiting 554 ms; commit 0 ms)
2026-11-08T10:03:24Z [load_day 2025-01-28] 2025-01-28 hour 12: 278766 events in 0 files, snapshot none (task 8059 ms: download 5111 ms overlapping gunzip 1188 ms, parse 5070 ms, sort 0 ms, write 0 ms, index 1051 ms: 8 candidates, 136186 repo-hours, 1352 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:03:27Z [load_day 2025-01-28] 2025-01-28 hour 13: 262078 events in 0 files, snapshot none (task 8201 ms: download 5237 ms overlapping gunzip 1192 ms, parse 5171 ms, sort 0 ms, write 0 ms, index 1001 ms: 11 candidates, 119901 repo-hours, 1216 releases; waiting 536 ms; commit 0 ms)
2026-11-08T10:03:36Z [load_day 2025-01-28] 2025-01-28 hour 14: 253567 events in 0 files, snapshot none (task 11630 ms: download 8222 ms overlapping gunzip 1933 ms, parse 7992 ms, sort 0 ms, write 0 ms, index 821 ms: 11 candidates, 105450 repo-hours, 1221 releases; waiting 564 ms; commit 0 ms)
2026-11-08T10:03:39Z [load_day 2025-01-28] 2025-01-28 hour 15: 258597 events in 0 files, snapshot none (task 11429 ms: download 8190 ms overlapping gunzip 1707 ms, parse 7521 ms, sort 0 ms, write 0 ms, index 1329 ms: 6 candidates, 111714 repo-hours, 1561 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:03:48Z [load_day 2025-01-28] 2025-01-28 hour 16: 258253 events in 0 files, snapshot none (task 11321 ms: download 7761 ms overlapping gunzip 1856 ms, parse 7542 ms, sort 0 ms, write 0 ms, index 1187 ms: 7 candidates, 108065 repo-hours, 1512 releases; waiting 534 ms; commit 0 ms)
2026-11-08T10:03:50Z [load_day 2025-01-28] 2025-01-28 hour 17: 256521 events in 0 files, snapshot none (task 10112 ms: download 7099 ms overlapping gunzip 1650 ms, parse 7082 ms, sort 0 ms, write 0 ms, index 883 ms: 8 candidates, 101736 repo-hours, 1197 releases; waiting 215 ms; commit 0 ms)
2026-11-08T10:03:59Z [load_day 2025-01-28] 2025-01-28 hour 18: 257108 events in 0 files, snapshot none (task 10358 ms: download 7326 ms overlapping gunzip 1760 ms, parse 6994 ms, sort 0 ms, write 0 ms, index 882 ms: 5 candidates, 111270 repo-hours, 1178 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:03:59Z [load_day 2025-01-28] 2025-01-28 hour 19: 229348 events in 0 files, snapshot none (task 9118 ms: download 6127 ms overlapping gunzip 1513 ms, parse 6196 ms, sort 0 ms, write 0 ms, index 697 ms: 11 candidates, 89825 repo-hours, 1125 releases; waiting 466 ms; commit 0 ms)
2026-11-08T10:04:08Z [load_day 2025-01-28] 2025-01-28 hour 20: 224279 events in 0 files, snapshot none (task 9202 ms: download 6575 ms overlapping gunzip 1488 ms, parse 6193 ms, sort 0 ms, write 0 ms, index 709 ms: 7 candidates, 90335 repo-hours, 1091 releases; waiting 523 ms; commit 0 ms)
2026-11-08T10:04:09Z [load_day 2025-01-28] 2025-01-28 hour 21: 221259 events in 0 files, snapshot none (task 9311 ms: download 6846 ms overlapping gunzip 1612 ms, parse 6605 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 88937 repo-hours, 1180 releases; waiting 241 ms; commit 0 ms)
2026-11-08T10:04:16Z [load_day 2025-01-28] 2025-01-28 hour 22: 201469 events in 0 files, snapshot none (task 7311 ms: download 3986 ms overlapping gunzip 1202 ms, parse 4817 ms, sort 0 ms, write 0 ms, index 741 ms: 13 candidates, 76392 repo-hours, 1232 releases; waiting 271 ms; commit 0 ms)
2026-11-08T10:04:18Z [load_day 2025-01-28] 2025-01-28 hour 23: 184573 events in 0 files, snapshot none (task 8108 ms: download 5655 ms overlapping gunzip 1133 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 572 ms: 10 candidates, 69129 repo-hours, 1081 releases; waiting 1330 ms; commit 0 ms)
2026-11-08T10:04:28Z [load_day 2025-01-28] 2025-01-28: repo_hour merged from 24 files to 1 (2244732 rows, 10442 ms)
2026-11-08T10:04:31Z [load_day 2025-01-28] 2025-01-28: index committed in 13069 ms (24 + 1 + 24 files)
2026-11-08T10:04:31Z [load_day 2025-01-28] 2025-01-28: 5376056 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:04:31Z [load_day 2025-01-28] attempt 1 succeeded