orcaLog in

Runs · run 3775

load_day 2025-04-11, attempt 1 succeeded

Host
73ccef5e07c2:286101
Started
2026-11-08T11:22:02Z
Ended
2026-11-08T11:24:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
814 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3775/load_day/2025-04-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:22:02Z [load_day 2025-04-11] attempt 1 started
2026-11-08T11:22:03Z [load_day 2025-04-11] 2025-04-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:22:10Z [load_day 2025-04-11] 2025-04-11 hour 0: 199264 events in 0 files, snapshot none (task 6219 ms: download 3630 ms overlapping gunzip 884 ms, parse 3784 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 93519 repo-hours, 1228 releases; waiting 551 ms; commit 0 ms)
2026-11-08T11:22:10Z [load_day 2025-04-11] 2025-04-11 hour 1: 226647 events in 0 files, snapshot none (task 6682 ms: download 3813 ms overlapping gunzip 944 ms, parse 3951 ms, sort 0 ms, write 0 ms, index 905 ms: 6 candidates, 124553 repo-hours, 1055 releases; waiting 583 ms; commit 0 ms)
2026-11-08T11:22:19Z [load_day 2025-04-11] 2025-04-11 hour 2: 192737 events in 0 files, snapshot none (task 8662 ms: download 5569 ms overlapping gunzip 1254 ms, parse 5463 ms, sort 0 ms, write 0 ms, index 665 ms: 9 candidates, 86489 repo-hours, 977 releases; waiting 985 ms; commit 0 ms)
2026-11-08T11:22:19Z [load_day 2025-04-11] 2025-04-11 hour 3: 207635 events in 0 files, snapshot none (task 8082 ms: download 4734 ms overlapping gunzip 1207 ms, parse 5177 ms, sort 0 ms, write 0 ms, index 819 ms: 4 candidates, 86315 repo-hours, 3063 releases; waiting 267 ms; commit 0 ms)
2026-11-08T11:22:27Z [load_day 2025-04-11] 2025-04-11 hour 4: 185090 events in 0 files, snapshot none (task 7626 ms: download 4756 ms overlapping gunzip 1164 ms, parse 5095 ms, sort 0 ms, write 0 ms, index 610 ms: 9 candidates, 72094 repo-hours, 791 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:22:27Z [load_day 2025-04-11] 2025-04-11 hour 5: 197854 events in 0 files, snapshot none (task 7669 ms: download 4709 ms overlapping gunzip 1170 ms, parse 4990 ms, sort 0 ms, write 0 ms, index 592 ms: 0 candidates, 77914 repo-hours, 924 releases; waiting 532 ms; commit 0 ms)
2026-11-08T11:22:36Z [load_day 2025-04-11] 2025-04-11 hour 6: 229546 events in 0 files, snapshot none (task 8319 ms: download 5412 ms overlapping gunzip 1315 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 846 ms: 4 candidates, 102342 repo-hours, 1189 releases; waiting 187 ms; commit 0 ms)
2026-11-08T11:22:38Z [load_day 2025-04-11] 2025-04-11 hour 7: 231852 events in 0 files, snapshot none (task 10691 ms: download 7198 ms overlapping gunzip 1682 ms, parse 7044 ms, sort 0 ms, write 0 ms, index 1242 ms: 3 candidates, 95130 repo-hours, 1123 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:22:47Z [load_day 2025-04-11] 2025-04-11 hour 8: 251223 events in 0 files, snapshot none (task 10430 ms: download 6629 ms overlapping gunzip 1618 ms, parse 7085 ms, sort 0 ms, write 0 ms, index 976 ms: 3 candidates, 103661 repo-hours, 1337 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:22:49Z [load_day 2025-04-11] 2025-04-11 hour 9: 259732 events in 0 files, snapshot none (task 9810 ms: download 6963 ms overlapping gunzip 1540 ms, parse 6594 ms, sort 0 ms, write 0 ms, index 894 ms: 8 candidates, 106671 repo-hours, 1467 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:22:57Z [load_day 2025-04-11] 2025-04-11 hour 10: 240148 events in 0 files, snapshot none (task 9888 ms: download 7049 ms overlapping gunzip 1520 ms, parse 6646 ms, sort 0 ms, write 0 ms, index 745 ms: 10 candidates, 99433 repo-hours, 1235 releases; waiting 685 ms; commit 0 ms)
2026-11-08T11:22:59Z [load_day 2025-04-11] 2025-04-11 hour 11: 238320 events in 0 files, snapshot none (task 9435 ms: download 6763 ms overlapping gunzip 1472 ms, parse 6325 ms, sort 0 ms, write 0 ms, index 779 ms: 9 candidates, 93899 repo-hours, 1224 releases; waiting 543 ms; commit 0 ms)
2026-11-08T11:23:08Z [load_day 2025-04-11] 2025-04-11 hour 12: 274878 events in 0 files, snapshot none (task 10561 ms: download 6069 ms overlapping gunzip 1445 ms, parse 6338 ms, sort 0 ms, write 0 ms, index 1867 ms: 5 candidates, 139225 repo-hours, 1480 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:23:13Z [load_day 2025-04-11] 2025-04-11 hour 13: 266418 events in 0 files, snapshot none (task 13247 ms: download 9858 ms overlapping gunzip 1611 ms, parse 7145 ms, sort 0 ms, write 0 ms, index 1007 ms: 10 candidates, 123757 repo-hours, 1430 releases; waiting 3145 ms; commit 0 ms)
2026-11-08T11:23:21Z [load_day 2025-04-11] 2025-04-11 hour 14: 263063 events in 0 files, snapshot none (task 12003 ms: download 9359 ms overlapping gunzip 2001 ms, parse 8154 ms, sort 0 ms, write 0 ms, index 795 ms: 6 candidates, 110596 repo-hours, 1426 releases; waiting 713 ms; commit 0 ms)
2026-11-08T11:23:25Z [load_day 2025-04-11] 2025-04-11 hour 15: 262807 events in 0 files, snapshot none (task 11619 ms: download 7605 ms overlapping gunzip 1870 ms, parse 7681 ms, sort 0 ms, write 0 ms, index 1364 ms: 9 candidates, 116041 repo-hours, 1484 releases; waiting 326 ms; commit 0 ms)
2026-11-08T11:23:32Z [load_day 2025-04-11] 2025-04-11 hour 16: 247315 events in 0 files, snapshot none (task 10136 ms: download 6620 ms overlapping gunzip 1644 ms, parse 6751 ms, sort 0 ms, write 0 ms, index 1032 ms: 9 candidates, 105582 repo-hours, 1327 releases; waiting 454 ms; commit 0 ms)
2026-11-08T11:23:34Z [load_day 2025-04-11] 2025-04-11 hour 17: 243998 events in 0 files, snapshot none (task 8850 ms: download 6191 ms overlapping gunzip 1364 ms, parse 5893 ms, sort 0 ms, write 0 ms, index 728 ms: 14 candidates, 96636 repo-hours, 1140 releases; waiting 583 ms; commit 0 ms)
2026-11-08T11:23:41Z [load_day 2025-04-11] 2025-04-11 hour 18: 250740 events in 0 files, snapshot none (task 8851 ms: download 5980 ms overlapping gunzip 1423 ms, parse 5725 ms, sort 0 ms, write 0 ms, index 826 ms: 14 candidates, 107309 repo-hours, 1247 releases; waiting 524 ms; commit 0 ms)
2026-11-08T11:23:43Z [load_day 2025-04-11] 2025-04-11 hour 19: 234731 events in 0 files, snapshot none (task 8331 ms: download 5914 ms overlapping gunzip 1282 ms, parse 5603 ms, sort 0 ms, write 0 ms, index 648 ms: 5 candidates, 86800 repo-hours, 1208 releases; waiting 524 ms; commit 0 ms)
2026-11-08T11:23:49Z [load_day 2025-04-11] 2025-04-11 hour 20: 226989 events in 0 files, snapshot none (task 7811 ms: download 4906 ms overlapping gunzip 1222 ms, parse 5040 ms, sort 0 ms, write 0 ms, index 662 ms: 9 candidates, 84397 repo-hours, 1153 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:23:51Z [load_day 2025-04-11] 2025-04-11 hour 21: 211667 events in 0 files, snapshot none (task 6735 ms: download 4333 ms overlapping gunzip 1066 ms, parse 4624 ms, sort 0 ms, write 0 ms, index 605 ms: 6 candidates, 80097 repo-hours, 1274 releases; waiting 179 ms; commit 0 ms)
2026-11-08T11:23:58Z [load_day 2025-04-11] 2025-04-11 hour 22: 184826 events in 0 files, snapshot none (task 8137 ms: download 4194 ms overlapping gunzip 1210 ms, parse 4784 ms, sort 0 ms, write 0 ms, index 1057 ms: 2 candidates, 69868 repo-hours, 1115 releases; waiting 668 ms; commit 0 ms)
2026-11-08T11:23:58Z [load_day 2025-04-11] 2025-04-11 hour 23: 173158 events in 0 files, snapshot none (task 7129 ms: download 3282 ms overlapping gunzip 998 ms, parse 4456 ms, sort 0 ms, write 0 ms, index 879 ms: 5 candidates, 63788 repo-hours, 1163 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:24:09Z [load_day 2025-04-11] 2025-04-11: repo_hour merged from 24 files to 1 (2326116 rows, 10985 ms)
2026-11-08T11:24:12Z [load_day 2025-04-11] 2025-04-11: index committed in 13660 ms (23 + 1 + 24 files)
2026-11-08T11:24:12Z [load_day 2025-04-11] 2025-04-11: 5500638 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:24:12Z [load_day 2025-04-11] attempt 1 succeeded