orcaLog in

Runs · run 3561

load_day 2025-02-14, attempt 1 succeeded

Host
73ccef5e07c2:255272
Started
2026-11-08T10:20:13Z
Ended
2026-11-08T10:22:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
836 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.9 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3561/load_day/2025-02-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:20:13Z [load_day 2025-02-14] attempt 1 started
2026-11-08T10:20:14Z [load_day 2025-02-14] 2025-02-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:20:24Z [load_day 2025-02-14] 2025-02-14 hour 0: 224372 events in 0 files, snapshot none (task 9916 ms: download 6414 ms overlapping gunzip 1490 ms, parse 6250 ms, sort 0 ms, write 0 ms, index 1291 ms: 8 candidates, 108370 repo-hours, 1457 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:20:24Z [load_day 2025-02-14] 2025-02-14 hour 1: 238711 events in 0 files, snapshot none (task 10066 ms: download 6650 ms overlapping gunzip 1541 ms, parse 6426 ms, sort 0 ms, write 0 ms, index 1417 ms: 5 candidates, 130081 repo-hours, 1231 releases; waiting 468 ms; commit 0 ms)
2026-11-08T10:20:34Z [load_day 2025-02-14] 2025-02-14 hour 2: 207372 events in 0 files, snapshot none (task 9037 ms: download 5772 ms overlapping gunzip 1403 ms, parse 6164 ms, sort 0 ms, write 0 ms, index 746 ms: 11 candidates, 92676 repo-hours, 1007 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:20:34Z [load_day 2025-02-14] 2025-02-14 hour 3: 218792 events in 0 files, snapshot none (task 9184 ms: download 6133 ms overlapping gunzip 1473 ms, parse 6116 ms, sort 0 ms, write 0 ms, index 793 ms: 5 candidates, 87797 repo-hours, 3988 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:20:43Z [load_day 2025-02-14] 2025-02-14 hour 4: 214091 events in 0 files, snapshot none (task 8626 ms: download 5210 ms overlapping gunzip 1353 ms, parse 5592 ms, sort 0 ms, write 0 ms, index 890 ms: 7 candidates, 72723 repo-hours, 775 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:20:44Z [load_day 2025-02-14] 2025-02-14 hour 5: 222944 events in 0 files, snapshot none (task 8868 ms: download 5625 ms overlapping gunzip 1511 ms, parse 6163 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 77418 repo-hours, 891 releases; waiting 269 ms; commit 0 ms)
2026-11-08T10:20:52Z [load_day 2025-02-14] 2025-02-14 hour 6: 243106 events in 0 files, snapshot none (task 7898 ms: download 4298 ms overlapping gunzip 1159 ms, parse 4906 ms, sort 0 ms, write 0 ms, index 1199 ms: 4 candidates, 98893 repo-hours, 1047 releases; waiting 294 ms; commit 0 ms)
2026-11-08T10:20:53Z [load_day 2025-02-14] 2025-02-14 hour 7: 240858 events in 0 files, snapshot none (task 8444 ms: download 4770 ms overlapping gunzip 1406 ms, parse 5795 ms, sort 0 ms, write 0 ms, index 786 ms: 6 candidates, 87985 repo-hours, 1027 releases; waiting 199 ms; commit 0 ms)
2026-11-08T10:21:00Z [load_day 2025-02-14] 2025-02-14 hour 8: 252466 events in 0 files, snapshot none (task 7990 ms: download 5339 ms overlapping gunzip 1310 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 784 ms: 13 candidates, 97250 repo-hours, 1158 releases; waiting 266 ms; commit 0 ms)
2026-11-08T10:21:03Z [load_day 2025-02-14] 2025-02-14 hour 9: 264836 events in 0 files, snapshot none (task 9303 ms: download 5832 ms overlapping gunzip 1428 ms, parse 5647 ms, sort 0 ms, write 0 ms, index 1220 ms: 10 candidates, 104714 repo-hours, 1473 releases; waiting 607 ms; commit 0 ms)
2026-11-08T10:21:11Z [load_day 2025-02-14] 2025-02-14 hour 10: 258759 events in 0 files, snapshot none (task 9866 ms: download 6839 ms overlapping gunzip 1551 ms, parse 6384 ms, sort 0 ms, write 0 ms, index 1047 ms: 13 candidates, 99073 repo-hours, 1222 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:21:12Z [load_day 2025-02-14] 2025-02-14 hour 11: 252345 events in 0 files, snapshot none (task 9154 ms: download 5714 ms overlapping gunzip 1424 ms, parse 5959 ms, sort 0 ms, write 0 ms, index 926 ms: 13 candidates, 93305 repo-hours, 1118 releases; waiting 244 ms; commit 0 ms)
2026-11-08T10:21:20Z [load_day 2025-02-14] 2025-02-14 hour 12: 287307 events in 0 files, snapshot none (task 8821 ms: download 5910 ms overlapping gunzip 1330 ms, parse 5651 ms, sort 0 ms, write 0 ms, index 883 ms: 4 candidates, 130684 repo-hours, 1205 releases; waiting 619 ms; commit 0 ms)
2026-11-08T10:21:22Z [load_day 2025-02-14] 2025-02-14 hour 13: 270419 events in 0 files, snapshot none (task 9038 ms: download 6460 ms overlapping gunzip 1368 ms, parse 5859 ms, sort 0 ms, write 0 ms, index 780 ms: 16 candidates, 111884 repo-hours, 1244 releases; waiting 782 ms; commit 0 ms)
2026-11-08T10:21:33Z [load_day 2025-02-14] 2025-02-14 hour 14: 257587 events in 0 files, snapshot none (task 12575 ms: download 9914 ms overlapping gunzip 1293 ms, parse 5419 ms, sort 0 ms, write 0 ms, index 794 ms: 8 candidates, 101335 repo-hours, 1315 releases; waiting 4757 ms; commit 0 ms)
2026-11-08T10:21:33Z [load_day 2025-02-14] 2025-02-14 hour 15: 266095 events in 0 files, snapshot none (task 7528 ms: download 4962 ms overlapping gunzip 1220 ms, parse 5068 ms, sort 0 ms, write 0 ms, index 765 ms: 8 candidates, 108344 repo-hours, 1435 releases; waiting 191 ms; commit 0 ms)
2026-11-08T10:21:44Z [load_day 2025-02-14] 2025-02-14 hour 16: 247211 events in 0 files, snapshot none (task 10048 ms: download 6882 ms overlapping gunzip 1573 ms, parse 6624 ms, sort 0 ms, write 0 ms, index 998 ms: 14 candidates, 100363 repo-hours, 1497 releases; waiting 554 ms; commit 0 ms)
2026-11-08T10:21:44Z [load_day 2025-02-14] 2025-02-14 hour 17: 230608 events in 0 files, snapshot none (task 9172 ms: download 6271 ms overlapping gunzip 1474 ms, parse 6086 ms, sort 0 ms, write 0 ms, index 818 ms: 5 candidates, 91028 repo-hours, 1434 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:21:54Z [load_day 2025-02-14] 2025-02-14 hour 18: 241620 events in 0 files, snapshot none (task 9728 ms: download 7150 ms overlapping gunzip 1631 ms, parse 6590 ms, sort 0 ms, write 0 ms, index 786 ms: 6 candidates, 104546 repo-hours, 1492 releases; waiting 478 ms; commit 0 ms)
2026-11-08T10:21:54Z [load_day 2025-02-14] 2025-02-14 hour 19: 216894 events in 0 files, snapshot none (task 8392 ms: download 5365 ms overlapping gunzip 1403 ms, parse 5766 ms, sort 0 ms, write 0 ms, index 637 ms: 14 candidates, 81186 repo-hours, 1240 releases; waiting 230 ms; commit 0 ms)
2026-11-08T10:22:03Z [load_day 2025-02-14] 2025-02-14 hour 20: 205257 events in 0 files, snapshot none (task 8134 ms: download 5282 ms overlapping gunzip 1204 ms, parse 5210 ms, sort 0 ms, write 0 ms, index 601 ms: 4 candidates, 78464 repo-hours, 1141 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:22:03Z [load_day 2025-02-14] 2025-02-14 hour 21: 207730 events in 0 files, snapshot none (task 7567 ms: download 5115 ms overlapping gunzip 1188 ms, parse 4908 ms, sort 0 ms, write 0 ms, index 620 ms: 10 candidates, 81249 repo-hours, 1135 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:22:15Z [load_day 2025-02-14] 2025-02-14 hour 22: 191613 events in 0 files, snapshot none (task 7246 ms: download 4725 ms overlapping gunzip 1094 ms, parse 4675 ms, sort 0 ms, write 0 ms, index 662 ms: 13 candidates, 71947 repo-hours, 1190 releases; waiting 548 ms; commit 0 ms)
2026-11-08T10:22:15Z [load_day 2025-02-14] 2025-02-14 hour 23: 180590 events in 0 files, snapshot none (task 6819 ms: download 3677 ms overlapping gunzip 1047 ms, parse 4277 ms, sort 0 ms, write 0 ms, index 688 ms: 7 candidates, 67127 repo-hours, 937 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:22:25Z [load_day 2025-02-14] 2025-02-14: repo_hour merged from 24 files to 1 (2278442 rows, 9883 ms)
2026-11-08T10:22:28Z [load_day 2025-02-14] 2025-02-14: index committed in 12827 ms (24 + 1 + 24 files)
2026-11-08T10:22:28Z [load_day 2025-02-14] 2025-02-14: 5641583 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:22:28Z [load_day 2025-02-14] attempt 1 succeeded