orcaLog in

Runs · run 3654

load_day 2025-03-10, attempt 1 succeeded

Host
73ccef5e07c2:268156
Started
2026-11-08T10:45:27Z
Ended
2026-11-08T10:47:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
989 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
236.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3654/load_day/2025-03-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:45:27Z [load_day 2025-03-10] attempt 1 started
2026-11-08T10:45:27Z [load_day 2025-03-10] 2025-03-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:45:37Z [load_day 2025-03-10] 2025-03-10 hour 0: 221417 events in 0 files, snapshot none (task 8799 ms: download 6077 ms overlapping gunzip 1372 ms, parse 5928 ms, sort 0 ms, write 0 ms, index 757 ms: 9 candidates, 104697 repo-hours, 1355 releases; waiting 465 ms; commit 0 ms)
2026-11-08T10:45:37Z [load_day 2025-03-10] 2025-03-10 hour 1: 239863 events in 0 files, snapshot none (task 8750 ms: download 5818 ms overlapping gunzip 1453 ms, parse 5652 ms, sort 0 ms, write 0 ms, index 893 ms: 8 candidates, 123080 repo-hours, 932 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:45:51Z [load_day 2025-03-10] 2025-03-10 hour 2: 218729 events in 0 files, snapshot none (task 8969 ms: download 6485 ms overlapping gunzip 1498 ms, parse 5933 ms, sort 0 ms, write 0 ms, index 715 ms: 13 candidates, 86055 repo-hours, 934 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:45:52Z [load_day 2025-03-10] 2025-03-10 hour 3: 229945 events in 0 files, snapshot none (task 9081 ms: download 6642 ms overlapping gunzip 1537 ms, parse 5969 ms, sort 0 ms, write 0 ms, index 696 ms: 15 candidates, 88528 repo-hours, 3827 releases; waiting 555 ms; commit 0 ms)
2026-11-08T10:46:00Z [load_day 2025-03-10] 2025-03-10 hour 4: 210045 events in 0 files, snapshot none (task 8253 ms: download 5741 ms overlapping gunzip 1437 ms, parse 5470 ms, sort 0 ms, write 0 ms, index 641 ms: 21 candidates, 75319 repo-hours, 744 releases; waiting 391 ms; commit 0 ms)
2026-11-08T10:46:01Z [load_day 2025-03-10] 2025-03-10 hour 5: 220119 events in 0 files, snapshot none (task 9261 ms: download 6353 ms overlapping gunzip 1573 ms, parse 5968 ms, sort 0 ms, write 0 ms, index 951 ms: 3 candidates, 81763 repo-hours, 869 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:46:11Z [load_day 2025-03-10] 2025-03-10 hour 6: 249368 events in 0 files, snapshot none (task 9970 ms: download 6240 ms overlapping gunzip 1667 ms, parse 6474 ms, sort 0 ms, write 0 ms, index 1200 ms: 6 candidates, 104890 repo-hours, 1086 releases; waiting 325 ms; commit 0 ms)
2026-11-08T10:46:12Z [load_day 2025-03-10] 2025-03-10 hour 7: 242492 events in 0 files, snapshot none (task 10270 ms: download 7065 ms overlapping gunzip 1816 ms, parse 6953 ms, sort 0 ms, write 0 ms, index 689 ms: 2 candidates, 93817 repo-hours, 933 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:46:23Z [load_day 2025-03-10] 2025-03-10 hour 8: 260106 events in 0 files, snapshot none (task 11234 ms: download 8297 ms overlapping gunzip 2032 ms, parse 7552 ms, sort 0 ms, write 0 ms, index 765 ms: 9 candidates, 104076 repo-hours, 1132 releases; waiting 667 ms; commit 0 ms)
2026-11-08T10:46:24Z [load_day 2025-03-10] 2025-03-10 hour 9: 270513 events in 0 files, snapshot none (task 11564 ms: download 9094 ms overlapping gunzip 2007 ms, parse 7997 ms, sort 0 ms, write 0 ms, index 765 ms: 9 candidates, 111301 repo-hours, 1363 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:46:35Z [load_day 2025-03-10] 2025-03-10 hour 10: 267137 events in 0 files, snapshot none (task 11589 ms: download 8515 ms overlapping gunzip 1982 ms, parse 7859 ms, sort 0 ms, write 0 ms, index 999 ms: 10 candidates, 108678 repo-hours, 1246 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:46:36Z [load_day 2025-03-10] 2025-03-10 hour 11: 259250 events in 0 files, snapshot none (task 11418 ms: download 8421 ms overlapping gunzip 2005 ms, parse 7875 ms, sort 0 ms, write 0 ms, index 776 ms: 14 candidates, 101046 repo-hours, 1244 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:46:45Z [load_day 2025-03-10] 2025-03-10 hour 12: 292993 events in 0 files, snapshot none (task 9129 ms: download 6326 ms overlapping gunzip 1450 ms, parse 5869 ms, sort 0 ms, write 0 ms, index 1033 ms: 15 candidates, 142413 repo-hours, 1347 releases; waiting 547 ms; commit 0 ms)
2026-11-08T10:46:46Z [load_day 2025-03-10] 2025-03-10 hour 13: 283043 events in 0 files, snapshot none (task 8946 ms: download 6293 ms overlapping gunzip 1500 ms, parse 6032 ms, sort 0 ms, write 0 ms, index 888 ms: 14 candidates, 130553 repo-hours, 1377 releases; waiting 276 ms; commit 0 ms)
2026-11-08T10:46:57Z [load_day 2025-03-10] 2025-03-10 hour 14: 278397 events in 0 files, snapshot none (task 11434 ms: download 7690 ms overlapping gunzip 1926 ms, parse 7454 ms, sort 0 ms, write 0 ms, index 951 ms: 8 candidates, 119552 repo-hours, 1363 releases; waiting 877 ms; commit 0 ms)
2026-11-08T10:46:58Z [load_day 2025-03-10] 2025-03-10 hour 15: 281743 events in 0 files, snapshot none (task 11118 ms: download 8024 ms overlapping gunzip 1804 ms, parse 7200 ms, sort 0 ms, write 0 ms, index 979 ms: 8 candidates, 123519 repo-hours, 1477 releases; waiting 840 ms; commit 0 ms)
2026-11-08T10:47:09Z [load_day 2025-03-10] 2025-03-10 hour 16: 276854 events in 0 files, snapshot none (task 11594 ms: download 8272 ms overlapping gunzip 1981 ms, parse 7849 ms, sort 0 ms, write 0 ms, index 943 ms: 10 candidates, 116193 repo-hours, 1374 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:47:09Z [load_day 2025-03-10] 2025-03-10 hour 17: 266925 events in 0 files, snapshot none (task 10180 ms: download 6877 ms overlapping gunzip 1785 ms, parse 6894 ms, sort 0 ms, write 0 ms, index 1024 ms: 14 candidates, 108574 repo-hours, 1386 releases; waiting 188 ms; commit 0 ms)
2026-11-08T10:47:21Z [load_day 2025-03-10] 2025-03-10 hour 18: 269088 events in 0 files, snapshot none (task 11951 ms: download 8658 ms overlapping gunzip 1995 ms, parse 8148 ms, sort 0 ms, write 0 ms, index 918 ms: 11 candidates, 116433 repo-hours, 1295 releases; waiting 563 ms; commit 0 ms)
2026-11-08T10:47:21Z [load_day 2025-03-10] 2025-03-10 hour 19: 255458 events in 0 files, snapshot none (task 11137 ms: download 7946 ms overlapping gunzip 1821 ms, parse 7543 ms, sort 0 ms, write 0 ms, index 1272 ms: 13 candidates, 96854 repo-hours, 1139 releases; waiting 275 ms; commit 0 ms)
2026-11-08T10:47:33Z [load_day 2025-03-10] 2025-03-10 hour 20: 245323 events in 0 files, snapshot none (task 10656 ms: download 8078 ms overlapping gunzip 1769 ms, parse 7371 ms, sort 0 ms, write 0 ms, index 724 ms: 5 candidates, 95252 repo-hours, 1182 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:47:33Z [load_day 2025-03-10] 2025-03-10 hour 21: 238944 events in 0 files, snapshot none (task 10435 ms: download 7541 ms overlapping gunzip 1781 ms, parse 6935 ms, sort 0 ms, write 0 ms, index 785 ms: 6 candidates, 92427 repo-hours, 1260 releases; waiting 381 ms; commit 0 ms)
2026-11-08T10:47:42Z [load_day 2025-03-10] 2025-03-10 hour 22: 227108 events in 0 files, snapshot none (task 8509 ms: download 5997 ms overlapping gunzip 1506 ms, parse 5644 ms, sort 0 ms, write 0 ms, index 692 ms: 14 candidates, 85584 repo-hours, 1217 releases; waiting 383 ms; commit 0 ms)
2026-11-08T10:47:42Z [load_day 2025-03-10] 2025-03-10 hour 23: 206897 events in 0 files, snapshot none (task 8305 ms: download 5608 ms overlapping gunzip 1355 ms, parse 5355 ms, sort 0 ms, write 0 ms, index 803 ms: 9 candidates, 77113 repo-hours, 1186 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:47:52Z [load_day 2025-03-10] 2025-03-10: repo_hour merged from 24 files to 1 (2487717 rows, 10330 ms)
2026-11-08T10:47:55Z [load_day 2025-03-10] 2025-03-10: index committed in 12877 ms (24 + 1 + 24 files)
2026-11-08T10:47:55Z [load_day 2025-03-10] 2025-03-10: 6011757 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:47:55Z [load_day 2025-03-10] attempt 1 succeeded