orcaLog in

Runs · run 3656

load_day 2025-03-11, attempt 1 succeeded

Host
73ccef5e07c2:268693
Started
2026-11-08T10:46:49Z
Ended
2026-11-08T10:49:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
882 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
218.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3656/load_day/2025-03-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:46:49Z [load_day 2025-03-11] attempt 1 started
2026-11-08T10:46:51Z [load_day 2025-03-11] 2025-03-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:47:01Z [load_day 2025-03-11] 2025-03-11 hour 0: 217561 events in 0 files, snapshot none (task 9465 ms: download 5878 ms overlapping gunzip 1471 ms, parse 6026 ms, sort 0 ms, write 0 ms, index 1258 ms: 9 candidates, 100585 repo-hours, 1344 releases; waiting 231 ms; commit 0 ms)
2026-11-08T10:47:01Z [load_day 2025-03-11] 2025-03-11 hour 1: 232519 events in 0 files, snapshot none (task 8188 ms: download 5198 ms overlapping gunzip 1269 ms, parse 5108 ms, sort 0 ms, write 0 ms, index 1143 ms: 11 candidates, 125545 repo-hours, 1019 releases; waiting 450 ms; commit 0 ms)
2026-11-08T10:47:10Z [load_day 2025-03-11] 2025-03-11 hour 2: 209683 events in 0 files, snapshot none (task 8224 ms: download 5460 ms overlapping gunzip 1294 ms, parse 5511 ms, sort 0 ms, write 0 ms, index 665 ms: 6 candidates, 92323 repo-hours, 961 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:47:11Z [load_day 2025-03-11] 2025-03-11 hour 3: 218089 events in 0 files, snapshot none (task 9535 ms: download 6948 ms overlapping gunzip 1119 ms, parse 4847 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 90367 repo-hours, 3988 releases; waiting 2581 ms; commit 0 ms)
2026-11-08T10:47:17Z [load_day 2025-03-11] 2025-03-11 hour 4: 203723 events in 0 files, snapshot none (task 7499 ms: download 4231 ms overlapping gunzip 1171 ms, parse 4787 ms, sort 0 ms, write 0 ms, index 756 ms: 9 candidates, 77323 repo-hours, 812 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:47:22Z [load_day 2025-03-11] 2025-03-11 hour 5: 212931 events in 0 files, snapshot none (task 10281 ms: download 7039 ms overlapping gunzip 1306 ms, parse 5617 ms, sort 0 ms, write 0 ms, index 683 ms: 5 candidates, 83270 repo-hours, 844 releases; waiting 2385 ms; commit 0 ms)
2026-11-08T10:47:27Z [load_day 2025-03-11] 2025-03-11 hour 6: 233839 events in 0 files, snapshot none (task 9067 ms: download 4670 ms overlapping gunzip 1328 ms, parse 5577 ms, sort 0 ms, write 0 ms, index 1406 ms: 9 candidates, 105555 repo-hours, 1073 releases; waiting 473 ms; commit 0 ms)
2026-11-08T10:47:31Z [load_day 2025-03-11] 2025-03-11 hour 7: 233606 events in 0 files, snapshot none (task 8920 ms: download 5755 ms overlapping gunzip 1448 ms, parse 5945 ms, sort 0 ms, write 0 ms, index 968 ms: 5 candidates, 94546 repo-hours, 977 releases; waiting 354 ms; commit 0 ms)
2026-11-08T10:47:38Z [load_day 2025-03-11] 2025-03-11 hour 8: 249601 events in 0 files, snapshot none (task 9813 ms: download 5739 ms overlapping gunzip 1476 ms, parse 6543 ms, sort 0 ms, write 0 ms, index 1199 ms: 8 candidates, 105119 repo-hours, 1349 releases; waiting 295 ms; commit 0 ms)
2026-11-08T10:47:41Z [load_day 2025-03-11] 2025-03-11 hour 9: 262043 events in 0 files, snapshot none (task 9826 ms: download 6882 ms overlapping gunzip 1521 ms, parse 6380 ms, sort 0 ms, write 0 ms, index 993 ms: 4 candidates, 113270 repo-hours, 1391 releases; waiting 633 ms; commit 0 ms)
2026-11-08T10:47:48Z [load_day 2025-03-11] 2025-03-11 hour 10: 261313 events in 0 files, snapshot none (task 8432 ms: download 5645 ms overlapping gunzip 1266 ms, parse 5470 ms, sort 0 ms, write 0 ms, index 863 ms: 9 candidates, 110039 repo-hours, 1277 releases; waiting 477 ms; commit 0 ms)
2026-11-08T10:47:50Z [load_day 2025-03-11] 2025-03-11 hour 11: 256854 events in 0 files, snapshot none (task 8645 ms: download 5895 ms overlapping gunzip 1300 ms, parse 5361 ms, sort 0 ms, write 0 ms, index 851 ms: 11 candidates, 105624 repo-hours, 1181 releases; waiting 814 ms; commit 0 ms)
2026-11-08T10:47:57Z [load_day 2025-03-11] 2025-03-11 hour 12: 289414 events in 0 files, snapshot none (task 8367 ms: download 5364 ms overlapping gunzip 1232 ms, parse 5294 ms, sort 0 ms, write 0 ms, index 1076 ms: 11 candidates, 146181 repo-hours, 1269 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:48:01Z [load_day 2025-03-11] 2025-03-11 hour 13: 283594 events in 0 files, snapshot none (task 10196 ms: download 5954 ms overlapping gunzip 1433 ms, parse 6102 ms, sort 0 ms, write 0 ms, index 1980 ms: 10 candidates, 135370 repo-hours, 1365 releases; waiting 421 ms; commit 0 ms)
2026-11-08T10:48:10Z [load_day 2025-03-11] 2025-03-11 hour 14: 277831 events in 0 files, snapshot none (task 12632 ms: download 9071 ms overlapping gunzip 1944 ms, parse 8434 ms, sort 0 ms, write 0 ms, index 1245 ms: 8 candidates, 120321 repo-hours, 1439 releases; waiting 529 ms; commit 0 ms)
2026-11-08T10:48:14Z [load_day 2025-03-11] 2025-03-11 hour 15: 280789 events in 0 files, snapshot none (task 12220 ms: download 8141 ms overlapping gunzip 1925 ms, parse 8165 ms, sort 0 ms, write 0 ms, index 1145 ms: 30 candidates, 125500 repo-hours, 1514 releases; waiting 636 ms; commit 0 ms)
2026-11-08T10:48:22Z [load_day 2025-03-11] 2025-03-11 hour 16: 274820 events in 0 files, snapshot none (task 11575 ms: download 7663 ms overlapping gunzip 1765 ms, parse 7755 ms, sort 0 ms, write 0 ms, index 1343 ms: 14 candidates, 118754 repo-hours, 1406 releases; waiting 453 ms; commit 0 ms)
2026-11-08T10:48:26Z [load_day 2025-03-11] 2025-03-11 hour 17: 271916 events in 0 files, snapshot none (task 11656 ms: download 8668 ms overlapping gunzip 1812 ms, parse 7607 ms, sort 0 ms, write 0 ms, index 1053 ms: 10 candidates, 110309 repo-hours, 1314 releases; waiting 897 ms; commit 0 ms)
2026-11-08T10:48:33Z [load_day 2025-03-11] 2025-03-11 hour 18: 266394 events in 0 files, snapshot none (task 10695 ms: download 7274 ms overlapping gunzip 1699 ms, parse 7290 ms, sort 0 ms, write 0 ms, index 917 ms: 7 candidates, 117787 repo-hours, 1237 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:48:37Z [load_day 2025-03-11] 2025-03-11 hour 19: 251733 events in 0 files, snapshot none (task 10645 ms: download 7275 ms overlapping gunzip 1632 ms, parse 6718 ms, sort 0 ms, write 0 ms, index 1502 ms: 7 candidates, 96946 repo-hours, 1267 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:48:44Z [load_day 2025-03-11] 2025-03-11 hour 20: 244021 events in 0 files, snapshot none (task 10409 ms: download 7268 ms overlapping gunzip 1737 ms, parse 6967 ms, sort 0 ms, write 0 ms, index 925 ms: 12 candidates, 97588 repo-hours, 1232 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:48:47Z [load_day 2025-03-11] 2025-03-11 hour 21: 239888 events in 0 files, snapshot none (task 8930 ms: download 6341 ms overlapping gunzip 1461 ms, parse 5641 ms, sort 0 ms, write 0 ms, index 810 ms: 4 candidates, 93262 repo-hours, 1305 releases; waiting 764 ms; commit 0 ms)
2026-11-08T10:48:54Z [load_day 2025-03-11] 2025-03-11 hour 22: 218057 events in 0 files, snapshot none (task 9320 ms: download 6024 ms overlapping gunzip 1511 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 776 ms: 10 candidates, 82685 repo-hours, 1290 releases; waiting 882 ms; commit 0 ms)
2026-11-08T10:48:56Z [load_day 2025-03-11] 2025-03-11 hour 23: 206269 events in 0 files, snapshot none (task 8344 ms: download 5711 ms overlapping gunzip 1333 ms, parse 5470 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 77106 repo-hours, 1135 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:49:07Z [load_day 2025-03-11] 2025-03-11: repo_hour merged from 24 files to 1 (2525375 rows, 10911 ms)
2026-11-08T10:49:10Z [load_day 2025-03-11] 2025-03-11: index committed in 14407 ms (24 + 1 + 24 files)
2026-11-08T10:49:10Z [load_day 2025-03-11] 2025-03-11: 5896488 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:49:10Z [load_day 2025-03-11] attempt 1 succeeded