orcaLog in

Runs · run 3769

load_day 2025-04-09, attempt 1 succeeded

Host
73ccef5e07c2:285229
Started
2026-11-08T11:19:41Z
Ended
2026-11-08T11:22:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
857 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
213.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3769/load_day/2025-04-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:19:41Z [load_day 2025-04-09] attempt 1 started
2026-11-08T11:19:42Z [load_day 2025-04-09] 2025-04-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:19:49Z [load_day 2025-04-09] 2025-04-09 hour 0: 208598 events in 0 files, snapshot none (task 6593 ms: download 3939 ms overlapping gunzip 957 ms, parse 4091 ms, sort 0 ms, write 0 ms, index 729 ms: 5 candidates, 96786 repo-hours, 1326 releases; waiting 535 ms; commit 0 ms)
2026-11-08T11:19:50Z [load_day 2025-04-09] 2025-04-09 hour 1: 237061 events in 0 files, snapshot none (task 6679 ms: download 3899 ms overlapping gunzip 1037 ms, parse 4269 ms, sort 0 ms, write 0 ms, index 913 ms: 5 candidates, 126390 repo-hours, 969 releases; waiting 187 ms; commit 0 ms)
2026-11-08T11:19:59Z [load_day 2025-04-09] 2025-04-09 hour 2: 201764 events in 0 files, snapshot none (task 8639 ms: download 6014 ms overlapping gunzip 1417 ms, parse 5724 ms, sort 0 ms, write 0 ms, index 711 ms: 9 candidates, 90060 repo-hours, 1063 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:19:59Z [load_day 2025-04-09] 2025-04-09 hour 3: 217131 events in 0 files, snapshot none (task 8472 ms: download 5610 ms overlapping gunzip 1388 ms, parse 5823 ms, sort 0 ms, write 0 ms, index 750 ms: 9 candidates, 90064 repo-hours, 2975 releases; waiting 297 ms; commit 0 ms)
2026-11-08T11:20:07Z [load_day 2025-04-09] 2025-04-09 hour 4: 198129 events in 0 files, snapshot none (task 8125 ms: download 5054 ms overlapping gunzip 1280 ms, parse 5271 ms, sort 0 ms, write 0 ms, index 647 ms: 3 candidates, 77208 repo-hours, 811 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:20:08Z [load_day 2025-04-09] 2025-04-09 hour 5: 211303 events in 0 files, snapshot none (task 8982 ms: download 6265 ms overlapping gunzip 1519 ms, parse 6245 ms, sort 0 ms, write 0 ms, index 632 ms: 2 candidates, 83918 repo-hours, 1056 releases; waiting 353 ms; commit 0 ms)
2026-11-08T11:20:18Z [load_day 2025-04-09] 2025-04-09 hour 6: 239368 events in 0 files, snapshot none (task 9983 ms: download 6894 ms overlapping gunzip 1575 ms, parse 6800 ms, sort 0 ms, write 0 ms, index 788 ms: 5 candidates, 107739 repo-hours, 1077 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:20:19Z [load_day 2025-04-09] 2025-04-09 hour 7: 243120 events in 0 files, snapshot none (task 10463 ms: download 7731 ms overlapping gunzip 1705 ms, parse 7290 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 101227 repo-hours, 1230 releases; waiting 462 ms; commit 0 ms)
2026-11-08T11:20:28Z [load_day 2025-04-09] 2025-04-09 hour 8: 253795 events in 0 files, snapshot none (task 10241 ms: download 7497 ms overlapping gunzip 1554 ms, parse 6957 ms, sort 0 ms, write 0 ms, index 841 ms: 6 candidates, 109691 repo-hours, 1299 releases; waiting 632 ms; commit 0 ms)
2026-11-08T11:20:30Z [load_day 2025-04-09] 2025-04-09 hour 9: 254712 events in 0 files, snapshot none (task 10158 ms: download 7420 ms overlapping gunzip 1569 ms, parse 6976 ms, sort 0 ms, write 0 ms, index 822 ms: 7 candidates, 111961 repo-hours, 1752 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:20:39Z [load_day 2025-04-09] 2025-04-09 hour 10: 241801 events in 0 files, snapshot none (task 10275 ms: download 7035 ms overlapping gunzip 1637 ms, parse 6961 ms, sort 0 ms, write 0 ms, index 883 ms: 14 candidates, 106270 repo-hours, 1268 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:20:41Z [load_day 2025-04-09] 2025-04-09 hour 11: 253613 events in 0 files, snapshot none (task 10518 ms: download 7746 ms overlapping gunzip 1700 ms, parse 7231 ms, sort 0 ms, write 0 ms, index 784 ms: 9 candidates, 103048 repo-hours, 1251 releases; waiting 454 ms; commit 0 ms)
2026-11-08T11:20:52Z [load_day 2025-04-09] 2025-04-09 hour 12: 274616 events in 0 files, snapshot none (task 12597 ms: download 8889 ms overlapping gunzip 2029 ms, parse 8551 ms, sort 0 ms, write 0 ms, index 1215 ms: 3 candidates, 143886 repo-hours, 1381 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:20:53Z [load_day 2025-04-09] 2025-04-09 hour 13: 271064 events in 0 files, snapshot none (task 12032 ms: download 8905 ms overlapping gunzip 1969 ms, parse 8011 ms, sort 0 ms, write 0 ms, index 1183 ms: 13 candidates, 133984 repo-hours, 1455 releases; waiting 457 ms; commit 0 ms)
2026-11-08T11:21:04Z [load_day 2025-04-09] 2025-04-09 hour 14: 260464 events in 0 files, snapshot none (task 11639 ms: download 8822 ms overlapping gunzip 1943 ms, parse 8001 ms, sort 0 ms, write 0 ms, index 881 ms: 3 candidates, 117391 repo-hours, 1513 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:21:06Z [load_day 2025-04-09] 2025-04-09 hour 15: 265095 events in 0 files, snapshot none (task 12342 ms: download 9076 ms overlapping gunzip 1874 ms, parse 8374 ms, sort 0 ms, write 0 ms, index 1213 ms: 8 candidates, 120055 repo-hours, 1592 releases; waiting 639 ms; commit 0 ms)
2026-11-08T11:21:16Z [load_day 2025-04-09] 2025-04-09 hour 16: 260494 events in 0 files, snapshot none (task 11094 ms: download 8111 ms overlapping gunzip 1783 ms, parse 7641 ms, sort 0 ms, write 0 ms, index 840 ms: 6 candidates, 113571 repo-hours, 1417 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:21:17Z [load_day 2025-04-09] 2025-04-09 hour 17: 251858 events in 0 files, snapshot none (task 10067 ms: download 7207 ms overlapping gunzip 1579 ms, parse 6761 ms, sort 0 ms, write 0 ms, index 931 ms: 15 candidates, 104986 repo-hours, 1214 releases; waiting 487 ms; commit 0 ms)
2026-11-08T11:21:27Z [load_day 2025-04-09] 2025-04-09 hour 18: 256809 events in 0 files, snapshot none (task 10129 ms: download 7105 ms overlapping gunzip 1527 ms, parse 7153 ms, sort 0 ms, write 0 ms, index 912 ms: 5 candidates, 116194 repo-hours, 1413 releases; waiting 301 ms; commit 0 ms)
2026-11-08T11:21:28Z [load_day 2025-04-09] 2025-04-09 hour 19: 242319 events in 0 files, snapshot none (task 9867 ms: download 7138 ms overlapping gunzip 1562 ms, parse 6798 ms, sort 0 ms, write 0 ms, index 678 ms: 4 candidates, 96285 repo-hours, 1212 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:21:38Z [load_day 2025-04-09] 2025-04-09 hour 20: 231784 events in 0 files, snapshot none (task 10524 ms: download 7697 ms overlapping gunzip 1399 ms, parse 6254 ms, sort 0 ms, write 0 ms, index 713 ms: 10 candidates, 94429 repo-hours, 1111 releases; waiting 1890 ms; commit 0 ms)
2026-11-08T11:21:38Z [load_day 2025-04-09] 2025-04-09 hour 21: 217992 events in 0 files, snapshot none (task 8514 ms: download 5425 ms overlapping gunzip 1324 ms, parse 5546 ms, sort 0 ms, write 0 ms, index 713 ms: 12 candidates, 89221 repo-hours, 1210 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:21:47Z [load_day 2025-04-09] 2025-04-09 hour 22: 226851 events in 0 files, snapshot none (task 8899 ms: download 5836 ms overlapping gunzip 1261 ms, parse 6068 ms, sort 0 ms, write 0 ms, index 681 ms: 9 candidates, 78355 repo-hours, 1080 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:21:47Z [load_day 2025-04-09] 2025-04-09 hour 23: 234931 events in 0 files, snapshot none (task 8723 ms: download 5489 ms overlapping gunzip 1261 ms, parse 5880 ms, sort 0 ms, write 0 ms, index 739 ms: 7 candidates, 71698 repo-hours, 1162 releases; waiting 541 ms; commit 0 ms)
2026-11-08T11:21:58Z [load_day 2025-04-09] 2025-04-09: repo_hour merged from 24 files to 1 (2484417 rows, 11096 ms)
2026-11-08T11:22:01Z [load_day 2025-04-09] 2025-04-09: index committed in 13496 ms (24 + 1 + 24 files)
2026-11-08T11:22:01Z [load_day 2025-04-09] 2025-04-09: 5754672 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:22:01Z [load_day 2025-04-09] attempt 1 succeeded