orcaLog in

Runs · run 3612

load_day 2025-02-27, attempt 1 succeeded

Host
73ccef5e07c2:262393
Started
2026-11-08T10:33:56Z
Ended
2026-11-08T10:36:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
951 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
210.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3612/load_day/2025-02-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:33:56Z [load_day 2025-02-27] attempt 1 started
2026-11-08T10:33:57Z [load_day 2025-02-27] 2025-02-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:34:06Z [load_day 2025-02-27] 2025-02-27 hour 0: 218678 events in 0 files, snapshot none (task 8115 ms: download 4762 ms overlapping gunzip 1234 ms, parse 5233 ms, sort 0 ms, write 0 ms, index 828 ms: 14 candidates, 101476 repo-hours, 1282 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:34:06Z [load_day 2025-02-27] 2025-02-27 hour 1: 235095 events in 0 files, snapshot none (task 8047 ms: download 4699 ms overlapping gunzip 1179 ms, parse 5004 ms, sort 0 ms, write 0 ms, index 1065 ms: 20 candidates, 126232 repo-hours, 1042 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:34:15Z [load_day 2025-02-27] 2025-02-27 hour 2: 210333 events in 0 files, snapshot none (task 8076 ms: download 5428 ms overlapping gunzip 1333 ms, parse 5297 ms, sort 0 ms, write 0 ms, index 699 ms: 9 candidates, 92654 repo-hours, 928 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:34:15Z [load_day 2025-02-27] 2025-02-27 hour 3: 223940 events in 0 files, snapshot none (task 7966 ms: download 5346 ms overlapping gunzip 1231 ms, parse 5439 ms, sort 0 ms, write 0 ms, index 675 ms: 13 candidates, 90875 repo-hours, 3952 releases; waiting 424 ms; commit 0 ms)
2026-11-08T10:34:24Z [load_day 2025-02-27] 2025-02-27 hour 4: 204175 events in 0 files, snapshot none (task 8164 ms: download 4884 ms overlapping gunzip 1393 ms, parse 5483 ms, sort 0 ms, write 0 ms, index 680 ms: 4 candidates, 76633 repo-hours, 796 releases; waiting 379 ms; commit 0 ms)
2026-11-08T10:34:25Z [load_day 2025-02-27] 2025-02-27 hour 5: 221814 events in 0 files, snapshot none (task 9334 ms: download 6405 ms overlapping gunzip 1525 ms, parse 6250 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 83571 repo-hours, 847 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:34:35Z [load_day 2025-02-27] 2025-02-27 hour 6: 246951 events in 0 files, snapshot none (task 10678 ms: download 7476 ms overlapping gunzip 1565 ms, parse 6549 ms, sort 0 ms, write 0 ms, index 788 ms: 6 candidates, 104879 repo-hours, 1004 releases; waiting 1509 ms; commit 0 ms)
2026-11-08T10:34:35Z [load_day 2025-02-27] 2025-02-27 hour 7: 243300 events in 0 files, snapshot none (task 9264 ms: download 5826 ms overlapping gunzip 1466 ms, parse 6278 ms, sort 0 ms, write 0 ms, index 918 ms: 7 candidates, 94982 repo-hours, 967 releases; waiting 323 ms; commit 0 ms)
2026-11-08T10:34:44Z [load_day 2025-02-27] 2025-02-27 hour 8: 256662 events in 0 files, snapshot none (task 9243 ms: download 6214 ms overlapping gunzip 1386 ms, parse 6188 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 104359 repo-hours, 1300 releases; waiting 593 ms; commit 0 ms)
2026-11-08T10:34:45Z [load_day 2025-02-27] 2025-02-27 hour 9: 266383 events in 0 files, snapshot none (task 9486 ms: download 6421 ms overlapping gunzip 1585 ms, parse 6515 ms, sort 0 ms, write 0 ms, index 794 ms: 12 candidates, 110963 repo-hours, 1379 releases; waiting 243 ms; commit 0 ms)
2026-11-08T10:34:54Z [load_day 2025-02-27] 2025-02-27 hour 10: 258869 events in 0 files, snapshot none (task 9151 ms: download 5970 ms overlapping gunzip 1483 ms, parse 5911 ms, sort 0 ms, write 0 ms, index 959 ms: 5 candidates, 105875 repo-hours, 1280 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:34:55Z [load_day 2025-02-27] 2025-02-27 hour 11: 252236 events in 0 files, snapshot none (task 9439 ms: download 6122 ms overlapping gunzip 1513 ms, parse 6387 ms, sort 0 ms, write 0 ms, index 834 ms: 12 candidates, 100849 repo-hours, 1183 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:35:03Z [load_day 2025-02-27] 2025-02-27 hour 12: 285480 events in 0 files, snapshot none (task 8923 ms: download 5959 ms overlapping gunzip 1358 ms, parse 5714 ms, sort 0 ms, write 0 ms, index 1051 ms: 14 candidates, 144881 repo-hours, 1302 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:35:04Z [load_day 2025-02-27] 2025-02-27 hour 13: 274903 events in 0 files, snapshot none (task 8771 ms: download 5920 ms overlapping gunzip 1290 ms, parse 5742 ms, sort 0 ms, write 0 ms, index 923 ms: 10 candidates, 128637 repo-hours, 1238 releases; waiting 477 ms; commit 0 ms)
2026-11-08T10:35:13Z [load_day 2025-02-27] 2025-02-27 hour 14: 273099 events in 0 files, snapshot none (task 8561 ms: download 5932 ms overlapping gunzip 1355 ms, parse 5563 ms, sort 0 ms, write 0 ms, index 848 ms: 14 candidates, 116143 repo-hours, 1406 releases; waiting 523 ms; commit 0 ms)
2026-11-08T10:35:13Z [load_day 2025-02-27] 2025-02-27 hour 15: 276301 events in 0 files, snapshot none (task 8621 ms: download 5804 ms overlapping gunzip 1306 ms, parse 5532 ms, sort 0 ms, write 0 ms, index 938 ms: 19 candidates, 123284 repo-hours, 1496 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:35:25Z [load_day 2025-02-27] 2025-02-27 hour 16: 269765 events in 0 files, snapshot none (task 12214 ms: download 9293 ms overlapping gunzip 2054 ms, parse 8213 ms, sort 0 ms, write 0 ms, index 901 ms: 17 candidates, 116028 repo-hours, 1323 releases; waiting 696 ms; commit 0 ms)
2026-11-08T10:35:25Z [load_day 2025-02-27] 2025-02-27 hour 17: 259605 events in 0 files, snapshot none (task 11157 ms: download 8605 ms overlapping gunzip 1885 ms, parse 7774 ms, sort 0 ms, write 0 ms, index 754 ms: 17 candidates, 106424 repo-hours, 1368 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:35:36Z [load_day 2025-02-27] 2025-02-27 hour 18: 262437 events in 0 files, snapshot none (task 10260 ms: download 6465 ms overlapping gunzip 1644 ms, parse 6709 ms, sort 0 ms, write 0 ms, index 1207 ms: 13 candidates, 117910 repo-hours, 1451 releases; waiting 347 ms; commit 0 ms)
2026-11-08T10:35:36Z [load_day 2025-02-27] 2025-02-27 hour 19: 239217 events in 0 files, snapshot none (task 10468 ms: download 6651 ms overlapping gunzip 1708 ms, parse 6964 ms, sort 0 ms, write 0 ms, index 952 ms: 13 candidates, 94813 repo-hours, 1101 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:35:46Z [load_day 2025-02-27] 2025-02-27 hour 20: 232206 events in 0 files, snapshot none (task 9569 ms: download 6421 ms overlapping gunzip 1571 ms, parse 6340 ms, sort 0 ms, write 0 ms, index 825 ms: 20 candidates, 93164 repo-hours, 1160 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:35:46Z [load_day 2025-02-27] 2025-02-27 hour 21: 227657 events in 0 files, snapshot none (task 9201 ms: download 6172 ms overlapping gunzip 1568 ms, parse 6349 ms, sort 0 ms, write 0 ms, index 802 ms: 18 candidates, 91896 repo-hours, 1239 releases; waiting 204 ms; commit 0 ms)
2026-11-08T10:35:56Z [load_day 2025-02-27] 2025-02-27 hour 22: 212752 events in 0 files, snapshot none (task 8940 ms: download 6183 ms overlapping gunzip 1441 ms, parse 5996 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 82437 repo-hours, 1331 releases; waiting 542 ms; commit 0 ms)
2026-11-08T10:35:56Z [load_day 2025-02-27] 2025-02-27 hour 23: 199986 events in 0 files, snapshot none (task 7883 ms: download 4663 ms overlapping gunzip 1300 ms, parse 5304 ms, sort 0 ms, write 0 ms, index 766 ms: 17 candidates, 76585 repo-hours, 1220 releases; waiting 184 ms; commit 0 ms)
2026-11-08T10:36:06Z [load_day 2025-02-27] 2025-02-27: repo_hour merged from 24 files to 1 (2485550 rows, 10470 ms)
2026-11-08T10:36:09Z [load_day 2025-02-27] 2025-02-27: index committed in 13427 ms (24 + 1 + 24 files)
2026-11-08T10:36:09Z [load_day 2025-02-27] 2025-02-27: 5851844 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:36:09Z [load_day 2025-02-27] attempt 1 succeeded