orcaLog in

Runs · run 4750

load_day 2025-12-24, attempt 1 succeeded

Host
73ccef5e07c2:421214
Started
2026-11-08T14:50:52Z
Ended
2026-11-08T14:51:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
658 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4750/load_day/2025-12-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:50:52Z [load_day 2025-12-24] attempt 1 started
2026-11-08T14:50:53Z [load_day 2025-12-24] 2025-12-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:50:57Z [load_day 2025-12-24] 2025-12-24 hour 0: 139467 events in 0 files, snapshot none (task 3234 ms: download 2217 ms overlapping gunzip 367 ms, parse 1107 ms, sort 0 ms, write 0 ms, index 646 ms: 10 candidates, 66194 repo-hours, 880 releases; waiting 805 ms; commit 0 ms)
2026-11-08T14:50:57Z [load_day 2025-12-24] 2025-12-24 hour 1: 150714 events in 0 files, snapshot none (task 3246 ms: download 1963 ms overlapping gunzip 354 ms, parse 1171 ms, sort 0 ms, write 0 ms, index 698 ms: 9 candidates, 90146 repo-hours, 645 releases; waiting 714 ms; commit 0 ms)
2026-11-08T14:51:01Z [load_day 2025-12-24] 2025-12-24 hour 2: 141815 events in 0 files, snapshot none (task 3416 ms: download 2172 ms overlapping gunzip 394 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 577 ms: 7 candidates, 73788 repo-hours, 622 releases; waiting 935 ms; commit 0 ms)
2026-11-08T14:51:01Z [load_day 2025-12-24] 2025-12-24 hour 3: 142572 events in 0 files, snapshot none (task 3395 ms: download 2347 ms overlapping gunzip 363 ms, parse 1084 ms, sort 0 ms, write 0 ms, index 567 ms: 2 candidates, 68680 repo-hours, 806 releases; waiting 1079 ms; commit 0 ms)
2026-11-08T14:51:04Z [load_day 2025-12-24] 2025-12-24 hour 4: 140914 events in 0 files, snapshot none (task 2719 ms: download 1653 ms overlapping gunzip 320 ms, parse 1019 ms, sort 0 ms, write 0 ms, index 492 ms: 5 candidates, 63533 repo-hours, 1342 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:51:05Z [load_day 2025-12-24] 2025-12-24 hour 5: 140697 events in 0 files, snapshot none (task 3141 ms: download 2138 ms overlapping gunzip 369 ms, parse 1092 ms, sort 0 ms, write 0 ms, index 523 ms: 4 candidates, 66037 repo-hours, 616 releases; waiting 846 ms; commit 0 ms)
2026-11-08T14:51:08Z [load_day 2025-12-24] 2025-12-24 hour 6: 147932 events in 0 files, snapshot none (task 3199 ms: download 1968 ms overlapping gunzip 359 ms, parse 1098 ms, sort 0 ms, write 0 ms, index 624 ms: 4 candidates, 76738 repo-hours, 686 releases; waiting 780 ms; commit 0 ms)
2026-11-08T14:51:09Z [load_day 2025-12-24] 2025-12-24 hour 7: 146762 events in 0 files, snapshot none (task 3605 ms: download 2645 ms overlapping gunzip 453 ms, parse 1272 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 70440 repo-hours, 595 releases; waiting 1071 ms; commit 0 ms)
2026-11-08T14:51:12Z [load_day 2025-12-24] 2025-12-24 hour 8: 145240 events in 0 files, snapshot none (task 3515 ms: download 2230 ms overlapping gunzip 463 ms, parse 1316 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 72937 repo-hours, 650 releases; waiting 707 ms; commit 0 ms)
2026-11-08T14:51:13Z [load_day 2025-12-24] 2025-12-24 hour 9: 150760 events in 0 files, snapshot none (task 3278 ms: download 2037 ms overlapping gunzip 479 ms, parse 1402 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 71470 repo-hours, 727 releases; waiting 489 ms; commit 0 ms)
2026-11-08T14:51:16Z [load_day 2025-12-24] 2025-12-24 hour 10: 147907 events in 0 files, snapshot none (task 3586 ms: download 2348 ms overlapping gunzip 522 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 644 ms: 4 candidates, 72813 repo-hours, 708 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:51:17Z [load_day 2025-12-24] 2025-12-24 hour 11: 149340 events in 0 files, snapshot none (task 3671 ms: download 2568 ms overlapping gunzip 408 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 70066 repo-hours, 640 releases; waiting 1184 ms; commit 0 ms)
2026-11-08T14:51:21Z [load_day 2025-12-24] 2025-12-24 hour 12: 156711 events in 0 files, snapshot none (task 4163 ms: download 2900 ms overlapping gunzip 416 ms, parse 1365 ms, sort 0 ms, write 0 ms, index 753 ms: 4 candidates, 93187 repo-hours, 664 releases; waiting 1282 ms; commit 0 ms)
2026-11-08T14:51:21Z [load_day 2025-12-24] 2025-12-24 hour 13: 153708 events in 0 files, snapshot none (task 3341 ms: download 2335 ms overlapping gunzip 410 ms, parse 1231 ms, sort 0 ms, write 0 ms, index 604 ms: 8 candidates, 85237 repo-hours, 582 releases; waiting 801 ms; commit 0 ms)
2026-11-08T14:51:25Z [load_day 2025-12-24] 2025-12-24 hour 14: 147442 events in 0 files, snapshot none (task 3551 ms: download 1612 ms overlapping gunzip 539 ms, parse 1746 ms, sort 0 ms, write 0 ms, index 719 ms: 8 candidates, 71089 repo-hours, 684 releases; waiting 258 ms; commit 0 ms)
2026-11-08T14:51:25Z [load_day 2025-12-24] 2025-12-24 hour 15: 150584 events in 0 files, snapshot none (task 3428 ms: download 2024 ms overlapping gunzip 523 ms, parse 1513 ms, sort 0 ms, write 0 ms, index 547 ms: 3 candidates, 75281 repo-hours, 798 releases; waiting 550 ms; commit 0 ms)
2026-11-08T14:51:29Z [load_day 2025-12-24] 2025-12-24 hour 16: 150775 events in 0 files, snapshot none (task 3345 ms: download 1863 ms overlapping gunzip 427 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 675 ms: 6 candidates, 75349 repo-hours, 753 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:51:29Z [load_day 2025-12-24] 2025-12-24 hour 17: 148831 events in 0 files, snapshot none (task 3429 ms: download 2203 ms overlapping gunzip 483 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 525 ms: 5 candidates, 68244 repo-hours, 645 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:51:33Z [load_day 2025-12-24] 2025-12-24 hour 18: 148168 events in 0 files, snapshot none (task 3689 ms: download 2172 ms overlapping gunzip 493 ms, parse 1623 ms, sort 0 ms, write 0 ms, index 630 ms: 3 candidates, 72461 repo-hours, 675 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:51:33Z [load_day 2025-12-24] 2025-12-24 hour 19: 145398 events in 0 files, snapshot none (task 3293 ms: download 2132 ms overlapping gunzip 492 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 490 ms: 4 candidates, 61611 repo-hours, 622 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:51:37Z [load_day 2025-12-24] 2025-12-24 hour 20: 142912 events in 0 files, snapshot none (task 3454 ms: download 2181 ms overlapping gunzip 499 ms, parse 1530 ms, sort 0 ms, write 0 ms, index 517 ms: 6 candidates, 63053 repo-hours, 604 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:51:37Z [load_day 2025-12-24] 2025-12-24 hour 21: 141762 events in 0 files, snapshot none (task 3360 ms: download 2197 ms overlapping gunzip 506 ms, parse 1517 ms, sort 0 ms, write 0 ms, index 445 ms: 5 candidates, 59986 repo-hours, 651 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:51:40Z [load_day 2025-12-24] 2025-12-24 hour 22: 140944 events in 0 files, snapshot none (task 2842 ms: download 1452 ms overlapping gunzip 347 ms, parse 1084 ms, sort 0 ms, write 0 ms, index 822 ms: 5 candidates, 60137 repo-hours, 816 releases; waiting 316 ms; commit 0 ms)
2026-11-08T14:51:41Z [load_day 2025-12-24] 2025-12-24 hour 23: 131276 events in 0 files, snapshot none (task 3749 ms: download 2362 ms overlapping gunzip 357 ms, parse 1245 ms, sort 0 ms, write 0 ms, index 372 ms: 3 candidates, 50454 repo-hours, 762 releases; waiting 1434 ms; commit 0 ms)
2026-11-08T14:51:49Z [load_day 2025-12-24] 2025-12-24: repo_hour merged from 24 files to 1 (1698931 rows, 7525 ms)
2026-11-08T14:51:52Z [load_day 2025-12-24] 2025-12-24: index committed in 10572 ms (24 + 1 + 24 files)
2026-11-08T14:51:52Z [load_day 2025-12-24] 2025-12-24: 3502631 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:51:52Z [load_day 2025-12-24] attempt 1 succeeded