orcaLog in

Runs · run 4717

load_day 2025-12-15, attempt 1 succeeded

Host
73ccef5e07c2:417048
Started
2026-11-08T14:45:48Z
Ended
2026-11-08T14:46:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
726 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.0 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4717/load_day/2025-12-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:45:48Z [load_day 2025-12-15] attempt 1 started
2026-11-08T14:45:49Z [load_day 2025-12-15] 2025-12-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:45:55Z [load_day 2025-12-15] 2025-12-15 hour 0: 145353 events in 0 files, snapshot none (task 5398 ms: download 2558 ms overlapping gunzip 895 ms, parse 2917 ms, sort 0 ms, write 0 ms, index 895 ms: 9 candidates, 70803 repo-hours, 849 releases; waiting 339 ms; commit 0 ms)
2026-11-08T14:45:55Z [load_day 2025-12-15] 2025-12-15 hour 1: 154155 events in 0 files, snapshot none (task 5654 ms: download 2977 ms overlapping gunzip 913 ms, parse 2926 ms, sort 0 ms, write 0 ms, index 907 ms: 10 candidates, 88541 repo-hours, 668 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:46:00Z [load_day 2025-12-15] 2025-12-15 hour 2: 147155 events in 0 files, snapshot none (task 4604 ms: download 2558 ms overlapping gunzip 729 ms, parse 2468 ms, sort 0 ms, write 0 ms, index 875 ms: 3 candidates, 76769 repo-hours, 563 releases; waiting 209 ms; commit 0 ms)
2026-11-08T14:46:00Z [load_day 2025-12-15] 2025-12-15 hour 3: 141024 events in 0 files, snapshot none (task 4645 ms: download 2687 ms overlapping gunzip 768 ms, parse 2407 ms, sort 0 ms, write 0 ms, index 564 ms: 2 candidates, 62886 repo-hours, 636 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:46:04Z [load_day 2025-12-15] 2025-12-15 hour 4: 146967 events in 0 files, snapshot none (task 3886 ms: download 2783 ms overlapping gunzip 483 ms, parse 1474 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 71779 repo-hours, 1367 releases; waiting 964 ms; commit 0 ms)
2026-11-08T14:46:04Z [load_day 2025-12-15] 2025-12-15 hour 5: 148760 events in 0 files, snapshot none (task 3289 ms: download 1913 ms overlapping gunzip 484 ms, parse 1481 ms, sort 0 ms, write 0 ms, index 620 ms: 7 candidates, 70790 repo-hours, 556 releases; waiting 362 ms; commit 0 ms)
2026-11-08T14:46:09Z [load_day 2025-12-15] 2025-12-15 hour 6: 153984 events in 0 files, snapshot none (task 4313 ms: download 2556 ms overlapping gunzip 584 ms, parse 1678 ms, sort 0 ms, write 0 ms, index 711 ms: 7 candidates, 78370 repo-hours, 576 releases; waiting 857 ms; commit 0 ms)
2026-11-08T14:46:09Z [load_day 2025-12-15] 2025-12-15 hour 7: 145985 events in 0 files, snapshot none (task 4189 ms: download 2894 ms overlapping gunzip 670 ms, parse 1814 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 70379 repo-hours, 564 releases; waiting 692 ms; commit 0 ms)
2026-11-08T14:46:15Z [load_day 2025-12-15] 2025-12-15 hour 8: 149999 events in 0 files, snapshot none (task 4529 ms: download 3017 ms overlapping gunzip 568 ms, parse 1533 ms, sort 0 ms, write 0 ms, index 583 ms: 9 candidates, 77084 repo-hours, 650 releases; waiting 1513 ms; commit 0 ms)
2026-11-08T14:46:15Z [load_day 2025-12-15] 2025-12-15 hour 9: 148833 events in 0 files, snapshot none (task 3894 ms: download 2129 ms overlapping gunzip 542 ms, parse 1468 ms, sort 0 ms, write 0 ms, index 993 ms: 6 candidates, 79272 repo-hours, 417 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:46:18Z [load_day 2025-12-15] 2025-12-15 hour 10: 148810 events in 0 files, snapshot none (task 3418 ms: download 1532 ms overlapping gunzip 660 ms, parse 1909 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 80645 repo-hours, 489 releases; waiting 21 ms; commit 0 ms)
2026-11-08T14:46:18Z [load_day 2025-12-15] 2025-12-15 hour 11: 150926 events in 0 files, snapshot none (task 3254 ms: download 1277 ms overlapping gunzip 577 ms, parse 1742 ms, sort 0 ms, write 0 ms, index 727 ms: 3 candidates, 78227 repo-hours, 561 releases; waiting 18 ms; commit 0 ms)
2026-11-08T14:46:21Z [load_day 2025-12-15] 2025-12-15 hour 12: 156113 events in 0 files, snapshot none (task 2403 ms: download 633 ms overlapping gunzip 367 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 653 ms: 0 candidates, 94338 repo-hours, 410 releases; waiting 25 ms; commit 0 ms)
2026-11-08T14:46:21Z [load_day 2025-12-15] 2025-12-15 hour 13: 164740 events in 0 files, snapshot none (task 2440 ms: download 556 ms overlapping gunzip 382 ms, parse 1106 ms, sort 0 ms, write 0 ms, index 741 ms: 2 candidates, 98011 repo-hours, 295 releases; waiting 17 ms; commit 0 ms)
2026-11-08T14:46:25Z [load_day 2025-12-15] 2025-12-15 hour 14: 149281 events in 0 files, snapshot none (task 3360 ms: download 2189 ms overlapping gunzip 426 ms, parse 1210 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 82755 repo-hours, 468 releases; waiting 799 ms; commit 0 ms)
2026-11-08T14:46:25Z [load_day 2025-12-15] 2025-12-15 hour 15: 152440 events in 0 files, snapshot none (task 2301 ms: download 600 ms overlapping gunzip 340 ms, parse 1065 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 84183 repo-hours, 410 releases; waiting 14 ms; commit 0 ms)
2026-11-08T14:46:28Z [load_day 2025-12-15] 2025-12-15 hour 16: 151354 events in 0 files, snapshot none (task 2565 ms: download 667 ms overlapping gunzip 435 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 614 ms: 9 candidates, 84114 repo-hours, 504 releases; waiting 16 ms; commit 0 ms)
2026-11-08T14:46:28Z [load_day 2025-12-15] 2025-12-15 hour 17: 151088 events in 0 files, snapshot none (task 2309 ms: download 869 ms overlapping gunzip 412 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 557 ms: 8 candidates, 78786 repo-hours, 545 releases; waiting 11 ms; commit 0 ms)
2026-11-08T14:46:32Z [load_day 2025-12-15] 2025-12-15 hour 18: 152461 events in 0 files, snapshot none (task 3385 ms: download 2225 ms overlapping gunzip 367 ms, parse 1109 ms, sort 0 ms, write 0 ms, index 644 ms: 8 candidates, 84734 repo-hours, 568 releases; waiting 946 ms; commit 0 ms)
2026-11-08T14:46:32Z [load_day 2025-12-15] 2025-12-15 hour 19: 148264 events in 0 files, snapshot none (task 2323 ms: download 679 ms overlapping gunzip 388 ms, parse 1155 ms, sort 0 ms, write 0 ms, index 553 ms: 9 candidates, 73044 repo-hours, 732 releases; waiting 18 ms; commit 0 ms)
2026-11-08T14:46:35Z [load_day 2025-12-15] 2025-12-15 hour 20: 145724 events in 0 files, snapshot none (task 2715 ms: download 972 ms overlapping gunzip 519 ms, parse 1408 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 72346 repo-hours, 674 releases; waiting 11 ms; commit 0 ms)
2026-11-08T14:46:36Z [load_day 2025-12-15] 2025-12-15 hour 21: 149313 events in 0 files, snapshot none (task 2995 ms: download 962 ms overlapping gunzip 548 ms, parse 1683 ms, sort 0 ms, write 0 ms, index 516 ms: 5 candidates, 70950 repo-hours, 767 releases; waiting 19 ms; commit 0 ms)
2026-11-08T14:46:39Z [load_day 2025-12-15] 2025-12-15 hour 22: 149844 events in 0 files, snapshot none (task 2999 ms: download 668 ms overlapping gunzip 547 ms, parse 1662 ms, sort 0 ms, write 0 ms, index 560 ms: 8 candidates, 69814 repo-hours, 733 releases; waiting 17 ms; commit 0 ms)
2026-11-08T14:46:39Z [load_day 2025-12-15] 2025-12-15 hour 23: 146002 events in 0 files, snapshot none (task 3151 ms: download 1167 ms overlapping gunzip 594 ms, parse 1733 ms, sort 0 ms, write 0 ms, index 538 ms: 3 candidates, 65799 repo-hours, 714 releases; waiting 17 ms; commit 0 ms)
2026-11-08T14:46:47Z [load_day 2025-12-15] 2025-12-15: repo_hour merged from 24 files to 1 (1864419 rows, 7850 ms)
2026-11-08T14:46:50Z [load_day 2025-12-15] 2025-12-15: index committed in 10348 ms (23 + 1 + 24 files)
2026-11-08T14:46:50Z [load_day 2025-12-15] 2025-12-15: 3598575 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:46:50Z [load_day 2025-12-15] attempt 1 succeeded