orcaLog in

Runs · run 4758

load_day 2025-12-26, attempt 1 succeeded

Host
73ccef5e07c2:421801
Started
2026-11-08T14:51:53Z
Ended
2026-11-08T14:52:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
660 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.7 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4758/load_day/2025-12-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:51:53Z [load_day 2025-12-26] attempt 1 started
2026-11-08T14:51:54Z [load_day 2025-12-26] 2025-12-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:51:58Z [load_day 2025-12-26] 2025-12-26 hour 0: 134964 events in 0 files, snapshot none (task 3075 ms: download 2036 ms overlapping gunzip 373 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 465 ms: 2 candidates, 64664 repo-hours, 904 releases; waiting 630 ms; commit 0 ms)
2026-11-08T14:51:58Z [load_day 2025-12-26] 2025-12-26 hour 1: 143758 events in 0 files, snapshot none (task 3164 ms: download 2020 ms overlapping gunzip 392 ms, parse 1237 ms, sort 0 ms, write 0 ms, index 611 ms: 5 candidates, 87397 repo-hours, 568 releases; waiting 580 ms; commit 0 ms)
2026-11-08T14:52:02Z [load_day 2025-12-26] 2025-12-26 hour 2: 135944 events in 0 files, snapshot none (task 3413 ms: download 2043 ms overlapping gunzip 355 ms, parse 1248 ms, sort 0 ms, write 0 ms, index 564 ms: 7 candidates, 66487 repo-hours, 707 releases; waiting 795 ms; commit 0 ms)
2026-11-08T14:52:02Z [load_day 2025-12-26] 2025-12-26 hour 3: 138910 events in 0 files, snapshot none (task 3720 ms: download 2395 ms overlapping gunzip 395 ms, parse 1176 ms, sort 0 ms, write 0 ms, index 461 ms: 3 candidates, 63256 repo-hours, 871 releases; waiting 1069 ms; commit 0 ms)
2026-11-08T14:52:05Z [load_day 2025-12-26] 2025-12-26 hour 4: 138490 events in 0 files, snapshot none (task 3011 ms: download 1829 ms overlapping gunzip 299 ms, parse 968 ms, sort 0 ms, write 0 ms, index 477 ms: 4 candidates, 64274 repo-hours, 1547 releases; waiting 718 ms; commit 0 ms)
2026-11-08T14:52:05Z [load_day 2025-12-26] 2025-12-26 hour 5: 142295 events in 0 files, snapshot none (task 2650 ms: download 1716 ms overlapping gunzip 320 ms, parse 1009 ms, sort 0 ms, write 0 ms, index 465 ms: 2 candidates, 62687 repo-hours, 581 releases; waiting 594 ms; commit 0 ms)
2026-11-08T14:52:09Z [load_day 2025-12-26] 2025-12-26 hour 6: 147518 events in 0 files, snapshot none (task 3592 ms: download 2406 ms overlapping gunzip 342 ms, parse 1063 ms, sort 0 ms, write 0 ms, index 586 ms: 5 candidates, 74499 repo-hours, 630 releases; waiting 1205 ms; commit 0 ms)
2026-11-08T14:52:09Z [load_day 2025-12-26] 2025-12-26 hour 7: 142260 events in 0 files, snapshot none (task 3443 ms: download 2416 ms overlapping gunzip 344 ms, parse 1011 ms, sort 0 ms, write 0 ms, index 501 ms: 4 candidates, 63848 repo-hours, 560 releases; waiting 1177 ms; commit 0 ms)
2026-11-08T14:52:13Z [load_day 2025-12-26] 2025-12-26 hour 8: 146271 events in 0 files, snapshot none (task 3463 ms: download 1620 ms overlapping gunzip 511 ms, parse 1609 ms, sort 0 ms, write 0 ms, index 761 ms: 4 candidates, 66615 repo-hours, 708 releases; waiting 258 ms; commit 0 ms)
2026-11-08T14:52:13Z [load_day 2025-12-26] 2025-12-26 hour 9: 148943 events in 0 files, snapshot none (task 3472 ms: download 2289 ms overlapping gunzip 477 ms, parse 1460 ms, sort 0 ms, write 0 ms, index 666 ms: 2 candidates, 72664 repo-hours, 604 releases; waiting 576 ms; commit 0 ms)
2026-11-08T14:52:18Z [load_day 2025-12-26] 2025-12-26 hour 10: 149189 events in 0 files, snapshot none (task 3932 ms: download 1973 ms overlapping gunzip 503 ms, parse 1587 ms, sort 0 ms, write 0 ms, index 838 ms: 4 candidates, 71959 repo-hours, 615 releases; waiting 596 ms; commit 0 ms)
2026-11-08T14:52:18Z [load_day 2025-12-26] 2025-12-26 hour 11: 144906 events in 0 files, snapshot none (task 3770 ms: download 2226 ms overlapping gunzip 549 ms, parse 1669 ms, sort 0 ms, write 0 ms, index 705 ms: 5 candidates, 66902 repo-hours, 537 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:52:22Z [load_day 2025-12-26] 2025-12-26 hour 12: 155683 events in 0 files, snapshot none (task 3539 ms: download 2347 ms overlapping gunzip 470 ms, parse 1429 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 92627 repo-hours, 645 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:52:22Z [load_day 2025-12-26] 2025-12-26 hour 13: 152558 events in 0 files, snapshot none (task 3811 ms: download 2569 ms overlapping gunzip 561 ms, parse 1671 ms, sort 0 ms, write 0 ms, index 764 ms: 8 candidates, 80553 repo-hours, 566 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:52:26Z [load_day 2025-12-26] 2025-12-26 hour 14: 150841 events in 0 files, snapshot none (task 3900 ms: download 2457 ms overlapping gunzip 464 ms, parse 1341 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 73047 repo-hours, 647 releases; waiting 749 ms; commit 0 ms)
2026-11-08T14:52:26Z [load_day 2025-12-26] 2025-12-26 hour 15: 150086 events in 0 files, snapshot none (task 3428 ms: download 1896 ms overlapping gunzip 527 ms, parse 1468 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 73047 repo-hours, 750 releases; waiting 298 ms; commit 0 ms)
2026-11-08T14:52:30Z [load_day 2025-12-26] 2025-12-26 hour 16: 152099 events in 0 files, snapshot none (task 3444 ms: download 1987 ms overlapping gunzip 568 ms, parse 1698 ms, sort 0 ms, write 0 ms, index 636 ms: 3 candidates, 72824 repo-hours, 744 releases; waiting 226 ms; commit 0 ms)
2026-11-08T14:52:30Z [load_day 2025-12-26] 2025-12-26 hour 17: 149559 events in 0 files, snapshot none (task 3395 ms: download 1749 ms overlapping gunzip 536 ms, parse 1742 ms, sort 0 ms, write 0 ms, index 666 ms: 7 candidates, 70003 repo-hours, 656 releases; waiting 188 ms; commit 0 ms)
2026-11-08T14:52:34Z [load_day 2025-12-26] 2025-12-26 hour 18: 144668 events in 0 files, snapshot none (task 3478 ms: download 2260 ms overlapping gunzip 489 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 630 ms: 3 candidates, 69573 repo-hours, 653 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:52:34Z [load_day 2025-12-26] 2025-12-26 hour 19: 148841 events in 0 files, snapshot none (task 3555 ms: download 2220 ms overlapping gunzip 523 ms, parse 1507 ms, sort 0 ms, write 0 ms, index 585 ms: 10 candidates, 65845 repo-hours, 609 releases; waiting 624 ms; commit 0 ms)
2026-11-08T14:52:38Z [load_day 2025-12-26] 2025-12-26 hour 20: 142707 events in 0 files, snapshot none (task 3734 ms: download 2822 ms overlapping gunzip 431 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 452 ms: 4 candidates, 64203 repo-hours, 623 releases; waiting 1170 ms; commit 0 ms)
2026-11-08T14:52:38Z [load_day 2025-12-26] 2025-12-26 hour 21: 145552 events in 0 files, snapshot none (task 3453 ms: download 1744 ms overlapping gunzip 532 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 672 ms: 4 candidates, 62956 repo-hours, 710 releases; waiting 522 ms; commit 0 ms)
2026-11-08T14:52:42Z [load_day 2025-12-26] 2025-12-26 hour 22: 142161 events in 0 files, snapshot none (task 3015 ms: download 1943 ms overlapping gunzip 406 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 517 ms: 2 candidates, 60624 repo-hours, 812 releases; waiting 564 ms; commit 0 ms)
2026-11-08T14:52:42Z [load_day 2025-12-26] 2025-12-26 hour 23: 137720 events in 0 files, snapshot none (task 3281 ms: download 2156 ms overlapping gunzip 472 ms, parse 1483 ms, sort 0 ms, write 0 ms, index 438 ms: 2 candidates, 52454 repo-hours, 791 releases; waiting 559 ms; commit 0 ms)
2026-11-08T14:52:50Z [load_day 2025-12-26] 2025-12-26: repo_hour merged from 24 files to 1 (1663008 rows, 7425 ms)
2026-11-08T14:52:53Z [load_day 2025-12-26] 2025-12-26: index committed in 10901 ms (24 + 1 + 24 files)
2026-11-08T14:52:53Z [load_day 2025-12-26] 2025-12-26: 3485923 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:52:53Z [load_day 2025-12-26] attempt 1 succeeded