load_day 2025-12-30, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:423334

Started

2026-11-08T14:53:55Z

Ended

2026-11-08T14:54:57Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

664 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

71.6 s, up to 2.3 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/4768/load_day/2025-12-30/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T14:53:55Z [load_day 2025-12-30] attempt 1 started
2026-11-08T14:53:56Z [load_day 2025-12-30] 2025-12-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:54:02Z [load_day 2025-12-30] 2025-12-30 hour 0: 138995 events in 0 files, snapshot none (task 3442 ms: download 2011 ms overlapping gunzip 511 ms, parse 1623 ms, sort 0 ms, write 0 ms, index 592 ms: 6 candidates, 66359 repo-hours, 825 releases; waiting 361 ms; commit 0 ms)
2026-11-08T14:54:02Z [load_day 2025-12-30] 2025-12-30 hour 1: 149837 events in 0 files, snapshot none (task 3697 ms: download 2083 ms overlapping gunzip 438 ms, parse 1511 ms, sort 0 ms, write 0 ms, index 795 ms: 4 candidates, 86275 repo-hours, 735 releases; waiting 671 ms; commit 0 ms)
2026-11-08T14:54:05Z [load_day 2025-12-30] 2025-12-30 hour 2: 145366 events in 0 files, snapshot none (task 3277 ms: download 2249 ms overlapping gunzip 394 ms, parse 1187 ms, sort 0 ms, write 0 ms, index 587 ms: 8 candidates, 71518 repo-hours, 648 releases; waiting 820 ms; commit 0 ms)
2026-11-08T14:54:06Z [load_day 2025-12-30] 2025-12-30 hour 3: 142062 events in 0 files, snapshot none (task 3539 ms: download 2498 ms overlapping gunzip 368 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 486 ms: 7 candidates, 64735 repo-hours, 746 releases; waiting 1212 ms; commit 0 ms)
2026-11-08T14:54:09Z [load_day 2025-12-30] 2025-12-30 hour 4: 141542 events in 0 files, snapshot none (task 2486 ms: download 1541 ms overlapping gunzip 325 ms, parse 1055 ms, sort 0 ms, write 0 ms, index 556 ms: 5 candidates, 65931 repo-hours, 1446 releases; waiting 279 ms; commit 0 ms)
2026-11-08T14:54:09Z [load_day 2025-12-30] 2025-12-30 hour 5: 144570 events in 0 files, snapshot none (task 3044 ms: download 1983 ms overlapping gunzip 391 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 65293 repo-hours, 574 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:54:13Z [load_day 2025-12-30] 2025-12-30 hour 6: 146755 events in 0 files, snapshot none (task 3569 ms: download 2415 ms overlapping gunzip 366 ms, parse 1136 ms, sort 0 ms, write 0 ms, index 543 ms: 7 candidates, 71635 repo-hours, 674 releases; waiting 1164 ms; commit 0 ms)
2026-11-08T14:54:13Z [load_day 2025-12-30] 2025-12-30 hour 7: 146693 events in 0 files, snapshot none (task 3382 ms: download 2007 ms overlapping gunzip 359 ms, parse 1091 ms, sort 0 ms, write 0 ms, index 552 ms: 6 candidates, 66534 repo-hours, 604 releases; waiting 915 ms; commit 0 ms)
2026-11-08T14:54:17Z [load_day 2025-12-30] 2025-12-30 hour 8: 147704 events in 0 files, snapshot none (task 4061 ms: download 2483 ms overlapping gunzip 543 ms, parse 1571 ms, sort 0 ms, write 0 ms, index 663 ms: 7 candidates, 71152 repo-hours, 788 releases; waiting 942 ms; commit 0 ms)
2026-11-08T14:54:17Z [load_day 2025-12-30] 2025-12-30 hour 9: 151526 events in 0 files, snapshot none (task 3792 ms: download 2278 ms overlapping gunzip 453 ms, parse 1395 ms, sort 0 ms, write 0 ms, index 937 ms: 9 candidates, 72115 repo-hours, 719 releases; waiting 783 ms; commit 0 ms)
2026-11-08T14:54:22Z [load_day 2025-12-30] 2025-12-30 hour 10: 148018 events in 0 files, snapshot none (task 3754 ms: download 2302 ms overlapping gunzip 451 ms, parse 1508 ms, sort 0 ms, write 0 ms, index 710 ms: 6 candidates, 72508 repo-hours, 666 releases; waiting 745 ms; commit 0 ms)
2026-11-08T14:54:22Z [load_day 2025-12-30] 2025-12-30 hour 11: 149031 events in 0 files, snapshot none (task 3432 ms: download 1843 ms overlapping gunzip 501 ms, parse 1528 ms, sort 0 ms, write 0 ms, index 686 ms: 3 candidates, 69531 repo-hours, 653 releases; waiting 396 ms; commit 0 ms)
2026-11-08T14:54:26Z [load_day 2025-12-30] 2025-12-30 hour 12: 155698 events in 0 files, snapshot none (task 3410 ms: download 2026 ms overlapping gunzip 428 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 91484 repo-hours, 646 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:54:26Z [load_day 2025-12-30] 2025-12-30 hour 13: 152876 events in 0 files, snapshot none (task 3662 ms: download 2416 ms overlapping gunzip 442 ms, parse 1385 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 84149 repo-hours, 644 releases; waiting 866 ms; commit 0 ms)
2026-11-08T14:54:30Z [load_day 2025-12-30] 2025-12-30 hour 14: 149961 events in 0 files, snapshot none (task 3859 ms: download 2565 ms overlapping gunzip 525 ms, parse 1583 ms, sort 0 ms, write 0 ms, index 616 ms: 8 candidates, 71657 repo-hours, 793 releases; waiting 772 ms; commit 0 ms)
2026-11-08T14:54:30Z [load_day 2025-12-30] 2025-12-30 hour 15: 146594 events in 0 files, snapshot none (task 3416 ms: download 2041 ms overlapping gunzip 508 ms, parse 1464 ms, sort 0 ms, write 0 ms, index 621 ms: 5 candidates, 72662 repo-hours, 715 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:54:34Z [load_day 2025-12-30] 2025-12-30 hour 16: 148448 events in 0 files, snapshot none (task 3380 ms: download 2137 ms overlapping gunzip 541 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 674 ms: 4 candidates, 73239 repo-hours, 770 releases; waiting 350 ms; commit 0 ms)
2026-11-08T14:54:34Z [load_day 2025-12-30] 2025-12-30 hour 17: 151578 events in 0 files, snapshot none (task 3457 ms: download 2398 ms overlapping gunzip 465 ms, parse 1476 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 71449 repo-hours, 775 releases; waiting 669 ms; commit 0 ms)
2026-11-08T14:54:38Z [load_day 2025-12-30] 2025-12-30 hour 18: 147405 events in 0 files, snapshot none (task 3622 ms: download 2190 ms overlapping gunzip 512 ms, parse 1566 ms, sort 0 ms, write 0 ms, index 711 ms: 6 candidates, 74263 repo-hours, 782 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:54:38Z [load_day 2025-12-30] 2025-12-30 hour 19: 148803 events in 0 files, snapshot none (task 3927 ms: download 2710 ms overlapping gunzip 535 ms, parse 1655 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 65555 repo-hours, 684 releases; waiting 769 ms; commit 0 ms)
2026-11-08T14:54:42Z [load_day 2025-12-30] 2025-12-30 hour 20: 145816 events in 0 files, snapshot none (task 3289 ms: download 1729 ms overlapping gunzip 506 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 816 ms: 9 candidates, 66857 repo-hours, 690 releases; waiting 208 ms; commit 0 ms)
2026-11-08T14:54:42Z [load_day 2025-12-30] 2025-12-30 hour 21: 148805 events in 0 files, snapshot none (task 3228 ms: download 937 ms overlapping gunzip 517 ms, parse 1723 ms, sort 0 ms, write 0 ms, index 753 ms: 9 candidates, 66952 repo-hours, 672 releases; waiting 22 ms; commit 0 ms)
2026-11-08T14:54:46Z [load_day 2025-12-30] 2025-12-30 hour 22: 146019 events in 0 files, snapshot none (task 3841 ms: download 2498 ms overlapping gunzip 561 ms, parse 1704 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 62198 repo-hours, 789 releases; waiting 751 ms; commit 0 ms)
2026-11-08T14:54:46Z [load_day 2025-12-30] 2025-12-30 hour 23: 142090 events in 0 files, snapshot none (task 3637 ms: download 2212 ms overlapping gunzip 449 ms, parse 1417 ms, sort 0 ms, write 0 ms, index 507 ms: 8 candidates, 61897 repo-hours, 680 releases; waiting 946 ms; commit 0 ms)
2026-11-08T14:54:54Z [load_day 2025-12-30] 2025-12-30: repo_hour merged from 24 files to 1 (1705948 rows, 7979 ms)
2026-11-08T14:54:57Z [load_day 2025-12-30] 2025-12-30: index committed in 10988 ms (24 + 1 + 24 files)
2026-11-08T14:54:57Z [load_day 2025-12-30] 2025-12-30: 3536192 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:54:57Z [load_day 2025-12-30] attempt 1 succeeded