load_day 2026-02-12, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:441883

Started

2026-11-08T15:17:38Z

Ended

2026-11-08T15:18:43Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

714 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

72.2 s, up to 2.1 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/4926/load_day/2026-02-12/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T15:17:38Z [load_day 2026-02-12] attempt 1 started
2026-11-08T15:17:39Z [load_day 2026-02-12] 2026-02-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:17:44Z [load_day 2026-02-12] 2026-02-12 hour 0: 140470 events in 0 files, snapshot none (task 4621 ms: download 3378 ms overlapping gunzip 689 ms, parse 1939 ms, sort 0 ms, write 0 ms, index 522 ms: 6 candidates, 68641 repo-hours, 879 releases; waiting 1180 ms; commit 0 ms)
2026-11-08T15:17:44Z [load_day 2026-02-12] 2026-02-12 hour 1: 151592 events in 0 files, snapshot none (task 3348 ms: download 2078 ms overlapping gunzip 527 ms, parse 1539 ms, sort 0 ms, write 0 ms, index 654 ms: 5 candidates, 85489 repo-hours, 766 releases; waiting 352 ms; commit 0 ms)
2026-11-08T15:17:48Z [load_day 2026-02-12] 2026-02-12 hour 2: 148939 events in 0 files, snapshot none (task 3529 ms: download 2184 ms overlapping gunzip 567 ms, parse 1596 ms, sort 0 ms, write 0 ms, index 606 ms: 12 candidates, 84583 repo-hours, 817 releases; waiting 483 ms; commit 0 ms)
2026-11-08T15:17:48Z [load_day 2026-02-12] 2026-02-12 hour 3: 144032 events in 0 files, snapshot none (task 3398 ms: download 2163 ms overlapping gunzip 532 ms, parse 1561 ms, sort 0 ms, write 0 ms, index 623 ms: 9 candidates, 72260 repo-hours, 948 releases; waiting 318 ms; commit 0 ms)
2026-11-08T15:17:52Z [load_day 2026-02-12] 2026-02-12 hour 4: 143642 events in 0 files, snapshot none (task 3629 ms: download 2580 ms overlapping gunzip 543 ms, parse 1571 ms, sort 0 ms, write 0 ms, index 567 ms: 9 candidates, 72932 repo-hours, 822 releases; waiting 617 ms; commit 0 ms)
2026-11-08T15:17:52Z [load_day 2026-02-12] 2026-02-12 hour 5: 145137 events in 0 files, snapshot none (task 3772 ms: download 2358 ms overlapping gunzip 576 ms, parse 1615 ms, sort 0 ms, write 0 ms, index 596 ms: 9 candidates, 76744 repo-hours, 1408 releases; waiting 614 ms; commit 0 ms)
2026-11-08T15:17:56Z [load_day 2026-02-12] 2026-02-12 hour 6: 146764 events in 0 files, snapshot none (task 3698 ms: download 2080 ms overlapping gunzip 624 ms, parse 1887 ms, sort 0 ms, write 0 ms, index 536 ms: 5 candidates, 75901 repo-hours, 837 releases; waiting 342 ms; commit 0 ms)
2026-11-08T15:17:57Z [load_day 2026-02-12] 2026-02-12 hour 7: 142199 events in 0 files, snapshot none (task 3739 ms: download 2226 ms overlapping gunzip 603 ms, parse 1649 ms, sort 0 ms, write 0 ms, index 623 ms: 9 candidates, 78151 repo-hours, 684 releases; waiting 552 ms; commit 0 ms)
2026-11-08T15:18:01Z [load_day 2026-02-12] 2026-02-12 hour 8: 140974 events in 0 files, snapshot none (task 3951 ms: download 2352 ms overlapping gunzip 677 ms, parse 1806 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 79069 repo-hours, 711 releases; waiting 528 ms; commit 0 ms)
2026-11-08T15:18:01Z [load_day 2026-02-12] 2026-02-12 hour 9: 142693 events in 0 files, snapshot none (task 3596 ms: download 2034 ms overlapping gunzip 577 ms, parse 1740 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 81678 repo-hours, 569 releases; waiting 328 ms; commit 0 ms)
2026-11-08T15:18:05Z [load_day 2026-02-12] 2026-02-12 hour 10: 141683 events in 0 files, snapshot none (task 3685 ms: download 2102 ms overlapping gunzip 523 ms, parse 1388 ms, sort 0 ms, write 0 ms, index 773 ms: 5 candidates, 80319 repo-hours, 518 releases; waiting 633 ms; commit 0 ms)
2026-11-08T15:18:06Z [load_day 2026-02-12] 2026-02-12 hour 11: 146447 events in 0 files, snapshot none (task 4466 ms: download 3104 ms overlapping gunzip 456 ms, parse 1392 ms, sort 0 ms, write 0 ms, index 620 ms: 7 candidates, 79212 repo-hours, 661 releases; waiting 1713 ms; commit 0 ms)
2026-11-08T15:18:09Z [load_day 2026-02-12] 2026-02-12 hour 12: 149799 events in 0 files, snapshot none (task 3684 ms: download 2026 ms overlapping gunzip 495 ms, parse 1642 ms, sort 0 ms, write 0 ms, index 862 ms: 1 candidates, 88009 repo-hours, 556 releases; waiting 425 ms; commit 0 ms)
2026-11-08T15:18:10Z [load_day 2026-02-12] 2026-02-12 hour 13: 154530 events in 0 files, snapshot none (task 3628 ms: download 2168 ms overlapping gunzip 564 ms, parse 1530 ms, sort 0 ms, write 0 ms, index 768 ms: 7 candidates, 96768 repo-hours, 259 releases; waiting 402 ms; commit 0 ms)
2026-11-08T15:18:14Z [load_day 2026-02-12] 2026-02-12 hour 14: 146491 events in 0 files, snapshot none (task 3970 ms: download 2177 ms overlapping gunzip 579 ms, parse 1666 ms, sort 0 ms, write 0 ms, index 733 ms: 7 candidates, 87641 repo-hours, 516 releases; waiting 643 ms; commit 0 ms)
2026-11-08T15:18:14Z [load_day 2026-02-12] 2026-02-12 hour 15: 137479 events in 0 files, snapshot none (task 3627 ms: download 1830 ms overlapping gunzip 546 ms, parse 1601 ms, sort 0 ms, write 0 ms, index 826 ms: 5 candidates, 83203 repo-hours, 418 releases; waiting 337 ms; commit 0 ms)
2026-11-08T15:18:18Z [load_day 2026-02-12] 2026-02-12 hour 16: 136434 events in 0 files, snapshot none (task 3490 ms: download 1908 ms overlapping gunzip 426 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 828 ms: 5 candidates, 80680 repo-hours, 350 releases; waiting 631 ms; commit 0 ms)
2026-11-08T15:18:18Z [load_day 2026-02-12] 2026-02-12 hour 17: 134013 events in 0 files, snapshot none (task 3365 ms: download 1855 ms overlapping gunzip 463 ms, parse 1457 ms, sort 0 ms, write 0 ms, index 615 ms: 8 candidates, 77560 repo-hours, 384 releases; waiting 509 ms; commit 0 ms)
2026-11-08T15:18:22Z [load_day 2026-02-12] 2026-02-12 hour 18: 137257 events in 0 files, snapshot none (task 3771 ms: download 2141 ms overlapping gunzip 489 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 821 ms: 7 candidates, 80598 repo-hours, 487 releases; waiting 730 ms; commit 0 ms)
2026-11-08T15:18:22Z [load_day 2026-02-12] 2026-02-12 hour 19: 137249 events in 0 files, snapshot none (task 3918 ms: download 2057 ms overlapping gunzip 632 ms, parse 1635 ms, sort 0 ms, write 0 ms, index 610 ms: 12 candidates, 78962 repo-hours, 547 releases; waiting 676 ms; commit 0 ms)
2026-11-08T15:18:27Z [load_day 2026-02-12] 2026-02-12 hour 20: 143566 events in 0 files, snapshot none (task 4461 ms: download 2598 ms overlapping gunzip 725 ms, parse 2007 ms, sort 0 ms, write 0 ms, index 735 ms: 5 candidates, 77894 repo-hours, 687 releases; waiting 634 ms; commit 0 ms)
2026-11-08T15:18:27Z [load_day 2026-02-12] 2026-02-12 hour 21: 140306 events in 0 files, snapshot none (task 4275 ms: download 2037 ms overlapping gunzip 680 ms, parse 2048 ms, sort 0 ms, write 0 ms, index 677 ms: 7 candidates, 71822 repo-hours, 940 releases; waiting 535 ms; commit 0 ms)
2026-11-08T15:18:32Z [load_day 2026-02-12] 2026-02-12 hour 22: 145222 events in 0 files, snapshot none (task 4394 ms: download 2844 ms overlapping gunzip 493 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 571 ms: 7 candidates, 72713 repo-hours, 946 releases; waiting 1554 ms; commit 0 ms)
2026-11-08T15:18:32Z [load_day 2026-02-12] 2026-02-12 hour 23: 140263 events in 0 files, snapshot none (task 3954 ms: download 2670 ms overlapping gunzip 502 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 70777 repo-hours, 977 releases; waiting 981 ms; commit 0 ms)
2026-11-08T15:18:40Z [load_day 2026-02-12] 2026-02-12: repo_hour merged from 24 files to 1 (1901606 rows, 8374 ms)
2026-11-08T15:18:43Z [load_day 2026-02-12] 2026-02-12: index committed in 11539 ms (24 + 1 + 24 files)
2026-11-08T15:18:43Z [load_day 2026-02-12] 2026-02-12: 3437181 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:18:43Z [load_day 2026-02-12] attempt 1 succeeded