load_day 2026-03-02, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:449911

Started

2026-11-08T15:27:38Z

Ended

2026-11-08T15:28:45Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

728 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

74.1 s, up to 2.4 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/4992/load_day/2026-03-02/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T15:27:38Z [load_day 2026-03-02] attempt 1 started
2026-11-08T15:27:39Z [load_day 2026-03-02] 2026-03-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:27:43Z [load_day 2026-03-02] 2026-03-02 hour 0: 146823 events in 0 files, snapshot none (task 3674 ms: download 2169 ms overlapping gunzip 528 ms, parse 1609 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 69919 repo-hours, 1133 releases; waiting 554 ms; commit 0 ms)
2026-11-08T15:27:43Z [load_day 2026-03-02] 2026-03-02 hour 1: 158147 events in 0 files, snapshot none (task 3926 ms: download 2195 ms overlapping gunzip 410 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 962 ms: 7 candidates, 90366 repo-hours, 604 releases; waiting 662 ms; commit 0 ms)
2026-11-08T15:27:47Z [load_day 2026-03-02] 2026-03-02 hour 2: 155457 events in 0 files, snapshot none (task 3278 ms: download 1981 ms overlapping gunzip 389 ms, parse 1194 ms, sort 0 ms, write 0 ms, index 762 ms: 9 candidates, 86205 repo-hours, 714 releases; waiting 706 ms; commit 0 ms)
2026-11-08T15:27:48Z [load_day 2026-03-02] 2026-03-02 hour 3: 151682 events in 0 files, snapshot none (task 4083 ms: download 2709 ms overlapping gunzip 574 ms, parse 1534 ms, sort 0 ms, write 0 ms, index 749 ms: 10 candidates, 72835 repo-hours, 872 releases; waiting 852 ms; commit 0 ms)
2026-11-08T15:27:52Z [load_day 2026-03-02] 2026-03-02 hour 4: 153859 events in 0 files, snapshot none (task 4135 ms: download 2748 ms overlapping gunzip 485 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 795 ms: 8 candidates, 74606 repo-hours, 946 releases; waiting 1151 ms; commit 0 ms)
2026-11-08T15:27:52Z [load_day 2026-03-02] 2026-03-02 hour 5: 150749 events in 0 files, snapshot none (task 3887 ms: download 2262 ms overlapping gunzip 521 ms, parse 1544 ms, sort 0 ms, write 0 ms, index 639 ms: 3 candidates, 77032 repo-hours, 941 releases; waiting 841 ms; commit 0 ms)
2026-11-08T15:27:57Z [load_day 2026-03-02] 2026-03-02 hour 6: 151488 events in 0 files, snapshot none (task 4089 ms: download 2533 ms overlapping gunzip 625 ms, parse 1698 ms, sort 0 ms, write 0 ms, index 822 ms: 2 candidates, 79103 repo-hours, 867 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:27:57Z [load_day 2026-03-02] 2026-03-02 hour 7: 151288 events in 0 files, snapshot none (task 4042 ms: download 2319 ms overlapping gunzip 614 ms, parse 1757 ms, sort 0 ms, write 0 ms, index 877 ms: 6 candidates, 80993 repo-hours, 919 releases; waiting 579 ms; commit 0 ms)
2026-11-08T15:28:01Z [load_day 2026-03-02] 2026-03-02 hour 8: 155751 events in 0 files, snapshot none (task 3552 ms: download 2037 ms overlapping gunzip 490 ms, parse 1426 ms, sort 0 ms, write 0 ms, index 829 ms: 6 candidates, 84554 repo-hours, 587 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:28:01Z [load_day 2026-03-02] 2026-03-02 hour 9: 153694 events in 0 files, snapshot none (task 3675 ms: download 2284 ms overlapping gunzip 441 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 720 ms: 6 candidates, 82367 repo-hours, 351 releases; waiting 849 ms; commit 0 ms)
2026-11-08T15:28:05Z [load_day 2026-03-02] 2026-03-02 hour 10: 152951 events in 0 files, snapshot none (task 3941 ms: download 1727 ms overlapping gunzip 545 ms, parse 1715 ms, sort 0 ms, write 0 ms, index 755 ms: 14 candidates, 87177 repo-hours, 505 releases; waiting 312 ms; commit 0 ms)
2026-11-08T15:28:05Z [load_day 2026-03-02] 2026-03-02 hour 11: 151142 events in 0 files, snapshot none (task 3818 ms: download 2552 ms overlapping gunzip 477 ms, parse 1555 ms, sort 0 ms, write 0 ms, index 712 ms: 7 candidates, 83157 repo-hours, 608 releases; waiting 825 ms; commit 0 ms)
2026-11-08T15:28:10Z [load_day 2026-03-02] 2026-03-02 hour 12: 158626 events in 0 files, snapshot none (task 3782 ms: download 2273 ms overlapping gunzip 493 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 852 ms: 7 candidates, 93376 repo-hours, 465 releases; waiting 658 ms; commit 0 ms)
2026-11-08T15:28:10Z [load_day 2026-03-02] 2026-03-02 hour 13: 158261 events in 0 files, snapshot none (task 3624 ms: download 1359 ms overlapping gunzip 498 ms, parse 1593 ms, sort 0 ms, write 0 ms, index 910 ms: 9 candidates, 97578 repo-hours, 348 releases; waiting 249 ms; commit 0 ms)
2026-11-08T15:28:14Z [load_day 2026-03-02] 2026-03-02 hour 14: 154645 events in 0 files, snapshot none (task 3727 ms: download 2076 ms overlapping gunzip 451 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 965 ms: 5 candidates, 88777 repo-hours, 481 releases; waiting 629 ms; commit 0 ms)
2026-11-08T15:28:15Z [load_day 2026-03-02] 2026-03-02 hour 15: 145727 events in 0 files, snapshot none (task 4470 ms: download 2367 ms overlapping gunzip 676 ms, parse 1950 ms, sort 0 ms, write 0 ms, index 789 ms: 5 candidates, 85167 repo-hours, 473 releases; waiting 774 ms; commit 0 ms)
2026-11-08T15:28:18Z [load_day 2026-03-02] 2026-03-02 hour 16: 151314 events in 0 files, snapshot none (task 3923 ms: download 2058 ms overlapping gunzip 498 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 946 ms: 8 candidates, 86323 repo-hours, 505 releases; waiting 718 ms; commit 0 ms)
2026-11-08T15:28:19Z [load_day 2026-03-02] 2026-03-02 hour 17: 158655 events in 0 files, snapshot none (task 3899 ms: download 1974 ms overlapping gunzip 485 ms, parse 1527 ms, sort 0 ms, write 0 ms, index 738 ms: 9 candidates, 90891 repo-hours, 377 releases; waiting 741 ms; commit 0 ms)
2026-11-08T15:28:23Z [load_day 2026-03-02] 2026-03-02 hour 18: 157113 events in 0 files, snapshot none (task 4425 ms: download 2108 ms overlapping gunzip 447 ms, parse 1574 ms, sort 0 ms, write 0 ms, index 1442 ms: 9 candidates, 90441 repo-hours, 415 releases; waiting 702 ms; commit 0 ms)
2026-11-08T15:28:24Z [load_day 2026-03-02] 2026-03-02 hour 19: 150002 events in 0 files, snapshot none (task 4787 ms: download 3102 ms overlapping gunzip 541 ms, parse 1642 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 81824 repo-hours, 583 releases; waiting 1576 ms; commit 0 ms)
2026-11-08T15:28:28Z [load_day 2026-03-02] 2026-03-02 hour 20: 146664 events in 0 files, snapshot none (task 3931 ms: download 2785 ms overlapping gunzip 493 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 721 ms: 8 candidates, 79032 repo-hours, 699 releases; waiting 977 ms; commit 0 ms)
2026-11-08T15:28:28Z [load_day 2026-03-02] 2026-03-02 hour 21: 155721 events in 0 files, snapshot none (task 3655 ms: download 2218 ms overlapping gunzip 528 ms, parse 1504 ms, sort 0 ms, write 0 ms, index 799 ms: 6 candidates, 82524 repo-hours, 724 releases; waiting 483 ms; commit 0 ms)
2026-11-08T15:28:33Z [load_day 2026-03-02] 2026-03-02 hour 22: 150172 events in 0 files, snapshot none (task 3867 ms: download 2404 ms overlapping gunzip 562 ms, parse 1608 ms, sort 0 ms, write 0 ms, index 666 ms: 8 candidates, 76836 repo-hours, 847 releases; waiting 735 ms; commit 0 ms)
2026-11-08T15:28:33Z [load_day 2026-03-02] 2026-03-02 hour 23: 147794 events in 0 files, snapshot none (task 4009 ms: download 2616 ms overlapping gunzip 565 ms, parse 1902 ms, sort 0 ms, write 0 ms, index 664 ms: 1 candidates, 73893 repo-hours, 864 releases; waiting 621 ms; commit 0 ms)
2026-11-08T15:28:42Z [load_day 2026-03-02] 2026-03-02: repo_hour merged from 24 files to 1 (1994976 rows, 8758 ms)
2026-11-08T15:28:45Z [load_day 2026-03-02] 2026-03-02: index committed in 11949 ms (24 + 1 + 24 files)
2026-11-08T15:28:45Z [load_day 2026-03-02] 2026-03-02: 3667725 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:28:45Z [load_day 2026-03-02] attempt 1 succeeded