load_day 2025-10-19, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:394938

Started

2026-11-08T14:15:17Z

Ended

2026-11-08T14:16:16Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

627 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

62.0 s, up to 2.4 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/4520/load_day/2025-10-19/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T14:15:17Z [load_day 2025-10-19] attempt 1 started
2026-11-08T14:15:17Z [load_day 2025-10-19] 2025-10-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:15:21Z [load_day 2025-10-19] 2025-10-19 hour 0: 133378 events in 0 files, snapshot none (task 2764 ms: download 1724 ms overlapping gunzip 282 ms, parse 945 ms, sort 0 ms, write 0 ms, index 495 ms: 4 candidates, 59123 repo-hours, 718 releases; waiting 693 ms; commit 0 ms)
2026-11-08T14:15:21Z [load_day 2025-10-19] 2025-10-19 hour 1: 148078 events in 0 files, snapshot none (task 2903 ms: download 1652 ms overlapping gunzip 307 ms, parse 1089 ms, sort 0 ms, write 0 ms, index 650 ms: 8 candidates, 83530 repo-hours, 536 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:15:24Z [load_day 2025-10-19] 2025-10-19 hour 2: 136858 events in 0 files, snapshot none (task 2655 ms: download 1830 ms overlapping gunzip 298 ms, parse 1027 ms, sort 0 ms, write 0 ms, index 441 ms: 7 candidates, 61183 repo-hours, 682 releases; waiting 594 ms; commit 0 ms)
2026-11-08T14:15:24Z [load_day 2025-10-19] 2025-10-19 hour 3: 136898 events in 0 files, snapshot none (task 2991 ms: download 2005 ms overlapping gunzip 293 ms, parse 997 ms, sort 0 ms, write 0 ms, index 437 ms: 6 candidates, 57693 repo-hours, 1559 releases; waiting 967 ms; commit 0 ms)
2026-11-08T14:15:27Z [load_day 2025-10-19] 2025-10-19 hour 4: 144608 events in 0 files, snapshot none (task 2377 ms: download 1357 ms overlapping gunzip 302 ms, parse 1020 ms, sort 0 ms, write 0 ms, index 447 ms: 8 candidates, 50695 repo-hours, 515 releases; waiting 289 ms; commit 0 ms)
2026-11-08T14:15:28Z [load_day 2025-10-19] 2025-10-19 hour 5: 144770 events in 0 files, snapshot none (task 3141 ms: download 2189 ms overlapping gunzip 290 ms, parse 991 ms, sort 0 ms, write 0 ms, index 380 ms: 6 candidates, 50363 repo-hours, 407 releases; waiting 1097 ms; commit 0 ms)
2026-11-08T14:15:31Z [load_day 2025-10-19] 2025-10-19 hour 6: 150732 events in 0 files, snapshot none (task 3399 ms: download 1635 ms overlapping gunzip 300 ms, parse 1050 ms, sort 0 ms, write 0 ms, index 892 ms: 7 candidates, 59355 repo-hours, 440 releases; waiting 595 ms; commit 0 ms)
2026-11-08T14:15:31Z [load_day 2025-10-19] 2025-10-19 hour 7: 150008 events in 0 files, snapshot none (task 2547 ms: download 1494 ms overlapping gunzip 356 ms, parse 1135 ms, sort 0 ms, write 0 ms, index 508 ms: 6 candidates, 53308 repo-hours, 381 releases; waiting 265 ms; commit 0 ms)
2026-11-08T14:15:35Z [load_day 2025-10-19] 2025-10-19 hour 8: 140242 events in 0 files, snapshot none (task 3504 ms: download 2321 ms overlapping gunzip 400 ms, parse 1380 ms, sort 0 ms, write 0 ms, index 507 ms: 3 candidates, 57844 repo-hours, 437 releases; waiting 883 ms; commit 0 ms)
2026-11-08T14:15:35Z [load_day 2025-10-19] 2025-10-19 hour 9: 140425 events in 0 files, snapshot none (task 2922 ms: download 1844 ms overlapping gunzip 310 ms, parse 1051 ms, sort 0 ms, write 0 ms, index 618 ms: 8 candidates, 60107 repo-hours, 546 releases; waiting 622 ms; commit 0 ms)
2026-11-08T14:15:39Z [load_day 2025-10-19] 2025-10-19 hour 10: 144715 events in 0 files, snapshot none (task 3167 ms: download 1523 ms overlapping gunzip 368 ms, parse 1225 ms, sort 0 ms, write 0 ms, index 585 ms: 10 candidates, 62856 repo-hours, 488 releases; waiting 338 ms; commit 0 ms)
2026-11-08T14:15:39Z [load_day 2025-10-19] 2025-10-19 hour 11: 145541 events in 0 files, snapshot none (task 3414 ms: download 1952 ms overlapping gunzip 382 ms, parse 1270 ms, sort 0 ms, write 0 ms, index 650 ms: 13 candidates, 60094 repo-hours, 435 releases; waiting 741 ms; commit 0 ms)
2026-11-08T14:15:43Z [load_day 2025-10-19] 2025-10-19 hour 12: 152793 events in 0 files, snapshot none (task 3247 ms: download 1887 ms overlapping gunzip 315 ms, parse 1160 ms, sort 0 ms, write 0 ms, index 915 ms: 6 candidates, 85604 repo-hours, 500 releases; waiting 644 ms; commit 0 ms)
2026-11-08T14:15:43Z [load_day 2025-10-19] 2025-10-19 hour 13: 152092 events in 0 files, snapshot none (task 3265 ms: download 1904 ms overlapping gunzip 377 ms, parse 1229 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 76186 repo-hours, 463 releases; waiting 681 ms; commit 0 ms)
2026-11-08T14:15:47Z [load_day 2025-10-19] 2025-10-19 hour 14: 144785 events in 0 files, snapshot none (task 3570 ms: download 2029 ms overlapping gunzip 354 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 992 ms: 6 candidates, 65157 repo-hours, 590 releases; waiting 702 ms; commit 0 ms)
2026-11-08T14:15:47Z [load_day 2025-10-19] 2025-10-19 hour 15: 150892 events in 0 files, snapshot none (task 3823 ms: download 2449 ms overlapping gunzip 427 ms, parse 1486 ms, sort 0 ms, write 0 ms, index 635 ms: 6 candidates, 67557 repo-hours, 675 releases; waiting 954 ms; commit 0 ms)
2026-11-08T14:15:51Z [load_day 2025-10-19] 2025-10-19 hour 16: 148059 events in 0 files, snapshot none (task 3374 ms: download 2063 ms overlapping gunzip 380 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 65991 repo-hours, 580 releases; waiting 740 ms; commit 0 ms)
2026-11-08T14:15:52Z [load_day 2025-10-19] 2025-10-19 hour 17: 146850 events in 0 files, snapshot none (task 3578 ms: download 2410 ms overlapping gunzip 458 ms, parse 1417 ms, sort 0 ms, write 0 ms, index 589 ms: 12 candidates, 64175 repo-hours, 575 releases; waiting 720 ms; commit 0 ms)
2026-11-08T14:15:56Z [load_day 2025-10-19] 2025-10-19 hour 18: 152383 events in 0 files, snapshot none (task 5050 ms: download 3184 ms overlapping gunzip 460 ms, parse 1583 ms, sort 0 ms, write 0 ms, index 656 ms: 7 candidates, 73205 repo-hours, 775 releases; waiting 1953 ms; commit 0 ms)
2026-11-08T14:15:56Z [load_day 2025-10-19] 2025-10-19 hour 19: 147897 events in 0 files, snapshot none (task 3699 ms: download 2362 ms overlapping gunzip 446 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 768 ms: 6 candidates, 61777 repo-hours, 554 releases; waiting 741 ms; commit 0 ms)
2026-11-08T14:16:01Z [load_day 2025-10-19] 2025-10-19 hour 20: 144991 events in 0 files, snapshot none (task 3920 ms: download 1861 ms overlapping gunzip 650 ms, parse 2114 ms, sort 0 ms, write 0 ms, index 736 ms: 3 candidates, 60143 repo-hours, 578 releases; waiting 208 ms; commit 0 ms)
2026-11-08T14:16:01Z [load_day 2025-10-19] 2025-10-19 hour 21: 146686 events in 0 files, snapshot none (task 3923 ms: download 2054 ms overlapping gunzip 639 ms, parse 1874 ms, sort 0 ms, write 0 ms, index 614 ms: 7 candidates, 58323 repo-hours, 574 releases; waiting 511 ms; commit 0 ms)
2026-11-08T14:16:06Z [load_day 2025-10-19] 2025-10-19 hour 22: 144138 events in 0 files, snapshot none (task 3983 ms: download 2453 ms overlapping gunzip 589 ms, parse 2002 ms, sort 0 ms, write 0 ms, index 635 ms: 9 candidates, 57400 repo-hours, 641 releases; waiting 502 ms; commit 0 ms)
2026-11-08T14:16:06Z [load_day 2025-10-19] 2025-10-19 hour 23: 139135 events in 0 files, snapshot none (task 3976 ms: download 2212 ms overlapping gunzip 604 ms, parse 1985 ms, sort 0 ms, write 0 ms, index 505 ms: 6 candidates, 54363 repo-hours, 484 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:16:13Z [load_day 2025-10-19] 2025-10-19: repo_hour merged from 24 files to 1 (1506032 rows, 7332 ms)
2026-11-08T14:16:16Z [load_day 2025-10-19] 2025-10-19: index committed in 10293 ms (24 + 1 + 24 files)
2026-11-08T14:16:16Z [load_day 2025-10-19] 2025-10-19: 3486954 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:16:16Z [load_day 2025-10-19] attempt 1 succeeded