load_day 2026-11-09, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

be5d0c462014:120853

Started

2026-11-10T03:00:01Z

Ended

2026-11-10T03:00:21Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

279 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

9.9 s, up to 0.8 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5187/load_day/2026-11-09/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-10T03:00:01Z [load_day 2026-11-09] attempt 1 started
2026-11-10T03:00:02Z [load_day 2026-11-09] 2026-11-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-10T03:00:03Z [load_day 2026-11-09] 2026-11-09 hour 0: 7528 events in 0 files, snapshot none (task 305 ms: download 88 ms overlapping gunzip 40 ms, parse 110 ms, sort 0 ms, write 0 ms, index 83 ms: 5 candidates, 6366 repo-hours, 109 releases; waiting 12 ms; commit 0 ms)
2026-11-10T03:00:03Z [load_day 2026-11-09] 2026-11-09 hour 1: 7440 events in 0 files, snapshot none (task 569 ms: download 74 ms overlapping gunzip 37 ms, parse 98 ms, sort 0 ms, write 0 ms, index 82 ms: 1 candidates, 6339 repo-hours, 85 releases; waiting 8 ms; commit 0 ms)
2026-11-10T03:00:04Z [load_day 2026-11-09] 2026-11-09 hour 2: 5294 events in 0 files, snapshot none (task 382 ms: download 80 ms overlapping gunzip 37 ms, parse 96 ms, sort 0 ms, write 0 ms, index 51 ms: 0 candidates, 4640 repo-hours, 107 releases; waiting 11 ms; commit 0 ms)
2026-11-10T03:00:04Z [load_day 2026-11-09] 2026-11-09 hour 3: 5604 events in 0 files, snapshot none (task 402 ms: download 79 ms overlapping gunzip 33 ms, parse 87 ms, sort 0 ms, write 0 ms, index 63 ms: 0 candidates, 4897 repo-hours, 98 releases; waiting 13 ms; commit 0 ms)
2026-11-10T03:00:05Z [load_day 2026-11-09] 2026-11-09 hour 4: 6027 events in 0 files, snapshot none (task 413 ms: download 76 ms overlapping gunzip 37 ms, parse 90 ms, sort 0 ms, write 0 ms, index 78 ms: 1 candidates, 5309 repo-hours, 113 releases; waiting 20 ms; commit 0 ms)
2026-11-10T03:00:05Z [load_day 2026-11-09] 2026-11-09 hour 5: 6115 events in 0 files, snapshot none (task 427 ms: download 83 ms overlapping gunzip 37 ms, parse 87 ms, sort 0 ms, write 0 ms, index 76 ms: 2 candidates, 5356 repo-hours, 89 releases; waiting 18 ms; commit 0 ms)
2026-11-10T03:00:06Z [load_day 2026-11-09] 2026-11-09 hour 6: 5194 events in 0 files, snapshot none (task 417 ms: download 84 ms overlapping gunzip 36 ms, parse 89 ms, sort 0 ms, write 0 ms, index 68 ms: 2 candidates, 4681 repo-hours, 131 releases; waiting 23 ms; commit 0 ms)
2026-11-10T03:00:06Z [load_day 2026-11-09] 2026-11-09 hour 7: 3881 events in 0 files, snapshot none (task 390 ms: download 84 ms overlapping gunzip 32 ms, parse 79 ms, sort 0 ms, write 0 ms, index 66 ms: 2 candidates, 3509 repo-hours, 181 releases; waiting 16 ms; commit 0 ms)
2026-11-10T03:00:07Z [load_day 2026-11-09] 2026-11-09 hour 8: 2855 events in 0 files, snapshot none (task 409 ms: download 66 ms overlapping gunzip 34 ms, parse 111 ms, sort 0 ms, write 0 ms, index 41 ms: 0 candidates, 2629 repo-hours, 149 releases; waiting 5 ms; commit 0 ms)
2026-11-10T03:00:07Z [load_day 2026-11-09] 2026-11-09 hour 9: 2734 events in 0 files, snapshot none (task 365 ms: download 62 ms overlapping gunzip 27 ms, parse 68 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 2522 repo-hours, 175 releases; waiting 17 ms; commit 0 ms)
2026-11-10T03:00:08Z [load_day 2026-11-09] 2026-11-09 hour 10: 2769 events in 0 files, snapshot none (task 268 ms: download 87 ms overlapping gunzip 31 ms, parse 82 ms, sort 0 ms, write 0 ms, index 57 ms: 0 candidates, 2507 repo-hours, 207 releases; waiting 32 ms; commit 0 ms)
2026-11-10T03:00:08Z [load_day 2026-11-09] 2026-11-09 hour 11: 2921 events in 0 files, snapshot none (task 213 ms: download 52 ms overlapping gunzip 25 ms, parse 76 ms, sort 0 ms, write 0 ms, index 48 ms: 1 candidates, 2680 repo-hours, 197 releases; waiting 8 ms; commit 0 ms)
2026-11-10T03:00:09Z [load_day 2026-11-09] 2026-11-09 hour 12: 2958 events in 0 files, snapshot none (task 222 ms: download 64 ms overlapping gunzip 24 ms, parse 69 ms, sort 0 ms, write 0 ms, index 50 ms: 0 candidates, 2718 repo-hours, 265 releases; waiting 17 ms; commit 0 ms)
2026-11-10T03:00:09Z [load_day 2026-11-09] 2026-11-09 hour 13: 2959 events in 0 files, snapshot none (task 214 ms: download 52 ms overlapping gunzip 22 ms, parse 61 ms, sort 0 ms, write 0 ms, index 35 ms: 0 candidates, 2771 repo-hours, 197 releases; waiting 17 ms; commit 0 ms)
2026-11-10T03:00:09Z [load_day 2026-11-09] 2026-11-09 hour 14: 3150 events in 0 files, snapshot none (task 237 ms: download 56 ms overlapping gunzip 26 ms, parse 78 ms, sort 0 ms, write 0 ms, index 37 ms: 0 candidates, 2907 repo-hours, 268 releases; waiting 25 ms; commit 0 ms)
2026-11-10T03:00:09Z [load_day 2026-11-09] 2026-11-09 hour 15: 3470 events in 0 files, snapshot none (task 224 ms: download 79 ms overlapping gunzip 30 ms, parse 77 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 3167 repo-hours, 254 releases; waiting 20 ms; commit 0 ms)
2026-11-10T03:00:10Z [load_day 2026-11-09] 2026-11-09 hour 16: 2898 events in 0 files, snapshot none (task 191 ms: download 45 ms overlapping gunzip 18 ms, parse 54 ms, sort 0 ms, write 0 ms, index 35 ms: 0 candidates, 2704 repo-hours, 207 releases; waiting 19 ms; commit 0 ms)
2026-11-10T03:00:10Z [load_day 2026-11-09] 2026-11-09 hour 17: 4425 events in 0 files, snapshot none (task 215 ms: download 63 ms overlapping gunzip 24 ms, parse 83 ms, sort 0 ms, write 0 ms, index 40 ms: 0 candidates, 3991 repo-hours, 444 releases; waiting 19 ms; commit 0 ms)
2026-11-10T03:00:11Z [load_day 2026-11-09] 2026-11-09 hour 18: 2745 events in 0 files, snapshot none (task 196 ms: download 55 ms overlapping gunzip 17 ms, parse 55 ms, sort 0 ms, write 0 ms, index 34 ms: 0 candidates, 2529 repo-hours, 175 releases; waiting 15 ms; commit 0 ms)
2026-11-10T03:00:11Z [load_day 2026-11-09] 2026-11-09 hour 19: 2819 events in 0 files, snapshot none (task 230 ms: download 46 ms overlapping gunzip 18 ms, parse 48 ms, sort 0 ms, write 0 ms, index 91 ms: 1 candidates, 2637 repo-hours, 145 releases; waiting 16 ms; commit 0 ms)
2026-11-10T03:00:12Z [load_day 2026-11-09] 2026-11-09 hour 20: 2982 events in 0 files, snapshot none (task 208 ms: download 65 ms overlapping gunzip 22 ms, parse 62 ms, sort 0 ms, write 0 ms, index 55 ms: 1 candidates, 2747 repo-hours, 155 releases; waiting 21 ms; commit 0 ms)
2026-11-10T03:00:12Z [load_day 2026-11-09] 2026-11-09 hour 21: 4597 events in 0 files, snapshot none (task 265 ms: download 68 ms overlapping gunzip 34 ms, parse 92 ms, sort 0 ms, write 0 ms, index 61 ms: 2 candidates, 3984 repo-hours, 203 releases; waiting 14 ms; commit 0 ms)
2026-11-10T03:00:13Z [load_day 2026-11-09] 2026-11-09 hour 22: 3144 events in 0 files, snapshot none (task 274 ms: download 77 ms overlapping gunzip 29 ms, parse 89 ms, sort 0 ms, write 0 ms, index 81 ms: 1 candidates, 2876 repo-hours, 132 releases; waiting 21 ms; commit 0 ms)
2026-11-10T03:00:13Z [load_day 2026-11-09] 2026-11-09 hour 23: 3250 events in 0 files, snapshot none (task 231 ms: download 70 ms overlapping gunzip 32 ms, parse 74 ms, sort 0 ms, write 0 ms, index 41 ms: 0 candidates, 2875 repo-hours, 107 releases; waiting 15 ms; commit 0 ms)
2026-11-10T03:00:14Z [load_day 2026-11-09] 2026-11-09: repo_hour merged from 24 files to 1 (87341 rows, 1452 ms)
2026-11-10T03:00:21Z [load_day 2026-11-09] 2026-11-09: index committed in 8420 ms (11 + 1 + 24 files)
2026-11-10T03:00:21Z [load_day 2026-11-09] 2026-11-09: 97759 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-10T03:00:21Z [load_day 2026-11-09] attempt 1 succeeded