load_day 2026-11-10, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

812409c719ea:22257

Started

2026-11-11T02:00:01Z

Ended

2026-11-11T02:00:17Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

230 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

9.1 s, up to 0.9 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5562/load_day/2026-11-10/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-11T02:00:01Z [load_day 2026-11-10] attempt 1 started
2026-11-11T02:00:02Z [load_day 2026-11-10] 2026-11-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-11T02:00:03Z [load_day 2026-11-10] 2026-11-10 hour 0: 3094 events in 0 files, snapshot none (task 260 ms: download 97 ms overlapping gunzip 37 ms, parse 84 ms, sort 0 ms, write 0 ms, index 51 ms: 0 candidates, 2788 repo-hours, 121 releases; waiting 25 ms; commit 0 ms)
2026-11-11T02:00:03Z [load_day 2026-11-10] 2026-11-10 hour 1: 3305 events in 0 files, snapshot none (task 288 ms: download 93 ms overlapping gunzip 39 ms, parse 88 ms, sort 0 ms, write 0 ms, index 60 ms: 1 candidates, 2963 repo-hours, 136 releases; waiting 14 ms; commit 0 ms)
2026-11-11T02:00:04Z [load_day 2026-11-10] 2026-11-10 hour 2: 3593 events in 0 files, snapshot none (task 267 ms: download 63 ms overlapping gunzip 32 ms, parse 88 ms, sort 0 ms, write 0 ms, index 59 ms: 1 candidates, 3199 repo-hours, 170 releases; waiting 7 ms; commit 0 ms)
2026-11-11T02:00:04Z [load_day 2026-11-10] 2026-11-10 hour 3: 3378 events in 0 files, snapshot none (task 261 ms: download 68 ms overlapping gunzip 43 ms, parse 99 ms, sort 0 ms, write 0 ms, index 56 ms: 1 candidates, 2964 repo-hours, 156 releases; waiting 8 ms; commit 0 ms)
2026-11-11T02:00:05Z [load_day 2026-11-10] 2026-11-10 hour 4: 3352 events in 0 files, snapshot none (task 305 ms: download 78 ms overlapping gunzip 35 ms, parse 77 ms, sort 0 ms, write 0 ms, index 97 ms: 0 candidates, 2910 repo-hours, 155 releases; waiting 29 ms; commit 0 ms)
2026-11-11T02:00:05Z [load_day 2026-11-10] 2026-11-10 hour 5: 3169 events in 0 files, snapshot none (task 239 ms: download 80 ms overlapping gunzip 36 ms, parse 76 ms, sort 0 ms, write 0 ms, index 39 ms: 0 candidates, 2868 repo-hours, 151 releases; waiting 22 ms; commit 0 ms)
2026-11-11T02:00:06Z [load_day 2026-11-10] 2026-11-10 hour 6: 4141 events in 0 files, snapshot none (task 313 ms: download 90 ms overlapping gunzip 47 ms, parse 99 ms, sort 0 ms, write 0 ms, index 85 ms: 2 candidates, 3597 repo-hours, 208 releases; waiting 23 ms; commit 0 ms)
2026-11-11T02:00:06Z [load_day 2026-11-10] 2026-11-10 hour 7: 3550 events in 0 files, snapshot none (task 261 ms: download 68 ms overlapping gunzip 34 ms, parse 86 ms, sort 0 ms, write 0 ms, index 46 ms: 1 candidates, 3218 repo-hours, 187 releases; waiting 20 ms; commit 0 ms)
2026-11-11T02:00:07Z [load_day 2026-11-10] 2026-11-10 hour 8: 3417 events in 0 files, snapshot none (task 254 ms: download 72 ms overlapping gunzip 31 ms, parse 83 ms, sort 0 ms, write 0 ms, index 51 ms: 1 candidates, 3062 repo-hours, 164 releases; waiting 14 ms; commit 0 ms)
2026-11-11T02:00:07Z [load_day 2026-11-10] 2026-11-10 hour 9: 3606 events in 0 files, snapshot none (task 256 ms: download 68 ms overlapping gunzip 33 ms, parse 79 ms, sort 0 ms, write 0 ms, index 58 ms: 0 candidates, 3279 repo-hours, 176 releases; waiting 20 ms; commit 0 ms)
2026-11-11T02:00:07Z [load_day 2026-11-10] 2026-11-10 hour 10: 3681 events in 0 files, snapshot none (task 252 ms: download 72 ms overlapping gunzip 32 ms, parse 81 ms, sort 0 ms, write 0 ms, index 43 ms: 0 candidates, 3320 repo-hours, 249 releases; waiting 19 ms; commit 0 ms)
2026-11-11T02:00:07Z [load_day 2026-11-10] 2026-11-10 hour 11: 3549 events in 0 files, snapshot none (task 255 ms: download 81 ms overlapping gunzip 35 ms, parse 94 ms, sort 0 ms, write 0 ms, index 60 ms: 0 candidates, 3222 repo-hours, 225 releases; waiting 15 ms; commit 0 ms)
2026-11-11T02:00:08Z [load_day 2026-11-10] 2026-11-10 hour 12: 3779 events in 0 files, snapshot none (task 248 ms: download 63 ms overlapping gunzip 32 ms, parse 80 ms, sort 0 ms, write 0 ms, index 63 ms: 0 candidates, 3471 repo-hours, 277 releases; waiting 16 ms; commit 0 ms)
2026-11-11T02:00:08Z [load_day 2026-11-10] 2026-11-10 hour 13: 3358 events in 0 files, snapshot none (task 238 ms: download 53 ms overlapping gunzip 27 ms, parse 80 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 3086 repo-hours, 273 releases; waiting 18 ms; commit 0 ms)
2026-11-11T02:00:09Z [load_day 2026-11-10] 2026-11-10 hour 14: 3293 events in 0 files, snapshot none (task 210 ms: download 49 ms overlapping gunzip 22 ms, parse 73 ms, sort 0 ms, write 0 ms, index 41 ms: 0 candidates, 3027 repo-hours, 286 releases; waiting 15 ms; commit 0 ms)
2026-11-11T02:00:09Z [load_day 2026-11-10] 2026-11-10 hour 15: 3323 events in 0 files, snapshot none (task 189 ms: download 45 ms overlapping gunzip 23 ms, parse 64 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 3022 repo-hours, 253 releases; waiting 15 ms; commit 0 ms)
2026-11-11T02:00:10Z [load_day 2026-11-10] 2026-11-10 hour 16: 3006 events in 0 files, snapshot none (task 313 ms: download 48 ms overlapping gunzip 17 ms, parse 52 ms, sort 0 ms, write 0 ms, index 43 ms: 1 candidates, 2780 repo-hours, 217 releases; waiting 18 ms; commit 0 ms)
2026-11-11T02:00:10Z [load_day 2026-11-10] 2026-11-10 hour 17: 2688 events in 0 files, snapshot none (task 183 ms: download 44 ms overlapping gunzip 18 ms, parse 52 ms, sort 0 ms, write 0 ms, index 33 ms: 0 candidates, 2485 repo-hours, 152 releases; waiting 16 ms; commit 0 ms)
2026-11-11T02:00:11Z [load_day 2026-11-10] 2026-11-10 hour 18: 2743 events in 0 files, snapshot none (task 184 ms: download 53 ms overlapping gunzip 19 ms, parse 52 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 2546 repo-hours, 158 releases; waiting 19 ms; commit 0 ms)
2026-11-11T02:00:11Z [load_day 2026-11-10] 2026-11-10 hour 19: 2841 events in 0 files, snapshot none (task 202 ms: download 58 ms overlapping gunzip 25 ms, parse 61 ms, sort 0 ms, write 0 ms, index 34 ms: 0 candidates, 2600 repo-hours, 134 releases; waiting 22 ms; commit 0 ms)
2026-11-11T02:00:12Z [load_day 2026-11-10] 2026-11-10 hour 20: 3339 events in 0 files, snapshot none (task 213 ms: download 62 ms overlapping gunzip 36 ms, parse 70 ms, sort 0 ms, write 0 ms, index 35 ms: 0 candidates, 3041 repo-hours, 109 releases; waiting 16 ms; commit 0 ms)
2026-11-11T02:00:12Z [load_day 2026-11-10] 2026-11-10 hour 21: 3612 events in 0 files, snapshot none (task 221 ms: download 64 ms overlapping gunzip 34 ms, parse 77 ms, sort 0 ms, write 0 ms, index 35 ms: 0 candidates, 3259 repo-hours, 161 releases; waiting 16 ms; commit 0 ms)
2026-11-11T02:00:13Z [load_day 2026-11-10] 2026-11-10 hour 22: 3615 events in 0 files, snapshot none (task 262 ms: download 78 ms overlapping gunzip 32 ms, parse 81 ms, sort 0 ms, write 0 ms, index 75 ms: 3 candidates, 3229 repo-hours, 145 releases; waiting 19 ms; commit 0 ms)
2026-11-11T02:00:13Z [load_day 2026-11-10] 2026-11-10 hour 23: 3710 events in 0 files, snapshot none (task 243 ms: download 97 ms overlapping gunzip 34 ms, parse 82 ms, sort 0 ms, write 0 ms, index 44 ms: 0 candidates, 3279 repo-hours, 130 releases; waiting 15 ms; commit 0 ms)
2026-11-11T02:00:14Z [load_day 2026-11-10] 2026-11-10: repo_hour merged from 24 files to 1 (73215 rows, 1335 ms)
2026-11-11T02:00:17Z [load_day 2026-11-10] 2026-11-10: index committed in 4111 ms (8 + 1 + 24 files)
2026-11-11T02:00:17Z [load_day 2026-11-10] 2026-11-10: 81142 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-11T02:00:17Z [load_day 2026-11-10] attempt 1 succeeded