load_day 2026-11-11, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

5adca2642bfc:112413

Started

2026-11-12T03:00:00Z

Ended

2026-11-12T03:00:21Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

324 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

11.2 s, up to 1.0 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5744/load_day/2026-11-11/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-12T03:00:00Z [load_day 2026-11-11] attempt 1 started
2026-11-12T03:00:01Z [load_day 2026-11-11] 2026-11-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-12T03:00:02Z [load_day 2026-11-11] 2026-11-11 hour 0: 3687 events in 0 files, snapshot none (task 286 ms: download 76 ms overlapping gunzip 35 ms, parse 92 ms, sort 0 ms, write 0 ms, index 72 ms: 1 candidates, 3192 repo-hours, 135 releases; waiting 10 ms; commit 0 ms)
2026-11-12T03:00:02Z [load_day 2026-11-11] 2026-11-11 hour 1: 3576 events in 0 files, snapshot none (task 274 ms: download 107 ms overlapping gunzip 32 ms, parse 85 ms, sort 0 ms, write 0 ms, index 61 ms: 1 candidates, 3170 repo-hours, 142 releases; waiting 15 ms; commit 0 ms)
2026-11-12T03:00:03Z [load_day 2026-11-11] 2026-11-11 hour 2: 3795 events in 0 files, snapshot none (task 243 ms: download 77 ms overlapping gunzip 39 ms, parse 104 ms, sort 0 ms, write 0 ms, index 38 ms: 0 candidates, 3302 repo-hours, 193 releases; waiting 15 ms; commit 0 ms)
2026-11-12T03:00:03Z [load_day 2026-11-11] 2026-11-11 hour 3: 3807 events in 0 files, snapshot none (task 284 ms: download 78 ms overlapping gunzip 39 ms, parse 97 ms, sort 0 ms, write 0 ms, index 84 ms: 1 candidates, 3372 repo-hours, 208 releases; waiting 14 ms; commit 0 ms)
2026-11-12T03:00:04Z [load_day 2026-11-11] 2026-11-11 hour 4: 4060 events in 0 files, snapshot none (task 267 ms: download 87 ms overlapping gunzip 37 ms, parse 92 ms, sort 0 ms, write 0 ms, index 62 ms: 1 candidates, 3534 repo-hours, 241 releases; waiting 20 ms; commit 0 ms)
2026-11-12T03:00:04Z [load_day 2026-11-11] 2026-11-11 hour 5: 4069 events in 0 files, snapshot none (task 275 ms: download 77 ms overlapping gunzip 42 ms, parse 97 ms, sort 0 ms, write 0 ms, index 50 ms: 0 candidates, 3527 repo-hours, 242 releases; waiting 16 ms; commit 0 ms)
2026-11-12T03:00:05Z [load_day 2026-11-11] 2026-11-11 hour 6: 3798 events in 0 files, snapshot none (task 267 ms: download 79 ms overlapping gunzip 35 ms, parse 90 ms, sort 0 ms, write 0 ms, index 47 ms: 0 candidates, 3344 repo-hours, 294 releases; waiting 22 ms; commit 0 ms)
2026-11-12T03:00:05Z [load_day 2026-11-11] 2026-11-11 hour 7: 3961 events in 0 files, snapshot none (task 257 ms: download 70 ms overlapping gunzip 37 ms, parse 95 ms, sort 0 ms, write 0 ms, index 40 ms: 0 candidates, 3532 repo-hours, 337 releases; waiting 18 ms; commit 0 ms)
2026-11-12T03:00:06Z [load_day 2026-11-11] 2026-11-11 hour 8: 3870 events in 0 files, snapshot none (task 258 ms: download 81 ms overlapping gunzip 36 ms, parse 95 ms, sort 0 ms, write 0 ms, index 54 ms: 1 candidates, 3491 repo-hours, 276 releases; waiting 18 ms; commit 0 ms)
2026-11-12T03:00:06Z [load_day 2026-11-11] 2026-11-11 hour 9: 3928 events in 0 files, snapshot none (task 237 ms: download 85 ms overlapping gunzip 32 ms, parse 89 ms, sort 0 ms, write 0 ms, index 40 ms: 0 candidates, 3555 repo-hours, 325 releases; waiting 20 ms; commit 0 ms)
2026-11-12T03:00:07Z [load_day 2026-11-11] 2026-11-11 hour 10: 4000 events in 0 files, snapshot none (task 264 ms: download 91 ms overlapping gunzip 32 ms, parse 92 ms, sort 0 ms, write 0 ms, index 64 ms: 1 candidates, 3446 repo-hours, 292 releases; waiting 16 ms; commit 0 ms)
2026-11-12T03:00:07Z [load_day 2026-11-11] 2026-11-11 hour 11: 4489 events in 0 files, snapshot none (task 247 ms: download 77 ms overlapping gunzip 33 ms, parse 96 ms, sort 0 ms, write 0 ms, index 42 ms: 0 candidates, 3921 repo-hours, 361 releases; waiting 15 ms; commit 0 ms)
2026-11-12T03:00:07Z [load_day 2026-11-11] 2026-11-11 hour 12: 4391 events in 0 files, snapshot none (task 293 ms: download 80 ms overlapping gunzip 34 ms, parse 98 ms, sort 0 ms, write 0 ms, index 65 ms: 1 candidates, 3936 repo-hours, 306 releases; waiting 20 ms; commit 0 ms)
2026-11-12T03:00:08Z [load_day 2026-11-11] 2026-11-11 hour 13: 4296 events in 0 files, snapshot none (task 238 ms: download 67 ms overlapping gunzip 31 ms, parse 86 ms, sort 0 ms, write 0 ms, index 52 ms: 2 candidates, 3881 repo-hours, 388 releases; waiting 18 ms; commit 0 ms)
2026-11-12T03:00:08Z [load_day 2026-11-11] 2026-11-11 hour 14: 3960 events in 0 files, snapshot none (task 236 ms: download 68 ms overlapping gunzip 30 ms, parse 81 ms, sort 0 ms, write 0 ms, index 47 ms: 1 candidates, 3584 repo-hours, 293 releases; waiting 15 ms; commit 0 ms)
2026-11-12T03:00:08Z [load_day 2026-11-11] 2026-11-11 hour 15: 5409 events in 0 files, snapshot none (task 271 ms: download 76 ms overlapping gunzip 36 ms, parse 104 ms, sort 0 ms, write 0 ms, index 54 ms: 0 candidates, 4815 repo-hours, 382 releases; waiting 13 ms; commit 0 ms)
2026-11-12T03:00:09Z [load_day 2026-11-11] 2026-11-11 hour 16: 4365 events in 0 files, snapshot none (task 258 ms: download 71 ms overlapping gunzip 31 ms, parse 81 ms, sort 0 ms, write 0 ms, index 69 ms: 0 candidates, 3834 repo-hours, 247 releases; waiting 18 ms; commit 0 ms)
2026-11-12T03:00:09Z [load_day 2026-11-11] 2026-11-11 hour 17: 3894 events in 0 files, snapshot none (task 255 ms: download 69 ms overlapping gunzip 32 ms, parse 94 ms, sort 0 ms, write 0 ms, index 40 ms: 0 candidates, 3581 repo-hours, 297 releases; waiting 20 ms; commit 0 ms)
2026-11-12T03:00:10Z [load_day 2026-11-11] 2026-11-11 hour 18: 3988 events in 0 files, snapshot none (task 247 ms: download 65 ms overlapping gunzip 29 ms, parse 81 ms, sort 0 ms, write 0 ms, index 69 ms: 1 candidates, 3603 repo-hours, 243 releases; waiting 18 ms; commit 0 ms)
2026-11-12T03:00:10Z [load_day 2026-11-11] 2026-11-11 hour 19: 3723 events in 0 files, snapshot none (task 223 ms: download 56 ms overlapping gunzip 28 ms, parse 72 ms, sort 0 ms, write 0 ms, index 51 ms: 1 candidates, 3350 repo-hours, 184 releases; waiting 16 ms; commit 0 ms)
2026-11-12T03:00:11Z [load_day 2026-11-11] 2026-11-11 hour 20: 3378 events in 0 files, snapshot none (task 232 ms: download 77 ms overlapping gunzip 28 ms, parse 66 ms, sort 0 ms, write 0 ms, index 53 ms: 1 candidates, 3047 repo-hours, 91 releases; waiting 20 ms; commit 0 ms)
2026-11-12T03:00:11Z [load_day 2026-11-11] 2026-11-11 hour 21: 12290 events in 0 files, snapshot none (task 329 ms: download 86 ms overlapping gunzip 47 ms, parse 116 ms, sort 0 ms, write 0 ms, index 91 ms: 3 candidates, 10264 repo-hours, 146 releases; waiting 20 ms; commit 0 ms)
2026-11-12T03:00:12Z [load_day 2026-11-11] 2026-11-11 hour 22: 12957 events in 0 files, snapshot none (task 342 ms: download 133 ms overlapping gunzip 49 ms, parse 122 ms, sort 0 ms, write 0 ms, index 94 ms: 4 candidates, 10858 repo-hours, 177 releases; waiting 16 ms; commit 0 ms)
2026-11-12T03:00:12Z [load_day 2026-11-11] 2026-11-11 hour 23: 8295 events in 0 files, snapshot none (task 363 ms: download 105 ms overlapping gunzip 50 ms, parse 133 ms, sort 0 ms, write 0 ms, index 80 ms: 0 candidates, 7117 repo-hours, 198 releases; waiting 11 ms; commit 0 ms)
2026-11-12T03:00:13Z [load_day 2026-11-11] 2026-11-11: repo_hour merged from 24 files to 1 (103256 rows, 1460 ms)
2026-11-12T03:00:21Z [load_day 2026-11-11] 2026-11-11: index committed in 9126 ms (14 + 1 + 24 files)
2026-11-12T03:00:21Z [load_day 2026-11-11] 2026-11-11: 117986 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-12T03:00:21Z [load_day 2026-11-11] attempt 1 succeeded