load_day 2026-11-09, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

be5d0c462014:101730

Started

2026-11-10T02:00:00Z

Ended

2026-11-10T02:00:16Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

237 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

9.2 s, up to 0.9 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/5182/load_day/2026-11-09/1.log

Code

pipelines/gharchive.mojo:151↗

2026-11-10T02:00:00Z [load_day 2026-11-09] attempt 1 started
2026-11-10T02:00:01Z [load_day 2026-11-09] 2026-11-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-10T02:00:02Z [load_day 2026-11-09] 2026-11-09 hour 0: 7528 events in 0 files, snapshot none (task 533 ms: download 76 ms overlapping gunzip 62 ms, parse 153 ms, sort 0 ms, write 0 ms, index 83 ms: 5 candidates, 6366 repo-hours, 109 releases; waiting 7 ms; commit 0 ms)
2026-11-10T02:00:02Z [load_day 2026-11-09] 2026-11-09 hour 1: 7440 events in 0 files, snapshot none (task 478 ms: download 131 ms overlapping gunzip 50 ms, parse 134 ms, sort 0 ms, write 0 ms, index 74 ms: 1 candidates, 6339 repo-hours, 85 releases; waiting 11 ms; commit 0 ms)
2026-11-10T02:00:03Z [load_day 2026-11-09] 2026-11-09 hour 2: 5294 events in 0 files, snapshot none (task 276 ms: download 92 ms overlapping gunzip 34 ms, parse 100 ms, sort 0 ms, write 0 ms, index 57 ms: 0 candidates, 4640 repo-hours, 107 releases; waiting 8 ms; commit 0 ms)
2026-11-10T02:00:03Z [load_day 2026-11-09] 2026-11-09 hour 3: 5604 events in 0 files, snapshot none (task 400 ms: download 75 ms overlapping gunzip 52 ms, parse 93 ms, sort 0 ms, write 0 ms, index 49 ms: 0 candidates, 4897 repo-hours, 98 releases; waiting 15 ms; commit 0 ms)
2026-11-10T02:00:04Z [load_day 2026-11-09] 2026-11-09 hour 4: 6027 events in 0 files, snapshot none (task 425 ms: download 73 ms overlapping gunzip 37 ms, parse 89 ms, sort 0 ms, write 0 ms, index 91 ms: 1 candidates, 5309 repo-hours, 113 releases; waiting 16 ms; commit 0 ms)
2026-11-10T02:00:04Z [load_day 2026-11-09] 2026-11-09 hour 5: 6115 events in 0 files, snapshot none (task 476 ms: download 71 ms overlapping gunzip 46 ms, parse 101 ms, sort 0 ms, write 0 ms, index 103 ms: 2 candidates, 5356 repo-hours, 89 releases; waiting 18 ms; commit 0 ms)
2026-11-10T02:00:05Z [load_day 2026-11-09] 2026-11-09 hour 6: 5194 events in 0 files, snapshot none (task 409 ms: download 72 ms overlapping gunzip 37 ms, parse 101 ms, sort 0 ms, write 0 ms, index 67 ms: 2 candidates, 4681 repo-hours, 131 releases; waiting 9 ms; commit 0 ms)
2026-11-10T02:00:05Z [load_day 2026-11-09] 2026-11-09 hour 7: 3881 events in 0 files, snapshot none (task 427 ms: download 82 ms overlapping gunzip 33 ms, parse 92 ms, sort 0 ms, write 0 ms, index 75 ms: 2 candidates, 3509 repo-hours, 181 releases; waiting 11 ms; commit 0 ms)
2026-11-10T02:00:06Z [load_day 2026-11-09] 2026-11-09 hour 8: 2855 events in 0 files, snapshot none (task 401 ms: download 59 ms overlapping gunzip 36 ms, parse 95 ms, sort 0 ms, write 0 ms, index 48 ms: 0 candidates, 2629 repo-hours, 149 releases; waiting 16 ms; commit 0 ms)
2026-11-10T02:00:06Z [load_day 2026-11-09] 2026-11-09 hour 9: 2734 events in 0 files, snapshot none (task 351 ms: download 72 ms overlapping gunzip 30 ms, parse 78 ms, sort 0 ms, write 0 ms, index 35 ms: 0 candidates, 2522 repo-hours, 175 releases; waiting 18 ms; commit 0 ms)
2026-11-10T02:00:07Z [load_day 2026-11-09] 2026-11-09 hour 10: 2769 events in 0 files, snapshot none (task 214 ms: download 55 ms overlapping gunzip 25 ms, parse 74 ms, sort 0 ms, write 0 ms, index 32 ms: 0 candidates, 2507 repo-hours, 207 releases; waiting 17 ms; commit 0 ms)
2026-11-10T02:00:07Z [load_day 2026-11-09] 2026-11-09 hour 11: 2921 events in 0 files, snapshot none (task 224 ms: download 64 ms overlapping gunzip 27 ms, parse 73 ms, sort 0 ms, write 0 ms, index 47 ms: 1 candidates, 2680 repo-hours, 197 releases; waiting 20 ms; commit 0 ms)
2026-11-10T02:00:08Z [load_day 2026-11-09] 2026-11-09 hour 12: 2958 events in 0 files, snapshot none (task 216 ms: download 49 ms overlapping gunzip 24 ms, parse 68 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 2718 repo-hours, 265 releases; waiting 16 ms; commit 0 ms)
2026-11-10T02:00:08Z [load_day 2026-11-09] 2026-11-09 hour 13: 2959 events in 0 files, snapshot none (task 232 ms: download 51 ms overlapping gunzip 24 ms, parse 68 ms, sort 0 ms, write 0 ms, index 49 ms: 0 candidates, 2771 repo-hours, 197 releases; waiting 19 ms; commit 0 ms)
2026-11-10T02:00:08Z [load_day 2026-11-09] 2026-11-09 hour 14: 3150 events in 0 files, snapshot none (task 206 ms: download 57 ms overlapping gunzip 23 ms, parse 66 ms, sort 0 ms, write 0 ms, index 36 ms: 0 candidates, 2907 repo-hours, 268 releases; waiting 19 ms; commit 0 ms)
2026-11-10T02:00:09Z [load_day 2026-11-09] 2026-11-09 hour 15: 3470 events in 0 files, snapshot none (task 191 ms: download 53 ms overlapping gunzip 21 ms, parse 63 ms, sort 0 ms, write 0 ms, index 34 ms: 0 candidates, 3167 repo-hours, 254 releases; waiting 16 ms; commit 0 ms)
2026-11-10T02:00:09Z [load_day 2026-11-09] 2026-11-09 hour 16: 2898 events in 0 files, snapshot none (task 218 ms: download 48 ms overlapping gunzip 18 ms, parse 55 ms, sort 0 ms, write 0 ms, index 61 ms: 0 candidates, 2704 repo-hours, 207 releases; waiting 25 ms; commit 0 ms)
2026-11-10T02:00:10Z [load_day 2026-11-09] 2026-11-09 hour 17: 4425 events in 0 files, snapshot none (task 229 ms: download 53 ms overlapping gunzip 30 ms, parse 86 ms, sort 0 ms, write 0 ms, index 43 ms: 0 candidates, 3991 repo-hours, 444 releases; waiting 15 ms; commit 0 ms)
2026-11-10T02:00:10Z [load_day 2026-11-09] 2026-11-09 hour 18: 2745 events in 0 files, snapshot none (task 177 ms: download 44 ms overlapping gunzip 17 ms, parse 47 ms, sort 0 ms, write 0 ms, index 42 ms: 0 candidates, 2529 repo-hours, 175 releases; waiting 16 ms; commit 0 ms)
2026-11-10T02:00:11Z [load_day 2026-11-09] 2026-11-09 hour 19: 2819 events in 0 files, snapshot none (task 226 ms: download 64 ms overlapping gunzip 18 ms, parse 53 ms, sort 0 ms, write 0 ms, index 68 ms: 1 candidates, 2637 repo-hours, 145 releases; waiting 22 ms; commit 0 ms)
2026-11-10T02:00:11Z [load_day 2026-11-09] 2026-11-09 hour 20: 2982 events in 0 files, snapshot none (task 235 ms: download 65 ms overlapping gunzip 21 ms, parse 64 ms, sort 0 ms, write 0 ms, index 63 ms: 1 candidates, 2747 repo-hours, 155 releases; waiting 20 ms; commit 0 ms)
2026-11-10T02:00:11Z [load_day 2026-11-09] 2026-11-09 hour 21: 4597 events in 0 files, snapshot none (task 276 ms: download 79 ms overlapping gunzip 36 ms, parse 95 ms, sort 0 ms, write 0 ms, index 65 ms: 2 candidates, 3984 repo-hours, 203 releases; waiting 22 ms; commit 0 ms)
2026-11-10T02:00:11Z [load_day 2026-11-09] 2026-11-09 hour 22: 3144 events in 0 files, snapshot none (task 246 ms: download 73 ms overlapping gunzip 28 ms, parse 81 ms, sort 0 ms, write 0 ms, index 62 ms: 1 candidates, 2876 repo-hours, 132 releases; waiting 17 ms; commit 0 ms)
2026-11-10T02:00:12Z [load_day 2026-11-09] 2026-11-09 hour 23: 3250 events in 0 files, snapshot none (task 221 ms: download 77 ms overlapping gunzip 31 ms, parse 73 ms, sort 0 ms, write 0 ms, index 43 ms: 0 candidates, 2875 repo-hours, 107 releases; waiting 16 ms; commit 0 ms)
2026-11-10T02:00:13Z [load_day 2026-11-09] 2026-11-09: repo_hour merged from 24 files to 1 (87341 rows, 1333 ms)
2026-11-10T02:00:16Z [load_day 2026-11-09] 2026-11-09: index committed in 3440 ms (11 + 1 + 24 files)
2026-11-10T02:00:16Z [load_day 2026-11-09] 2026-11-09: 97759 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-10T02:00:16Z [load_day 2026-11-09] attempt 1 succeeded