orcaLog in

Runs · run 5740

load_day 2026-11-11, attempt 1 succeeded

Host
5adca2642bfc:109621
Started
2026-11-12T02:00:00Z
Ended
2026-11-12T02:00:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
249 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
10.6 s, up to 1.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5740/load_day/2026-11-11/1.log
Code
pipelines/gharchive.mojo:151

Log

2026-11-12T02:00:00Z [load_day 2026-11-11] attempt 1 started
2026-11-12T02:00:07Z [load_day 2026-11-11] 2026-11-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-12T02:00:08Z [load_day 2026-11-11] 2026-11-11 hour 0: 3687 events in 0 files, snapshot none (task 287 ms: download 99 ms overlapping gunzip 35 ms, parse 92 ms, sort 0 ms, write 0 ms, index 58 ms: 1 candidates, 3192 repo-hours, 135 releases; waiting 9 ms; commit 0 ms)
2026-11-12T02:00:08Z [load_day 2026-11-11] 2026-11-11 hour 1: 3576 events in 0 files, snapshot none (task 398 ms: download 65 ms overlapping gunzip 36 ms, parse 88 ms, sort 0 ms, write 0 ms, index 68 ms: 1 candidates, 3170 repo-hours, 142 releases; waiting 10 ms; commit 0 ms)
2026-11-12T02:00:08Z [load_day 2026-11-11] 2026-11-11 hour 2: 3795 events in 0 files, snapshot none (task 371 ms: download 84 ms overlapping gunzip 34 ms, parse 89 ms, sort 0 ms, write 0 ms, index 45 ms: 0 candidates, 3302 repo-hours, 193 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:09Z [load_day 2026-11-11] 2026-11-11 hour 3: 3807 events in 0 files, snapshot none (task 453 ms: download 114 ms overlapping gunzip 44 ms, parse 113 ms, sort 0 ms, write 0 ms, index 62 ms: 1 candidates, 3372 repo-hours, 208 releases; waiting 13 ms; commit 0 ms)
2026-11-12T02:00:09Z [load_day 2026-11-11] 2026-11-11 hour 4: 4060 events in 0 files, snapshot none (task 399 ms: download 81 ms overlapping gunzip 36 ms, parse 90 ms, sort 0 ms, write 0 ms, index 52 ms: 1 candidates, 3534 repo-hours, 241 releases; waiting 20 ms; commit 0 ms)
2026-11-12T02:00:11Z [load_day 2026-11-11] 2026-11-11 hour 5: 4069 events in 0 files, snapshot none (task 1646 ms: download 1151 ms overlapping gunzip 48 ms, parse 122 ms, sort 0 ms, write 0 ms, index 66 ms: 0 candidates, 3527 repo-hours, 242 releases; waiting 1019 ms; commit 0 ms)
2026-11-12T02:00:11Z [load_day 2026-11-11] 2026-11-11 hour 6: 3798 events in 0 files, snapshot none (task 773 ms: download 80 ms overlapping gunzip 35 ms, parse 96 ms, sort 0 ms, write 0 ms, index 48 ms: 0 candidates, 3344 repo-hours, 294 releases; waiting 12 ms; commit 0 ms)
2026-11-12T02:00:12Z [load_day 2026-11-11] 2026-11-11 hour 7: 3961 events in 0 files, snapshot none (task 434 ms: download 72 ms overlapping gunzip 38 ms, parse 92 ms, sort 0 ms, write 0 ms, index 56 ms: 0 candidates, 3532 repo-hours, 337 releases; waiting 19 ms; commit 0 ms)
2026-11-12T02:00:17Z [load_day 2026-11-11] 2026-11-11 hour 8: 3870 events in 0 files, snapshot none (task 5609 ms: download 73 ms overlapping gunzip 36 ms, parse 97 ms, sort 0 ms, write 0 ms, index 5260 ms: 1 candidates, 3491 repo-hours, 276 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:21Z [load_day 2026-11-11] 2026-11-11 hour 9: 3928 events in 0 files, snapshot none (task 3656 ms: download 77 ms overlapping gunzip 31 ms, parse 82 ms, sort 0 ms, write 0 ms, index 3327 ms: 0 candidates, 3555 repo-hours, 325 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:21Z [load_day 2026-11-11] 2026-11-11 hour 10: 4000 events in 0 files, snapshot none (task 414 ms: download 83 ms overlapping gunzip 33 ms, parse 100 ms, sort 0 ms, write 0 ms, index 57 ms: 1 candidates, 3446 repo-hours, 292 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:22Z [load_day 2026-11-11] 2026-11-11 hour 11: 4489 events in 0 files, snapshot none (task 420 ms: download 64 ms overlapping gunzip 33 ms, parse 97 ms, sort 0 ms, write 0 ms, index 67 ms: 0 candidates, 3921 repo-hours, 361 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:23Z [load_day 2026-11-11] 2026-11-11 hour 12: 4391 events in 0 files, snapshot none (task 1114 ms: download 698 ms overlapping gunzip 40 ms, parse 117 ms, sort 0 ms, write 0 ms, index 61 ms: 1 candidates, 3936 repo-hours, 306 releases; waiting 552 ms; commit 0 ms)
2026-11-12T02:00:23Z [load_day 2026-11-11] 2026-11-11 hour 13: 4296 events in 0 files, snapshot none (task 269 ms: download 76 ms overlapping gunzip 32 ms, parse 87 ms, sort 0 ms, write 0 ms, index 65 ms: 2 candidates, 3881 repo-hours, 388 releases; waiting 15 ms; commit 0 ms)
2026-11-12T02:00:24Z [load_day 2026-11-11] 2026-11-11 hour 14: 3960 events in 0 files, snapshot none (task 240 ms: download 64 ms overlapping gunzip 33 ms, parse 80 ms, sort 0 ms, write 0 ms, index 62 ms: 1 candidates, 3584 repo-hours, 293 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:24Z [load_day 2026-11-11] 2026-11-11 hour 15: 5409 events in 0 files, snapshot none (task 1028 ms: download 716 ms overlapping gunzip 47 ms, parse 134 ms, sort 0 ms, write 0 ms, index 55 ms: 0 candidates, 4815 repo-hours, 382 releases; waiting 548 ms; commit 0 ms)
2026-11-12T02:00:24Z [load_day 2026-11-11] 2026-11-11 hour 16: 4365 events in 0 files, snapshot none (task 237 ms: download 86 ms overlapping gunzip 33 ms, parse 86 ms, sort 0 ms, write 0 ms, index 48 ms: 0 candidates, 3834 repo-hours, 247 releases; waiting 21 ms; commit 0 ms)
2026-11-12T02:00:25Z [load_day 2026-11-11] 2026-11-11 hour 17: 3894 events in 0 files, snapshot none (task 250 ms: download 71 ms overlapping gunzip 31 ms, parse 89 ms, sort 0 ms, write 0 ms, index 52 ms: 0 candidates, 3581 repo-hours, 297 releases; waiting 19 ms; commit 0 ms)
2026-11-12T02:00:25Z [load_day 2026-11-11] 2026-11-11 hour 18: 3988 events in 0 files, snapshot none (task 257 ms: download 69 ms overlapping gunzip 34 ms, parse 88 ms, sort 0 ms, write 0 ms, index 53 ms: 1 candidates, 3603 repo-hours, 243 releases; waiting 19 ms; commit 0 ms)
2026-11-12T02:00:26Z [load_day 2026-11-11] 2026-11-11 hour 19: 3723 events in 0 files, snapshot none (task 264 ms: download 63 ms overlapping gunzip 35 ms, parse 84 ms, sort 0 ms, write 0 ms, index 61 ms: 1 candidates, 3350 repo-hours, 184 releases; waiting 16 ms; commit 0 ms)
2026-11-12T02:00:26Z [load_day 2026-11-11] 2026-11-11 hour 20: 3378 events in 0 files, snapshot none (task 220 ms: download 81 ms overlapping gunzip 29 ms, parse 66 ms, sort 0 ms, write 0 ms, index 49 ms: 1 candidates, 3047 repo-hours, 91 releases; waiting 18 ms; commit 0 ms)
2026-11-12T02:00:27Z [load_day 2026-11-11] 2026-11-11 hour 21: 12290 events in 0 files, snapshot none (task 468 ms: download 107 ms overlapping gunzip 45 ms, parse 115 ms, sort 0 ms, write 0 ms, index 94 ms: 3 candidates, 10264 repo-hours, 146 releases; waiting 17 ms; commit 0 ms)
2026-11-12T02:00:27Z [load_day 2026-11-11] 2026-11-11 hour 22: 12957 events in 0 files, snapshot none (task 343 ms: download 104 ms overlapping gunzip 50 ms, parse 124 ms, sort 0 ms, write 0 ms, index 94 ms: 4 candidates, 10858 repo-hours, 177 releases; waiting 17 ms; commit 0 ms)
2026-11-12T02:00:28Z [load_day 2026-11-11] 2026-11-11 hour 23: 8295 events in 0 files, snapshot none (task 319 ms: download 107 ms overlapping gunzip 51 ms, parse 133 ms, sort 0 ms, write 0 ms, index 61 ms: 0 candidates, 7117 repo-hours, 198 releases; waiting 8 ms; commit 0 ms)
2026-11-12T02:00:29Z [load_day 2026-11-11] 2026-11-11: repo_hour merged from 24 files to 1 (103256 rows, 1431 ms)
2026-11-12T02:00:31Z [load_day 2026-11-11] 2026-11-11: index committed in 3123 ms (14 + 1 + 24 files)
2026-11-12T02:00:31Z [load_day 2026-11-11] 2026-11-11: 117986 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-12T02:00:31Z [load_day 2026-11-11] attempt 1 succeeded