orcaLog in

Runs · run 3116

load_day 2024-10-22, attempt 1 succeeded

Host
73ccef5e07c2:196359
Started
2026-11-08T08:27:03Z
Ended
2026-11-08T08:28:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
926 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
177.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3116/load_day/2024-10-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:27:03Z [load_day 2024-10-22] attempt 1 started
2026-11-08T08:27:04Z [load_day 2024-10-22] 2024-10-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:27:10Z [load_day 2024-10-22] 2024-10-22 hour 0: 194749 events in 0 files, snapshot none (task 5836 ms: download 3227 ms overlapping gunzip 973 ms, parse 3702 ms, sort 0 ms, write 0 ms, index 673 ms: 2 candidates, 91436 repo-hours, 1078 releases; waiting 181 ms; commit 0 ms)
2026-11-08T08:27:11Z [load_day 2024-10-22] 2024-10-22 hour 1: 213886 events in 0 files, snapshot none (task 6382 ms: download 3670 ms overlapping gunzip 990 ms, parse 3747 ms, sort 0 ms, write 0 ms, index 911 ms: 4 candidates, 112339 repo-hours, 907 releases; waiting 492 ms; commit 0 ms)
2026-11-08T08:27:18Z [load_day 2024-10-22] 2024-10-22 hour 2: 192946 events in 0 files, snapshot none (task 7116 ms: download 4367 ms overlapping gunzip 1055 ms, parse 4484 ms, sort 0 ms, write 0 ms, index 731 ms: 6 candidates, 83127 repo-hours, 898 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:27:18Z [load_day 2024-10-22] 2024-10-22 hour 3: 217774 events in 0 files, snapshot none (task 6898 ms: download 4195 ms overlapping gunzip 1104 ms, parse 4328 ms, sort 0 ms, write 0 ms, index 702 ms: 5 candidates, 83227 repo-hours, 3982 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:27:24Z [load_day 2024-10-22] 2024-10-22 hour 4: 194837 events in 0 files, snapshot none (task 6516 ms: download 3460 ms overlapping gunzip 1011 ms, parse 3952 ms, sort 0 ms, write 0 ms, index 708 ms: 3 candidates, 70596 repo-hours, 757 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:27:26Z [load_day 2024-10-22] 2024-10-22 hour 5: 206238 events in 0 files, snapshot none (task 7435 ms: download 4667 ms overlapping gunzip 1292 ms, parse 4751 ms, sort 0 ms, write 0 ms, index 624 ms: 5 candidates, 75117 repo-hours, 904 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:27:32Z [load_day 2024-10-22] 2024-10-22 hour 6: 236484 events in 0 files, snapshot none (task 7051 ms: download 3915 ms overlapping gunzip 1124 ms, parse 4212 ms, sort 0 ms, write 0 ms, index 860 ms: 19 candidates, 101626 repo-hours, 1009 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:27:34Z [load_day 2024-10-22] 2024-10-22 hour 7: 235623 events in 0 files, snapshot none (task 7048 ms: download 4436 ms overlapping gunzip 1187 ms, parse 4566 ms, sort 0 ms, write 0 ms, index 843 ms: 10 candidates, 92251 repo-hours, 1215 releases; waiting 202 ms; commit 0 ms)
2026-11-08T08:27:42Z [load_day 2024-10-22] 2024-10-22 hour 8: 254288 events in 0 files, snapshot none (task 9128 ms: download 6296 ms overlapping gunzip 1591 ms, parse 5694 ms, sort 0 ms, write 0 ms, index 1110 ms: 20 candidates, 104646 repo-hours, 1243 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:27:43Z [load_day 2024-10-22] 2024-10-22 hour 9: 260556 events in 0 files, snapshot none (task 8741 ms: download 6132 ms overlapping gunzip 1477 ms, parse 5649 ms, sort 0 ms, write 0 ms, index 884 ms: 28 candidates, 106579 repo-hours, 1384 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:27:50Z [load_day 2024-10-22] 2024-10-22 hour 10: 245538 events in 0 files, snapshot none (task 8478 ms: download 5713 ms overlapping gunzip 1405 ms, parse 5444 ms, sort 0 ms, write 0 ms, index 818 ms: 32 candidates, 97175 repo-hours, 1399 releases; waiting 555 ms; commit 0 ms)
2026-11-08T08:27:52Z [load_day 2024-10-22] 2024-10-22 hour 11: 252232 events in 0 files, snapshot none (task 8243 ms: download 5429 ms overlapping gunzip 1431 ms, parse 5195 ms, sort 0 ms, write 0 ms, index 708 ms: 27 candidates, 93702 repo-hours, 1302 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:28:00Z [load_day 2024-10-22] 2024-10-22 hour 12: 282848 events in 0 files, snapshot none (task 8909 ms: download 5514 ms overlapping gunzip 1353 ms, parse 5484 ms, sort 0 ms, write 0 ms, index 1227 ms: 29 candidates, 140508 repo-hours, 1437 releases; waiting 557 ms; commit 0 ms)
2026-11-08T08:28:02Z [load_day 2024-10-22] 2024-10-22 hour 13: 279534 events in 0 files, snapshot none (task 9316 ms: download 6492 ms overlapping gunzip 1504 ms, parse 5959 ms, sort 0 ms, write 0 ms, index 1095 ms: 19 candidates, 124489 repo-hours, 1430 releases; waiting 476 ms; commit 0 ms)
2026-11-08T08:28:09Z [load_day 2024-10-22] 2024-10-22 hour 14: 267236 events in 0 files, snapshot none (task 8550 ms: download 6103 ms overlapping gunzip 1447 ms, parse 5494 ms, sort 0 ms, write 0 ms, index 848 ms: 22 candidates, 110390 repo-hours, 1341 releases; waiting 538 ms; commit 0 ms)
2026-11-08T08:28:10Z [load_day 2024-10-22] 2024-10-22 hour 15: 273077 events in 0 files, snapshot none (task 7713 ms: download 5372 ms overlapping gunzip 1285 ms, parse 4881 ms, sort 0 ms, write 0 ms, index 782 ms: 16 candidates, 114525 repo-hours, 1459 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:28:16Z [load_day 2024-10-22] 2024-10-22 hour 16: 257170 events in 0 files, snapshot none (task 6834 ms: download 4473 ms overlapping gunzip 1147 ms, parse 4200 ms, sort 0 ms, write 0 ms, index 708 ms: 19 candidates, 104889 repo-hours, 1270 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:28:17Z [load_day 2024-10-22] 2024-10-22 hour 17: 256228 events in 0 files, snapshot none (task 7142 ms: download 4733 ms overlapping gunzip 1193 ms, parse 4490 ms, sort 0 ms, write 0 ms, index 709 ms: 14 candidates, 97273 repo-hours, 1160 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:28:24Z [load_day 2024-10-22] 2024-10-22 hour 18: 258863 events in 0 files, snapshot none (task 7706 ms: download 4589 ms overlapping gunzip 1108 ms, parse 4269 ms, sort 0 ms, write 0 ms, index 1459 ms: 19 candidates, 110786 repo-hours, 1320 releases; waiting 599 ms; commit 0 ms)
2026-11-08T08:28:25Z [load_day 2024-10-22] 2024-10-22 hour 19: 236471 events in 0 files, snapshot none (task 6744 ms: download 3932 ms overlapping gunzip 1090 ms, parse 3955 ms, sort 0 ms, write 0 ms, index 876 ms: 16 candidates, 87295 repo-hours, 1290 releases; waiting 598 ms; commit 0 ms)
2026-11-08T08:28:33Z [load_day 2024-10-22] 2024-10-22 hour 20: 226615 events in 0 files, snapshot none (task 8200 ms: download 4854 ms overlapping gunzip 1436 ms, parse 5216 ms, sort 0 ms, write 0 ms, index 752 ms: 16 candidates, 83984 repo-hours, 1176 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:28:33Z [load_day 2024-10-22] 2024-10-22 hour 21: 218953 events in 0 files, snapshot none (task 7602 ms: download 4499 ms overlapping gunzip 1265 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 831 ms: 10 candidates, 79439 repo-hours, 1340 releases; waiting 558 ms; commit 0 ms)
2026-11-08T08:28:41Z [load_day 2024-10-22] 2024-10-22 hour 22: 202157 events in 0 files, snapshot none (task 7188 ms: download 4192 ms overlapping gunzip 1254 ms, parse 4742 ms, sort 0 ms, write 0 ms, index 575 ms: 9 candidates, 68485 repo-hours, 1327 releases; waiting 351 ms; commit 0 ms)
2026-11-08T08:28:41Z [load_day 2024-10-22] 2024-10-22 hour 23: 191151 events in 0 files, snapshot none (task 6817 ms: download 3625 ms overlapping gunzip 1132 ms, parse 4172 ms, sort 0 ms, write 0 ms, index 691 ms: 10 candidates, 65686 repo-hours, 895 releases; waiting 500 ms; commit 0 ms)
2026-11-08T08:28:51Z [load_day 2024-10-22] 2024-10-22: repo_hour merged from 24 files to 1 (2299570 rows, 10097 ms)
2026-11-08T08:28:54Z [load_day 2024-10-22] 2024-10-22: index committed in 12668 ms (24 + 1 + 24 files)
2026-11-08T08:28:54Z [load_day 2024-10-22] 2024-10-22: 5655454 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:28:54Z [load_day 2024-10-22] attempt 1 succeeded