orcaLog in

Runs · run 3149

load_day 2024-10-31, attempt 1 succeeded

Host
73ccef5e07c2:200560
Started
2026-11-08T08:35:23Z
Ended
2026-11-08T08:37:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
727 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
162.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3149/load_day/2024-10-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:35:23Z [load_day 2024-10-31] attempt 1 started
2026-11-08T08:35:24Z [load_day 2024-10-31] 2024-10-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:35:31Z [load_day 2024-10-31] 2024-10-31 hour 0: 193576 events in 0 files, snapshot none (task 5783 ms: download 2530 ms overlapping gunzip 846 ms, parse 3509 ms, sort 0 ms, write 0 ms, index 949 ms: 8 candidates, 90640 repo-hours, 1300 releases; waiting 206 ms; commit 0 ms)
2026-11-08T08:35:32Z [load_day 2024-10-31] 2024-10-31 hour 1: 217703 events in 0 files, snapshot none (task 6514 ms: download 3708 ms overlapping gunzip 959 ms, parse 3819 ms, sort 0 ms, write 0 ms, index 928 ms: 7 candidates, 112964 repo-hours, 1030 releases; waiting 484 ms; commit 0 ms)
2026-11-08T08:35:37Z [load_day 2024-10-31] 2024-10-31 hour 2: 187305 events in 0 files, snapshot none (task 6223 ms: download 4213 ms overlapping gunzip 817 ms, parse 3153 ms, sort 0 ms, write 0 ms, index 891 ms: 10 candidates, 81961 repo-hours, 1065 releases; waiting 1033 ms; commit 0 ms)
2026-11-08T08:35:38Z [load_day 2024-10-31] 2024-10-31 hour 3: 194879 events in 0 files, snapshot none (task 6174 ms: download 3267 ms overlapping gunzip 877 ms, parse 3466 ms, sort 0 ms, write 0 ms, index 702 ms: 6 candidates, 75332 repo-hours, 3983 releases; waiting 806 ms; commit 0 ms)
2026-11-08T08:35:43Z [load_day 2024-10-31] 2024-10-31 hour 4: 172301 events in 0 files, snapshot none (task 5502 ms: download 3061 ms overlapping gunzip 843 ms, parse 3337 ms, sort 0 ms, write 0 ms, index 439 ms: 3 candidates, 60811 repo-hours, 980 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:35:45Z [load_day 2024-10-31] 2024-10-31 hour 5: 173410 events in 0 files, snapshot none (task 6001 ms: download 3625 ms overlapping gunzip 887 ms, parse 3686 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 63337 repo-hours, 895 releases; waiting 538 ms; commit 0 ms)
2026-11-08T08:35:51Z [load_day 2024-10-31] 2024-10-31 hour 6: 203827 events in 0 files, snapshot none (task 7286 ms: download 4379 ms overlapping gunzip 1181 ms, parse 4589 ms, sort 0 ms, write 0 ms, index 700 ms: 6 candidates, 89226 repo-hours, 1020 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:35:52Z [load_day 2024-10-31] 2024-10-31 hour 7: 208080 events in 0 files, snapshot none (task 6828 ms: download 4597 ms overlapping gunzip 1208 ms, parse 4286 ms, sort 0 ms, write 0 ms, index 598 ms: 10 candidates, 79582 repo-hours, 886 releases; waiting 456 ms; commit 0 ms)
2026-11-08T08:36:00Z [load_day 2024-10-31] 2024-10-31 hour 8: 223581 events in 0 files, snapshot none (task 8216 ms: download 5641 ms overlapping gunzip 1415 ms, parse 5073 ms, sort 0 ms, write 0 ms, index 737 ms: 11 candidates, 88295 repo-hours, 1267 releases; waiting 589 ms; commit 0 ms)
2026-11-08T08:36:01Z [load_day 2024-10-31] 2024-10-31 hour 9: 235732 events in 0 files, snapshot none (task 8003 ms: download 5691 ms overlapping gunzip 1337 ms, parse 5206 ms, sort 0 ms, write 0 ms, index 720 ms: 6 candidates, 94187 repo-hours, 1352 releases; waiting 475 ms; commit 0 ms)
2026-11-08T08:36:07Z [load_day 2024-10-31] 2024-10-31 hour 10: 228831 events in 0 files, snapshot none (task 6940 ms: download 4861 ms overlapping gunzip 1079 ms, parse 3876 ms, sort 0 ms, write 0 ms, index 618 ms: 7 candidates, 87981 repo-hours, 1297 releases; waiting 1058 ms; commit 0 ms)
2026-11-08T08:36:08Z [load_day 2024-10-31] 2024-10-31 hour 11: 230151 events in 0 files, snapshot none (task 6599 ms: download 4600 ms overlapping gunzip 1081 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 630 ms: 6 candidates, 84858 repo-hours, 1334 releases; waiting 638 ms; commit 0 ms)
2026-11-08T08:36:14Z [load_day 2024-10-31] 2024-10-31 hour 12: 267888 events in 0 files, snapshot none (task 6172 ms: download 3381 ms overlapping gunzip 899 ms, parse 3637 ms, sort 0 ms, write 0 ms, index 1012 ms: 9 candidates, 132397 repo-hours, 1341 releases; waiting 340 ms; commit 0 ms)
2026-11-08T08:36:15Z [load_day 2024-10-31] 2024-10-31 hour 13: 262790 events in 0 files, snapshot none (task 7041 ms: download 4733 ms overlapping gunzip 1108 ms, parse 4069 ms, sort 0 ms, write 0 ms, index 970 ms: 10 candidates, 116408 repo-hours, 1437 releases; waiting 548 ms; commit 0 ms)
2026-11-08T08:36:23Z [load_day 2024-10-31] 2024-10-31 hour 14: 256443 events in 0 files, snapshot none (task 8606 ms: download 5944 ms overlapping gunzip 1433 ms, parse 5763 ms, sort 0 ms, write 0 ms, index 902 ms: 3 candidates, 102318 repo-hours, 1493 releases; waiting 155 ms; commit 0 ms)
2026-11-08T08:36:25Z [load_day 2024-10-31] 2024-10-31 hour 15: 258918 events in 0 files, snapshot none (task 9315 ms: download 6243 ms overlapping gunzip 1472 ms, parse 5522 ms, sort 0 ms, write 0 ms, index 1357 ms: 2 candidates, 108062 repo-hours, 1654 releases; waiting 716 ms; commit 0 ms)
2026-11-08T08:36:32Z [load_day 2024-10-31] 2024-10-31 hour 16: 243858 events in 0 files, snapshot none (task 8514 ms: download 4790 ms overlapping gunzip 1413 ms, parse 5017 ms, sort 0 ms, write 0 ms, index 1262 ms: 6 candidates, 97247 repo-hours, 1482 releases; waiting 545 ms; commit 0 ms)
2026-11-08T08:36:34Z [load_day 2024-10-31] 2024-10-31 hour 17: 231613 events in 0 files, snapshot none (task 7736 ms: download 5195 ms overlapping gunzip 1270 ms, parse 4790 ms, sort 0 ms, write 0 ms, index 674 ms: 8 candidates, 88596 repo-hours, 1188 releases; waiting 732 ms; commit 0 ms)
2026-11-08T08:36:41Z [load_day 2024-10-31] 2024-10-31 hour 18: 237687 events in 0 files, snapshot none (task 8180 ms: download 5239 ms overlapping gunzip 1334 ms, parse 5138 ms, sort 0 ms, write 0 ms, index 838 ms: 8 candidates, 100276 repo-hours, 1353 releases; waiting 575 ms; commit 0 ms)
2026-11-08T08:36:41Z [load_day 2024-10-31] 2024-10-31 hour 19: 228727 events in 0 files, snapshot none (task 7390 ms: download 4874 ms overlapping gunzip 1185 ms, parse 4747 ms, sort 0 ms, write 0 ms, index 668 ms: 12 candidates, 83259 repo-hours, 1298 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:36:49Z [load_day 2024-10-31] 2024-10-31 hour 20: 218454 events in 0 files, snapshot none (task 7363 ms: download 4986 ms overlapping gunzip 1246 ms, parse 4735 ms, sort 0 ms, write 0 ms, index 602 ms: 5 candidates, 80121 repo-hours, 1124 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:36:49Z [load_day 2024-10-31] 2024-10-31 hour 21: 206422 events in 0 files, snapshot none (task 7453 ms: download 5210 ms overlapping gunzip 1268 ms, parse 4779 ms, sort 0 ms, write 0 ms, index 604 ms: 6 candidates, 76168 repo-hours, 1238 releases; waiting 535 ms; commit 0 ms)
2026-11-08T08:36:56Z [load_day 2024-10-31] 2024-10-31 hour 22: 197933 events in 0 files, snapshot none (task 6149 ms: download 3273 ms overlapping gunzip 1019 ms, parse 3681 ms, sort 0 ms, write 0 ms, index 665 ms: 3 candidates, 67936 repo-hours, 1393 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:36:58Z [load_day 2024-10-31] 2024-10-31 hour 23: 193024 events in 0 files, snapshot none (task 7982 ms: download 5915 ms overlapping gunzip 931 ms, parse 3767 ms, sort 0 ms, write 0 ms, index 474 ms: 6 candidates, 65633 repo-hours, 986 releases; waiting 2575 ms; commit 0 ms)
2026-11-08T08:37:07Z [load_day 2024-10-31] 2024-10-31: repo_hour merged from 24 files to 1 (2127595 rows, 9330 ms)
2026-11-08T08:37:10Z [load_day 2024-10-31] 2024-10-31: index committed in 12217 ms (24 + 1 + 24 files)
2026-11-08T08:37:10Z [load_day 2024-10-31] 2024-10-31: 5273133 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:37:10Z [load_day 2024-10-31] attempt 1 succeeded