orcaLog in

Runs · run 3000

load_day 2024-09-24, attempt 1 succeeded

Host
73ccef5e07c2:182389
Started
2026-11-08T08:03:58Z
Ended
2026-11-08T08:05:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
731 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
161.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3000/load_day/2024-09-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:03:58Z [load_day 2024-09-24] attempt 1 started
2026-11-08T08:03:59Z [load_day 2024-09-24] 2024-09-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:04:06Z [load_day 2024-09-24] 2024-09-24 hour 0: 193228 events in 0 files, snapshot none (task 6824 ms: download 3974 ms overlapping gunzip 1057 ms, parse 4127 ms, sort 0 ms, write 0 ms, index 833 ms: 18 candidates, 91661 repo-hours, 1139 releases; waiting 495 ms; commit 0 ms)
2026-11-08T08:04:06Z [load_day 2024-09-24] 2024-09-24 hour 1: 205600 events in 0 files, snapshot none (task 6838 ms: download 3874 ms overlapping gunzip 1055 ms, parse 3994 ms, sort 0 ms, write 0 ms, index 1000 ms: 7 candidates, 110252 repo-hours, 902 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:04:13Z [load_day 2024-09-24] 2024-09-24 hour 2: 182823 events in 0 files, snapshot none (task 6533 ms: download 3555 ms overlapping gunzip 993 ms, parse 3654 ms, sort 0 ms, write 0 ms, index 827 ms: 10 candidates, 83080 repo-hours, 999 releases; waiting 685 ms; commit 0 ms)
2026-11-08T08:04:13Z [load_day 2024-09-24] 2024-09-24 hour 3: 195145 events in 0 files, snapshot none (task 6385 ms: download 3443 ms overlapping gunzip 984 ms, parse 3723 ms, sort 0 ms, write 0 ms, index 824 ms: 8 candidates, 79742 repo-hours, 4051 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:04:21Z [load_day 2024-09-24] 2024-09-24 hour 4: 179179 events in 0 files, snapshot none (task 7273 ms: download 4104 ms overlapping gunzip 1263 ms, parse 4515 ms, sort 0 ms, write 0 ms, index 641 ms: 8 candidates, 69459 repo-hours, 844 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:04:22Z [load_day 2024-09-24] 2024-09-24 hour 5: 187792 events in 0 files, snapshot none (task 7768 ms: download 4383 ms overlapping gunzip 1213 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 676 ms: 17 candidates, 72827 repo-hours, 890 releases; waiting 508 ms; commit 0 ms)
2026-11-08T08:04:29Z [load_day 2024-09-24] 2024-09-24 hour 6: 224336 events in 0 files, snapshot none (task 6996 ms: download 4026 ms overlapping gunzip 1063 ms, parse 4177 ms, sort 0 ms, write 0 ms, index 1044 ms: 8 candidates, 98982 repo-hours, 1225 releases; waiting 388 ms; commit 0 ms)
2026-11-08T08:04:30Z [load_day 2024-09-24] 2024-09-24 hour 7: 223458 events in 0 files, snapshot none (task 7458 ms: download 4294 ms overlapping gunzip 1218 ms, parse 4585 ms, sort 0 ms, write 0 ms, index 718 ms: 7 candidates, 90837 repo-hours, 1152 releases; waiting 541 ms; commit 0 ms)
2026-11-08T08:04:38Z [load_day 2024-09-24] 2024-09-24 hour 8: 242487 events in 0 files, snapshot none (task 7929 ms: download 5318 ms overlapping gunzip 1341 ms, parse 5317 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 99404 repo-hours, 1372 releases; waiting 181 ms; commit 0 ms)
2026-11-08T08:04:38Z [load_day 2024-09-24] 2024-09-24 hour 9: 247872 events in 0 files, snapshot none (task 8052 ms: download 4981 ms overlapping gunzip 1254 ms, parse 4752 ms, sort 0 ms, write 0 ms, index 911 ms: 16 candidates, 103596 repo-hours, 1493 releases; waiting 763 ms; commit 0 ms)
2026-11-08T08:04:46Z [load_day 2024-09-24] 2024-09-24 hour 10: 231890 events in 0 files, snapshot none (task 7476 ms: download 5050 ms overlapping gunzip 1190 ms, parse 4430 ms, sort 0 ms, write 0 ms, index 724 ms: 10 candidates, 94322 repo-hours, 1198 releases; waiting 811 ms; commit 0 ms)
2026-11-08T08:04:46Z [load_day 2024-09-24] 2024-09-24 hour 11: 232281 events in 0 files, snapshot none (task 7155 ms: download 4737 ms overlapping gunzip 1135 ms, parse 4545 ms, sort 0 ms, write 0 ms, index 645 ms: 17 candidates, 92368 repo-hours, 1238 releases; waiting 481 ms; commit 0 ms)
2026-11-08T08:04:56Z [load_day 2024-09-24] 2024-09-24 hour 12: 277242 events in 0 files, snapshot none (task 9442 ms: download 6677 ms overlapping gunzip 1319 ms, parse 5180 ms, sort 0 ms, write 0 ms, index 954 ms: 15 candidates, 139170 repo-hours, 1522 releases; waiting 1726 ms; commit 0 ms)
2026-11-08T08:04:56Z [load_day 2024-09-24] 2024-09-24 hour 13: 271888 events in 0 files, snapshot none (task 7753 ms: download 5236 ms overlapping gunzip 1318 ms, parse 5090 ms, sort 0 ms, write 0 ms, index 881 ms: 11 candidates, 124843 repo-hours, 1329 releases; waiting 201 ms; commit 0 ms)
2026-11-08T08:05:04Z [load_day 2024-09-24] 2024-09-24 hour 14: 264483 events in 0 files, snapshot none (task 7621 ms: download 5133 ms overlapping gunzip 1265 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 784 ms: 5 candidates, 111563 repo-hours, 1471 releases; waiting 580 ms; commit 0 ms)
2026-11-08T08:05:04Z [load_day 2024-09-24] 2024-09-24 hour 15: 262335 events in 0 files, snapshot none (task 7755 ms: download 5234 ms overlapping gunzip 1307 ms, parse 4840 ms, sort 0 ms, write 0 ms, index 729 ms: 10 candidates, 113672 repo-hours, 1422 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:05:11Z [load_day 2024-09-24] 2024-09-24 hour 16: 246141 events in 0 files, snapshot none (task 6725 ms: download 3915 ms overlapping gunzip 1047 ms, parse 3875 ms, sort 0 ms, write 0 ms, index 951 ms: 12 candidates, 103635 repo-hours, 1267 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:05:11Z [load_day 2024-09-24] 2024-09-24 hour 17: 237540 events in 0 files, snapshot none (task 6751 ms: download 3942 ms overlapping gunzip 988 ms, parse 3770 ms, sort 0 ms, write 0 ms, index 1063 ms: 17 candidates, 99383 repo-hours, 1187 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:05:20Z [load_day 2024-09-24] 2024-09-24 hour 18: 242604 events in 0 files, snapshot none (task 8681 ms: download 6012 ms overlapping gunzip 1320 ms, parse 5010 ms, sort 0 ms, write 0 ms, index 813 ms: 14 candidates, 108707 repo-hours, 1311 releases; waiting 1259 ms; commit 0 ms)
2026-11-08T08:05:20Z [load_day 2024-09-24] 2024-09-24 hour 19: 217090 events in 0 files, snapshot none (task 6817 ms: download 3720 ms overlapping gunzip 1056 ms, parse 4010 ms, sort 0 ms, write 0 ms, index 904 ms: 8 candidates, 84286 repo-hours, 1328 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:05:27Z [load_day 2024-09-24] 2024-09-24 hour 20: 209656 events in 0 files, snapshot none (task 7207 ms: download 4819 ms overlapping gunzip 1178 ms, parse 4602 ms, sort 0 ms, write 0 ms, index 590 ms: 12 candidates, 83151 repo-hours, 1907 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:05:27Z [load_day 2024-09-24] 2024-09-24 hour 21: 198241 events in 0 files, snapshot none (task 6805 ms: download 4407 ms overlapping gunzip 1141 ms, parse 4306 ms, sort 0 ms, write 0 ms, index 539 ms: 16 candidates, 78367 repo-hours, 4939 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:05:34Z [load_day 2024-09-24] 2024-09-24 hour 22: 178251 events in 0 files, snapshot none (task 6104 ms: download 3911 ms overlapping gunzip 983 ms, parse 3866 ms, sort 0 ms, write 0 ms, index 473 ms: 10 candidates, 64711 repo-hours, 4977 releases; waiting 500 ms; commit 0 ms)
2026-11-08T08:05:34Z [load_day 2024-09-24] 2024-09-24 hour 23: 163336 events in 0 files, snapshot none (task 5997 ms: download 3389 ms overlapping gunzip 899 ms, parse 3699 ms, sort 0 ms, write 0 ms, index 517 ms: 5 candidates, 60577 repo-hours, 2139 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:05:44Z [load_day 2024-09-24] 2024-09-24: repo_hour merged from 24 files to 1 (2258595 rows, 10152 ms)
2026-11-08T08:05:47Z [load_day 2024-09-24] 2024-09-24: index committed in 12908 ms (24 + 1 + 24 files)
2026-11-08T08:05:47Z [load_day 2024-09-24] 2024-09-24: 5314898 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:05:47Z [load_day 2024-09-24] attempt 1 succeeded