orcaLog in

Runs · run 2552

load_day 2024-06-06, attempt 1 succeeded

Host
73ccef5e07c2:132273
Started
2026-11-08T06:25:17Z
Ended
2026-11-08T06:27:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
754 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
177.9 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2552/load_day/2024-06-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:25:17Z [load_day 2024-06-06] attempt 1 started
2026-11-08T06:25:18Z [load_day 2024-06-06] 2024-06-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:25:25Z [load_day 2024-06-06] 2024-06-06 hour 0: 186204 events in 0 files, snapshot none (task 6478 ms: download 3549 ms overlapping gunzip 1060 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 704 ms: 7 candidates, 93722 repo-hours, 1102 releases; waiting 6 ms; commit 0 ms)
2026-11-08T06:25:25Z [load_day 2024-06-06] 2024-06-06 hour 1: 197489 events in 0 files, snapshot none (task 6487 ms: download 3642 ms overlapping gunzip 1095 ms, parse 4469 ms, sort 0 ms, write 0 ms, index 746 ms: 4 candidates, 104712 repo-hours, 883 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:25:31Z [load_day 2024-06-06] 2024-06-06 hour 2: 163251 events in 0 files, snapshot none (task 5658 ms: download 2800 ms overlapping gunzip 881 ms, parse 3686 ms, sort 0 ms, write 0 ms, index 828 ms: 3 candidates, 66118 repo-hours, 853 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:25:32Z [load_day 2024-06-06] 2024-06-06 hour 3: 184307 events in 0 files, snapshot none (task 6037 ms: download 2998 ms overlapping gunzip 1008 ms, parse 4245 ms, sort 0 ms, write 0 ms, index 565 ms: 6 candidates, 73309 repo-hours, 4050 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:25:38Z [load_day 2024-06-06] 2024-06-06 hour 4: 157888 events in 0 files, snapshot none (task 6258 ms: download 2704 ms overlapping gunzip 1098 ms, parse 4397 ms, sort 0 ms, write 0 ms, index 555 ms: 6 candidates, 61122 repo-hours, 696 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:25:38Z [load_day 2024-06-06] 2024-06-06 hour 5: 169907 events in 0 files, snapshot none (task 5985 ms: download 3202 ms overlapping gunzip 1007 ms, parse 4184 ms, sort 0 ms, write 0 ms, index 572 ms: 4 candidates, 67415 repo-hours, 943 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:25:46Z [load_day 2024-06-06] 2024-06-06 hour 6: 205248 events in 0 files, snapshot none (task 7647 ms: download 4568 ms overlapping gunzip 1243 ms, parse 5452 ms, sort 0 ms, write 0 ms, index 728 ms: 8 candidates, 93180 repo-hours, 1070 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:25:46Z [load_day 2024-06-06] 2024-06-06 hour 7: 210118 events in 0 files, snapshot none (task 7449 ms: download 4809 ms overlapping gunzip 1276 ms, parse 5244 ms, sort 0 ms, write 0 ms, index 698 ms: 7 candidates, 86586 repo-hours, 1144 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:25:54Z [load_day 2024-06-06] 2024-06-06 hour 8: 234210 events in 0 files, snapshot none (task 7175 ms: download 4792 ms overlapping gunzip 1250 ms, parse 5060 ms, sort 0 ms, write 0 ms, index 643 ms: 11 candidates, 92075 repo-hours, 1183 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:25:54Z [load_day 2024-06-06] 2024-06-06 hour 9: 241450 events in 0 files, snapshot none (task 7342 ms: download 4942 ms overlapping gunzip 1262 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 662 ms: 8 candidates, 96836 repo-hours, 1391 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:26:01Z [load_day 2024-06-06] 2024-06-06 hour 10: 223477 events in 0 files, snapshot none (task 6966 ms: download 4496 ms overlapping gunzip 1116 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 713 ms: 11 candidates, 90639 repo-hours, 1312 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:26:01Z [load_day 2024-06-06] 2024-06-06 hour 11: 222809 events in 0 files, snapshot none (task 6197 ms: download 3858 ms overlapping gunzip 1049 ms, parse 4317 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 88082 repo-hours, 1136 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:26:10Z [load_day 2024-06-06] 2024-06-06 hour 12: 288148 events in 0 files, snapshot none (task 8874 ms: download 5476 ms overlapping gunzip 1390 ms, parse 6292 ms, sort 0 ms, write 0 ms, index 982 ms: 17 candidates, 140722 repo-hours, 1240 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:26:11Z [load_day 2024-06-06] 2024-06-06 hour 13: 260660 events in 0 files, snapshot none (task 8846 ms: download 6076 ms overlapping gunzip 1530 ms, parse 6225 ms, sort 0 ms, write 0 ms, index 880 ms: 12 candidates, 119472 repo-hours, 1306 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:26:22Z [load_day 2024-06-06] 2024-06-06 hour 14: 244071 events in 0 files, snapshot none (task 10787 ms: download 7483 ms overlapping gunzip 1880 ms, parse 7867 ms, sort 0 ms, write 0 ms, index 841 ms: 11 candidates, 102817 repo-hours, 1307 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:26:22Z [load_day 2024-06-06] 2024-06-06 hour 15: 260716 events in 0 files, snapshot none (task 11167 ms: download 7887 ms overlapping gunzip 1820 ms, parse 8145 ms, sort 0 ms, write 0 ms, index 983 ms: 8 candidates, 107987 repo-hours, 1430 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:26:31Z [load_day 2024-06-06] 2024-06-06 hour 16: 236781 events in 0 files, snapshot none (task 8958 ms: download 5768 ms overlapping gunzip 1502 ms, parse 6397 ms, sort 0 ms, write 0 ms, index 841 ms: 8 candidates, 97286 repo-hours, 1184 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:26:31Z [load_day 2024-06-06] 2024-06-06 hour 17: 214292 events in 0 files, snapshot none (task 8272 ms: download 5245 ms overlapping gunzip 1312 ms, parse 6060 ms, sort 0 ms, write 0 ms, index 673 ms: 17 candidates, 85068 repo-hours, 1352 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:26:40Z [load_day 2024-06-06] 2024-06-06 hour 18: 231529 events in 0 files, snapshot none (task 8267 ms: download 4964 ms overlapping gunzip 1314 ms, parse 5601 ms, sort 0 ms, write 0 ms, index 1145 ms: 15 candidates, 99590 repo-hours, 1255 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:26:40Z [load_day 2024-06-06] 2024-06-06 hour 19: 208825 events in 0 files, snapshot none (task 8584 ms: download 5822 ms overlapping gunzip 1482 ms, parse 6073 ms, sort 0 ms, write 0 ms, index 636 ms: 15 candidates, 79029 repo-hours, 1081 releases; waiting 6 ms; commit 0 ms)
2026-11-08T06:26:47Z [load_day 2024-06-06] 2024-06-06 hour 20: 217792 events in 0 files, snapshot none (task 6975 ms: download 4246 ms overlapping gunzip 1202 ms, parse 4875 ms, sort 0 ms, write 0 ms, index 705 ms: 10 candidates, 76213 repo-hours, 1004 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:26:47Z [load_day 2024-06-06] 2024-06-06 hour 21: 188887 events in 0 files, snapshot none (task 6691 ms: download 3939 ms overlapping gunzip 1077 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 762 ms: 13 candidates, 75251 repo-hours, 1095 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:26:54Z [load_day 2024-06-06] 2024-06-06 hour 22: 172877 events in 0 files, snapshot none (task 6427 ms: download 3616 ms overlapping gunzip 1133 ms, parse 4296 ms, sort 0 ms, write 0 ms, index 803 ms: 8 candidates, 61838 repo-hours, 966 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:26:54Z [load_day 2024-06-06] 2024-06-06 hour 23: 158576 events in 0 files, snapshot none (task 6514 ms: download 4038 ms overlapping gunzip 1216 ms, parse 4516 ms, sort 0 ms, write 0 ms, index 560 ms: 8 candidates, 60398 repo-hours, 806 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:27:04Z [load_day 2024-06-06] 2024-06-06: repo_hour merged from 24 files to 1 (2119467 rows, 10119 ms)
2026-11-08T06:27:07Z [load_day 2024-06-06] 2024-06-06: index committed in 12485 ms (24 + 1 + 24 files)
2026-11-08T06:27:07Z [load_day 2024-06-06] 2024-06-06: 5079512 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:27:07Z [load_day 2024-06-06] attempt 1 succeeded