orcaLog in

Runs · run 2778

load_day 2024-07-30, attempt 1 succeeded

Host
73ccef5e07c2:156627
Started
2026-11-08T07:12:49Z
Ended
2026-11-08T07:14:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
718 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2778/load_day/2024-07-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:12:49Z [load_day 2024-07-30] attempt 1 started
2026-11-08T07:12:50Z [load_day 2024-07-30] 2024-07-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:12:57Z [load_day 2024-07-30] 2024-07-30 hour 0: 187652 events in 0 files, snapshot none (task 7225 ms: download 4184 ms overlapping gunzip 1077 ms, parse 4258 ms, sort 0 ms, write 0 ms, index 993 ms: 9 candidates, 97429 repo-hours, 1178 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:12:57Z [load_day 2024-07-30] 2024-07-30 hour 1: 194900 events in 0 files, snapshot none (task 7209 ms: download 3764 ms overlapping gunzip 942 ms, parse 4144 ms, sort 0 ms, write 0 ms, index 1354 ms: 3 candidates, 112136 repo-hours, 876 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:13:04Z [load_day 2024-07-30] 2024-07-30 hour 2: 157877 events in 0 files, snapshot none (task 6239 ms: download 3547 ms overlapping gunzip 903 ms, parse 3916 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 68092 repo-hours, 820 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:13:05Z [load_day 2024-07-30] 2024-07-30 hour 3: 178724 events in 0 files, snapshot none (task 7212 ms: download 4626 ms overlapping gunzip 1138 ms, parse 4748 ms, sort 0 ms, write 0 ms, index 587 ms: 5 candidates, 76707 repo-hours, 5455 releases; waiting 460 ms; commit 0 ms)
2026-11-08T07:13:11Z [load_day 2024-07-30] 2024-07-30 hour 4: 155708 events in 0 files, snapshot none (task 6766 ms: download 3810 ms overlapping gunzip 1087 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 585 ms: 4 candidates, 62099 repo-hours, 705 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:13:14Z [load_day 2024-07-30] 2024-07-30 hour 5: 169108 events in 0 files, snapshot none (task 8316 ms: download 4990 ms overlapping gunzip 1303 ms, parse 5284 ms, sort 0 ms, write 0 ms, index 910 ms: 7 candidates, 67880 repo-hours, 926 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:13:20Z [load_day 2024-07-30] 2024-07-30 hour 6: 207714 events in 0 files, snapshot none (task 7769 ms: download 4789 ms overlapping gunzip 1131 ms, parse 4917 ms, sort 0 ms, write 0 ms, index 940 ms: 5 candidates, 97403 repo-hours, 1156 releases; waiting 470 ms; commit 0 ms)
2026-11-08T07:13:23Z [load_day 2024-07-30] 2024-07-30 hour 7: 210139 events in 0 files, snapshot none (task 8037 ms: download 4613 ms overlapping gunzip 1159 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 1187 ms: 3 candidates, 86281 repo-hours, 1229 releases; waiting 560 ms; commit 0 ms)
2026-11-08T07:13:29Z [load_day 2024-07-30] 2024-07-30 hour 8: 220139 events in 0 files, snapshot none (task 8743 ms: download 6026 ms overlapping gunzip 1370 ms, parse 5848 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 93146 repo-hours, 1405 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:13:32Z [load_day 2024-07-30] 2024-07-30 hour 9: 221895 events in 0 files, snapshot none (task 8598 ms: download 5153 ms overlapping gunzip 1279 ms, parse 5280 ms, sort 0 ms, write 0 ms, index 1194 ms: 5 candidates, 97891 repo-hours, 1268 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:13:39Z [load_day 2024-07-30] 2024-07-30 hour 10: 217407 events in 0 files, snapshot none (task 9304 ms: download 6521 ms overlapping gunzip 1458 ms, parse 6296 ms, sort 0 ms, write 0 ms, index 714 ms: 6 candidates, 89838 repo-hours, 1043 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:13:40Z [load_day 2024-07-30] 2024-07-30 hour 11: 210137 events in 0 files, snapshot none (task 7729 ms: download 5245 ms overlapping gunzip 1230 ms, parse 5057 ms, sort 0 ms, write 0 ms, index 688 ms: 8 candidates, 85450 repo-hours, 1073 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:13:50Z [load_day 2024-07-30] 2024-07-30 hour 12: 267367 events in 0 files, snapshot none (task 10637 ms: download 7489 ms overlapping gunzip 1605 ms, parse 7143 ms, sort 0 ms, write 0 ms, index 1081 ms: 6 candidates, 133225 repo-hours, 1318 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:13:51Z [load_day 2024-07-30] 2024-07-30 hour 13: 244561 events in 0 files, snapshot none (task 10381 ms: download 7718 ms overlapping gunzip 1662 ms, parse 7129 ms, sort 0 ms, write 0 ms, index 894 ms: 6 candidates, 115340 repo-hours, 1331 releases; waiting 454 ms; commit 0 ms)
2026-11-08T07:14:00Z [load_day 2024-07-30] 2024-07-30 hour 14: 239057 events in 0 files, snapshot none (task 9622 ms: download 7061 ms overlapping gunzip 1623 ms, parse 6527 ms, sort 0 ms, write 0 ms, index 745 ms: 9 candidates, 105583 repo-hours, 1302 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:14:00Z [load_day 2024-07-30] 2024-07-30 hour 15: 241166 events in 0 files, snapshot none (task 8628 ms: download 6048 ms overlapping gunzip 1354 ms, parse 5776 ms, sort 0 ms, write 0 ms, index 772 ms: 10 candidates, 108771 repo-hours, 1374 releases; waiting 476 ms; commit 0 ms)
2026-11-08T07:14:08Z [load_day 2024-07-30] 2024-07-30 hour 16: 224438 events in 0 files, snapshot none (task 7506 ms: download 4893 ms overlapping gunzip 1143 ms, parse 4810 ms, sort 0 ms, write 0 ms, index 685 ms: 7 candidates, 95617 repo-hours, 1128 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:14:09Z [load_day 2024-07-30] 2024-07-30 hour 17: 221650 events in 0 files, snapshot none (task 7741 ms: download 4960 ms overlapping gunzip 1169 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 765 ms: 7 candidates, 92436 repo-hours, 1155 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:14:17Z [load_day 2024-07-30] 2024-07-30 hour 18: 226518 events in 0 files, snapshot none (task 8329 ms: download 4900 ms overlapping gunzip 1322 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 907 ms: 10 candidates, 101828 repo-hours, 1179 releases; waiting 455 ms; commit 0 ms)
2026-11-08T07:14:17Z [load_day 2024-07-30] 2024-07-30 hour 19: 197990 events in 0 files, snapshot none (task 7667 ms: download 4688 ms overlapping gunzip 1287 ms, parse 5132 ms, sort 0 ms, write 0 ms, index 638 ms: 6 candidates, 77830 repo-hours, 1090 releases; waiting 389 ms; commit 0 ms)
2026-11-08T07:14:25Z [load_day 2024-07-30] 2024-07-30 hour 20: 189035 events in 0 files, snapshot none (task 7738 ms: download 4826 ms overlapping gunzip 1075 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 737 ms: 2 candidates, 75731 repo-hours, 1034 releases; waiting 623 ms; commit 0 ms)
2026-11-08T07:14:25Z [load_day 2024-07-30] 2024-07-30 hour 21: 179583 events in 0 files, snapshot none (task 7466 ms: download 4776 ms overlapping gunzip 1136 ms, parse 4827 ms, sort 0 ms, write 0 ms, index 610 ms: 10 candidates, 75177 repo-hours, 1284 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:14:32Z [load_day 2024-07-30] 2024-07-30 hour 22: 156538 events in 0 files, snapshot none (task 6742 ms: download 4090 ms overlapping gunzip 1089 ms, parse 4400 ms, sort 0 ms, write 0 ms, index 476 ms: 24 candidates, 61853 repo-hours, 1102 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:14:32Z [load_day 2024-07-30] 2024-07-30 hour 23: 147732 events in 0 files, snapshot none (task 6445 ms: download 4002 ms overlapping gunzip 993 ms, parse 4215 ms, sort 0 ms, write 0 ms, index 525 ms: 24 candidates, 60343 repo-hours, 702 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:14:45Z [load_day 2024-07-30] 2024-07-30: repo_hour merged from 24 files to 1 (2138086 rows, 12604 ms)
2026-11-08T07:14:47Z [load_day 2024-07-30] 2024-07-30: index committed in 14912 ms (24 + 1 + 24 files)
2026-11-08T07:14:47Z [load_day 2024-07-30] 2024-07-30: 4867035 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:14:47Z [load_day 2024-07-30] attempt 1 succeeded