orcaLog in

Runs · run 2846

load_day 2024-08-15, attempt 1 succeeded

Host
73ccef5e07c2:164345
Started
2026-11-08T07:27:16Z
Ended
2026-11-08T07:28:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
164.7 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2846/load_day/2024-08-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:27:16Z [load_day 2024-08-15] attempt 1 started
2026-11-08T07:27:18Z [load_day 2024-08-15] 2024-08-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:27:24Z [load_day 2024-08-15] 2024-08-15 hour 0: 162673 events in 0 files, snapshot none (task 6231 ms: download 3503 ms overlapping gunzip 909 ms, parse 3889 ms, sort 0 ms, write 0 ms, index 635 ms: 13 candidates, 88314 repo-hours, 1036 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:27:25Z [load_day 2024-08-15] 2024-08-15 hour 1: 189689 events in 0 files, snapshot none (task 6643 ms: download 3912 ms overlapping gunzip 998 ms, parse 4373 ms, sort 0 ms, write 0 ms, index 717 ms: 9 candidates, 103430 repo-hours, 1036 releases; waiting 286 ms; commit 0 ms)
2026-11-08T07:27:33Z [load_day 2024-08-15] 2024-08-15 hour 2: 157631 events in 0 files, snapshot none (task 7954 ms: download 4186 ms overlapping gunzip 1251 ms, parse 5349 ms, sort 0 ms, write 0 ms, index 694 ms: 4 candidates, 64193 repo-hours, 829 releases; waiting 450 ms; commit 0 ms)
2026-11-08T07:27:33Z [load_day 2024-08-15] 2024-08-15 hour 3: 177057 events in 0 files, snapshot none (task 7527 ms: download 3630 ms overlapping gunzip 1110 ms, parse 4708 ms, sort 0 ms, write 0 ms, index 887 ms: 9 candidates, 72217 repo-hours, 4736 releases; waiting 141 ms; commit 0 ms)
2026-11-08T07:27:40Z [load_day 2024-08-15] 2024-08-15 hour 4: 147379 events in 0 files, snapshot none (task 6239 ms: download 2810 ms overlapping gunzip 984 ms, parse 4150 ms, sort 0 ms, write 0 ms, index 455 ms: 6 candidates, 56447 repo-hours, 685 releases; waiting 322 ms; commit 0 ms)
2026-11-08T07:27:40Z [load_day 2024-08-15] 2024-08-15 hour 5: 154436 events in 0 files, snapshot none (task 6498 ms: download 3118 ms overlapping gunzip 1006 ms, parse 4216 ms, sort 0 ms, write 0 ms, index 474 ms: 5 candidates, 60862 repo-hours, 849 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:27:47Z [load_day 2024-08-15] 2024-08-15 hour 6: 186089 events in 0 files, snapshot none (task 6911 ms: download 4281 ms overlapping gunzip 1016 ms, parse 4518 ms, sort 0 ms, write 0 ms, index 635 ms: 4 candidates, 85918 repo-hours, 959 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:27:48Z [load_day 2024-08-15] 2024-08-15 hour 7: 187518 events in 0 files, snapshot none (task 7323 ms: download 4718 ms overlapping gunzip 1163 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 558 ms: 9 candidates, 74144 repo-hours, 928 releases; waiting 400 ms; commit 0 ms)
2026-11-08T07:27:57Z [load_day 2024-08-15] 2024-08-15 hour 8: 199408 events in 0 files, snapshot none (task 9042 ms: download 6280 ms overlapping gunzip 1363 ms, parse 6370 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 82373 repo-hours, 1249 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:27:57Z [load_day 2024-08-15] 2024-08-15 hour 9: 206201 events in 0 files, snapshot none (task 8657 ms: download 6111 ms overlapping gunzip 1363 ms, parse 5861 ms, sort 0 ms, write 0 ms, index 612 ms: 8 candidates, 88051 repo-hours, 1171 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:28:04Z [load_day 2024-08-15] 2024-08-15 hour 10: 193313 events in 0 files, snapshot none (task 7154 ms: download 4094 ms overlapping gunzip 1246 ms, parse 5013 ms, sort 0 ms, write 0 ms, index 689 ms: 7 candidates, 78447 repo-hours, 1048 releases; waiting 9 ms; commit 0 ms)
2026-11-08T07:28:04Z [load_day 2024-08-15] 2024-08-15 hour 11: 194768 events in 0 files, snapshot none (task 6948 ms: download 4215 ms overlapping gunzip 1141 ms, parse 4974 ms, sort 0 ms, write 0 ms, index 627 ms: 2 candidates, 76474 repo-hours, 1055 releases; waiting 12 ms; commit 0 ms)
2026-11-08T07:28:13Z [load_day 2024-08-15] 2024-08-15 hour 12: 257182 events in 0 files, snapshot none (task 7922 ms: download 4292 ms overlapping gunzip 1206 ms, parse 5290 ms, sort 0 ms, write 0 ms, index 1218 ms: 6 candidates, 123370 repo-hours, 1294 releases; waiting 21 ms; commit 0 ms)
2026-11-08T07:28:13Z [load_day 2024-08-15] 2024-08-15 hour 13: 234793 events in 0 files, snapshot none (task 8121 ms: download 4985 ms overlapping gunzip 1361 ms, parse 5757 ms, sort 0 ms, write 0 ms, index 773 ms: 13 candidates, 106791 repo-hours, 1323 releases; waiting 28 ms; commit 0 ms)
2026-11-08T07:28:20Z [load_day 2024-08-15] 2024-08-15 hour 14: 230551 events in 0 files, snapshot none (task 6868 ms: download 4373 ms overlapping gunzip 1174 ms, parse 4826 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 94813 repo-hours, 1199 releases; waiting 12 ms; commit 0 ms)
2026-11-08T07:28:21Z [load_day 2024-08-15] 2024-08-15 hour 15: 230368 events in 0 files, snapshot none (task 7471 ms: download 4881 ms overlapping gunzip 1218 ms, parse 5191 ms, sort 0 ms, write 0 ms, index 739 ms: 20 candidates, 99092 repo-hours, 1397 releases; waiting 24 ms; commit 0 ms)
2026-11-08T07:28:27Z [load_day 2024-08-15] 2024-08-15 hour 16: 216658 events in 0 files, snapshot none (task 6474 ms: download 4031 ms overlapping gunzip 1086 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 641 ms: 7 candidates, 88522 repo-hours, 1117 releases; waiting 10 ms; commit 0 ms)
2026-11-08T07:28:27Z [load_day 2024-08-15] 2024-08-15 hour 17: 209700 events in 0 files, snapshot none (task 5944 ms: download 3613 ms overlapping gunzip 1009 ms, parse 4120 ms, sort 0 ms, write 0 ms, index 597 ms: 2 candidates, 82665 repo-hours, 1133 releases; waiting 10 ms; commit 0 ms)
2026-11-08T07:28:34Z [load_day 2024-08-15] 2024-08-15 hour 18: 215450 events in 0 files, snapshot none (task 6342 ms: download 3833 ms overlapping gunzip 1017 ms, parse 4378 ms, sort 0 ms, write 0 ms, index 755 ms: 11 candidates, 95030 repo-hours, 1190 releases; waiting 9 ms; commit 0 ms)
2026-11-08T07:28:34Z [load_day 2024-08-15] 2024-08-15 hour 19: 197115 events in 0 files, snapshot none (task 5477 ms: download 3062 ms overlapping gunzip 905 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 635 ms: 10 candidates, 74033 repo-hours, 1054 releases; waiting 14 ms; commit 0 ms)
2026-11-08T07:28:41Z [load_day 2024-08-15] 2024-08-15 hour 20: 193775 events in 0 files, snapshot none (task 7308 ms: download 4489 ms overlapping gunzip 1235 ms, parse 5270 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 74403 repo-hours, 1036 releases; waiting 16 ms; commit 0 ms)
2026-11-08T07:28:41Z [load_day 2024-08-15] 2024-08-15 hour 21: 182950 events in 0 files, snapshot none (task 6735 ms: download 3740 ms overlapping gunzip 1150 ms, parse 4815 ms, sort 0 ms, write 0 ms, index 561 ms: 7 candidates, 72901 repo-hours, 1171 releases; waiting 15 ms; commit 0 ms)
2026-11-08T07:28:48Z [load_day 2024-08-15] 2024-08-15 hour 22: 164002 events in 0 files, snapshot none (task 5962 ms: download 3430 ms overlapping gunzip 980 ms, parse 4323 ms, sort 0 ms, write 0 ms, index 439 ms: 8 candidates, 58720 repo-hours, 968 releases; waiting 17 ms; commit 0 ms)
2026-11-08T07:28:48Z [load_day 2024-08-15] 2024-08-15 hour 23: 154764 events in 0 files, snapshot none (task 5131 ms: download 2151 ms overlapping gunzip 841 ms, parse 3644 ms, sort 0 ms, write 0 ms, index 452 ms: 8 candidates, 55948 repo-hours, 853 releases; waiting 16 ms; commit 0 ms)
2026-11-08T07:28:56Z [load_day 2024-08-15] 2024-08-15: repo_hour merged from 24 files to 1 (1957158 rows, 8488 ms)
2026-11-08T07:28:59Z [load_day 2024-08-15] 2024-08-15: index committed in 11414 ms (24 + 1 + 24 files)
2026-11-08T07:28:59Z [load_day 2024-08-15] 2024-08-15: 4643470 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:28:59Z [load_day 2024-08-15] attempt 1 succeeded