orcaLog in

Runs · run 3496

load_day 2025-01-30, attempt 1 succeeded

Host
73ccef5e07c2:246373
Started
2026-11-08T10:04:31Z
Ended
2026-11-08T10:06:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
821 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3496/load_day/2025-01-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:04:31Z [load_day 2025-01-30] attempt 1 started
2026-11-08T10:04:32Z [load_day 2025-01-30] 2025-01-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:04:40Z [load_day 2025-01-30] 2025-01-30 hour 0: 197308 events in 0 files, snapshot none (task 7165 ms: download 4063 ms overlapping gunzip 1104 ms, parse 4583 ms, sort 0 ms, write 0 ms, index 957 ms: 13 candidates, 94957 repo-hours, 1188 releases; waiting 209 ms; commit 0 ms)
2026-11-08T10:04:41Z [load_day 2025-01-30] 2025-01-30 hour 1: 205708 events in 0 files, snapshot none (task 7792 ms: download 5006 ms overlapping gunzip 1034 ms, parse 4610 ms, sort 0 ms, write 0 ms, index 893 ms: 9 candidates, 106027 repo-hours, 877 releases; waiting 1012 ms; commit 0 ms)
2026-11-08T10:04:47Z [load_day 2025-01-30] 2025-01-30 hour 2: 174543 events in 0 files, snapshot none (task 6332 ms: download 3644 ms overlapping gunzip 957 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 600 ms: 4 candidates, 71901 repo-hours, 849 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:04:47Z [load_day 2025-01-30] 2025-01-30 hour 3: 187521 events in 0 files, snapshot none (task 6180 ms: download 3607 ms overlapping gunzip 928 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 71259 repo-hours, 3843 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:04:55Z [load_day 2025-01-30] 2025-01-30 hour 4: 178302 events in 0 files, snapshot none (task 6913 ms: download 3682 ms overlapping gunzip 1006 ms, parse 4404 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 64882 repo-hours, 595 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:04:55Z [load_day 2025-01-30] 2025-01-30 hour 5: 181159 events in 0 files, snapshot none (task 6789 ms: download 3810 ms overlapping gunzip 1037 ms, parse 4375 ms, sort 0 ms, write 0 ms, index 660 ms: 3 candidates, 67123 repo-hours, 681 releases; waiting 502 ms; commit 0 ms)
2026-11-08T10:05:02Z [load_day 2025-01-30] 2025-01-30 hour 6: 198472 events in 0 files, snapshot none (task 7377 ms: download 3990 ms overlapping gunzip 1082 ms, parse 4747 ms, sort 0 ms, write 0 ms, index 780 ms: 4 candidates, 84297 repo-hours, 816 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:05:03Z [load_day 2025-01-30] 2025-01-30 hour 7: 191745 events in 0 files, snapshot none (task 7686 ms: download 4658 ms overlapping gunzip 1174 ms, parse 5158 ms, sort 0 ms, write 0 ms, index 586 ms: 8 candidates, 73708 repo-hours, 788 releases; waiting 526 ms; commit 0 ms)
2026-11-08T10:05:11Z [load_day 2025-01-30] 2025-01-30 hour 8: 209382 events in 0 files, snapshot none (task 7788 ms: download 4883 ms overlapping gunzip 1192 ms, parse 5205 ms, sort 0 ms, write 0 ms, index 759 ms: 6 candidates, 84054 repo-hours, 1043 releases; waiting 296 ms; commit 0 ms)
2026-11-08T10:05:12Z [load_day 2025-01-30] 2025-01-30 hour 9: 232026 events in 0 files, snapshot none (task 8581 ms: download 5574 ms overlapping gunzip 1312 ms, parse 5687 ms, sort 0 ms, write 0 ms, index 962 ms: 6 candidates, 95395 repo-hours, 1308 releases; waiting 372 ms; commit 0 ms)
2026-11-08T10:05:19Z [load_day 2025-01-30] 2025-01-30 hour 10: 231561 events in 0 files, snapshot none (task 7665 ms: download 4974 ms overlapping gunzip 1180 ms, parse 4881 ms, sort 0 ms, write 0 ms, index 682 ms: 4 candidates, 94891 repo-hours, 1093 releases; waiting 549 ms; commit 0 ms)
2026-11-08T10:05:20Z [load_day 2025-01-30] 2025-01-30 hour 11: 227214 events in 0 files, snapshot none (task 7117 ms: download 4713 ms overlapping gunzip 1112 ms, parse 4662 ms, sort 0 ms, write 0 ms, index 636 ms: 4 candidates, 87345 repo-hours, 1080 releases; waiting 470 ms; commit 0 ms)
2026-11-08T10:05:27Z [load_day 2025-01-30] 2025-01-30 hour 12: 260028 events in 0 files, snapshot none (task 7680 ms: download 4634 ms overlapping gunzip 1092 ms, parse 4834 ms, sort 0 ms, write 0 ms, index 915 ms: 10 candidates, 129347 repo-hours, 1324 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:05:28Z [load_day 2025-01-30] 2025-01-30 hour 13: 259136 events in 0 files, snapshot none (task 7856 ms: download 5147 ms overlapping gunzip 1191 ms, parse 5036 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 118130 repo-hours, 1135 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:05:36Z [load_day 2025-01-30] 2025-01-30 hour 14: 230578 events in 0 files, snapshot none (task 8262 ms: download 4412 ms overlapping gunzip 1346 ms, parse 5338 ms, sort 0 ms, write 0 ms, index 1119 ms: 6 candidates, 98916 repo-hours, 995 releases; waiting 178 ms; commit 0 ms)
2026-11-08T10:05:39Z [load_day 2025-01-30] 2025-01-30 hour 15: 262622 events in 0 files, snapshot none (task 10139 ms: download 7131 ms overlapping gunzip 1559 ms, parse 6759 ms, sort 0 ms, write 0 ms, index 989 ms: 4 candidates, 114605 repo-hours, 1419 releases; waiting 567 ms; commit 0 ms)
2026-11-08T10:05:46Z [load_day 2025-01-30] 2025-01-30 hour 16: 252477 events in 0 files, snapshot none (task 9819 ms: download 6671 ms overlapping gunzip 1544 ms, parse 6395 ms, sort 0 ms, write 0 ms, index 969 ms: 10 candidates, 108832 repo-hours, 1304 releases; waiting 541 ms; commit 0 ms)
2026-11-08T10:05:49Z [load_day 2025-01-30] 2025-01-30 hour 17: 244672 events in 0 files, snapshot none (task 9121 ms: download 6670 ms overlapping gunzip 1504 ms, parse 6124 ms, sort 0 ms, write 0 ms, index 725 ms: 12 candidates, 101285 repo-hours, 1187 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:05:58Z [load_day 2025-01-30] 2025-01-30 hour 18: 254250 events in 0 files, snapshot none (task 9981 ms: download 6960 ms overlapping gunzip 1557 ms, parse 6430 ms, sort 0 ms, write 0 ms, index 1073 ms: 11 candidates, 114532 repo-hours, 1289 releases; waiting 541 ms; commit 0 ms)
2026-11-08T10:05:59Z [load_day 2025-01-30] 2025-01-30 hour 19: 232530 events in 0 files, snapshot none (task 8992 ms: download 5776 ms overlapping gunzip 1366 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 973 ms: 12 candidates, 91555 repo-hours, 1232 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:06:07Z [load_day 2025-01-30] 2025-01-30 hour 20: 222980 events in 0 files, snapshot none (task 8442 ms: download 5143 ms overlapping gunzip 1315 ms, parse 5473 ms, sort 0 ms, write 0 ms, index 895 ms: 6 candidates, 88728 repo-hours, 1198 releases; waiting 427 ms; commit 0 ms)
2026-11-08T10:06:07Z [load_day 2025-01-30] 2025-01-30 hour 21: 218642 events in 0 files, snapshot none (task 8342 ms: download 5365 ms overlapping gunzip 1308 ms, parse 5453 ms, sort 0 ms, write 0 ms, index 670 ms: 5 candidates, 87444 repo-hours, 1309 releases; waiting 547 ms; commit 0 ms)
2026-11-08T10:06:15Z [load_day 2025-01-30] 2025-01-30 hour 22: 197923 events in 0 files, snapshot none (task 8008 ms: download 4569 ms overlapping gunzip 1051 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 1693 ms: 8 candidates, 75322 repo-hours, 1450 releases; waiting 582 ms; commit 0 ms)
2026-11-08T10:06:15Z [load_day 2025-01-30] 2025-01-30 hour 23: 182516 events in 0 files, snapshot none (task 6294 ms: download 3859 ms overlapping gunzip 895 ms, parse 3998 ms, sort 0 ms, write 0 ms, index 597 ms: 4 candidates, 69647 repo-hours, 1198 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:06:30Z [load_day 2025-01-30] 2025-01-30: repo_hour merged from 24 files to 1 (2194182 rows, 15029 ms)
2026-11-08T10:06:33Z [load_day 2025-01-30] 2025-01-30: index committed in 17576 ms (24 + 1 + 24 files)
2026-11-08T10:06:33Z [load_day 2025-01-30] 2025-01-30: 5233295 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:06:33Z [load_day 2025-01-30] attempt 1 succeeded