orcaLog in

Runs · run 2817

load_day 2024-08-08, attempt 1 succeeded

Host
73ccef5e07c2:161068
Started
2026-11-08T07:21:19Z
Ended
2026-11-08T07:23:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
729 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
176.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2817/load_day/2024-08-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:21:19Z [load_day 2024-08-08] attempt 1 started
2026-11-08T07:21:20Z [load_day 2024-08-08] 2024-08-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:21:28Z [load_day 2024-08-08] 2024-08-08 hour 0: 185803 events in 0 files, snapshot none (task 7462 ms: download 4068 ms overlapping gunzip 1043 ms, parse 4411 ms, sort 0 ms, write 0 ms, index 1212 ms: 7 candidates, 94597 repo-hours, 1094 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:21:28Z [load_day 2024-08-08] 2024-08-08 hour 1: 193278 events in 0 files, snapshot none (task 7381 ms: download 4177 ms overlapping gunzip 1038 ms, parse 4514 ms, sort 0 ms, write 0 ms, index 1117 ms: 11 candidates, 107492 repo-hours, 801 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:21:35Z [load_day 2024-08-08] 2024-08-08 hour 2: 155710 events in 0 files, snapshot none (task 6036 ms: download 3520 ms overlapping gunzip 879 ms, parse 3726 ms, sort 0 ms, write 0 ms, index 569 ms: 6 candidates, 67130 repo-hours, 848 releases; waiting 480 ms; commit 0 ms)
2026-11-08T07:21:35Z [load_day 2024-08-08] 2024-08-08 hour 3: 173955 events in 0 files, snapshot none (task 6341 ms: download 3751 ms overlapping gunzip 939 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 594 ms: 11 candidates, 74140 repo-hours, 5544 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:21:42Z [load_day 2024-08-08] 2024-08-08 hour 4: 149434 events in 0 files, snapshot none (task 6006 ms: download 3371 ms overlapping gunzip 948 ms, parse 4034 ms, sort 0 ms, write 0 ms, index 420 ms: 10 candidates, 59256 repo-hours, 753 releases; waiting 294 ms; commit 0 ms)
2026-11-08T07:21:43Z [load_day 2024-08-08] 2024-08-08 hour 5: 169145 events in 0 files, snapshot none (task 6929 ms: download 4348 ms overlapping gunzip 1110 ms, parse 4527 ms, sort 0 ms, write 0 ms, index 559 ms: 5 candidates, 66656 repo-hours, 802 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:21:51Z [load_day 2024-08-08] 2024-08-08 hour 6: 206723 events in 0 files, snapshot none (task 8285 ms: download 5240 ms overlapping gunzip 1253 ms, parse 5545 ms, sort 0 ms, write 0 ms, index 694 ms: 9 candidates, 93101 repo-hours, 972 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:21:52Z [load_day 2024-08-08] 2024-08-08 hour 7: 205932 events in 0 files, snapshot none (task 8691 ms: download 6237 ms overlapping gunzip 1428 ms, parse 5977 ms, sort 0 ms, write 0 ms, index 594 ms: 8 candidates, 84191 repo-hours, 1149 releases; waiting 470 ms; commit 0 ms)
2026-11-08T07:22:00Z [load_day 2024-08-08] 2024-08-08 hour 8: 219551 events in 0 files, snapshot none (task 8702 ms: download 6293 ms overlapping gunzip 1369 ms, parse 5923 ms, sort 0 ms, write 0 ms, index 642 ms: 14 candidates, 91518 repo-hours, 1120 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:22:01Z [load_day 2024-08-08] 2024-08-08 hour 9: 228992 events in 0 files, snapshot none (task 8323 ms: download 5875 ms overlapping gunzip 1347 ms, parse 5515 ms, sort 0 ms, write 0 ms, index 677 ms: 18 candidates, 99236 repo-hours, 1356 releases; waiting 551 ms; commit 0 ms)
2026-11-08T07:22:07Z [load_day 2024-08-08] 2024-08-08 hour 10: 211859 events in 0 files, snapshot none (task 6915 ms: download 4426 ms overlapping gunzip 1031 ms, parse 4439 ms, sort 0 ms, write 0 ms, index 637 ms: 8 candidates, 87129 repo-hours, 1233 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:22:08Z [load_day 2024-08-08] 2024-08-08 hour 11: 208786 events in 0 files, snapshot none (task 6716 ms: download 4182 ms overlapping gunzip 1010 ms, parse 4276 ms, sort 0 ms, write 0 ms, index 660 ms: 15 candidates, 83897 repo-hours, 1239 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:22:16Z [load_day 2024-08-08] 2024-08-08 hour 12: 268558 events in 0 files, snapshot none (task 7904 ms: download 4918 ms overlapping gunzip 1108 ms, parse 4985 ms, sort 0 ms, write 0 ms, index 916 ms: 6 candidates, 132541 repo-hours, 1321 releases; waiting 542 ms; commit 0 ms)
2026-11-08T07:22:17Z [load_day 2024-08-08] 2024-08-08 hour 13: 243322 events in 0 files, snapshot none (task 8054 ms: download 5043 ms overlapping gunzip 1168 ms, parse 4895 ms, sort 0 ms, write 0 ms, index 1228 ms: 13 candidates, 114237 repo-hours, 1195 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:22:28Z [load_day 2024-08-08] 2024-08-08 hour 14: 230257 events in 0 files, snapshot none (task 10329 ms: download 7601 ms overlapping gunzip 1620 ms, parse 7082 ms, sort 0 ms, write 0 ms, index 873 ms: 7 candidates, 98674 repo-hours, 1266 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:22:28Z [load_day 2024-08-08] 2024-08-08 hour 15: 235302 events in 0 files, snapshot none (task 10101 ms: download 7140 ms overlapping gunzip 1575 ms, parse 6803 ms, sort 0 ms, write 0 ms, index 1016 ms: 5 candidates, 104997 repo-hours, 1501 releases; waiting 346 ms; commit 0 ms)
2026-11-08T07:22:38Z [load_day 2024-08-08] 2024-08-08 hour 16: 220980 events in 0 files, snapshot none (task 9446 ms: download 6198 ms overlapping gunzip 1526 ms, parse 6440 ms, sort 0 ms, write 0 ms, index 709 ms: 10 candidates, 92112 repo-hours, 1269 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:22:38Z [load_day 2024-08-08] 2024-08-08 hour 17: 212517 events in 0 files, snapshot none (task 8714 ms: download 5599 ms overlapping gunzip 1344 ms, parse 5606 ms, sort 0 ms, write 0 ms, index 941 ms: 14 candidates, 85100 repo-hours, 1015 releases; waiting 485 ms; commit 0 ms)
2026-11-08T07:22:47Z [load_day 2024-08-08] 2024-08-08 hour 18: 218314 events in 0 files, snapshot none (task 8501 ms: download 5872 ms overlapping gunzip 1334 ms, parse 5659 ms, sort 0 ms, write 0 ms, index 686 ms: 12 candidates, 98524 repo-hours, 1121 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:22:47Z [load_day 2024-08-08] 2024-08-08 hour 19: 191440 events in 0 files, snapshot none (task 8384 ms: download 5732 ms overlapping gunzip 1302 ms, parse 5585 ms, sort 0 ms, write 0 ms, index 567 ms: 11 candidates, 74509 repo-hours, 1060 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:22:56Z [load_day 2024-08-08] 2024-08-08 hour 20: 185907 events in 0 files, snapshot none (task 7801 ms: download 5253 ms overlapping gunzip 1261 ms, parse 5203 ms, sort 0 ms, write 0 ms, index 551 ms: 15 candidates, 73362 repo-hours, 1033 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:22:56Z [load_day 2024-08-08] 2024-08-08 hour 21: 177104 events in 0 files, snapshot none (task 7338 ms: download 4764 ms overlapping gunzip 1185 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 541 ms: 8 candidates, 71989 repo-hours, 1229 releases; waiting 552 ms; commit 0 ms)
2026-11-08T07:23:02Z [load_day 2024-08-08] 2024-08-08 hour 22: 157557 events in 0 files, snapshot none (task 6357 ms: download 3882 ms overlapping gunzip 997 ms, parse 4169 ms, sort 0 ms, write 0 ms, index 435 ms: 6 candidates, 59589 repo-hours, 1087 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:23:02Z [load_day 2024-08-08] 2024-08-08 hour 23: 153474 events in 0 files, snapshot none (task 6099 ms: download 3573 ms overlapping gunzip 921 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 443 ms: 4 candidates, 56596 repo-hours, 953 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:23:11Z [load_day 2024-08-08] 2024-08-08: repo_hour merged from 24 files to 1 (2070573 rows, 8923 ms)
2026-11-08T07:23:14Z [load_day 2024-08-08] 2024-08-08: index committed in 11181 ms (24 + 1 + 24 files)
2026-11-08T07:23:14Z [load_day 2024-08-08] 2024-08-08: 4803900 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:23:14Z [load_day 2024-08-08] attempt 1 succeeded