orcaLog in

Runs · run 3882

load_day 2025-05-10, attempt 1 succeeded

Host
73ccef5e07c2:301799
Started
2026-11-08T11:51:40Z
Ended
2026-11-08T11:53:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
709 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3882/load_day/2025-05-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:51:40Z [load_day 2025-05-10] attempt 1 started
2026-11-08T11:51:41Z [load_day 2025-05-10] 2025-05-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:51:49Z [load_day 2025-05-10] 2025-05-10 hour 0: 181928 events in 0 files, snapshot none (task 7785 ms: download 4224 ms overlapping gunzip 1119 ms, parse 5028 ms, sort 0 ms, write 0 ms, index 865 ms: 14 candidates, 83458 repo-hours, 1198 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:51:50Z [load_day 2025-05-10] 2025-05-10 hour 1: 205683 events in 0 files, snapshot none (task 7963 ms: download 4667 ms overlapping gunzip 1141 ms, parse 5094 ms, sort 0 ms, write 0 ms, index 951 ms: 6 candidates, 112512 repo-hours, 855 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:51:55Z [load_day 2025-05-10] 2025-05-10 hour 2: 162925 events in 0 files, snapshot none (task 5356 ms: download 2851 ms overlapping gunzip 721 ms, parse 3173 ms, sort 0 ms, write 0 ms, index 655 ms: 9 candidates, 70156 repo-hours, 830 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:51:56Z [load_day 2025-05-10] 2025-05-10 hour 3: 179429 events in 0 files, snapshot none (task 6003 ms: download 3411 ms overlapping gunzip 800 ms, parse 3653 ms, sort 0 ms, write 0 ms, index 626 ms: 10 candidates, 70648 repo-hours, 2849 releases; waiting 583 ms; commit 0 ms)
2026-11-08T11:52:01Z [load_day 2025-05-10] 2025-05-10 hour 4: 166718 events in 0 files, snapshot none (task 5000 ms: download 2955 ms overlapping gunzip 642 ms, parse 2864 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 62914 repo-hours, 644 releases; waiting 589 ms; commit 0 ms)
2026-11-08T11:52:04Z [load_day 2025-05-10] 2025-05-10 hour 5: 178630 events in 0 files, snapshot none (task 5584 ms: download 2554 ms overlapping gunzip 751 ms, parse 3225 ms, sort 0 ms, write 0 ms, index 860 ms: 5 candidates, 65828 repo-hours, 979 releases; waiting 466 ms; commit 0 ms)
2026-11-08T11:52:08Z [load_day 2025-05-10] 2025-05-10 hour 6: 194530 events in 0 files, snapshot none (task 6823 ms: download 3409 ms overlapping gunzip 870 ms, parse 4025 ms, sort 0 ms, write 0 ms, index 1068 ms: 7 candidates, 81526 repo-hours, 1087 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:52:11Z [load_day 2025-05-10] 2025-05-10 hour 7: 186149 events in 0 files, snapshot none (task 6042 ms: download 3258 ms overlapping gunzip 882 ms, parse 3600 ms, sort 0 ms, write 0 ms, index 699 ms: 5 candidates, 70169 repo-hours, 1004 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:52:15Z [load_day 2025-05-10] 2025-05-10 hour 8: 193906 events in 0 files, snapshot none (task 5899 ms: download 3219 ms overlapping gunzip 720 ms, parse 3121 ms, sort 0 ms, write 0 ms, index 1210 ms: 5 candidates, 76110 repo-hours, 1240 releases; waiting 546 ms; commit 0 ms)
2026-11-08T11:52:18Z [load_day 2025-05-10] 2025-05-10 hour 9: 199424 events in 0 files, snapshot none (task 6962 ms: download 3486 ms overlapping gunzip 1022 ms, parse 4192 ms, sort 0 ms, write 0 ms, index 827 ms: 4 candidates, 78766 repo-hours, 1159 releases; waiting 582 ms; commit 0 ms)
2026-11-08T11:52:22Z [load_day 2025-05-10] 2025-05-10 hour 10: 197997 events in 0 files, snapshot none (task 6996 ms: download 3903 ms overlapping gunzip 986 ms, parse 4373 ms, sort 0 ms, write 0 ms, index 854 ms: 8 candidates, 78758 repo-hours, 815 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:52:26Z [load_day 2025-05-10] 2025-05-10 hour 11: 196807 events in 0 files, snapshot none (task 6664 ms: download 3317 ms overlapping gunzip 872 ms, parse 3817 ms, sort 0 ms, write 0 ms, index 1158 ms: 6 candidates, 73527 repo-hours, 791 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:52:31Z [load_day 2025-05-10] 2025-05-10 hour 12: 249116 events in 0 files, snapshot none (task 8767 ms: download 4194 ms overlapping gunzip 1180 ms, parse 5602 ms, sort 0 ms, write 0 ms, index 1234 ms: 16 candidates, 123007 repo-hours, 1048 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:52:35Z [load_day 2025-05-10] 2025-05-10 hour 13: 232739 events in 0 files, snapshot none (task 8602 ms: download 5337 ms overlapping gunzip 1278 ms, parse 5599 ms, sort 0 ms, write 0 ms, index 1027 ms: 5 candidates, 106092 repo-hours, 854 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:52:41Z [load_day 2025-05-10] 2025-05-10 hour 14: 218974 events in 0 files, snapshot none (task 8216 ms: download 3682 ms overlapping gunzip 1256 ms, parse 5297 ms, sort 0 ms, write 0 ms, index 1041 ms: 10 candidates, 86589 repo-hours, 1007 releases; waiting 318 ms; commit 0 ms)
2026-11-08T11:52:44Z [load_day 2025-05-10] 2025-05-10 hour 15: 224280 events in 0 files, snapshot none (task 8477 ms: download 4708 ms overlapping gunzip 1249 ms, parse 5051 ms, sort 0 ms, write 0 ms, index 1047 ms: 5 candidates, 91139 repo-hours, 1132 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:52:49Z [load_day 2025-05-10] 2025-05-10 hour 16: 214193 events in 0 files, snapshot none (task 7015 ms: download 3548 ms overlapping gunzip 975 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 976 ms: 11 candidates, 88715 repo-hours, 1255 releases; waiting 478 ms; commit 0 ms)
2026-11-08T11:52:52Z [load_day 2025-05-10] 2025-05-10 hour 17: 211676 events in 0 files, snapshot none (task 7412 ms: download 3951 ms overlapping gunzip 1022 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 965 ms: 6 candidates, 80454 repo-hours, 985 releases; waiting 563 ms; commit 0 ms)
2026-11-08T11:52:56Z [load_day 2025-05-10] 2025-05-10 hour 18: 217344 events in 0 files, snapshot none (task 7212 ms: download 4063 ms overlapping gunzip 1025 ms, parse 4604 ms, sort 0 ms, write 0 ms, index 651 ms: 9 candidates, 92531 repo-hours, 1128 releases; waiting 458 ms; commit 0 ms)
2026-11-08T11:52:58Z [load_day 2025-05-10] 2025-05-10 hour 19: 194561 events in 0 files, snapshot none (task 5737 ms: download 2922 ms overlapping gunzip 752 ms, parse 3284 ms, sort 0 ms, write 0 ms, index 861 ms: 9 candidates, 72239 repo-hours, 974 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:53:05Z [load_day 2025-05-10] 2025-05-10 hour 20: 189016 events in 0 files, snapshot none (task 7923 ms: download 3880 ms overlapping gunzip 1082 ms, parse 4848 ms, sort 0 ms, write 0 ms, index 988 ms: 14 candidates, 70418 repo-hours, 1153 releases; waiting 639 ms; commit 0 ms)
2026-11-08T11:53:06Z [load_day 2025-05-10] 2025-05-10 hour 21: 184163 events in 0 files, snapshot none (task 6670 ms: download 3693 ms overlapping gunzip 1025 ms, parse 4277 ms, sort 0 ms, write 0 ms, index 531 ms: 13 candidates, 67985 repo-hours, 995 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:53:12Z [load_day 2025-05-10] 2025-05-10 hour 22: 168000 events in 0 files, snapshot none (task 6382 ms: download 3878 ms overlapping gunzip 812 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 60347 repo-hours, 939 releases; waiting 931 ms; commit 0 ms)
2026-11-08T11:53:12Z [load_day 2025-05-10] 2025-05-10 hour 23: 158575 events in 0 files, snapshot none (task 5317 ms: download 2940 ms overlapping gunzip 702 ms, parse 3272 ms, sort 0 ms, write 0 ms, index 483 ms: 6 candidates, 55323 repo-hours, 999 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:53:19Z [load_day 2025-05-10] 2025-05-10: repo_hour merged from 24 files to 1 (1919211 rows, 7891 ms)
2026-11-08T11:53:22Z [load_day 2025-05-10] 2025-05-10: index committed in 10815 ms (24 + 1 + 24 files)
2026-11-08T11:53:22Z [load_day 2025-05-10] 2025-05-10: 4706763 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:53:22Z [load_day 2025-05-10] attempt 1 succeeded