orcaLog in

Runs · run 3924

load_day 2025-05-20, attempt 1 succeeded

Host
73ccef5e07c2:308410
Started
2026-11-08T12:02:23Z
Ended
2026-11-08T12:04:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
779 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
215.5 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3924/load_day/2025-05-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:02:23Z [load_day 2025-05-20] attempt 1 started
2026-11-08T12:02:24Z [load_day 2025-05-20] 2025-05-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:02:34Z [load_day 2025-05-20] 2025-05-20 hour 0: 201295 events in 0 files, snapshot none (task 9036 ms: download 5492 ms overlapping gunzip 1418 ms, parse 5906 ms, sort 0 ms, write 0 ms, index 902 ms: 7 candidates, 93591 repo-hours, 1355 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:02:34Z [load_day 2025-05-20] 2025-05-20 hour 1: 233183 events in 0 files, snapshot none (task 9344 ms: download 6291 ms overlapping gunzip 1515 ms, parse 6284 ms, sort 0 ms, write 0 ms, index 936 ms: 8 candidates, 127952 repo-hours, 987 releases; waiting 337 ms; commit 0 ms)
2026-11-08T12:02:42Z [load_day 2025-05-20] 2025-05-20 hour 2: 206137 events in 0 files, snapshot none (task 8245 ms: download 5313 ms overlapping gunzip 1209 ms, parse 5481 ms, sort 0 ms, write 0 ms, index 779 ms: 8 candidates, 96278 repo-hours, 1019 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:02:42Z [load_day 2025-05-20] 2025-05-20 hour 3: 216787 events in 0 files, snapshot none (task 7952 ms: download 4614 ms overlapping gunzip 1240 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 856 ms: 2 candidates, 90785 repo-hours, 2828 releases; waiting 508 ms; commit 0 ms)
2026-11-08T12:02:50Z [load_day 2025-05-20] 2025-05-20 hour 4: 200486 events in 0 files, snapshot none (task 7114 ms: download 4206 ms overlapping gunzip 1098 ms, parse 4553 ms, sort 0 ms, write 0 ms, index 670 ms: 5 candidates, 80539 repo-hours, 882 releases; waiting 480 ms; commit 0 ms)
2026-11-08T12:02:51Z [load_day 2025-05-20] 2025-05-20 hour 5: 215828 events in 0 files, snapshot none (task 8395 ms: download 5533 ms overlapping gunzip 1288 ms, parse 5490 ms, sort 0 ms, write 0 ms, index 779 ms: 4 candidates, 86246 repo-hours, 914 releases; waiting 507 ms; commit 0 ms)
2026-11-08T12:03:01Z [load_day 2025-05-20] 2025-05-20 hour 6: 243724 events in 0 files, snapshot none (task 10458 ms: download 6973 ms overlapping gunzip 1631 ms, parse 6971 ms, sort 0 ms, write 0 ms, index 995 ms: 10 candidates, 110203 repo-hours, 1193 releases; waiting 538 ms; commit 0 ms)
2026-11-08T12:03:02Z [load_day 2025-05-20] 2025-05-20 hour 7: 248375 events in 0 files, snapshot none (task 10435 ms: download 7404 ms overlapping gunzip 1623 ms, parse 7198 ms, sort 0 ms, write 0 ms, index 800 ms: 20 candidates, 106517 repo-hours, 1086 releases; waiting 476 ms; commit 0 ms)
2026-11-08T12:03:12Z [load_day 2025-05-20] 2025-05-20 hour 8: 258747 events in 0 files, snapshot none (task 10821 ms: download 6692 ms overlapping gunzip 1625 ms, parse 7160 ms, sort 0 ms, write 0 ms, index 1068 ms: 5 candidates, 112079 repo-hours, 1357 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:03:18Z [load_day 2025-05-20] 2025-05-20 hour 9: 263867 events in 0 files, snapshot none (task 14483 ms: download 10894 ms overlapping gunzip 1673 ms, parse 7361 ms, sort 0 ms, write 0 ms, index 1243 ms: 6 candidates, 115806 repo-hours, 1469 releases; waiting 3836 ms; commit 0 ms)
2026-11-08T12:03:24Z [load_day 2025-05-20] 2025-05-20 hour 10: 252112 events in 0 files, snapshot none (task 10659 ms: download 7248 ms overlapping gunzip 1779 ms, parse 7022 ms, sort 0 ms, write 0 ms, index 1096 ms: 7 candidates, 107390 repo-hours, 1186 releases; waiting 487 ms; commit 0 ms)
2026-11-08T12:03:29Z [load_day 2025-05-20] 2025-05-20 hour 11: 258077 events in 0 files, snapshot none (task 11196 ms: download 7367 ms overlapping gunzip 1785 ms, parse 7532 ms, sort 0 ms, write 0 ms, index 1105 ms: 6 candidates, 106041 repo-hours, 1285 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:03:36Z [load_day 2025-05-20] 2025-05-20 hour 12: 278837 events in 0 files, snapshot none (task 11550 ms: download 7215 ms overlapping gunzip 1726 ms, parse 7628 ms, sort 0 ms, write 0 ms, index 1499 ms: 9 candidates, 146586 repo-hours, 1398 releases; waiting 441 ms; commit 0 ms)
2026-11-08T12:03:44Z [load_day 2025-05-20] 2025-05-20 hour 13: 271522 events in 0 files, snapshot none (task 13417 ms: download 9804 ms overlapping gunzip 2098 ms, parse 9375 ms, sort 0 ms, write 0 ms, index 1092 ms: 14 candidates, 133633 repo-hours, 1518 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:03:47Z [load_day 2025-05-20] 2025-05-20 hour 14: 266622 events in 0 files, snapshot none (task 10874 ms: download 8129 ms overlapping gunzip 1723 ms, parse 7405 ms, sort 0 ms, write 0 ms, index 902 ms: 8 candidates, 119795 repo-hours, 1586 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:03:53Z [load_day 2025-05-20] 2025-05-20 hour 15: 269339 events in 0 files, snapshot none (task 8874 ms: download 6139 ms overlapping gunzip 1388 ms, parse 5838 ms, sort 0 ms, write 0 ms, index 844 ms: 14 candidates, 119219 repo-hours, 1517 releases; waiting 533 ms; commit 0 ms)
2026-11-08T12:03:56Z [load_day 2025-05-20] 2025-05-20 hour 16: 264550 events in 0 files, snapshot none (task 8774 ms: download 6067 ms overlapping gunzip 1384 ms, parse 5779 ms, sort 0 ms, write 0 ms, index 789 ms: 13 candidates, 116227 repo-hours, 1251 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:04:02Z [load_day 2025-05-20] 2025-05-20 hour 17: 255690 events in 0 files, snapshot none (task 8899 ms: download 5197 ms overlapping gunzip 1233 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 1654 ms: 6 candidates, 106553 repo-hours, 1114 releases; waiting 444 ms; commit 0 ms)
2026-11-08T12:04:08Z [load_day 2025-05-20] 2025-05-20 hour 18: 258187 events in 0 files, snapshot none (task 11441 ms: download 8067 ms overlapping gunzip 1679 ms, parse 6940 ms, sort 0 ms, write 0 ms, index 823 ms: 7 candidates, 117225 repo-hours, 1283 releases; waiting 1607 ms; commit 0 ms)
2026-11-08T12:04:15Z [load_day 2025-05-20] 2025-05-20 hour 19: 247499 events in 0 files, snapshot none (task 12224 ms: download 8078 ms overlapping gunzip 1653 ms, parse 7259 ms, sort 0 ms, write 0 ms, index 1611 ms: 13 candidates, 99398 repo-hours, 1277 releases; waiting 1317 ms; commit 0 ms)
2026-11-08T12:04:18Z [load_day 2025-05-20] 2025-05-20 hour 20: 237404 events in 0 files, snapshot none (task 9930 ms: download 6803 ms overlapping gunzip 1590 ms, parse 6471 ms, sort 0 ms, write 0 ms, index 1003 ms: 13 candidates, 98248 repo-hours, 1093 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:04:27Z [load_day 2025-05-20] 2025-05-20 hour 21: 218876 events in 0 files, snapshot none (task 11222 ms: download 8073 ms overlapping gunzip 1592 ms, parse 6798 ms, sort 0 ms, write 0 ms, index 813 ms: 28 candidates, 88234 repo-hours, 1122 releases; waiting 1640 ms; commit 0 ms)
2026-11-08T12:04:28Z [load_day 2025-05-20] 2025-05-20 hour 22: 198986 events in 0 files, snapshot none (task 9273 ms: download 6340 ms overlapping gunzip 1512 ms, parse 6139 ms, sort 0 ms, write 0 ms, index 701 ms: 14 candidates, 77579 repo-hours, 1101 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:04:35Z [load_day 2025-05-20] 2025-05-20 hour 23: 193639 events in 0 files, snapshot none (task 7366 ms: download 4615 ms overlapping gunzip 1041 ms, parse 4812 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 76768 repo-hours, 1238 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:04:46Z [load_day 2025-05-20] 2025-05-20: repo_hour merged from 24 files to 1 (2532892 rows, 11060 ms)
2026-11-08T12:04:49Z [load_day 2025-05-20] 2025-05-20: index committed in 14118 ms (24 + 1 + 24 files)
2026-11-08T12:04:49Z [load_day 2025-05-20] 2025-05-20: 5759769 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:04:49Z [load_day 2025-05-20] attempt 1 succeeded