orcaLog in

Runs · run 2809

load_day 2024-08-06, attempt 1 succeeded

Host
73ccef5e07c2:160145
Started
2026-11-08T07:19:16Z
Ended
2026-11-08T07:21:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
812 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2809/load_day/2024-08-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:19:16Z [load_day 2024-08-06] attempt 1 started
2026-11-08T07:19:17Z [load_day 2024-08-06] 2024-08-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:19:25Z [load_day 2024-08-06] 2024-08-06 hour 0: 181872 events in 0 files, snapshot none (task 7366 ms: download 4050 ms overlapping gunzip 1092 ms, parse 4684 ms, sort 0 ms, write 0 ms, index 846 ms: 7 candidates, 96029 repo-hours, 1140 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:19:25Z [load_day 2024-08-06] 2024-08-06 hour 1: 194948 events in 0 files, snapshot none (task 7682 ms: download 4507 ms overlapping gunzip 1118 ms, parse 4875 ms, sort 0 ms, write 0 ms, index 949 ms: 3 candidates, 111466 repo-hours, 873 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:19:32Z [load_day 2024-08-06] 2024-08-06 hour 2: 161287 events in 0 files, snapshot none (task 6552 ms: download 4123 ms overlapping gunzip 1005 ms, parse 4019 ms, sort 0 ms, write 0 ms, index 541 ms: 4 candidates, 69469 repo-hours, 969 releases; waiting 627 ms; commit 0 ms)
2026-11-08T07:19:33Z [load_day 2024-08-06] 2024-08-06 hour 3: 181169 events in 0 files, snapshot none (task 6787 ms: download 3942 ms overlapping gunzip 1027 ms, parse 4374 ms, sort 0 ms, write 0 ms, index 673 ms: 3 candidates, 78075 repo-hours, 5471 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:19:41Z [load_day 2024-08-06] 2024-08-06 hour 4: 155632 events in 0 files, snapshot none (task 8341 ms: download 4485 ms overlapping gunzip 1300 ms, parse 5522 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 63152 repo-hours, 646 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:19:42Z [load_day 2024-08-06] 2024-08-06 hour 5: 182086 events in 0 files, snapshot none (task 9262 ms: download 6234 ms overlapping gunzip 1521 ms, parse 6344 ms, sort 0 ms, write 0 ms, index 606 ms: 9 candidates, 77884 repo-hours, 839 releases; waiting 477 ms; commit 0 ms)
2026-11-08T07:19:52Z [load_day 2024-08-06] 2024-08-06 hour 6: 215298 events in 0 files, snapshot none (task 9858 ms: download 6893 ms overlapping gunzip 1526 ms, parse 6383 ms, sort 0 ms, write 0 ms, index 750 ms: 9 candidates, 100675 repo-hours, 1015 releases; waiting 839 ms; commit 0 ms)
2026-11-08T07:19:52Z [load_day 2024-08-06] 2024-08-06 hour 7: 219003 events in 0 files, snapshot none (task 9558 ms: download 6830 ms overlapping gunzip 1665 ms, parse 6264 ms, sort 0 ms, write 0 ms, index 647 ms: 6 candidates, 89505 repo-hours, 1080 releases; waiting 664 ms; commit 0 ms)
2026-11-08T07:20:03Z [load_day 2024-08-06] 2024-08-06 hour 8: 229988 events in 0 files, snapshot none (task 10442 ms: download 7777 ms overlapping gunzip 1853 ms, parse 7061 ms, sort 0 ms, write 0 ms, index 661 ms: 4 candidates, 96110 repo-hours, 1150 releases; waiting 560 ms; commit 0 ms)
2026-11-08T07:20:03Z [load_day 2024-08-06] 2024-08-06 hour 9: 235119 events in 0 files, snapshot none (task 10243 ms: download 7584 ms overlapping gunzip 1707 ms, parse 7020 ms, sort 0 ms, write 0 ms, index 774 ms: 5 candidates, 101854 repo-hours, 1412 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:20:11Z [load_day 2024-08-06] 2024-08-06 hour 10: 217612 events in 0 files, snapshot none (task 7391 ms: download 4937 ms overlapping gunzip 1175 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 634 ms: 10 candidates, 90479 repo-hours, 1087 releases; waiting 397 ms; commit 0 ms)
2026-11-08T07:20:11Z [load_day 2024-08-06] 2024-08-06 hour 11: 218001 events in 0 files, snapshot none (task 7503 ms: download 5099 ms overlapping gunzip 1191 ms, parse 4942 ms, sort 0 ms, write 0 ms, index 634 ms: 6 candidates, 87808 repo-hours, 1089 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:20:20Z [load_day 2024-08-06] 2024-08-06 hour 12: 270459 events in 0 files, snapshot none (task 8794 ms: download 5042 ms overlapping gunzip 1258 ms, parse 5362 ms, sort 0 ms, write 0 ms, index 1468 ms: 3 candidates, 132032 repo-hours, 1417 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:20:21Z [load_day 2024-08-06] 2024-08-06 hour 13: 250165 events in 0 files, snapshot none (task 9488 ms: download 5687 ms overlapping gunzip 1415 ms, parse 6232 ms, sort 0 ms, write 0 ms, index 1011 ms: 9 candidates, 114005 repo-hours, 1304 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:20:31Z [load_day 2024-08-06] 2024-08-06 hour 14: 247046 events in 0 files, snapshot none (task 10108 ms: download 6957 ms overlapping gunzip 1703 ms, parse 6803 ms, sort 0 ms, write 0 ms, index 804 ms: 9 candidates, 101782 repo-hours, 1423 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:20:32Z [load_day 2024-08-06] 2024-08-06 hour 15: 243386 events in 0 files, snapshot none (task 10637 ms: download 7857 ms overlapping gunzip 1763 ms, parse 7028 ms, sort 0 ms, write 0 ms, index 738 ms: 4 candidates, 106997 repo-hours, 1453 releases; waiting 779 ms; commit 0 ms)
2026-11-08T07:20:41Z [load_day 2024-08-06] 2024-08-06 hour 16: 226274 events in 0 files, snapshot none (task 9691 ms: download 7095 ms overlapping gunzip 1574 ms, parse 6494 ms, sort 0 ms, write 0 ms, index 746 ms: 7 candidates, 93806 repo-hours, 1246 releases; waiting 599 ms; commit 0 ms)
2026-11-08T07:20:42Z [load_day 2024-08-06] 2024-08-06 hour 17: 215668 events in 0 files, snapshot none (task 8624 ms: download 5887 ms overlapping gunzip 1391 ms, parse 5748 ms, sort 0 ms, write 0 ms, index 704 ms: 7 candidates, 87260 repo-hours, 1121 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:20:50Z [load_day 2024-08-06] 2024-08-06 hour 18: 219827 events in 0 files, snapshot none (task 8457 ms: download 5799 ms overlapping gunzip 1319 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 745 ms: 12 candidates, 98243 repo-hours, 1095 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:20:50Z [load_day 2024-08-06] 2024-08-06 hour 19: 198824 events in 0 files, snapshot none (task 7977 ms: download 5394 ms overlapping gunzip 1228 ms, parse 5183 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 76144 repo-hours, 1025 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:20:58Z [load_day 2024-08-06] 2024-08-06 hour 20: 195527 events in 0 files, snapshot none (task 8117 ms: download 5308 ms overlapping gunzip 1212 ms, parse 5299 ms, sort 0 ms, write 0 ms, index 781 ms: 3 candidates, 78837 repo-hours, 961 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:20:59Z [load_day 2024-08-06] 2024-08-06 hour 21: 180384 events in 0 files, snapshot none (task 7983 ms: download 5510 ms overlapping gunzip 1216 ms, parse 5378 ms, sort 0 ms, write 0 ms, index 629 ms: 11 candidates, 73489 repo-hours, 1162 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:21:07Z [load_day 2024-08-06] 2024-08-06 hour 22: 158016 events in 0 files, snapshot none (task 7667 ms: download 4877 ms overlapping gunzip 1232 ms, parse 5094 ms, sort 0 ms, write 0 ms, index 487 ms: 27 candidates, 59733 repo-hours, 1086 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:21:07Z [load_day 2024-08-06] 2024-08-06 hour 23: 150822 events in 0 files, snapshot none (task 6987 ms: download 4284 ms overlapping gunzip 1138 ms, parse 4580 ms, sort 0 ms, write 0 ms, index 408 ms: 33 candidates, 57568 repo-hours, 798 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:21:16Z [load_day 2024-08-06] 2024-08-06: repo_hour merged from 24 files to 1 (2142402 rows, 9119 ms)
2026-11-08T07:21:18Z [load_day 2024-08-06] 2024-08-06: index committed in 11451 ms (24 + 1 + 24 files)
2026-11-08T07:21:18Z [load_day 2024-08-06] 2024-08-06: 4948413 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:21:18Z [load_day 2024-08-06] attempt 1 succeeded