orcaLog in

Runs · run 3311

load_day 2024-12-12, attempt 1 succeeded

Host
73ccef5e07c2:221478
Started
2026-11-08T09:20:14Z
Ended
2026-11-08T09:22:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
813 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3311/load_day/2024-12-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:20:14Z [load_day 2024-12-12] attempt 1 started
2026-11-08T09:20:15Z [load_day 2024-12-12] 2024-12-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:20:24Z [load_day 2024-12-12] 2024-12-12 hour 0: 190538 events in 0 files, snapshot none (task 7762 ms: download 4432 ms overlapping gunzip 1155 ms, parse 4873 ms, sort 0 ms, write 0 ms, index 1005 ms: 2 candidates, 89663 repo-hours, 1251 releases; waiting 371 ms; commit 0 ms)
2026-11-08T09:20:24Z [load_day 2024-12-12] 2024-12-12 hour 1: 203241 events in 0 files, snapshot none (task 7476 ms: download 4139 ms overlapping gunzip 1098 ms, parse 4499 ms, sort 0 ms, write 0 ms, index 1119 ms: 5 candidates, 112234 repo-hours, 1063 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:20:31Z [load_day 2024-12-12] 2024-12-12 hour 2: 168920 events in 0 files, snapshot none (task 7223 ms: download 4428 ms overlapping gunzip 1055 ms, parse 4630 ms, sort 0 ms, write 0 ms, index 728 ms: 4 candidates, 75057 repo-hours, 860 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:20:31Z [load_day 2024-12-12] 2024-12-12 hour 3: 188082 events in 0 files, snapshot none (task 7291 ms: download 4441 ms overlapping gunzip 1032 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 80554 repo-hours, 3901 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:20:38Z [load_day 2024-12-12] 2024-12-12 hour 4: 167970 events in 0 files, snapshot none (task 6581 ms: download 3726 ms overlapping gunzip 999 ms, parse 4352 ms, sort 0 ms, write 0 ms, index 528 ms: 4 candidates, 65828 repo-hours, 704 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:20:39Z [load_day 2024-12-12] 2024-12-12 hour 5: 176523 events in 0 files, snapshot none (task 6715 ms: download 3852 ms overlapping gunzip 1104 ms, parse 4573 ms, sort 0 ms, write 0 ms, index 517 ms: 2 candidates, 69985 repo-hours, 764 releases; waiting 178 ms; commit 0 ms)
2026-11-08T09:20:47Z [load_day 2024-12-12] 2024-12-12 hour 6: 206413 events in 0 files, snapshot none (task 8172 ms: download 5064 ms overlapping gunzip 1243 ms, parse 5142 ms, sort 0 ms, write 0 ms, index 866 ms: 8 candidates, 94679 repo-hours, 1006 releases; waiting 618 ms; commit 0 ms)
2026-11-08T09:20:47Z [load_day 2024-12-12] 2024-12-12 hour 7: 198944 events in 0 files, snapshot none (task 8210 ms: download 5361 ms overlapping gunzip 1228 ms, parse 5376 ms, sort 0 ms, write 0 ms, index 627 ms: 8 candidates, 82591 repo-hours, 870 releases; waiting 677 ms; commit 0 ms)
2026-11-08T09:20:57Z [load_day 2024-12-12] 2024-12-12 hour 8: 209013 events in 0 files, snapshot none (task 9940 ms: download 7353 ms overlapping gunzip 1321 ms, parse 5695 ms, sort 0 ms, write 0 ms, index 665 ms: 8 candidates, 90414 repo-hours, 1063 releases; waiting 1935 ms; commit 0 ms)
2026-11-08T09:20:57Z [load_day 2024-12-12] 2024-12-12 hour 9: 219093 events in 0 files, snapshot none (task 8914 ms: download 6280 ms overlapping gunzip 1375 ms, parse 5872 ms, sort 0 ms, write 0 ms, index 723 ms: 5 candidates, 97499 repo-hours, 1273 releases; waiting 594 ms; commit 0 ms)
2026-11-08T09:21:05Z [load_day 2024-12-12] 2024-12-12 hour 10: 217891 events in 0 files, snapshot none (task 7421 ms: download 4861 ms overlapping gunzip 1140 ms, parse 4680 ms, sort 0 ms, write 0 ms, index 661 ms: 11 candidates, 92246 repo-hours, 1142 releases; waiting 600 ms; commit 0 ms)
2026-11-08T09:21:05Z [load_day 2024-12-12] 2024-12-12 hour 11: 213151 events in 0 files, snapshot none (task 7219 ms: download 4720 ms overlapping gunzip 1090 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 676 ms: 8 candidates, 87398 repo-hours, 1241 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:21:12Z [load_day 2024-12-12] 2024-12-12 hour 12: 236395 events in 0 files, snapshot none (task 6949 ms: download 4238 ms overlapping gunzip 1056 ms, parse 4514 ms, sort 0 ms, write 0 ms, index 804 ms: 10 candidates, 121285 repo-hours, 1198 releases; waiting 284 ms; commit 0 ms)
2026-11-08T09:21:13Z [load_day 2024-12-12] 2024-12-12 hour 13: 241757 events in 0 files, snapshot none (task 7592 ms: download 4924 ms overlapping gunzip 1179 ms, parse 5020 ms, sort 0 ms, write 0 ms, index 764 ms: 14 candidates, 110262 repo-hours, 1178 releases; waiting 294 ms; commit 0 ms)
2026-11-08T09:21:25Z [load_day 2024-12-12] 2024-12-12 hour 14: 235242 events in 0 files, snapshot none (task 12356 ms: download 8580 ms overlapping gunzip 1867 ms, parse 8022 ms, sort 0 ms, write 0 ms, index 1674 ms: 6 candidates, 99884 repo-hours, 1358 releases; waiting 457 ms; commit 0 ms)
2026-11-08T09:21:26Z [load_day 2024-12-12] 2024-12-12 hour 15: 234391 events in 0 files, snapshot none (task 12501 ms: download 8819 ms overlapping gunzip 2154 ms, parse 8731 ms, sort 0 ms, write 0 ms, index 882 ms: 9 candidates, 104884 repo-hours, 1507 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:21:36Z [load_day 2024-12-12] 2024-12-12 hour 16: 225698 events in 0 files, snapshot none (task 9832 ms: download 6025 ms overlapping gunzip 1556 ms, parse 6859 ms, sort 0 ms, write 0 ms, index 798 ms: 10 candidates, 98827 repo-hours, 1392 releases; waiting 330 ms; commit 0 ms)
2026-11-08T09:21:37Z [load_day 2024-12-12] 2024-12-12 hour 17: 226283 events in 0 files, snapshot none (task 9853 ms: download 6809 ms overlapping gunzip 1580 ms, parse 6802 ms, sort 0 ms, write 0 ms, index 714 ms: 7 candidates, 91744 repo-hours, 1207 releases; waiting 453 ms; commit 0 ms)
2026-11-08T09:21:46Z [load_day 2024-12-12] 2024-12-12 hour 18: 223021 events in 0 files, snapshot none (task 10197 ms: download 6846 ms overlapping gunzip 1577 ms, parse 6588 ms, sort 0 ms, write 0 ms, index 785 ms: 1 candidates, 99364 repo-hours, 1184 releases; waiting 524 ms; commit 0 ms)
2026-11-08T09:21:46Z [load_day 2024-12-12] 2024-12-12 hour 19: 211152 events in 0 files, snapshot none (task 9050 ms: download 6341 ms overlapping gunzip 1472 ms, parse 6108 ms, sort 0 ms, write 0 ms, index 677 ms: 4 candidates, 81134 repo-hours, 1146 releases; waiting 530 ms; commit 0 ms)
2026-11-08T09:21:56Z [load_day 2024-12-12] 2024-12-12 hour 20: 204016 events in 0 files, snapshot none (task 8911 ms: download 6331 ms overlapping gunzip 1302 ms, parse 6115 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 81133 repo-hours, 1035 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:21:56Z [load_day 2024-12-12] 2024-12-12 hour 21: 206808 events in 0 files, snapshot none (task 8867 ms: download 6015 ms overlapping gunzip 1454 ms, parse 5746 ms, sort 0 ms, write 0 ms, index 633 ms: 4 candidates, 82267 repo-hours, 1084 releases; waiting 434 ms; commit 0 ms)
2026-11-08T09:22:05Z [load_day 2024-12-12] 2024-12-12 hour 22: 188136 events in 0 files, snapshot none (task 8797 ms: download 6065 ms overlapping gunzip 1432 ms, parse 5810 ms, sort 0 ms, write 0 ms, index 662 ms: 9 candidates, 71046 repo-hours, 1294 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:22:05Z [load_day 2024-12-12] 2024-12-12 hour 23: 177929 events in 0 files, snapshot none (task 8758 ms: download 5983 ms overlapping gunzip 1406 ms, parse 5924 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 67185 repo-hours, 1184 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:22:15Z [load_day 2024-12-12] 2024-12-12: repo_hour merged from 24 files to 1 (2147163 rows, 9805 ms)
2026-11-08T09:22:18Z [load_day 2024-12-12] 2024-12-12: index committed in 12933 ms (24 + 1 + 24 files)
2026-11-08T09:22:18Z [load_day 2024-12-12] 2024-12-12: 4970607 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:22:18Z [load_day 2024-12-12] attempt 1 succeeded