orcaLog in

Runs · run 3037

load_day 2024-10-03, attempt 1 succeeded

Host
73ccef5e07c2:186834
Started
2026-11-08T08:11:35Z
Ended
2026-11-08T08:13:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
823 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
145.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3037/load_day/2024-10-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:11:35Z [load_day 2024-10-03] attempt 1 started
2026-11-08T08:11:36Z [load_day 2024-10-03] 2024-10-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:11:41Z [load_day 2024-10-03] 2024-10-03 hour 0: 161614 events in 0 files, snapshot none (task 4625 ms: download 2587 ms overlapping gunzip 674 ms, parse 2809 ms, sort 0 ms, write 0 ms, index 555 ms: 8 candidates, 78385 repo-hours, 1082 releases; waiting 257 ms; commit 0 ms)
2026-11-08T08:11:42Z [load_day 2024-10-03] 2024-10-03 hour 1: 182028 events in 0 files, snapshot none (task 5512 ms: download 3099 ms overlapping gunzip 782 ms, parse 3230 ms, sort 0 ms, write 0 ms, index 694 ms: 9 candidates, 98022 repo-hours, 881 releases; waiting 455 ms; commit 0 ms)
2026-11-08T08:11:48Z [load_day 2024-10-03] 2024-10-03 hour 2: 153309 events in 0 files, snapshot none (task 6069 ms: download 3401 ms overlapping gunzip 940 ms, parse 3573 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 68763 repo-hours, 796 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:11:48Z [load_day 2024-10-03] 2024-10-03 hour 3: 168884 events in 0 files, snapshot none (task 5670 ms: download 3023 ms overlapping gunzip 796 ms, parse 3345 ms, sort 0 ms, write 0 ms, index 648 ms: 4 candidates, 68425 repo-hours, 3953 releases; waiting 489 ms; commit 0 ms)
2026-11-08T08:11:54Z [load_day 2024-10-03] 2024-10-03 hour 4: 149979 events in 0 files, snapshot none (task 5256 ms: download 2400 ms overlapping gunzip 816 ms, parse 3048 ms, sort 0 ms, write 0 ms, index 565 ms: 8 candidates, 59137 repo-hours, 689 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:11:54Z [load_day 2024-10-03] 2024-10-03 hour 5: 162260 events in 0 files, snapshot none (task 5127 ms: download 2692 ms overlapping gunzip 759 ms, parse 3008 ms, sort 0 ms, write 0 ms, index 556 ms: 4 candidates, 62720 repo-hours, 784 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:12:00Z [load_day 2024-10-03] 2024-10-03 hour 6: 195917 events in 0 files, snapshot none (task 5312 ms: download 2749 ms overlapping gunzip 713 ms, parse 2989 ms, sort 0 ms, write 0 ms, index 788 ms: 5 candidates, 85536 repo-hours, 862 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:12:00Z [load_day 2024-10-03] 2024-10-03 hour 7: 195881 events in 0 files, snapshot none (task 5809 ms: download 2965 ms overlapping gunzip 880 ms, parse 3371 ms, sort 0 ms, write 0 ms, index 718 ms: 7 candidates, 77953 repo-hours, 936 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:12:06Z [load_day 2024-10-03] 2024-10-03 hour 8: 214970 events in 0 files, snapshot none (task 5921 ms: download 3552 ms overlapping gunzip 964 ms, parse 3582 ms, sort 0 ms, write 0 ms, index 625 ms: 11 candidates, 85797 repo-hours, 1128 releases; waiting 452 ms; commit 0 ms)
2026-11-08T08:12:07Z [load_day 2024-10-03] 2024-10-03 hour 9: 225142 events in 0 files, snapshot none (task 5903 ms: download 3944 ms overlapping gunzip 1003 ms, parse 3617 ms, sort 0 ms, write 0 ms, index 668 ms: 10 candidates, 93985 repo-hours, 1263 releases; waiting 297 ms; commit 0 ms)
2026-11-08T08:12:12Z [load_day 2024-10-03] 2024-10-03 hour 10: 217741 events in 0 files, snapshot none (task 5589 ms: download 2979 ms overlapping gunzip 931 ms, parse 3439 ms, sort 0 ms, write 0 ms, index 738 ms: 8 candidates, 89481 repo-hours, 1127 releases; waiting 229 ms; commit 0 ms)
2026-11-08T08:12:12Z [load_day 2024-10-03] 2024-10-03 hour 11: 214696 events in 0 files, snapshot none (task 5506 ms: download 3111 ms overlapping gunzip 820 ms, parse 3165 ms, sort 0 ms, write 0 ms, index 688 ms: 5 candidates, 84882 repo-hours, 1035 releases; waiting 522 ms; commit 0 ms)
2026-11-08T08:12:20Z [load_day 2024-10-03] 2024-10-03 hour 12: 270863 events in 0 files, snapshot none (task 6854 ms: download 3472 ms overlapping gunzip 906 ms, parse 3718 ms, sort 0 ms, write 0 ms, index 1542 ms: 7 candidates, 134253 repo-hours, 1168 releases; waiting 430 ms; commit 0 ms)
2026-11-08T08:12:20Z [load_day 2024-10-03] 2024-10-03 hour 13: 252760 events in 0 files, snapshot none (task 6598 ms: download 3675 ms overlapping gunzip 953 ms, parse 3725 ms, sort 0 ms, write 0 ms, index 1071 ms: 4 candidates, 117183 repo-hours, 1195 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:12:27Z [load_day 2024-10-03] 2024-10-03 hour 14: 246265 events in 0 files, snapshot none (task 7084 ms: download 4272 ms overlapping gunzip 1159 ms, parse 4319 ms, sort 0 ms, write 0 ms, index 793 ms: 7 candidates, 104208 repo-hours, 1348 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:12:28Z [load_day 2024-10-03] 2024-10-03 hour 15: 246891 events in 0 files, snapshot none (task 7806 ms: download 5081 ms overlapping gunzip 1321 ms, parse 4886 ms, sort 0 ms, write 0 ms, index 741 ms: 6 candidates, 108443 repo-hours, 1364 releases; waiting 445 ms; commit 0 ms)
2026-11-08T08:12:36Z [load_day 2024-10-03] 2024-10-03 hour 16: 219901 events in 0 files, snapshot none (task 8152 ms: download 4972 ms overlapping gunzip 1319 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 974 ms: 12 candidates, 96163 repo-hours, 1129 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:12:36Z [load_day 2024-10-03] 2024-10-03 hour 17: 226604 events in 0 files, snapshot none (task 7501 ms: download 4295 ms overlapping gunzip 1143 ms, parse 4288 ms, sort 0 ms, write 0 ms, index 1298 ms: 6 candidates, 92317 repo-hours, 1062 releases; waiting 502 ms; commit 0 ms)
2026-11-08T08:12:46Z [load_day 2024-10-03] 2024-10-03 hour 18: 243763 events in 0 files, snapshot none (task 9602 ms: download 7342 ms overlapping gunzip 1339 ms, parse 4833 ms, sort 0 ms, write 0 ms, index 736 ms: 12 candidates, 108670 repo-hours, 1163 releases; waiting 2385 ms; commit 0 ms)
2026-11-08T08:12:46Z [load_day 2024-10-03] 2024-10-03 hour 19: 211638 events in 0 files, snapshot none (task 6954 ms: download 4076 ms overlapping gunzip 1227 ms, parse 4063 ms, sort 0 ms, write 0 ms, index 849 ms: 8 candidates, 83198 repo-hours, 1088 releases; waiting 562 ms; commit 0 ms)
2026-11-08T08:12:54Z [load_day 2024-10-03] 2024-10-03 hour 20: 202517 events in 0 files, snapshot none (task 7306 ms: download 4566 ms overlapping gunzip 1228 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 726 ms: 6 candidates, 79725 repo-hours, 1047 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:12:54Z [load_day 2024-10-03] 2024-10-03 hour 21: 197108 events in 0 files, snapshot none (task 7445 ms: download 4787 ms overlapping gunzip 1277 ms, parse 4499 ms, sort 0 ms, write 0 ms, index 797 ms: 11 candidates, 77485 repo-hours, 1311 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:13:01Z [load_day 2024-10-03] 2024-10-03 hour 22: 170420 events in 0 files, snapshot none (task 6380 ms: download 3747 ms overlapping gunzip 972 ms, parse 3805 ms, sort 0 ms, write 0 ms, index 440 ms: 7 candidates, 64028 repo-hours, 1105 releases; waiting 863 ms; commit 0 ms)
2026-11-08T08:13:01Z [load_day 2024-10-03] 2024-10-03 hour 23: 160634 events in 0 files, snapshot none (task 6117 ms: download 4129 ms overlapping gunzip 914 ms, parse 3479 ms, sort 0 ms, write 0 ms, index 455 ms: 11 candidates, 58329 repo-hours, 852 releases; waiting 830 ms; commit 0 ms)
2026-11-08T08:13:10Z [load_day 2024-10-03] 2024-10-03: repo_hour merged from 24 files to 1 (2077088 rows, 9014 ms)
2026-11-08T08:13:12Z [load_day 2024-10-03] 2024-10-03: index committed in 11353 ms (24 + 1 + 24 files)
2026-11-08T08:13:12Z [load_day 2024-10-03] 2024-10-03: 4891785 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:13:12Z [load_day 2024-10-03] attempt 1 succeeded