orcaLog in

Runs · run 1847

load_day 2023-12-12, attempt 1 succeeded

Host
73ccef5e07c2:8835
Started
2026-11-08T03:43:08Z
Ended
2026-11-08T03:44:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
768 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
174.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1847/load_day/2023-12-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:43:08Z [load_day 2023-12-12] attempt 1 started
2026-11-08T03:43:09Z [load_day 2023-12-12] 2023-12-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:43:17Z [load_day 2023-12-12] 2023-12-12 hour 0: 227578 events in 0 files, snapshot none (task 7359 ms: download 4227 ms overlapping gunzip 1135 ms, parse 4769 ms, sort 0 ms, write 0 ms, index 711 ms: 11 candidates, 86033 repo-hours, 883 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:43:17Z [load_day 2023-12-12] 2023-12-12 hour 1: 234265 events in 0 files, snapshot none (task 7328 ms: download 3679 ms overlapping gunzip 1030 ms, parse 4388 ms, sort 0 ms, write 0 ms, index 1156 ms: 7 candidates, 92927 repo-hours, 830 releases; waiting 471 ms; commit 0 ms)
2026-11-08T03:43:24Z [load_day 2023-12-12] 2023-12-12 hour 2: 211657 events in 0 files, snapshot none (task 6160 ms: download 3488 ms overlapping gunzip 891 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 622 ms: 11 candidates, 65021 repo-hours, 820 releases; waiting 511 ms; commit 0 ms)
2026-11-08T03:43:24Z [load_day 2023-12-12] 2023-12-12 hour 3: 202762 events in 0 files, snapshot none (task 6180 ms: download 3544 ms overlapping gunzip 906 ms, parse 3859 ms, sort 0 ms, write 0 ms, index 687 ms: 5 candidates, 62468 repo-hours, 895 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:43:30Z [load_day 2023-12-12] 2023-12-12 hour 4: 173836 events in 0 files, snapshot none (task 5628 ms: download 3291 ms overlapping gunzip 835 ms, parse 3626 ms, sort 0 ms, write 0 ms, index 420 ms: 6 candidates, 58811 repo-hours, 584 releases; waiting 513 ms; commit 0 ms)
2026-11-08T03:43:30Z [load_day 2023-12-12] 2023-12-12 hour 5: 178816 events in 0 files, snapshot none (task 6369 ms: download 4078 ms overlapping gunzip 1018 ms, parse 4158 ms, sort 0 ms, write 0 ms, index 429 ms: 5 candidates, 62313 repo-hours, 690 releases; waiting 484 ms; commit 0 ms)
2026-11-08T03:43:39Z [load_day 2023-12-12] 2023-12-12 hour 6: 202207 events in 0 files, snapshot none (task 9067 ms: download 5542 ms overlapping gunzip 1471 ms, parse 6034 ms, sort 0 ms, write 0 ms, index 801 ms: 9 candidates, 76396 repo-hours, 795 releases; waiting 531 ms; commit 0 ms)
2026-11-08T03:43:40Z [load_day 2023-12-12] 2023-12-12 hour 7: 200951 events in 0 files, snapshot none (task 8562 ms: download 5801 ms overlapping gunzip 1384 ms, parse 5795 ms, sort 0 ms, write 0 ms, index 582 ms: 7 candidates, 76947 repo-hours, 899 releases; waiting 538 ms; commit 0 ms)
2026-11-08T03:43:48Z [load_day 2023-12-12] 2023-12-12 hour 8: 214255 events in 0 files, snapshot none (task 8732 ms: download 5477 ms overlapping gunzip 1329 ms, parse 5761 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 84452 repo-hours, 996 releases; waiting 529 ms; commit 0 ms)
2026-11-08T03:43:49Z [load_day 2023-12-12] 2023-12-12 hour 9: 205358 events in 0 files, snapshot none (task 9256 ms: download 6314 ms overlapping gunzip 1463 ms, parse 6320 ms, sort 0 ms, write 0 ms, index 697 ms: 8 candidates, 89599 repo-hours, 1199 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:43:57Z [load_day 2023-12-12] 2023-12-12 hour 10: 204317 events in 0 files, snapshot none (task 8373 ms: download 4939 ms overlapping gunzip 1240 ms, parse 5416 ms, sort 0 ms, write 0 ms, index 951 ms: 12 candidates, 90044 repo-hours, 1150 releases; waiting 504 ms; commit 0 ms)
2026-11-08T03:43:57Z [load_day 2023-12-12] 2023-12-12 hour 11: 194577 events in 0 files, snapshot none (task 7582 ms: download 4615 ms overlapping gunzip 1210 ms, parse 4852 ms, sort 0 ms, write 0 ms, index 692 ms: 3 candidates, 84058 repo-hours, 1123 releases; waiting 553 ms; commit 0 ms)
2026-11-08T03:44:06Z [load_day 2023-12-12] 2023-12-12 hour 12: 245734 events in 0 files, snapshot none (task 8979 ms: download 5183 ms overlapping gunzip 1334 ms, parse 5721 ms, sort 0 ms, write 0 ms, index 1097 ms: 15 candidates, 117008 repo-hours, 1317 releases; waiting 498 ms; commit 0 ms)
2026-11-08T03:44:07Z [load_day 2023-12-12] 2023-12-12 hour 13: 227905 events in 0 files, snapshot none (task 9091 ms: download 5658 ms overlapping gunzip 1385 ms, parse 5858 ms, sort 0 ms, write 0 ms, index 959 ms: 10 candidates, 112246 repo-hours, 1201 releases; waiting 573 ms; commit 0 ms)
2026-11-08T03:44:17Z [load_day 2023-12-12] 2023-12-12 hour 14: 222298 events in 0 files, snapshot none (task 9716 ms: download 6045 ms overlapping gunzip 1486 ms, parse 6720 ms, sort 0 ms, write 0 ms, index 995 ms: 11 candidates, 98862 repo-hours, 1305 releases; waiting 307 ms; commit 0 ms)
2026-11-08T03:44:18Z [load_day 2023-12-12] 2023-12-12 hour 15: 214355 events in 0 files, snapshot none (task 10129 ms: download 6391 ms overlapping gunzip 1636 ms, parse 6879 ms, sort 0 ms, write 0 ms, index 853 ms: 12 candidates, 97951 repo-hours, 1581 releases; waiting 472 ms; commit 0 ms)
2026-11-08T03:44:26Z [load_day 2023-12-12] 2023-12-12 hour 16: 216394 events in 0 files, snapshot none (task 8528 ms: download 5489 ms overlapping gunzip 1308 ms, parse 5415 ms, sort 0 ms, write 0 ms, index 1040 ms: 11 candidates, 96496 repo-hours, 1628 releases; waiting 508 ms; commit 0 ms)
2026-11-08T03:44:26Z [load_day 2023-12-12] 2023-12-12 hour 17: 201078 events in 0 files, snapshot none (task 8250 ms: download 5376 ms overlapping gunzip 1302 ms, parse 5570 ms, sort 0 ms, write 0 ms, index 649 ms: 13 candidates, 87663 repo-hours, 1089 releases; waiting 482 ms; commit 0 ms)
2026-11-08T03:44:34Z [load_day 2023-12-12] 2023-12-12 hour 18: 202673 events in 0 files, snapshot none (task 8117 ms: download 5161 ms overlapping gunzip 1197 ms, parse 4851 ms, sort 0 ms, write 0 ms, index 1034 ms: 7 candidates, 92451 repo-hours, 1258 releases; waiting 809 ms; commit 0 ms)
2026-11-08T03:44:34Z [load_day 2023-12-12] 2023-12-12 hour 19: 182087 events in 0 files, snapshot none (task 7128 ms: download 4465 ms overlapping gunzip 1060 ms, parse 4554 ms, sort 0 ms, write 0 ms, index 703 ms: 3 candidates, 78221 repo-hours, 1110 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:44:42Z [load_day 2023-12-12] 2023-12-12 hour 20: 178673 events in 0 files, snapshot none (task 6535 ms: download 4148 ms overlapping gunzip 990 ms, parse 4218 ms, sort 0 ms, write 0 ms, index 541 ms: 3 candidates, 76565 repo-hours, 1000 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:44:42Z [load_day 2023-12-12] 2023-12-12 hour 21: 169189 events in 0 files, snapshot none (task 6609 ms: download 3848 ms overlapping gunzip 922 ms, parse 3950 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 70821 repo-hours, 1139 releases; waiting 524 ms; commit 0 ms)
2026-11-08T03:44:48Z [load_day 2023-12-12] 2023-12-12 hour 22: 159268 events in 0 files, snapshot none (task 5721 ms: download 3420 ms overlapping gunzip 847 ms, parse 3490 ms, sort 0 ms, write 0 ms, index 492 ms: 7 candidates, 65674 repo-hours, 994 releases; waiting 605 ms; commit 0 ms)
2026-11-08T03:44:48Z [load_day 2023-12-12] 2023-12-12 hour 23: 144728 events in 0 files, snapshot none (task 5178 ms: download 2910 ms overlapping gunzip 786 ms, parse 3182 ms, sort 0 ms, write 0 ms, index 421 ms: 8 candidates, 59402 repo-hours, 836 releases; waiting 506 ms; commit 0 ms)
2026-11-08T03:44:56Z [load_day 2023-12-12] 2023-12-12: repo_hour merged from 24 files to 1 (1982429 rows, 8138 ms)
2026-11-08T03:44:58Z [load_day 2023-12-12] 2023-12-12: index committed in 10670 ms (24 + 1 + 24 files)
2026-11-08T03:44:58Z [load_day 2023-12-12] 2023-12-12: 4814961 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:44:58Z [load_day 2023-12-12] attempt 1 succeeded