orcaLog in

Runs · run 4058

load_day 2025-06-23, attempt 1 succeeded

Host
73ccef5e07c2:329147
Started
2026-11-08T12:36:12Z
Ended
2026-11-08T12:38:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
693 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
162.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4058/load_day/2025-06-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:36:12Z [load_day 2025-06-23] attempt 1 started
2026-11-08T12:36:13Z [load_day 2025-06-23] 2025-06-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:36:19Z [load_day 2025-06-23] 2025-06-23 hour 0: 139195 events in 0 files, snapshot none (task 6229 ms: download 3782 ms overlapping gunzip 966 ms, parse 4058 ms, sort 0 ms, write 0 ms, index 489 ms: 1 candidates, 63963 repo-hours, 1106 releases; waiting 476 ms; commit 0 ms)
2026-11-08T12:36:20Z [load_day 2025-06-23] 2025-06-23 hour 1: 149248 events in 0 files, snapshot none (task 6613 ms: download 3840 ms overlapping gunzip 951 ms, parse 4016 ms, sort 0 ms, write 0 ms, index 778 ms: 8 candidates, 85792 repo-hours, 721 releases; waiting 556 ms; commit 0 ms)
2026-11-08T12:36:27Z [load_day 2025-06-23] 2025-06-23 hour 2: 150929 events in 0 files, snapshot none (task 7064 ms: download 4294 ms overlapping gunzip 1181 ms, parse 4614 ms, sort 0 ms, write 0 ms, index 552 ms: 6 candidates, 78468 repo-hours, 695 releases; waiting 386 ms; commit 0 ms)
2026-11-08T12:36:27Z [load_day 2025-06-23] 2025-06-23 hour 3: 151377 events in 0 files, snapshot none (task 7264 ms: download 4752 ms overlapping gunzip 1195 ms, parse 4685 ms, sort 0 ms, write 0 ms, index 514 ms: 10 candidates, 69311 repo-hours, 1129 releases; waiting 581 ms; commit 0 ms)
2026-11-08T12:36:35Z [load_day 2025-06-23] 2025-06-23 hour 4: 145407 events in 0 files, snapshot none (task 7290 ms: download 4634 ms overlapping gunzip 1197 ms, parse 4713 ms, sort 0 ms, write 0 ms, index 553 ms: 23 candidates, 64776 repo-hours, 1554 releases; waiting 490 ms; commit 0 ms)
2026-11-08T12:36:35Z [load_day 2025-06-23] 2025-06-23 hour 5: 146717 events in 0 files, snapshot none (task 7042 ms: download 4337 ms overlapping gunzip 1162 ms, parse 4519 ms, sort 0 ms, write 0 ms, index 639 ms: 11 candidates, 66218 repo-hours, 676 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:36:42Z [load_day 2025-06-23] 2025-06-23 hour 6: 161197 events in 0 files, snapshot none (task 5983 ms: download 3579 ms overlapping gunzip 935 ms, parse 3658 ms, sort 0 ms, write 0 ms, index 567 ms: 9 candidates, 80076 repo-hours, 826 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:36:42Z [load_day 2025-06-23] 2025-06-23 hour 7: 157615 events in 0 files, snapshot none (task 6607 ms: download 4278 ms overlapping gunzip 1119 ms, parse 4147 ms, sort 0 ms, write 0 ms, index 541 ms: 5 candidates, 75755 repo-hours, 692 releases; waiting 493 ms; commit 0 ms)
2026-11-08T12:36:49Z [load_day 2025-06-23] 2025-06-23 hour 8: 161338 events in 0 files, snapshot none (task 6548 ms: download 4063 ms overlapping gunzip 1052 ms, parse 4331 ms, sort 0 ms, write 0 ms, index 668 ms: 13 candidates, 80630 repo-hours, 876 releases; waiting 212 ms; commit 0 ms)
2026-11-08T12:36:53Z [load_day 2025-06-23] 2025-06-23 hour 9: 162088 events in 0 files, snapshot none (task 10131 ms: download 5721 ms overlapping gunzip 1181 ms, parse 4455 ms, sort 0 ms, write 0 ms, index 2662 ms: 13 candidates, 81360 repo-hours, 932 releases; waiting 1541 ms; commit 0 ms)
2026-11-08T12:36:58Z [load_day 2025-06-23] 2025-06-23 hour 10: 164316 events in 0 files, snapshot none (task 7239 ms: download 4037 ms overlapping gunzip 1068 ms, parse 4180 ms, sort 0 ms, write 0 ms, index 1144 ms: 11 candidates, 79715 repo-hours, 896 releases; waiting 478 ms; commit 0 ms)
2026-11-08T12:37:02Z [load_day 2025-06-23] 2025-06-23 hour 11: 160948 events in 0 files, snapshot none (task 7714 ms: download 4545 ms overlapping gunzip 1229 ms, parse 4846 ms, sort 0 ms, write 0 ms, index 717 ms: 16 candidates, 78234 repo-hours, 791 releases; waiting 572 ms; commit 0 ms)
2026-11-08T12:37:07Z [load_day 2025-06-23] 2025-06-23 hour 12: 167008 events in 0 files, snapshot none (task 8356 ms: download 3628 ms overlapping gunzip 1294 ms, parse 5261 ms, sort 0 ms, write 0 ms, index 1294 ms: 10 candidates, 97391 repo-hours, 845 releases; waiting 177 ms; commit 0 ms)
2026-11-08T12:37:14Z [load_day 2025-06-23] 2025-06-23 hour 13: 167887 events in 0 files, snapshot none (task 11450 ms: download 6385 ms overlapping gunzip 1871 ms, parse 7257 ms, sort 0 ms, write 0 ms, index 1619 ms: 8 candidates, 92241 repo-hours, 827 releases; waiting 470 ms; commit 0 ms)
2026-11-08T12:37:17Z [load_day 2025-06-23] 2025-06-23 hour 14: 165349 events in 0 files, snapshot none (task 9862 ms: download 6333 ms overlapping gunzip 1571 ms, parse 6323 ms, sort 0 ms, write 0 ms, index 1208 ms: 13 candidates, 85087 repo-hours, 868 releases; waiting 460 ms; commit 0 ms)
2026-11-08T12:37:24Z [load_day 2025-06-23] 2025-06-23 hour 15: 167770 events in 0 files, snapshot none (task 9467 ms: download 6198 ms overlapping gunzip 1629 ms, parse 5745 ms, sort 0 ms, write 0 ms, index 1130 ms: 11 candidates, 86215 repo-hours, 912 releases; waiting 627 ms; commit 0 ms)
2026-11-08T12:37:27Z [load_day 2025-06-23] 2025-06-23 hour 16: 165970 events in 0 files, snapshot none (task 8954 ms: download 6072 ms overlapping gunzip 1492 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 765 ms: 5 candidates, 81815 repo-hours, 812 releases; waiting 549 ms; commit 0 ms)
2026-11-08T12:37:35Z [load_day 2025-06-23] 2025-06-23 hour 17: 161167 events in 0 files, snapshot none (task 10018 ms: download 6280 ms overlapping gunzip 1670 ms, parse 6343 ms, sort 0 ms, write 0 ms, index 834 ms: 14 candidates, 78784 repo-hours, 699 releases; waiting 869 ms; commit 0 ms)
2026-11-08T12:37:36Z [load_day 2025-06-23] 2025-06-23 hour 18: 162041 events in 0 files, snapshot none (task 8786 ms: download 6288 ms overlapping gunzip 1464 ms, parse 5838 ms, sort 0 ms, write 0 ms, index 713 ms: 10 candidates, 83558 repo-hours, 871 releases; waiting 499 ms; commit 0 ms)
2026-11-08T12:37:43Z [load_day 2025-06-23] 2025-06-23 hour 19: 156179 events in 0 files, snapshot none (task 7637 ms: download 4795 ms overlapping gunzip 1236 ms, parse 4921 ms, sort 0 ms, write 0 ms, index 1015 ms: 9 candidates, 70375 repo-hours, 791 releases; waiting 234 ms; commit 0 ms)
2026-11-08T12:37:47Z [load_day 2025-06-23] 2025-06-23 hour 20: 156169 events in 0 files, snapshot none (task 9957 ms: download 7171 ms overlapping gunzip 1343 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 570 ms: 4 candidates, 71642 repo-hours, 772 releases; waiting 2405 ms; commit 0 ms)
2026-11-08T12:37:50Z [load_day 2025-06-23] 2025-06-23 hour 21: 151142 events in 0 files, snapshot none (task 7115 ms: download 5056 ms overlapping gunzip 1081 ms, parse 3880 ms, sort 0 ms, write 0 ms, index 531 ms: 12 candidates, 67706 repo-hours, 868 releases; waiting 1360 ms; commit 0 ms)
2026-11-08T12:37:55Z [load_day 2025-06-23] 2025-06-23 hour 22: 146388 events in 0 files, snapshot none (task 8159 ms: download 4884 ms overlapping gunzip 1196 ms, parse 4354 ms, sort 0 ms, write 0 ms, index 1060 ms: 9 candidates, 61496 repo-hours, 830 releases; waiting 1290 ms; commit 0 ms)
2026-11-08T12:37:58Z [load_day 2025-06-23] 2025-06-23 hour 23: 147318 events in 0 files, snapshot none (task 7226 ms: download 5206 ms overlapping gunzip 1360 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 511 ms: 11 candidates, 60675 repo-hours, 867 releases; waiting 188 ms; commit 0 ms)
2026-11-08T12:38:08Z [load_day 2025-06-23] 2025-06-23: repo_hour merged from 24 files to 1 (1841283 rows, 9518 ms)
2026-11-08T12:38:11Z [load_day 2025-06-23] 2025-06-23: index committed in 13329 ms (24 + 1 + 24 files)
2026-11-08T12:38:11Z [load_day 2025-06-23] 2025-06-23: 3764763 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:38:11Z [load_day 2025-06-23] attempt 1 succeeded