orcaLog in

Runs · run 4466

load_day 2025-10-03, attempt 1 succeeded

Host
73ccef5e07c2:389235
Started
2026-11-08T14:06:27Z
Ended
2026-11-08T14:08:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
698 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
151.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4466/load_day/2025-10-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:06:28Z [load_day 2025-10-03] attempt 1 started
2026-11-08T14:06:28Z [load_day 2025-10-03] 2025-10-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:06:35Z [load_day 2025-10-03] 2025-10-03 hour 0: 152732 events in 0 files, snapshot none (task 5874 ms: download 3564 ms overlapping gunzip 834 ms, parse 3357 ms, sort 0 ms, write 0 ms, index 760 ms: 6 candidates, 78192 repo-hours, 1034 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:06:35Z [load_day 2025-10-03] 2025-10-03 hour 1: 160381 events in 0 files, snapshot none (task 5917 ms: download 3372 ms overlapping gunzip 818 ms, parse 3310 ms, sort 0 ms, write 0 ms, index 804 ms: 6 candidates, 90297 repo-hours, 731 releases; waiting 597 ms; commit 0 ms)
2026-11-08T14:06:42Z [load_day 2025-10-03] 2025-10-03 hour 2: 146444 events in 0 files, snapshot none (task 6295 ms: download 3746 ms overlapping gunzip 998 ms, parse 3901 ms, sort 0 ms, write 0 ms, index 520 ms: 6 candidates, 70682 repo-hours, 659 releases; waiting 530 ms; commit 0 ms)
2026-11-08T14:06:42Z [load_day 2025-10-03] 2025-10-03 hour 3: 155468 events in 0 files, snapshot none (task 6435 ms: download 3589 ms overlapping gunzip 948 ms, parse 3800 ms, sort 0 ms, write 0 ms, index 557 ms: 4 candidates, 67442 repo-hours, 1887 releases; waiting 507 ms; commit 0 ms)
2026-11-08T14:06:50Z [load_day 2025-10-03] 2025-10-03 hour 4: 152274 events in 0 files, snapshot none (task 6678 ms: download 3985 ms overlapping gunzip 1034 ms, parse 4084 ms, sort 0 ms, write 0 ms, index 606 ms: 4 candidates, 64219 repo-hours, 584 releases; waiting 625 ms; commit 0 ms)
2026-11-08T14:06:50Z [load_day 2025-10-03] 2025-10-03 hour 5: 150397 events in 0 files, snapshot none (task 6831 ms: download 4323 ms overlapping gunzip 1120 ms, parse 4315 ms, sort 0 ms, write 0 ms, index 546 ms: 5 candidates, 64342 repo-hours, 652 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:06:59Z [load_day 2025-10-03] 2025-10-03 hour 6: 158348 events in 0 files, snapshot none (task 8558 ms: download 5550 ms overlapping gunzip 1191 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 75915 repo-hours, 750 releases; waiting 1755 ms; commit 0 ms)
2026-11-08T14:06:59Z [load_day 2025-10-03] 2025-10-03 hour 7: 156862 events in 0 files, snapshot none (task 7360 ms: download 4301 ms overlapping gunzip 1077 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 562 ms: 5 candidates, 70486 repo-hours, 847 releases; waiting 742 ms; commit 0 ms)
2026-11-08T14:07:07Z [load_day 2025-10-03] 2025-10-03 hour 8: 158503 events in 0 files, snapshot none (task 7813 ms: download 4558 ms overlapping gunzip 1310 ms, parse 5046 ms, sort 0 ms, write 0 ms, index 738 ms: 10 candidates, 74928 repo-hours, 806 releases; waiting 357 ms; commit 0 ms)
2026-11-08T14:07:08Z [load_day 2025-10-03] 2025-10-03 hour 9: 163418 events in 0 files, snapshot none (task 8918 ms: download 6134 ms overlapping gunzip 1448 ms, parse 5993 ms, sort 0 ms, write 0 ms, index 715 ms: 12 candidates, 76524 repo-hours, 894 releases; waiting 451 ms; commit 0 ms)
2026-11-08T14:07:16Z [load_day 2025-10-03] 2025-10-03 hour 10: 165108 events in 0 files, snapshot none (task 8464 ms: download 4233 ms overlapping gunzip 1186 ms, parse 4787 ms, sort 0 ms, write 0 ms, index 1323 ms: 10 candidates, 78866 repo-hours, 794 releases; waiting 728 ms; commit 0 ms)
2026-11-08T14:07:17Z [load_day 2025-10-03] 2025-10-03 hour 11: 169605 events in 0 files, snapshot none (task 8610 ms: download 4718 ms overlapping gunzip 1336 ms, parse 5678 ms, sort 0 ms, write 0 ms, index 806 ms: 9 candidates, 76087 repo-hours, 737 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:07:25Z [load_day 2025-10-03] 2025-10-03 hour 12: 171512 events in 0 files, snapshot none (task 8780 ms: download 3731 ms overlapping gunzip 1192 ms, parse 4965 ms, sort 0 ms, write 0 ms, index 1836 ms: 9 candidates, 98135 repo-hours, 806 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:07:30Z [load_day 2025-10-03] 2025-10-03 hour 13: 164269 events in 0 files, snapshot none (task 12819 ms: download 8776 ms overlapping gunzip 1652 ms, parse 7380 ms, sort 0 ms, write 0 ms, index 825 ms: 7 candidates, 88549 repo-hours, 800 releases; waiting 2584 ms; commit 0 ms)
2026-11-08T14:07:33Z [load_day 2025-10-03] 2025-10-03 hour 14: 168348 events in 0 files, snapshot none (task 7419 ms: download 4545 ms overlapping gunzip 1156 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 978 ms: 6 candidates, 83031 repo-hours, 805 releases; waiting 335 ms; commit 0 ms)
2026-11-08T14:07:40Z [load_day 2025-10-03] 2025-10-03 hour 15: 162717 events in 0 files, snapshot none (task 8586 ms: download 5825 ms overlapping gunzip 1239 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 589 ms: 17 candidates, 80687 repo-hours, 990 releases; waiting 1438 ms; commit 0 ms)
2026-11-08T14:07:41Z [load_day 2025-10-03] 2025-10-03 hour 16: 161747 events in 0 files, snapshot none (task 6794 ms: download 4441 ms overlapping gunzip 1090 ms, parse 4394 ms, sort 0 ms, write 0 ms, index 581 ms: 11 candidates, 79281 repo-hours, 780 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:07:47Z [load_day 2025-10-03] 2025-10-03 hour 17: 161509 events in 0 files, snapshot none (task 7437 ms: download 4875 ms overlapping gunzip 1029 ms, parse 4094 ms, sort 0 ms, write 0 ms, index 631 ms: 14 candidates, 75699 repo-hours, 771 releases; waiting 1406 ms; commit 0 ms)
2026-11-08T14:07:47Z [load_day 2025-10-03] 2025-10-03 hour 18: 164048 events in 0 files, snapshot none (task 6136 ms: download 3619 ms overlapping gunzip 939 ms, parse 3775 ms, sort 0 ms, write 0 ms, index 640 ms: 17 candidates, 81991 repo-hours, 822 releases; waiting 538 ms; commit 0 ms)
2026-11-08T14:07:54Z [load_day 2025-10-03] 2025-10-03 hour 19: 161412 events in 0 files, snapshot none (task 6149 ms: download 3808 ms overlapping gunzip 905 ms, parse 3604 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 70284 repo-hours, 739 releases; waiting 746 ms; commit 0 ms)
2026-11-08T14:07:54Z [load_day 2025-10-03] 2025-10-03 hour 20: 158019 events in 0 files, snapshot none (task 5961 ms: download 4021 ms overlapping gunzip 913 ms, parse 3605 ms, sort 0 ms, write 0 ms, index 606 ms: 9 candidates, 70579 repo-hours, 752 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:08:04Z [load_day 2025-10-03] 2025-10-03 hour 21: 156489 events in 0 files, snapshot none (task 9134 ms: download 6254 ms overlapping gunzip 1125 ms, parse 4338 ms, sort 0 ms, write 0 ms, index 819 ms: 18 candidates, 69781 repo-hours, 853 releases; waiting 2537 ms; commit 0 ms)
2026-11-08T14:08:04Z [load_day 2025-10-03] 2025-10-03 hour 22: 148257 events in 0 files, snapshot none (task 5944 ms: download 3525 ms overlapping gunzip 991 ms, parse 3955 ms, sort 0 ms, write 0 ms, index 523 ms: 15 candidates, 59500 repo-hours, 937 releases; waiting 176 ms; commit 0 ms)
2026-11-08T14:08:09Z [load_day 2025-10-03] 2025-10-03 hour 23: 145027 events in 0 files, snapshot none (task 5350 ms: download 3294 ms overlapping gunzip 742 ms, parse 3183 ms, sort 0 ms, write 0 ms, index 411 ms: 11 candidates, 55680 repo-hours, 936 releases; waiting 682 ms; commit 0 ms)
2026-11-08T14:08:18Z [load_day 2025-10-03] 2025-10-03: repo_hour merged from 24 files to 1 (1801177 rows, 8404 ms)
2026-11-08T14:08:21Z [load_day 2025-10-03] 2025-10-03: index committed in 11559 ms (24 + 1 + 24 files)
2026-11-08T14:08:21Z [load_day 2025-10-03] 2025-10-03: 3812894 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:08:21Z [load_day 2025-10-03] attempt 1 succeeded