orcaLog in

Runs · run 4093

load_day 2025-06-30, attempt 1 succeeded

Host
73ccef5e07c2:334236
Started
2026-11-08T12:43:18Z
Ended
2026-11-08T12:45:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
157.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4093/load_day/2025-06-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:43:18Z [load_day 2025-06-30] attempt 1 started
2026-11-08T12:43:20Z [load_day 2025-06-30] 2025-06-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:43:27Z [load_day 2025-06-30] 2025-06-30 hour 0: 139577 events in 0 files, snapshot none (task 6062 ms: download 3042 ms overlapping gunzip 967 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 679 ms: 10 candidates, 64594 repo-hours, 1182 releases; waiting 331 ms; commit 0 ms)
2026-11-08T12:43:27Z [load_day 2025-06-30] 2025-06-30 hour 1: 149828 events in 0 files, snapshot none (task 6019 ms: download 2850 ms overlapping gunzip 923 ms, parse 3783 ms, sort 0 ms, write 0 ms, index 885 ms: 11 candidates, 87565 repo-hours, 702 releases; waiting 180 ms; commit 0 ms)
2026-11-08T12:43:34Z [load_day 2025-06-30] 2025-06-30 hour 2: 145052 events in 0 files, snapshot none (task 7105 ms: download 4018 ms overlapping gunzip 1125 ms, parse 4267 ms, sort 0 ms, write 0 ms, index 768 ms: 8 candidates, 75355 repo-hours, 756 releases; waiting 642 ms; commit 0 ms)
2026-11-08T12:43:35Z [load_day 2025-06-30] 2025-06-30 hour 3: 143832 events in 0 files, snapshot none (task 7697 ms: download 4336 ms overlapping gunzip 1154 ms, parse 4598 ms, sort 0 ms, write 0 ms, index 851 ms: 14 candidates, 66144 repo-hours, 1185 releases; waiting 746 ms; commit 0 ms)
2026-11-08T12:43:41Z [load_day 2025-06-30] 2025-06-30 hour 4: 148901 events in 0 files, snapshot none (task 6455 ms: download 3182 ms overlapping gunzip 990 ms, parse 3913 ms, sort 0 ms, write 0 ms, index 727 ms: 26 candidates, 66856 repo-hours, 1520 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:43:43Z [load_day 2025-06-30] 2025-06-30 hour 5: 148548 events in 0 files, snapshot none (task 7339 ms: download 4705 ms overlapping gunzip 1077 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 528 ms: 9 candidates, 67335 repo-hours, 673 releases; waiting 1019 ms; commit 0 ms)
2026-11-08T12:43:48Z [load_day 2025-06-30] 2025-06-30 hour 6: 160378 events in 0 files, snapshot none (task 6569 ms: download 3622 ms overlapping gunzip 946 ms, parse 3929 ms, sort 0 ms, write 0 ms, index 742 ms: 6 candidates, 80367 repo-hours, 793 releases; waiting 728 ms; commit 0 ms)
2026-11-08T12:43:50Z [load_day 2025-06-30] 2025-06-30 hour 7: 160997 events in 0 files, snapshot none (task 7064 ms: download 4353 ms overlapping gunzip 1068 ms, parse 4325 ms, sort 0 ms, write 0 ms, index 728 ms: 8 candidates, 77566 repo-hours, 806 releases; waiting 514 ms; commit 0 ms)
2026-11-08T12:43:57Z [load_day 2025-06-30] 2025-06-30 hour 8: 158382 events in 0 files, snapshot none (task 7870 ms: download 4468 ms overlapping gunzip 1268 ms, parse 5118 ms, sort 0 ms, write 0 ms, index 753 ms: 6 candidates, 80821 repo-hours, 867 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:43:58Z [load_day 2025-06-30] 2025-06-30 hour 9: 155886 events in 0 files, snapshot none (task 7224 ms: download 4498 ms overlapping gunzip 1131 ms, parse 4655 ms, sort 0 ms, write 0 ms, index 636 ms: 3 candidates, 80601 repo-hours, 961 releases; waiting 570 ms; commit 0 ms)
2026-11-08T12:44:04Z [load_day 2025-06-30] 2025-06-30 hour 10: 156358 events in 0 files, snapshot none (task 7060 ms: download 4557 ms overlapping gunzip 1167 ms, parse 4514 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 78239 repo-hours, 763 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:44:05Z [load_day 2025-06-30] 2025-06-30 hour 11: 161368 events in 0 files, snapshot none (task 6495 ms: download 3986 ms overlapping gunzip 1140 ms, parse 4282 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 76662 repo-hours, 889 releases; waiting 206 ms; commit 0 ms)
2026-11-08T12:44:13Z [load_day 2025-06-30] 2025-06-30 hour 12: 164335 events in 0 files, snapshot none (task 8645 ms: download 5618 ms overlapping gunzip 1382 ms, parse 5930 ms, sort 0 ms, write 0 ms, index 765 ms: 6 candidates, 96977 repo-hours, 851 releases; waiting 275 ms; commit 0 ms)
2026-11-08T12:44:14Z [load_day 2025-06-30] 2025-06-30 hour 13: 165665 events in 0 files, snapshot none (task 8025 ms: download 5179 ms overlapping gunzip 1332 ms, parse 5418 ms, sort 0 ms, write 0 ms, index 664 ms: 4 candidates, 92265 repo-hours, 862 releases; waiting 218 ms; commit 0 ms)
2026-11-08T12:44:23Z [load_day 2025-06-30] 2025-06-30 hour 14: 167042 events in 0 files, snapshot none (task 8845 ms: download 5949 ms overlapping gunzip 1411 ms, parse 5648 ms, sort 0 ms, write 0 ms, index 956 ms: 8 candidates, 84310 repo-hours, 881 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:44:23Z [load_day 2025-06-30] 2025-06-30 hour 15: 163233 events in 0 files, snapshot none (task 8325 ms: download 5137 ms overlapping gunzip 1358 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 1323 ms: 5 candidates, 83335 repo-hours, 972 releases; waiting 200 ms; commit 0 ms)
2026-11-08T12:44:32Z [load_day 2025-06-30] 2025-06-30 hour 16: 165125 events in 0 files, snapshot none (task 8236 ms: download 5221 ms overlapping gunzip 1250 ms, parse 5391 ms, sort 0 ms, write 0 ms, index 753 ms: 10 candidates, 82562 repo-hours, 810 releases; waiting 509 ms; commit 0 ms)
2026-11-08T12:44:32Z [load_day 2025-06-30] 2025-06-30 hour 17: 159269 events in 0 files, snapshot none (task 7445 ms: download 4394 ms overlapping gunzip 1174 ms, parse 4696 ms, sort 0 ms, write 0 ms, index 753 ms: 10 candidates, 76427 repo-hours, 829 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:44:40Z [load_day 2025-06-30] 2025-06-30 hour 18: 158607 events in 0 files, snapshot none (task 8060 ms: download 5112 ms overlapping gunzip 1331 ms, parse 5346 ms, sort 0 ms, write 0 ms, index 631 ms: 3 candidates, 81703 repo-hours, 923 releases; waiting 459 ms; commit 0 ms)
2026-11-08T12:44:40Z [load_day 2025-06-30] 2025-06-30 hour 19: 156115 events in 0 files, snapshot none (task 7698 ms: download 4858 ms overlapping gunzip 1292 ms, parse 5365 ms, sort 0 ms, write 0 ms, index 596 ms: 10 candidates, 72102 repo-hours, 822 releases; waiting 236 ms; commit 0 ms)
2026-11-08T12:44:48Z [load_day 2025-06-30] 2025-06-30 hour 20: 151437 events in 0 files, snapshot none (task 7606 ms: download 5123 ms overlapping gunzip 1195 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 594 ms: 9 candidates, 72411 repo-hours, 860 releases; waiting 541 ms; commit 0 ms)
2026-11-08T12:44:48Z [load_day 2025-06-30] 2025-06-30 hour 21: 148368 events in 0 files, snapshot none (task 7392 ms: download 4766 ms overlapping gunzip 1242 ms, parse 4786 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 66289 repo-hours, 949 releases; waiting 596 ms; commit 0 ms)
2026-11-08T12:44:56Z [load_day 2025-06-30] 2025-06-30 hour 22: 143898 events in 0 files, snapshot none (task 7149 ms: download 4821 ms overlapping gunzip 1119 ms, parse 4736 ms, sort 0 ms, write 0 ms, index 492 ms: 6 candidates, 62296 repo-hours, 862 releases; waiting 518 ms; commit 0 ms)
2026-11-08T12:44:56Z [load_day 2025-06-30] 2025-06-30 hour 23: 144555 events in 0 files, snapshot none (task 7292 ms: download 4985 ms overlapping gunzip 1318 ms, parse 4893 ms, sort 0 ms, write 0 ms, index 475 ms: 6 candidates, 60455 repo-hours, 938 releases; waiting 374 ms; commit 0 ms)
2026-11-08T12:45:05Z [load_day 2025-06-30] 2025-06-30: repo_hour merged from 24 files to 1 (1833237 rows, 8794 ms)
2026-11-08T12:45:08Z [load_day 2025-06-30] 2025-06-30: index committed in 11977 ms (24 + 1 + 24 files)
2026-11-08T12:45:08Z [load_day 2025-06-30] 2025-06-30: 3716756 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:45:08Z [load_day 2025-06-30] attempt 1 succeeded