orcaLog in

Runs · run 1295

load_day 2023-07-14, attempt 1 succeeded

Host
3c2b29713ce8:124905
Started
2026-11-07T22:57:43Z
Ended
2026-11-07T23:01:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1295/load_day/2023-07-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:57:43Z [load_day 2023-07-14] attempt 1 started
2026-11-07T22:57:44Z [load_day 2023-07-14] 2023-07-14: 2 hours in flight, about 1200 MB
2026-11-07T22:58:03Z [load_day 2023-07-14] 2023-07-14 hour 0: 138468 events in 3 files, snapshot 4389060580108046187 (task 15191 ms: download 7032 ms overlapping gunzip 934 ms, parse 4410 ms, sort 118 ms, write 8443 ms, index 466 ms: 4 candidates, 66333 repo-hours, 772 releases; waiting 513 ms; commit 2439 ms)
2026-11-07T22:58:06Z [load_day 2023-07-14] 2023-07-14 hour 1: 156411 events in 4 files, snapshot 1002833909261080905 (task 15620 ms: download 6622 ms overlapping gunzip 952 ms, parse 4456 ms, sort 127 ms, write 8713 ms, index 569 ms: 2 candidates, 83942 repo-hours, 898 releases; waiting 491 ms; commit 2246 ms)
2026-11-07T22:58:18Z [load_day 2023-07-14] 2023-07-14 hour 2: 142725 events in 3 files, snapshot 7229695941671799436 (task 13644 ms: download 5361 ms overlapping gunzip 870 ms, parse 3697 ms, sort 87 ms, write 7731 ms, index 787 ms: 5 candidates, 68351 repo-hours, 691 releases; waiting 209 ms; commit 2141 ms)
2026-11-07T22:58:20Z [load_day 2023-07-14] 2023-07-14 hour 3: 132703 events in 3 files, snapshot 3758406250137777216 (task 13090 ms: download 5785 ms overlapping gunzip 780 ms, parse 3392 ms, sort 161 ms, write 7476 ms, index 449 ms: 7 candidates, 56795 repo-hours, 889 releases; waiting 521 ms; commit 2789 ms)
2026-11-07T22:58:30Z [load_day 2023-07-14] 2023-07-14 hour 4: 123019 events in 3 files, snapshot 1024986942003284820 (task 11706 ms: download 5150 ms overlapping gunzip 668 ms, parse 2913 ms, sort 115 ms, write 6739 ms, index 468 ms: 1 candidates, 51093 repo-hours, 573 releases; waiting 515 ms; commit 2247 ms)
2026-11-07T22:58:35Z [load_day 2023-07-14] 2023-07-14 hour 5: 138847 events in 3 files, snapshot 3715092678566332637 (task 13909 ms: download 5764 ms overlapping gunzip 846 ms, parse 3353 ms, sort 90 ms, write 8303 ms, index 510 ms: 5 candidates, 59753 repo-hours, 719 releases; waiting 477 ms; commit 2797 ms)
2026-11-07T22:58:47Z [load_day 2023-07-14] 2023-07-14 hour 6: 164426 events in 4 files, snapshot 8228397321186347702 (task 16047 ms: download 9905 ms overlapping gunzip 952 ms, parse 4233 ms, sort 150 ms, write 9663 ms, index 493 ms: 4 candidates, 74455 repo-hours, 894 releases; waiting 247 ms; commit 2085 ms)
2026-11-07T22:58:52Z [load_day 2023-07-14] 2023-07-14 hour 7: 167565 events in 4 files, snapshot 5165695075545923421 (task 15846 ms: download 9910 ms overlapping gunzip 988 ms, parse 4405 ms, sort 105 ms, write 9023 ms, index 502 ms: 3 candidates, 72277 repo-hours, 850 releases; waiting 505 ms; commit 2090 ms)
2026-11-07T22:59:04Z [load_day 2023-07-14] 2023-07-14 hour 8: 178687 events in 4 files, snapshot 6926371701328451500 (task 16180 ms: download 9655 ms overlapping gunzip 1012 ms, parse 4336 ms, sort 110 ms, write 9461 ms, index 525 ms: 5 candidates, 77680 repo-hours, 1060 releases; waiting 520 ms; commit 2278 ms)
2026-11-07T22:59:11Z [load_day 2023-07-14] 2023-07-14 hour 9: 181761 events in 4 files, snapshot 8418013557339290160 (task 17862 ms: download 9282 ms overlapping gunzip 1094 ms, parse 4709 ms, sort 139 ms, write 10524 ms, index 673 ms: 7 candidates, 77955 repo-hours, 1218 releases; waiting 500 ms; commit 2456 ms)
2026-11-07T22:59:25Z [load_day 2023-07-14] 2023-07-14 hour 10: 182580 events in 4 files, snapshot 756771945037848024 (task 19948 ms: download 11893 ms overlapping gunzip 1158 ms, parse 4919 ms, sort 150 ms, write 12244 ms, index 722 ms: 1 candidates, 83089 repo-hours, 971 releases; waiting 491 ms; commit 2149 ms)
2026-11-07T22:59:30Z [load_day 2023-07-14] 2023-07-14 hour 11: 167626 events in 4 files, snapshot 8048600875640746421 (task 17945 ms: download 10229 ms overlapping gunzip 1216 ms, parse 5625 ms, sort 194 ms, write 9530 ms, index 566 ms: 2 candidates, 70656 repo-hours, 1085 releases; waiting 520 ms; commit 2362 ms)
2026-11-07T22:59:48Z [load_day 2023-07-14] 2023-07-14 hour 12: 210785 events in 5 files, snapshot 6370001756387280651 (task 20616 ms: download 10646 ms overlapping gunzip 1136 ms, parse 5096 ms, sort 193 ms, write 12837 ms, index 626 ms: 9 candidates, 101384 repo-hours, 1024 releases; waiting 502 ms; commit 3347 ms)
2026-11-07T22:59:54Z [load_day 2023-07-14] 2023-07-14 hour 13: 207257 events in 5 files, snapshot 1768301357500842987 (task 22296 ms: download 11769 ms overlapping gunzip 1204 ms, parse 5571 ms, sort 151 ms, write 13775 ms, index 796 ms: 5 candidates, 98911 repo-hours, 1216 releases; waiting 528 ms; commit 3645 ms)
2026-11-07T23:00:09Z [load_day 2023-07-14] 2023-07-14 hour 14: 193516 events in 4 files, snapshot 676446141306949367 (task 21231 ms: download 12006 ms overlapping gunzip 1206 ms, parse 5601 ms, sort 154 ms, write 12671 ms, index 786 ms: 4 candidates, 81379 repo-hours, 1223 releases; waiting 498 ms; commit 2481 ms)
2026-11-07T23:00:16Z [load_day 2023-07-14] 2023-07-14 hour 15: 187474 events in 4 files, snapshot 8337472073242078233 (task 21593 ms: download 11917 ms overlapping gunzip 1419 ms, parse 6129 ms, sort 163 ms, write 12547 ms, index 535 ms: 6 candidates, 80305 repo-hours, 1221 releases; waiting 516 ms; commit 2282 ms)
2026-11-07T23:00:31Z [load_day 2023-07-14] 2023-07-14 hour 16: 187694 events in 4 files, snapshot 5694730042275277781 (task 20203 ms: download 11780 ms overlapping gunzip 1210 ms, parse 5058 ms, sort 196 ms, write 12351 ms, index 597 ms: 7 candidates, 88430 repo-hours, 983 releases; waiting 494 ms; commit 3343 ms)
2026-11-07T23:00:37Z [load_day 2023-07-14] 2023-07-14 hour 17: 172979 events in 4 files, snapshot 3347373896731727860 (task 18852 ms: download 11925 ms overlapping gunzip 1083 ms, parse 5021 ms, sort 218 ms, write 11110 ms, index 498 ms: 5 candidates, 72512 repo-hours, 1040 releases; waiting 549 ms; commit 3800 ms)
2026-11-07T23:00:52Z [load_day 2023-07-14] 2023-07-14 hour 18: 189874 events in 4 files, snapshot 2874300247439649794 (task 19629 ms: download 10990 ms overlapping gunzip 1178 ms, parse 4848 ms, sort 209 ms, write 11795 ms, index 750 ms: 4 candidates, 87540 repo-hours, 950 releases; waiting 526 ms; commit 3321 ms)
2026-11-07T23:00:55Z [load_day 2023-07-14] 2023-07-14 hour 19: 163710 events in 4 files, snapshot 2326809085340878207 (task 18384 ms: download 11077 ms overlapping gunzip 1178 ms, parse 5126 ms, sort 134 ms, write 10401 ms, index 761 ms: 11 candidates, 66739 repo-hours, 863 releases; waiting 504 ms; commit 2495 ms)
2026-11-07T23:01:11Z [load_day 2023-07-14] 2023-07-14 hour 20: 155020 events in 4 files, snapshot 7631414655386731945 (task 16840 ms: download 7822 ms overlapping gunzip 1074 ms, parse 4669 ms, sort 103 ms, write 9712 ms, index 473 ms: 5 candidates, 65395 repo-hours, 857 releases; waiting 472 ms; commit 4164 ms)
2026-11-07T23:01:16Z [load_day 2023-07-14] 2023-07-14 hour 21: 139433 events in 3 files, snapshot 2560055720439668956 (task 14771 ms: download 7165 ms overlapping gunzip 894 ms, parse 3765 ms, sort 90 ms, write 8808 ms, index 430 ms: 2 candidates, 56226 repo-hours, 987 releases; waiting 504 ms; commit 4736 ms)
2026-11-07T23:01:24Z [load_day 2023-07-14] 2023-07-14 hour 22: 131036 events in 3 files, snapshot 5720176834717008741 (task 14013 ms: download 6492 ms overlapping gunzip 927 ms, parse 3800 ms, sort 85 ms, write 8193 ms, index 379 ms: 8 candidates, 48395 repo-hours, 780 releases; waiting 341 ms; commit 2091 ms)
2026-11-07T23:01:37Z [load_day 2023-07-14] 2023-07-14 hour 23: 120161 events in 3 files, snapshot 540328383183258053 (task 11286 ms: download 5413 ms overlapping gunzip 678 ms, parse 2865 ms, sort 73 ms, write 6717 ms, index 306 ms: 4 candidates, 49944 repo-hours, 659 releases; waiting 357 ms; commit 13150 ms)
2026-11-07T23:01:44Z [load_day 2023-07-14] 2023-07-14: repo_hour merged from 24 files to 1 (1739539 rows, 7310 ms)
2026-11-07T23:01:47Z [load_day 2023-07-14] 2023-07-14: index committed in 9627 ms (24 + 1 + 24 files)
2026-11-07T23:01:47Z [load_day 2023-07-14] 2023-07-14: 3933757 events in 24 hours
2026-11-07T23:01:47Z [load_day 2023-07-14] attempt 1 succeeded