orcaLog in

Runs · run 1292

load_day 2023-07-13, attempt 1 succeeded

Host
3c2b29713ce8:119110
Started
2026-11-07T22:54:51Z
Ended
2026-11-07T22:58:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1292/load_day/2023-07-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:54:51Z [load_day 2023-07-13] attempt 1 started
2026-11-07T22:54:52Z [load_day 2023-07-13] 2023-07-13: 2 hours in flight, about 1200 MB
2026-11-07T22:55:12Z [load_day 2023-07-13] 2023-07-13 hour 0: 144228 events in 3 files, snapshot 958042810678132970 (task 16568 ms: download 8157 ms overlapping gunzip 1073 ms, parse 4869 ms, sort 113 ms, write 9182 ms, index 632 ms: 4 candidates, 70079 repo-hours, 1078 releases; waiting 387 ms; commit 1709 ms)
2026-11-07T22:55:15Z [load_day 2023-07-13] 2023-07-13 hour 1: 160102 events in 4 files, snapshot 5135960864936360761 (task 16847 ms: download 7865 ms overlapping gunzip 1056 ms, parse 4595 ms, sort 106 ms, write 9637 ms, index 647 ms: 3 candidates, 87809 repo-hours, 1141 releases; waiting 478 ms; commit 2355 ms)
2026-11-07T22:55:31Z [load_day 2023-07-13] 2023-07-13 hour 2: 145545 events in 3 files, snapshot 5999942831910125560 (task 14658 ms: download 6627 ms overlapping gunzip 865 ms, parse 3671 ms, sort 86 ms, write 8539 ms, index 604 ms: 7 candidates, 70156 repo-hours, 928 releases; waiting 529 ms; commit 5090 ms)
2026-11-07T22:55:33Z [load_day 2023-07-13] 2023-07-13 hour 3: 134516 events in 3 files, snapshot 1333161238566478184 (task 13170 ms: download 5824 ms overlapping gunzip 883 ms, parse 3804 ms, sort 85 ms, write 7085 ms, index 549 ms: 4 candidates, 59355 repo-hours, 1089 releases; waiting 471 ms; commit 2161 ms)
2026-11-07T22:55:43Z [load_day 2023-07-13] 2023-07-13 hour 4: 130414 events in 3 files, snapshot 6245294325739962547 (task 13510 ms: download 5413 ms overlapping gunzip 830 ms, parse 3764 ms, sort 133 ms, write 7946 ms, index 382 ms: 4 candidates, 55059 repo-hours, 952 releases; waiting 203 ms; commit 2129 ms)
2026-11-07T22:55:50Z [load_day 2023-07-13] 2023-07-13 hour 5: 143431 events in 3 files, snapshot 5237268840000130821 (task 15894 ms: download 6668 ms overlapping gunzip 1016 ms, parse 4679 ms, sort 180 ms, write 8813 ms, index 428 ms: 6 candidates, 62080 repo-hours, 1094 releases; waiting 472 ms; commit 2486 ms)
2026-11-07T22:56:02Z [load_day 2023-07-13] 2023-07-13 hour 6: 173402 events in 4 files, snapshot 5944690574125789891 (task 18822 ms: download 10758 ms overlapping gunzip 1122 ms, parse 4815 ms, sort 146 ms, write 11522 ms, index 624 ms: 4 candidates, 80242 repo-hours, 1169 releases; waiting 285 ms; commit 2304 ms)
2026-11-07T22:56:12Z [load_day 2023-07-13] 2023-07-13 hour 7: 178806 events in 4 files, snapshot 7134151236051265927 (task 20119 ms: download 11383 ms overlapping gunzip 1175 ms, parse 5217 ms, sort 113 ms, write 12076 ms, index 744 ms: 2 candidates, 78402 repo-hours, 1179 releases; waiting 483 ms; commit 2722 ms)
2026-11-07T22:56:25Z [load_day 2023-07-13] 2023-07-13 hour 8: 191883 events in 4 files, snapshot 8471282673852789482 (task 20843 ms: download 11776 ms overlapping gunzip 1374 ms, parse 6145 ms, sort 128 ms, write 11768 ms, index 625 ms: 4 candidates, 85759 repo-hours, 1183 releases; waiting 536 ms; commit 2811 ms)
2026-11-07T22:56:33Z [load_day 2023-07-13] 2023-07-13 hour 9: 187484 events in 4 files, snapshot 2100450589501818956 (task 20761 ms: download 11431 ms overlapping gunzip 1162 ms, parse 5306 ms, sort 135 ms, write 13027 ms, index 664 ms: 4 candidates, 84960 repo-hours, 1420 releases; waiting 190 ms; commit 2254 ms)
2026-11-07T22:56:46Z [load_day 2023-07-13] 2023-07-13 hour 10: 185876 events in 4 files, snapshot 5633356551586801939 (task 20542 ms: download 11567 ms overlapping gunzip 1321 ms, parse 5569 ms, sort 148 ms, write 12051 ms, index 671 ms: 4 candidates, 79629 repo-hours, 1257 releases; waiting 505 ms; commit 2474 ms)
2026-11-07T22:56:54Z [load_day 2023-07-13] 2023-07-13 hour 11: 177422 events in 4 files, snapshot 1788007925344225570 (task 19513 ms: download 11351 ms overlapping gunzip 1089 ms, parse 4985 ms, sort 185 ms, write 11629 ms, index 811 ms: 2 candidates, 76377 repo-hours, 1201 releases; waiting 498 ms; commit 2264 ms)
2026-11-07T22:57:07Z [load_day 2023-07-13] 2023-07-13 hour 12: 215253 events in 5 files, snapshot 7080063301875206514 (task 20927 ms: download 10571 ms overlapping gunzip 1169 ms, parse 5252 ms, sort 160 ms, write 12640 ms, index 882 ms: 5 candidates, 111678 repo-hours, 1135 releases; waiting 498 ms; commit 2168 ms)
2026-11-07T22:57:15Z [load_day 2023-07-13] 2023-07-13 hour 13: 183850 events in 4 files, snapshot 3130145632196312749 (task 20315 ms: download 11180 ms overlapping gunzip 1019 ms, parse 4897 ms, sort 104 ms, write 12888 ms, index 627 ms: 2 candidates, 94656 repo-hours, 971 releases; waiting 462 ms; commit 2237 ms)
2026-11-07T22:57:29Z [load_day 2023-07-13] 2023-07-13 hour 14: 182941 events in 4 files, snapshot 1280853654094454614 (task 20974 ms: download 12630 ms overlapping gunzip 1082 ms, parse 4862 ms, sort 128 ms, write 13472 ms, index 729 ms: 3 candidates, 90932 repo-hours, 1049 releases; waiting 386 ms; commit 2002 ms)
2026-11-07T22:57:34Z [load_day 2023-07-13] 2023-07-13 hour 15: 170595 events in 4 files, snapshot 8304952276363514888 (task 18169 ms: download 11644 ms overlapping gunzip 1088 ms, parse 4677 ms, sort 145 ms, write 10923 ms, index 564 ms: 5 candidates, 82792 repo-hours, 1052 releases; waiting 509 ms; commit 2071 ms)
2026-11-07T22:57:46Z [load_day 2023-07-13] 2023-07-13 hour 16: 163835 events in 4 files, snapshot 8466297292131404567 (task 15764 ms: download 9898 ms overlapping gunzip 952 ms, parse 4140 ms, sort 106 ms, write 9321 ms, index 492 ms: 3 candidates, 75912 repo-hours, 989 releases; waiting 489 ms; commit 1869 ms)
2026-11-07T22:57:54Z [load_day 2023-07-13] 2023-07-13 hour 17: 175510 events in 4 files, snapshot 5228033619299942808 (task 18921 ms: download 10133 ms overlapping gunzip 1275 ms, parse 5360 ms, sort 159 ms, write 10357 ms, index 1000 ms: 3 candidates, 76894 repo-hours, 952 releases; waiting 498 ms; commit 2760 ms)
2026-11-07T22:58:08Z [load_day 2023-07-13] 2023-07-13 hour 18: 176562 events in 4 files, snapshot 680176152983766684 (task 19605 ms: download 12129 ms overlapping gunzip 1009 ms, parse 4437 ms, sort 145 ms, write 12665 ms, index 674 ms: 6 candidates, 79444 repo-hours, 968 releases; waiting 364 ms; commit 3548 ms)
2026-11-07T22:58:14Z [load_day 2023-07-13] 2023-07-13 hour 19: 169429 events in 4 files, snapshot 7736205280750553093 (task 18516 ms: download 10824 ms overlapping gunzip 1176 ms, parse 5061 ms, sort 119 ms, write 10882 ms, index 508 ms: 6 candidates, 70670 repo-hours, 965 releases; waiting 481 ms; commit 2404 ms)
2026-11-07T22:58:26Z [load_day 2023-07-13] 2023-07-13 hour 20: 168668 events in 4 files, snapshot 652896595477300550 (task 18738 ms: download 11239 ms overlapping gunzip 1141 ms, parse 5087 ms, sort 126 ms, write 11186 ms, index 585 ms: 3 candidates, 71524 repo-hours, 822 releases; waiting 327 ms; commit 2418 ms)
2026-11-07T22:58:33Z [load_day 2023-07-13] 2023-07-13 hour 21: 155858 events in 4 files, snapshot 3414113463616463226 (task 18076 ms: download 7848 ms overlapping gunzip 1134 ms, parse 4937 ms, sort 130 ms, write 10341 ms, index 745 ms: 2 candidates, 62646 repo-hours, 935 releases; waiting 495 ms; commit 2462 ms)
2026-11-07T22:58:43Z [load_day 2023-07-13] 2023-07-13 hour 22: 139568 events in 3 files, snapshot 2276244653176831054 (task 15542 ms: download 6472 ms overlapping gunzip 1033 ms, parse 4462 ms, sort 125 ms, write 8478 ms, index 665 ms: 2 candidates, 55629 repo-hours, 839 releases; waiting 514 ms; commit 2005 ms)
2026-11-07T22:58:49Z [load_day 2023-07-13] 2023-07-13 hour 23: 127274 events in 3 files, snapshot 3623706261534711637 (task 13443 ms: download 6626 ms overlapping gunzip 707 ms, parse 3141 ms, sort 85 ms, write 8306 ms, index 336 ms: 3 candidates, 51241 repo-hours, 653 releases; waiting 549 ms; commit 3266 ms)
2026-11-07T22:58:56Z [load_day 2023-07-13] 2023-07-13: repo_hour merged from 24 files to 1 (1813925 rows, 7838 ms)
2026-11-07T22:58:58Z [load_day 2023-07-13] 2023-07-13: index committed in 9705 ms (24 + 1 + 24 files)
2026-11-07T22:58:58Z [load_day 2023-07-13] 2023-07-13: 3982452 events in 24 hours
2026-11-07T22:58:58Z [load_day 2023-07-13] attempt 1 succeeded