orcaLog in

Runs · run 1289

load_day 2023-07-12, attempt 1 succeeded

Host
3c2b29713ce8:116705
Started
2026-11-07T22:53:32Z
Ended
2026-11-07T22:57:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1289/load_day/2023-07-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:53:32Z [load_day 2023-07-12] attempt 1 started
2026-11-07T22:53:34Z [load_day 2023-07-12] 2023-07-12: 2 hours in flight, about 1200 MB
2026-11-07T22:53:54Z [load_day 2023-07-12] 2023-07-12 hour 0: 146535 events in 3 files, snapshot 4425418001252347051 (task 16572 ms: download 8414 ms overlapping gunzip 1057 ms, parse 4774 ms, sort 113 ms, write 9301 ms, index 463 ms: 8 candidates, 70247 repo-hours, 906 releases; waiting 557 ms; commit 1988 ms)
2026-11-07T22:54:02Z [load_day 2023-07-12] 2023-07-12 hour 1: 160240 events in 4 files, snapshot 6851368136120729576 (task 16675 ms: download 7630 ms overlapping gunzip 919 ms, parse 4131 ms, sort 148 ms, write 10108 ms, index 582 ms: 5 candidates, 87388 repo-hours, 898 releases; waiting 476 ms; commit 8142 ms)
2026-11-07T22:54:11Z [load_day 2023-07-12] 2023-07-12 hour 2: 147120 events in 3 files, snapshot 4363979794887305579 (task 16086 ms: download 7365 ms overlapping gunzip 888 ms, parse 3770 ms, sort 127 ms, write 9961 ms, index 505 ms: 7 candidates, 71891 repo-hours, 684 releases; waiting 489 ms; commit 2057 ms)
2026-11-07T22:54:13Z [load_day 2023-07-12] 2023-07-12 hour 3: 133520 events in 3 files, snapshot 6352578270559763818 (task 14203 ms: download 6721 ms overlapping gunzip 925 ms, parse 4147 ms, sort 124 ms, write 8081 ms, index 410 ms: 3 candidates, 60542 repo-hours, 897 releases; waiting 196 ms; commit 2231 ms)
2026-11-07T22:54:27Z [load_day 2023-07-12] 2023-07-12 hour 4: 126234 events in 3 files, snapshot 4523157058582000217 (task 12649 ms: download 5585 ms overlapping gunzip 839 ms, parse 3516 ms, sort 76 ms, write 6956 ms, index 456 ms: 3 candidates, 55119 repo-hours, 580 releases; waiting 518 ms; commit 4054 ms)
2026-11-07T22:54:29Z [load_day 2023-07-12] 2023-07-12 hour 5: 153368 events in 4 files, snapshot 8624679902813963861 (task 14945 ms: download 6316 ms overlapping gunzip 767 ms, parse 3599 ms, sort 144 ms, write 8917 ms, index 604 ms: 3 candidates, 74923 repo-hours, 750 releases; waiting 595 ms; commit 2069 ms)
2026-11-07T22:54:41Z [load_day 2023-07-12] 2023-07-12 hour 6: 166974 events in 4 files, snapshot 9074703290026839136 (task 15779 ms: download 9912 ms overlapping gunzip 1023 ms, parse 4268 ms, sort 92 ms, write 9093 ms, index 520 ms: 3 candidates, 79204 repo-hours, 966 releases; waiting 483 ms; commit 2104 ms)
2026-11-07T22:54:47Z [load_day 2023-07-12] 2023-07-12 hour 7: 172047 events in 4 files, snapshot 4967538353736703189 (task 16085 ms: download 9646 ms overlapping gunzip 957 ms, parse 4140 ms, sort 128 ms, write 9400 ms, index 568 ms: 9 candidates, 75868 repo-hours, 996 releases; waiting 583 ms; commit 2213 ms)
2026-11-07T22:55:00Z [load_day 2023-07-12] 2023-07-12 hour 8: 172907 events in 4 files, snapshot 6136104710333199930 (task 17424 ms: download 9484 ms overlapping gunzip 985 ms, parse 4166 ms, sort 130 ms, write 10670 ms, index 847 ms: 4 candidates, 80148 repo-hours, 1068 releases; waiting 366 ms; commit 2550 ms)
2026-11-07T22:55:08Z [load_day 2023-07-12] 2023-07-12 hour 9: 188673 events in 4 files, snapshot 7551744095594781306 (task 20488 ms: download 10229 ms overlapping gunzip 1254 ms, parse 5506 ms, sort 134 ms, write 12056 ms, index 715 ms: 4 candidates, 84246 repo-hours, 1355 releases; waiting 502 ms; commit 2320 ms)
2026-11-07T22:55:20Z [load_day 2023-07-12] 2023-07-12 hour 10: 183427 events in 4 files, snapshot 3445112212110962257 (task 19362 ms: download 11078 ms overlapping gunzip 1052 ms, parse 4508 ms, sort 192 ms, write 11824 ms, index 835 ms: 7 candidates, 85006 repo-hours, 1028 releases; waiting 615 ms; commit 2114 ms)
2026-11-07T22:55:28Z [load_day 2023-07-12] 2023-07-12 hour 11: 180565 events in 4 files, snapshot 5061975547251418548 (task 18940 ms: download 10919 ms overlapping gunzip 1087 ms, parse 4834 ms, sort 105 ms, write 11440 ms, index 571 ms: 5 candidates, 77587 repo-hours, 1036 releases; waiting 544 ms; commit 2350 ms)
2026-11-07T22:55:45Z [load_day 2023-07-12] 2023-07-12 hour 12: 228104 events in 5 files, snapshot 4770635521568050384 (task 21242 ms: download 12735 ms overlapping gunzip 1209 ms, parse 5364 ms, sort 157 ms, write 12889 ms, index 808 ms: 5 candidates, 118789 repo-hours, 1164 releases; waiting 527 ms; commit 4569 ms)
2026-11-07T22:55:53Z [load_day 2023-07-12] 2023-07-12 hour 13: 211570 events in 5 files, snapshot 3075204515898183581 (task 24161 ms: download 15092 ms overlapping gunzip 1331 ms, parse 6016 ms, sort 185 ms, write 14746 ms, index 1082 ms: 3 candidates, 105916 repo-hours, 1398 releases; waiting 519 ms; commit 2415 ms)
2026-11-07T22:56:07Z [load_day 2023-07-12] 2023-07-12 hour 14: 208484 events in 5 files, snapshot 8047785180864612834 (task 23058 ms: download 12825 ms overlapping gunzip 1251 ms, parse 5643 ms, sort 180 ms, write 14339 ms, index 873 ms: 6 candidates, 107338 repo-hours, 1309 releases; waiting 506 ms; commit 2286 ms)
2026-11-07T22:56:15Z [load_day 2023-07-12] 2023-07-12 hour 15: 179494 events in 4 files, snapshot 1440294209090197693 (task 21095 ms: download 12273 ms overlapping gunzip 1218 ms, parse 5394 ms, sort 110 ms, write 12846 ms, index 715 ms: 3 candidates, 85220 repo-hours, 1316 releases; waiting 512 ms; commit 2299 ms)
2026-11-07T22:56:27Z [load_day 2023-07-12] 2023-07-12 hour 16: 176873 events in 4 files, snapshot 5429923570869391380 (task 19362 ms: download 11456 ms overlapping gunzip 1267 ms, parse 5497 ms, sort 111 ms, write 11346 ms, index 631 ms: 4 candidates, 79714 repo-hours, 1258 releases; waiting 221 ms; commit 2560 ms)
2026-11-07T22:56:37Z [load_day 2023-07-12] 2023-07-12 hour 17: 182398 events in 4 files, snapshot 1585564742010813511 (task 21108 ms: download 11984 ms overlapping gunzip 1141 ms, parse 4894 ms, sort 107 ms, write 12718 ms, index 1015 ms: 3 candidates, 79024 repo-hours, 1194 releases; waiting 900 ms; commit 2426 ms)
2026-11-07T22:56:49Z [load_day 2023-07-12] 2023-07-12 hour 18: 188796 events in 4 files, snapshot 4743048304256423018 (task 21374 ms: download 12365 ms overlapping gunzip 1313 ms, parse 5502 ms, sort 123 ms, write 12976 ms, index 813 ms: 6 candidates, 83257 repo-hours, 1213 releases; waiting 385 ms; commit 2131 ms)
2026-11-07T22:56:58Z [load_day 2023-07-12] 2023-07-12 hour 19: 177149 events in 4 files, snapshot 4235413457877716709 (task 19550 ms: download 11653 ms overlapping gunzip 1112 ms, parse 4888 ms, sort 115 ms, write 11850 ms, index 794 ms: 5 candidates, 76676 repo-hours, 1110 releases; waiting 477 ms; commit 2784 ms)
2026-11-07T22:57:10Z [load_day 2023-07-12] 2023-07-12 hour 20: 174018 events in 4 files, snapshot 4469346275360857417 (task 18819 ms: download 11539 ms overlapping gunzip 1224 ms, parse 5381 ms, sort 137 ms, write 10749 ms, index 516 ms: 3 candidates, 73391 repo-hours, 1205 releases; waiting 500 ms; commit 2456 ms)
2026-11-07T22:57:17Z [load_day 2023-07-12] 2023-07-12 hour 21: 154832 events in 4 files, snapshot 7507270656640841322 (task 17039 ms: download 10017 ms overlapping gunzip 1022 ms, parse 4325 ms, sort 110 ms, write 10583 ms, index 514 ms: 5 candidates, 63044 repo-hours, 1187 releases; waiting 188 ms; commit 3600 ms)
2026-11-07T22:57:27Z [load_day 2023-07-12] 2023-07-12 hour 22: 138899 events in 3 files, snapshot 2953554697869608166 (task 16535 ms: download 6890 ms overlapping gunzip 1183 ms, parse 4959 ms, sort 149 ms, write 9163 ms, index 390 ms: 3 candidates, 57693 repo-hours, 1015 releases; waiting 329 ms; commit 1959 ms)
2026-11-07T22:57:31Z [load_day 2023-07-12] 2023-07-12 hour 23: 130587 events in 3 files, snapshot 6704569463843692744 (task 13852 ms: download 6793 ms overlapping gunzip 985 ms, parse 4232 ms, sort 128 ms, write 7320 ms, index 353 ms: 1 candidates, 55816 repo-hours, 924 releases; waiting 494 ms; commit 2571 ms)
2026-11-07T22:57:39Z [load_day 2023-07-12] 2023-07-12: repo_hour merged from 24 files to 1 (1888047 rows, 8262 ms)
2026-11-07T22:57:42Z [load_day 2023-07-12] 2023-07-12: index committed in 10769 ms (24 + 1 + 24 files)
2026-11-07T22:57:42Z [load_day 2023-07-12] 2023-07-12: 4082814 events in 24 hours
2026-11-07T22:57:42Z [load_day 2023-07-12] attempt 1 succeeded