orcaLog in

Runs · run 1179

load_day 2023-06-14, attempt 1 succeeded

Host
3c2b29713ce8:7773
Started
2026-11-07T21:29:17Z
Ended
2026-11-07T21:31:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1179/load_day/2023-06-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:29:17Z [load_day 2023-06-14] attempt 1 started
2026-11-07T21:29:18Z [load_day 2023-06-14] 2023-06-14: 4 hours in flight, about 2100 MB
2026-11-07T21:29:35Z [load_day 2023-06-14] 2023-06-14 hour 0: 149227 events in 3 files, snapshot 2049061271685412605 (task 13981 ms: download 6189 ms overlapping gunzip 772 ms, parse 3641 ms, sort 127 ms, write 8107 ms, index 500 ms: 8 candidates, 75602 repo-hours, 841 releases; waiting 515 ms; commit 1717 ms)
2026-11-07T21:29:37Z [load_day 2023-06-14] 2023-06-14 hour 1: 161298 events in 4 files, snapshot 6767799252321346506 (task 15082 ms: download 6718 ms overlapping gunzip 975 ms, parse 4565 ms, sort 126 ms, write 8385 ms, index 558 ms: 7 candidates, 88654 repo-hours, 889 releases; waiting 183 ms; commit 1650 ms)
2026-11-07T21:29:39Z [load_day 2023-06-14] 2023-06-14 hour 2: 156146 events in 4 files, snapshot 4675505622565157740 (task 13772 ms: download 5783 ms overlapping gunzip 788 ms, parse 3510 ms, sort 126 ms, write 8277 ms, index 487 ms: 13 candidates, 78174 repo-hours, 746 releases; waiting 276 ms; commit 1741 ms)
2026-11-07T21:29:41Z [load_day 2023-06-14] 2023-06-14 hour 3: 136066 events in 3 files, snapshot 455359894662838254 (task 12717 ms: download 5803 ms overlapping gunzip 745 ms, parse 3310 ms, sort 76 ms, write 7395 ms, index 387 ms: 5 candidates, 60527 repo-hours, 796 releases; waiting 495 ms; commit 2008 ms)
2026-11-07T21:29:48Z [load_day 2023-06-14] 2023-06-14 hour 4: 131633 events in 3 files, snapshot 4990115423994897896 (task 11298 ms: download 4278 ms overlapping gunzip 590 ms, parse 2538 ms, sort 74 ms, write 7210 ms, index 366 ms: 11 candidates, 56090 repo-hours, 646 releases; waiting 202 ms; commit 2108 ms)
2026-11-07T21:29:51Z [load_day 2023-06-14] 2023-06-14 hour 5: 144063 events in 3 files, snapshot 8571852807164479654 (task 13405 ms: download 5482 ms overlapping gunzip 732 ms, parse 3249 ms, sort 93 ms, write 8175 ms, index 479 ms: 4 candidates, 62752 repo-hours, 769 releases; waiting 382 ms; commit 1969 ms)
2026-11-07T21:29:57Z [load_day 2023-06-14] 2023-06-14 hour 6: 172380 events in 4 files, snapshot 6433200219543269505 (task 16700 ms: download 9450 ms overlapping gunzip 841 ms, parse 3980 ms, sort 133 ms, write 10303 ms, index 581 ms: 8 candidates, 82581 repo-hours, 968 releases; waiting 487 ms; commit 1817 ms)
2026-11-07T21:29:59Z [load_day 2023-06-14] 2023-06-14 hour 7: 164180 events in 4 files, snapshot 3233128826967522837 (task 17253 ms: download 6736 ms overlapping gunzip 878 ms, parse 4100 ms, sort 109 ms, write 10862 ms, index 516 ms: 11 candidates, 76499 repo-hours, 880 releases; waiting 490 ms; commit 2248 ms)
2026-11-07T21:30:07Z [load_day 2023-06-14] 2023-06-14 hour 8: 176951 events in 4 files, snapshot 6234836568133931869 (task 18758 ms: download 10687 ms overlapping gunzip 981 ms, parse 4205 ms, sort 107 ms, write 11928 ms, index 710 ms: 9 candidates, 85776 repo-hours, 977 releases; waiting 470 ms; commit 2148 ms)
2026-11-07T21:30:15Z [load_day 2023-06-14] 2023-06-14 hour 9: 192681 events in 4 files, snapshot 102181997414379461 (task 22850 ms: download 13215 ms overlapping gunzip 1231 ms, parse 5816 ms, sort 184 ms, write 13761 ms, index 691 ms: 10 candidates, 87288 repo-hours, 1136 releases; waiting 886 ms; commit 1824 ms)
2026-11-07T21:30:17Z [load_day 2023-06-14] 2023-06-14 hour 10: 181337 events in 4 files, snapshot 3081476542089617125 (task 18935 ms: download 10943 ms overlapping gunzip 910 ms, parse 4147 ms, sort 109 ms, write 12331 ms, index 627 ms: 8 candidates, 82265 repo-hours, 1024 releases; waiting 527 ms; commit 1958 ms)
2026-11-07T21:30:20Z [load_day 2023-06-14] 2023-06-14 hour 11: 181608 events in 4 files, snapshot 2112855404885751653 (task 19472 ms: download 10707 ms overlapping gunzip 1006 ms, parse 4614 ms, sort 133 ms, write 12357 ms, index 861 ms: 9 candidates, 80958 repo-hours, 1019 releases; waiting 194 ms; commit 2520 ms)
2026-11-07T21:30:32Z [load_day 2023-06-14] 2023-06-14 hour 12: 222771 events in 5 files, snapshot 1510755321407454666 (task 22914 ms: download 11095 ms overlapping gunzip 1140 ms, parse 4893 ms, sort 155 ms, write 15263 ms, index 970 ms: 13 candidates, 112559 repo-hours, 1083 releases; waiting 226 ms; commit 2292 ms)
2026-11-07T21:30:38Z [load_day 2023-06-14] 2023-06-14 hour 13: 205122 events in 5 files, snapshot 1039311337492230462 (task 21879 ms: download 11661 ms overlapping gunzip 1186 ms, parse 5277 ms, sort 154 ms, write 13908 ms, index 692 ms: 10 candidates, 105100 repo-hours, 1154 releases; waiting 339 ms; commit 1927 ms)
2026-11-07T21:30:40Z [load_day 2023-06-14] 2023-06-14 hour 14: 198697 events in 4 files, snapshot 3753426916404072212 (task 21801 ms: download 12561 ms overlapping gunzip 1119 ms, parse 5150 ms, sort 124 ms, write 14171 ms, index 634 ms: 12 candidates, 95523 repo-hours, 1138 releases; waiting 370 ms; commit 1918 ms)
2026-11-07T21:30:42Z [load_day 2023-06-14] 2023-06-14 hour 15: 180807 events in 4 files, snapshot 7574600706960414659 (task 19673 ms: download 11116 ms overlapping gunzip 1008 ms, parse 4448 ms, sort 98 ms, write 12713 ms, index 911 ms: 10 candidates, 88102 repo-hours, 1094 releases; waiting 179 ms; commit 2318 ms)
2026-11-07T21:30:53Z [load_day 2023-06-14] 2023-06-14 hour 16: 183258 events in 4 files, snapshot 334418564111577150 (task 21311 ms: download 12264 ms overlapping gunzip 1089 ms, parse 4772 ms, sort 123 ms, write 13794 ms, index 798 ms: 7 candidates, 85369 repo-hours, 882 releases; waiting 458 ms; commit 2069 ms)
2026-11-07T21:30:59Z [load_day 2023-06-14] 2023-06-14 hour 17: 182972 events in 4 files, snapshot 6755847127691266645 (task 19677 ms: download 11639 ms overlapping gunzip 994 ms, parse 4682 ms, sort 129 ms, write 12464 ms, index 577 ms: 4 candidates, 81083 repo-hours, 983 releases; waiting 530 ms; commit 2106 ms)
2026-11-07T21:31:01Z [load_day 2023-06-14] 2023-06-14 hour 18: 190042 events in 4 files, snapshot 2721257844077391569 (task 18924 ms: download 10697 ms overlapping gunzip 1076 ms, parse 4844 ms, sort 121 ms, write 11656 ms, index 536 ms: 6 candidates, 85368 repo-hours, 1059 releases; waiting 414 ms; commit 2135 ms)
2026-11-07T21:31:03Z [load_day 2023-06-14] 2023-06-14 hour 19: 175022 events in 4 files, snapshot 5817456944252163188 (task 19455 ms: download 11226 ms overlapping gunzip 936 ms, parse 4506 ms, sort 100 ms, write 12106 ms, index 615 ms: 6 candidates, 75127 repo-hours, 973 releases; waiting 824 ms; commit 1787 ms)
2026-11-07T21:31:13Z [load_day 2023-06-14] 2023-06-14 hour 20: 169902 events in 4 files, snapshot 1854396995397905361 (task 18424 ms: download 10758 ms overlapping gunzip 994 ms, parse 4501 ms, sort 119 ms, write 11474 ms, index 501 ms: 10 candidates, 74682 repo-hours, 946 releases; waiting 518 ms; commit 1849 ms)
2026-11-07T21:31:16Z [load_day 2023-06-14] 2023-06-14 hour 21: 154038 events in 4 files, snapshot 4066144614617196500 (task 16836 ms: download 7313 ms overlapping gunzip 945 ms, parse 4304 ms, sort 107 ms, write 10202 ms, index 466 ms: 4 candidates, 64579 repo-hours, 997 releases; waiting 510 ms; commit 1716 ms)
2026-11-07T21:31:20Z [load_day 2023-06-14] 2023-06-14 hour 22: 151709 events in 4 files, snapshot 882036227824848904 (task 18450 ms: download 8999 ms overlapping gunzip 973 ms, parse 4137 ms, sort 101 ms, write 10770 ms, index 401 ms: 8 candidates, 63226 repo-hours, 806 releases; waiting 1802 ms; commit 1703 ms)
2026-11-07T21:31:22Z [load_day 2023-06-14] 2023-06-14 hour 23: 130065 events in 3 files, snapshot 6546675179567808716 (task 12865 ms: download 5663 ms overlapping gunzip 696 ms, parse 3271 ms, sort 88 ms, write 7605 ms, index 365 ms: 6 candidates, 54437 repo-hours, 648 releases; waiting 528 ms; commit 1645 ms)
2026-11-07T21:31:29Z [load_day 2023-06-14] 2023-06-14: repo_hour merged from 24 files to 1 (1902321 rows, 7818 ms)
2026-11-07T21:31:32Z [load_day 2023-06-14] 2023-06-14: index committed in 9999 ms (24 + 1 + 24 files)
2026-11-07T21:31:32Z [load_day 2023-06-14] 2023-06-14: 4091975 events in 24 hours
2026-11-07T21:31:32Z [load_day 2023-06-14] attempt 1 succeeded