orcaLog in

Runs · run 1286

load_day 2023-07-11, attempt 1 succeeded

Host
3c2b29713ce8:110377
Started
2026-11-07T22:50:25Z
Ended
2026-11-07T22:54:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1286/load_day/2023-07-11/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:50:25Z [load_day 2023-07-11] attempt 1 started
2026-11-07T22:50:26Z [load_day 2023-07-11] 2023-07-11: 2 hours in flight, about 1200 MB
2026-11-07T22:50:50Z [load_day 2023-07-11] 2023-07-11 hour 0: 166737 events in 4 files, snapshot 1893097613144676390 (task 19950 ms: download 13119 ms overlapping gunzip 1264 ms, parse 5883 ms, sort 152 ms, write 11176 ms, index 563 ms: 5 candidates, 78899 repo-hours, 864 releases; waiting 558 ms; commit 2116 ms)
2026-11-07T22:50:52Z [load_day 2023-07-11] 2023-07-11 hour 1: 166636 events in 4 files, snapshot 8238378132292640407 (task 19514 ms: download 12690 ms overlapping gunzip 1231 ms, parse 5480 ms, sort 123 ms, write 11188 ms, index 665 ms: 3 candidates, 86900 repo-hours, 864 releases; waiting 510 ms; commit 2352 ms)
2026-11-07T22:51:08Z [load_day 2023-07-11] 2023-07-11 hour 2: 159683 events in 4 files, snapshot 5214533041907117034 (task 16558 ms: download 10605 ms overlapping gunzip 1003 ms, parse 4033 ms, sort 121 ms, write 10028 ms, index 541 ms: 6 candidates, 76231 repo-hours, 699 releases; waiting 523 ms; commit 2828 ms)
2026-11-07T22:51:11Z [load_day 2023-07-11] 2023-07-11 hour 3: 142926 events in 3 files, snapshot 2551808830853477114 (task 14618 ms: download 6901 ms overlapping gunzip 994 ms, parse 4139 ms, sort 111 ms, write 8142 ms, index 446 ms: 4 candidates, 63074 repo-hours, 823 releases; waiting 478 ms; commit 2658 ms)
2026-11-07T22:51:23Z [load_day 2023-07-11] 2023-07-11 hour 4: 132112 events in 3 files, snapshot 8294491127047524746 (task 13930 ms: download 5915 ms overlapping gunzip 860 ms, parse 3728 ms, sort 99 ms, write 8030 ms, index 407 ms: 0 candidates, 57580 repo-hours, 677 releases; waiting 514 ms; commit 2543 ms)
2026-11-07T22:51:27Z [load_day 2023-07-11] 2023-07-11 hour 5: 151938 events in 4 files, snapshot 1878262130815952667 (task 15644 ms: download 6769 ms overlapping gunzip 919 ms, parse 3932 ms, sort 98 ms, write 9711 ms, index 504 ms: 5 candidates, 66782 repo-hours, 816 releases; waiting 180 ms; commit 2278 ms)
2026-11-07T22:51:44Z [load_day 2023-07-11] 2023-07-11 hour 6: 188448 events in 4 files, snapshot 2823012304917300615 (task 19951 ms: download 11105 ms overlapping gunzip 1091 ms, parse 4689 ms, sort 149 ms, write 12565 ms, index 731 ms: 5 candidates, 96165 repo-hours, 891 releases; waiting 412 ms; commit 2291 ms)
2026-11-07T22:51:49Z [load_day 2023-07-11] 2023-07-11 hour 7: 176088 events in 4 files, snapshot 1685650576184257903 (task 20005 ms: download 11989 ms overlapping gunzip 1122 ms, parse 4877 ms, sort 149 ms, write 12399 ms, index 648 ms: 10 candidates, 78328 repo-hours, 990 releases; waiting 513 ms; commit 2537 ms)
2026-11-07T22:52:05Z [load_day 2023-07-11] 2023-07-11 hour 8: 175395 events in 4 files, snapshot 5127831002010551876 (task 19985 ms: download 11644 ms overlapping gunzip 1192 ms, parse 5044 ms, sort 143 ms, write 12171 ms, index 591 ms: 7 candidates, 80964 repo-hours, 1046 releases; waiting 501 ms; commit 2684 ms)
2026-11-07T22:52:12Z [load_day 2023-07-11] 2023-07-11 hour 9: 193859 events in 4 files, snapshot 867699488302435757 (task 22741 ms: download 13349 ms overlapping gunzip 1475 ms, parse 6388 ms, sort 204 ms, write 13015 ms, index 893 ms: 7 candidates, 88594 repo-hours, 1167 releases; waiting 504 ms; commit 2481 ms)
2026-11-07T22:52:26Z [load_day 2023-07-11] 2023-07-11 hour 10: 192036 events in 4 files, snapshot 8335386235877264133 (task 20582 ms: download 10801 ms overlapping gunzip 1309 ms, parse 5618 ms, sort 205 ms, write 11748 ms, index 761 ms: 5 candidates, 94175 repo-hours, 890 releases; waiting 487 ms; commit 2456 ms)
2026-11-07T22:52:35Z [load_day 2023-07-11] 2023-07-11 hour 11: 187089 events in 4 files, snapshot 8760764696784689483 (task 21760 ms: download 12683 ms overlapping gunzip 1133 ms, parse 4752 ms, sort 132 ms, write 14136 ms, index 795 ms: 7 candidates, 79860 repo-hours, 1133 releases; waiting 501 ms; commit 2299 ms)
2026-11-07T22:52:50Z [load_day 2023-07-11] 2023-07-11 hour 12: 218549 events in 5 files, snapshot 1558020440501957518 (task 23065 ms: download 15464 ms overlapping gunzip 1393 ms, parse 6168 ms, sort 176 ms, write 13707 ms, index 784 ms: 9 candidates, 109518 repo-hours, 1156 releases; waiting 494 ms; commit 2400 ms)
2026-11-07T22:52:58Z [load_day 2023-07-11] 2023-07-11 hour 13: 198938 events in 4 files, snapshot 8101490999150788909 (task 22261 ms: download 12332 ms overlapping gunzip 1120 ms, parse 5109 ms, sort 158 ms, write 14133 ms, index 781 ms: 7 candidates, 102057 repo-hours, 1018 releases; waiting 528 ms; commit 2385 ms)
2026-11-07T22:53:15Z [load_day 2023-07-11] 2023-07-11 hour 14: 197933 events in 4 files, snapshot 7955880463257478059 (task 24153 ms: download 13892 ms overlapping gunzip 1528 ms, parse 6617 ms, sort 138 ms, write 14330 ms, index 717 ms: 2 candidates, 90744 repo-hours, 1108 releases; waiting 491 ms; commit 2145 ms)
2026-11-07T22:53:20Z [load_day 2023-07-11] 2023-07-11 hour 15: 174418 events in 4 files, snapshot 7998926370430222829 (task 19952 ms: download 12347 ms overlapping gunzip 1234 ms, parse 5423 ms, sort 107 ms, write 11840 ms, index 660 ms: 9 candidates, 83151 repo-hours, 1104 releases; waiting 394 ms; commit 3242 ms)
2026-11-07T22:53:34Z [load_day 2023-07-11] 2023-07-11 hour 16: 184230 events in 4 files, snapshot 9050548672776141523 (task 17163 ms: download 10364 ms overlapping gunzip 1062 ms, parse 4523 ms, sort 107 ms, write 9909 ms, index 530 ms: 12 candidates, 83612 repo-hours, 1111 releases; waiting 747 ms; commit 2237 ms)
2026-11-07T22:53:37Z [load_day 2023-07-11] 2023-07-11 hour 17: 184678 events in 4 files, snapshot 6597876290685467612 (task 16948 ms: download 9916 ms overlapping gunzip 1010 ms, parse 4328 ms, sort 107 ms, write 10060 ms, index 636 ms: 3 candidates, 79736 repo-hours, 983 releases; waiting 478 ms; commit 2431 ms)
2026-11-07T22:54:03Z [load_day 2023-07-11] 2023-07-11 hour 18: 183039 events in 4 files, snapshot 6020894802457796527 (task 19596 ms: download 11787 ms overlapping gunzip 1288 ms, parse 5388 ms, sort 115 ms, write 11426 ms, index 551 ms: 6 candidates, 81444 repo-hours, 1033 releases; waiting 520 ms; commit 11357 ms)
2026-11-07T22:54:05Z [load_day 2023-07-11] 2023-07-11 hour 19: 180178 events in 4 files, snapshot 5131394127081651087 (task 19505 ms: download 12255 ms overlapping gunzip 1154 ms, parse 5445 ms, sort 166 ms, write 10934 ms, index 1041 ms: 3 candidates, 77078 repo-hours, 988 releases; waiting 471 ms; commit 1813 ms)
2026-11-07T22:54:16Z [load_day 2023-07-11] 2023-07-11 hour 20: 176837 events in 4 files, snapshot 8794135015371068738 (task 19526 ms: download 11849 ms overlapping gunzip 1087 ms, parse 4830 ms, sort 204 ms, write 11985 ms, index 579 ms: 1 candidates, 73095 repo-hours, 922 releases; waiting 492 ms; commit 3573 ms)
2026-11-07T22:54:25Z [load_day 2023-07-11] 2023-07-11 hour 21: 162290 events in 4 files, snapshot 3480036839912892835 (task 17904 ms: download 10265 ms overlapping gunzip 1132 ms, parse 5157 ms, sort 153 ms, write 10159 ms, index 480 ms: 4 candidates, 64887 repo-hours, 1122 releases; waiting 550 ms; commit 2318 ms)
2026-11-07T22:54:32Z [load_day 2023-07-11] 2023-07-11 hour 22: 142487 events in 3 files, snapshot 9167866596203086158 (task 15674 ms: download 6664 ms overlapping gunzip 967 ms, parse 4208 ms, sort 140 ms, write 9132 ms, index 381 ms: 1 candidates, 56827 repo-hours, 803 releases; waiting 236 ms; commit 2497 ms)
2026-11-07T22:54:40Z [load_day 2023-07-11] 2023-07-11 hour 23: 135702 events in 3 files, snapshot 4828553293320410561 (task 14606 ms: download 7197 ms overlapping gunzip 993 ms, parse 4196 ms, sort 91 ms, write 8140 ms, index 360 ms: 4 candidates, 55458 repo-hours, 661 releases; waiting 537 ms; commit 2012 ms)
2026-11-07T22:54:48Z [load_day 2023-07-11] 2023-07-11: repo_hour merged from 24 files to 1 (1905159 rows, 8459 ms)
2026-11-07T22:54:50Z [load_day 2023-07-11] 2023-07-11: index committed in 10522 ms (23 + 1 + 24 files)
2026-11-07T22:54:50Z [load_day 2023-07-11] 2023-07-11: 4172226 events in 24 hours
2026-11-07T22:54:50Z [load_day 2023-07-11] attempt 1 succeeded