orcaLog in

Runs · run 801

load_day 2023-02-08, attempt 1 succeeded

Host
caf251265124:31780
Started
2026-11-07T15:14:13Z
Ended
2026-11-07T15:17:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/801/load_day/2023-02-08/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:14:13Z [load_day 2023-02-08] attempt 1 started
2026-11-07T15:14:14Z [load_day 2023-02-08] 2023-02-08: 2 hours in flight, about 1200 MB
2026-11-07T15:14:31Z [load_day 2023-02-08] 2023-02-08 hour 0: 172049 events in 4 files, snapshot 2191054516541885844 (task 14811 ms: download 9105 ms overlapping gunzip 960 ms, parse 4082 ms, sort 113 ms, write 8179 ms, index 510 ms: 5 candidates, 78855 repo-hours, 917 releases; waiting 675 ms; commit 1331 ms)
2026-11-07T15:14:32Z [load_day 2023-02-08] 2023-02-08 hour 1: 163042 events in 4 files, snapshot 998464959844284083 (task 12520 ms: download 5369 ms overlapping gunzip 767 ms, parse 3319 ms, sort 89 ms, write 6959 ms, index 567 ms: 2 candidates, 81694 repo-hours, 852 releases; waiting 497 ms; commit 1438 ms)
2026-11-07T15:14:44Z [load_day 2023-02-08] 2023-02-08 hour 2: 147181 events in 3 files, snapshot 8064986684453313479 (task 11979 ms: download 5546 ms overlapping gunzip 782 ms, parse 3223 ms, sort 97 ms, write 6510 ms, index 457 ms: 5 candidates, 71850 repo-hours, 649 releases; waiting 509 ms; commit 1319 ms)
2026-11-07T15:14:45Z [load_day 2023-02-08] 2023-02-08 hour 3: 142322 events in 3 files, snapshot 2149275157837748687 (task 11527 ms: download 5382 ms overlapping gunzip 724 ms, parse 3039 ms, sort 74 ms, write 6349 ms, index 382 ms: 2 candidates, 61713 repo-hours, 899 releases; waiting 674 ms; commit 1247 ms)
2026-11-07T15:14:57Z [load_day 2023-02-08] 2023-02-08 hour 4: 142759 events in 3 files, snapshot 5893978941379208822 (task 12184 ms: download 6063 ms overlapping gunzip 824 ms, parse 3333 ms, sort 81 ms, write 6531 ms, index 386 ms: 2 candidates, 58702 repo-hours, 615 releases; waiting 718 ms; commit 1296 ms)
2026-11-07T15:14:58Z [load_day 2023-02-08] 2023-02-08 hour 5: 143680 events in 3 files, snapshot 4466991547586368696 (task 11039 ms: download 4950 ms overlapping gunzip 749 ms, parse 3050 ms, sort 105 ms, write 6078 ms, index 396 ms: 9 candidates, 61497 repo-hours, 730 releases; waiting 384 ms; commit 1405 ms)
2026-11-07T15:15:10Z [load_day 2023-02-08] 2023-02-08 hour 6: 160267 events in 4 files, snapshot 5322578108212140612 (task 12523 ms: download 5316 ms overlapping gunzip 755 ms, parse 3194 ms, sort 97 ms, write 7122 ms, index 508 ms: 3 candidates, 71905 repo-hours, 890 releases; waiting 531 ms; commit 1214 ms)
2026-11-07T15:15:12Z [load_day 2023-02-08] 2023-02-08 hour 7: 167023 events in 4 files, snapshot 7319392688655477496 (task 13394 ms: download 5799 ms overlapping gunzip 820 ms, parse 3458 ms, sort 102 ms, write 7711 ms, index 480 ms: 5 candidates, 72367 repo-hours, 833 releases; waiting 503 ms; commit 1237 ms)
2026-11-07T15:15:27Z [load_day 2023-02-08] 2023-02-08 hour 8: 184209 events in 4 files, snapshot 8423558955314572885 (task 15782 ms: download 9153 ms overlapping gunzip 963 ms, parse 4085 ms, sort 120 ms, write 9337 ms, index 533 ms: 10 candidates, 83466 repo-hours, 948 releases; waiting 389 ms; commit 1260 ms)
2026-11-07T15:15:30Z [load_day 2023-02-08] 2023-02-08 hour 9: 195091 events in 4 files, snapshot 7004805941225224378 (task 16962 ms: download 9976 ms overlapping gunzip 1067 ms, parse 4510 ms, sort 135 ms, write 9515 ms, index 574 ms: 4 candidates, 85345 repo-hours, 1321 releases; waiting 814 ms; commit 1377 ms)
2026-11-07T15:15:44Z [load_day 2023-02-08] 2023-02-08 hour 10: 198707 events in 4 files, snapshot 4052759791042597238 (task 16897 ms: download 9843 ms overlapping gunzip 1031 ms, parse 4466 ms, sort 129 ms, write 9785 ms, index 634 ms: 1 candidates, 89062 repo-hours, 1117 releases; waiting 539 ms; commit 1387 ms)
2026-11-07T15:15:46Z [load_day 2023-02-08] 2023-02-08 hour 11: 188164 events in 4 files, snapshot 3521897650998349790 (task 15677 ms: download 9195 ms overlapping gunzip 977 ms, parse 4169 ms, sort 112 ms, write 9129 ms, index 527 ms: 5 candidates, 79612 repo-hours, 1048 releases; waiting 524 ms; commit 1221 ms)
2026-11-07T15:16:03Z [load_day 2023-02-08] 2023-02-08 hour 12: 223700 events in 5 files, snapshot 5452972946336971068 (task 17647 ms: download 11897 ms overlapping gunzip 1025 ms, parse 4528 ms, sort 134 ms, write 9981 ms, index 672 ms: 6 candidates, 107963 repo-hours, 1036 releases; waiting 970 ms; commit 1680 ms)
2026-11-07T15:16:05Z [load_day 2023-02-08] 2023-02-08 hour 13: 224944 events in 5 files, snapshot 3944986960986962119 (task 17398 ms: download 11276 ms overlapping gunzip 1068 ms, parse 4625 ms, sort 146 ms, write 10125 ms, index 796 ms: 4 candidates, 110603 repo-hours, 978 releases; waiting 382 ms; commit 1405 ms)
2026-11-07T15:16:21Z [load_day 2023-02-08] 2023-02-08 hour 14: 218046 events in 5 files, snapshot 214355791132234429 (task 17161 ms: download 11462 ms overlapping gunzip 1062 ms, parse 4570 ms, sort 145 ms, write 10348 ms, index 615 ms: 6 candidates, 99099 repo-hours, 1072 releases; waiting 197 ms; commit 1417 ms)
2026-11-07T15:16:24Z [load_day 2023-02-08] 2023-02-08 hour 15: 218973 events in 5 files, snapshot 841066020941264372 (task 18581 ms: download 12753 ms overlapping gunzip 1122 ms, parse 4827 ms, sort 148 ms, write 10849 ms, index 674 ms: 1 candidates, 97963 repo-hours, 1220 releases; waiting 671 ms; commit 1381 ms)
2026-11-07T15:16:40Z [load_day 2023-02-08] 2023-02-08 hour 16: 208931 events in 5 files, snapshot 3489667020043780 (task 17717 ms: download 9854 ms overlapping gunzip 1070 ms, parse 4773 ms, sort 120 ms, write 10136 ms, index 602 ms: 7 candidates, 93092 repo-hours, 1037 releases; waiting 669 ms; commit 1750 ms)
2026-11-07T15:16:46Z [load_day 2023-02-08] 2023-02-08 hour 17: 207752 events in 5 files, snapshot 5383810203222134403 (task 20437 ms: download 12015 ms overlapping gunzip 1107 ms, parse 4810 ms, sort 131 ms, write 10646 ms, index 607 ms: 8 candidates, 89161 repo-hours, 1072 releases; waiting 2878 ms; commit 1531 ms)
2026-11-07T15:16:57Z [load_day 2023-02-08] 2023-02-08 hour 18: 212372 events in 5 files, snapshot 2894374142613216269 (task 16889 ms: download 9510 ms overlapping gunzip 1040 ms, parse 4469 ms, sort 119 ms, write 10155 ms, index 648 ms: 2 candidates, 97026 repo-hours, 1022 releases; waiting 187 ms; commit 1311 ms)
2026-11-07T15:17:02Z [load_day 2023-02-08] 2023-02-08 hour 19: 196186 events in 4 files, snapshot 5968097182713622215 (task 15423 ms: download 8373 ms overlapping gunzip 928 ms, parse 4064 ms, sort 130 ms, write 8839 ms, index 620 ms: 21 candidates, 83963 repo-hours, 1023 releases; waiting 523 ms; commit 1397 ms)
2026-11-07T15:17:16Z [load_day 2023-02-08] 2023-02-08 hour 20: 193277 events in 4 files, snapshot 4381307349102059331 (task 18061 ms: download 11336 ms overlapping gunzip 1006 ms, parse 4389 ms, sort 156 ms, write 8892 ms, index 573 ms: 8 candidates, 79731 repo-hours, 947 releases; waiting 2741 ms; commit 1675 ms)
2026-11-07T15:17:19Z [load_day 2023-02-08] 2023-02-08 hour 21: 190576 events in 4 files, snapshot 6080375119120722960 (task 16542 ms: download 10110 ms overlapping gunzip 961 ms, parse 4108 ms, sort 131 ms, write 8709 ms, index 525 ms: 1 candidates, 74800 repo-hours, 1034 releases; waiting 1821 ms; commit 1476 ms)
2026-11-07T15:17:32Z [load_day 2023-02-08] 2023-02-08 hour 22: 175327 events in 4 files, snapshot 6507763010648911063 (task 15315 ms: download 9565 ms overlapping gunzip 941 ms, parse 3943 ms, sort 108 ms, write 8303 ms, index 451 ms: 4 candidates, 69173 repo-hours, 962 releases; waiting 1253 ms; commit 1653 ms)
2026-11-07T15:17:34Z [load_day 2023-02-08] 2023-02-08 hour 23: 160375 events in 4 files, snapshot 5232113686732433919 (task 14111 ms: download 7070 ms overlapping gunzip 804 ms, parse 3412 ms, sort 88 ms, write 7245 ms, index 406 ms: 4 candidates, 63806 repo-hours, 782 releases; waiting 1848 ms; commit 1489 ms)
2026-11-07T15:17:42Z [load_day 2023-02-08] 2023-02-08: repo_hour merged from 24 files to 1 (1962448 rows, 7926 ms)
2026-11-07T15:17:45Z [load_day 2023-02-08] 2023-02-08: index committed in 10234 ms (24 + 1 + 24 files)
2026-11-07T15:17:45Z [load_day 2023-02-08] 2023-02-08: 4434953 events in 24 hours
2026-11-07T15:17:45Z [load_day 2023-02-08] attempt 1 succeeded