orcaLog in

Runs · run 1197

load_day 2023-06-20, attempt 1 succeeded

Host
3c2b29713ce8:8642
Started
2026-11-07T21:40:49Z
Ended
2026-11-07T21:43:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1197/load_day/2023-06-20/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:40:49Z [load_day 2023-06-20] attempt 1 started
2026-11-07T21:40:50Z [load_day 2023-06-20] 2023-06-20: 4 hours in flight, about 2100 MB
2026-11-07T21:41:07Z [load_day 2023-06-20] 2023-06-20 hour 0: 147417 events in 3 files, snapshot 7848479934021087446 (task 14295 ms: download 6958 ms overlapping gunzip 823 ms, parse 3742 ms, sort 99 ms, write 8296 ms, index 473 ms: 14 candidates, 72856 repo-hours, 840 releases; waiting 521 ms; commit 1819 ms)
2026-11-07T21:41:09Z [load_day 2023-06-20] 2023-06-20 hour 1: 158535 events in 4 files, snapshot 1798870480500646884 (task 14449 ms: download 6406 ms overlapping gunzip 831 ms, parse 3862 ms, sort 95 ms, write 8267 ms, index 532 ms: 4 candidates, 87208 repo-hours, 742 releases; waiting 508 ms; commit 1703 ms)
2026-11-07T21:41:11Z [load_day 2023-06-20] 2023-06-20 hour 2: 140664 events in 3 files, snapshot 6026503254911115900 (task 14079 ms: download 6630 ms overlapping gunzip 866 ms, parse 4006 ms, sort 123 ms, write 7717 ms, index 450 ms: 7 candidates, 67242 repo-hours, 764 releases; waiting 511 ms; commit 1906 ms)
2026-11-07T21:41:13Z [load_day 2023-06-20] 2023-06-20 hour 3: 133511 events in 3 files, snapshot 4198527928134840965 (task 13000 ms: download 6124 ms overlapping gunzip 774 ms, parse 3654 ms, sort 86 ms, write 7221 ms, index 379 ms: 3 candidates, 57716 repo-hours, 924 releases; waiting 507 ms; commit 2013 ms)
2026-11-07T21:41:20Z [load_day 2023-06-20] 2023-06-20 hour 4: 126245 events in 3 files, snapshot 8166771034920564504 (task 12427 ms: download 2361 ms overlapping gunzip 581 ms, parse 2527 ms, sort 92 ms, write 7947 ms, index 433 ms: 3 candidates, 53638 repo-hours, 583 releases; waiting 507 ms; commit 2099 ms)
2026-11-07T21:41:24Z [load_day 2023-06-20] 2023-06-20 hour 5: 139592 events in 3 files, snapshot 9029299646181239338 (task 14372 ms: download 6101 ms overlapping gunzip 819 ms, parse 3642 ms, sort 98 ms, write 8671 ms, index 405 ms: 2 candidates, 62997 repo-hours, 794 releases; waiting 500 ms; commit 1942 ms)
2026-11-07T21:41:29Z [load_day 2023-06-20] 2023-06-20 hour 6: 164383 events in 4 files, snapshot 5962096293100550823 (task 17412 ms: download 7421 ms overlapping gunzip 856 ms, parse 3849 ms, sort 144 ms, write 10935 ms, index 518 ms: 7 candidates, 79312 repo-hours, 872 releases; waiting 815 ms; commit 1860 ms)
2026-11-07T21:41:31Z [load_day 2023-06-20] 2023-06-20 hour 7: 153169 events in 4 files, snapshot 3916030925671776134 (task 16824 ms: download 7169 ms overlapping gunzip 885 ms, parse 3943 ms, sort 108 ms, write 10672 ms, index 458 ms: 7 candidates, 74579 repo-hours, 835 releases; waiting 466 ms; commit 2404 ms)
2026-11-07T21:41:40Z [load_day 2023-06-20] 2023-06-20 hour 8: 165194 events in 4 files, snapshot 4404341312795633007 (task 18670 ms: download 10625 ms overlapping gunzip 1064 ms, parse 4781 ms, sort 103 ms, write 11154 ms, index 609 ms: 5 candidates, 80734 repo-hours, 948 releases; waiting 632 ms; commit 1756 ms)
2026-11-07T21:41:46Z [load_day 2023-06-20] 2023-06-20 hour 9: 182197 events in 4 files, snapshot 303923002776158958 (task 20234 ms: download 11491 ms overlapping gunzip 1241 ms, parse 5422 ms, sort 124 ms, write 12106 ms, index 522 ms: 5 candidates, 84896 repo-hours, 1106 releases; waiting 518 ms; commit 1903 ms)
2026-11-07T21:41:49Z [load_day 2023-06-20] 2023-06-20 hour 10: 178995 events in 4 files, snapshot 761290293770311474 (task 18915 ms: download 10748 ms overlapping gunzip 877 ms, parse 4017 ms, sort 106 ms, write 12355 ms, index 749 ms: 5 candidates, 82483 repo-hours, 1011 releases; waiting 515 ms; commit 2034 ms)
2026-11-07T21:41:52Z [load_day 2023-06-20] 2023-06-20 hour 11: 174638 events in 4 files, snapshot 336927909558876388 (task 18124 ms: download 9989 ms overlapping gunzip 1018 ms, parse 4301 ms, sort 106 ms, write 11621 ms, index 597 ms: 9 candidates, 78921 repo-hours, 845 releases; waiting 224 ms; commit 2823 ms)
2026-11-07T21:42:02Z [load_day 2023-06-20] 2023-06-20 hour 12: 225821 events in 5 files, snapshot 4691371574877397047 (task 21297 ms: download 10714 ms overlapping gunzip 1009 ms, parse 4655 ms, sort 140 ms, write 14013 ms, index 718 ms: 9 candidates, 112479 repo-hours, 1076 releases; waiting 515 ms; commit 1945 ms)
2026-11-07T21:42:08Z [load_day 2023-06-20] 2023-06-20 hour 13: 193680 events in 4 files, snapshot 4148565880648071441 (task 21247 ms: download 11071 ms overlapping gunzip 1087 ms, parse 4948 ms, sort 178 ms, write 13563 ms, index 654 ms: 6 candidates, 100755 repo-hours, 1074 releases; waiting 504 ms; commit 2218 ms)
2026-11-07T21:42:12Z [load_day 2023-06-20] 2023-06-20 hour 14: 186047 events in 4 files, snapshot 6619086730364067356 (task 21921 ms: download 12000 ms overlapping gunzip 1097 ms, parse 4766 ms, sort 128 ms, write 14651 ms, index 665 ms: 7 candidates, 88822 repo-hours, 1030 releases; waiting 371 ms; commit 1805 ms)
2026-11-07T21:42:14Z [load_day 2023-06-20] 2023-06-20 hour 15: 174884 events in 4 files, snapshot 5376149955318038861 (task 19983 ms: download 11164 ms overlapping gunzip 1018 ms, parse 4542 ms, sort 131 ms, write 12939 ms, index 638 ms: 7 candidates, 84292 repo-hours, 1042 releases; waiting 484 ms; commit 2256 ms)
2026-11-07T21:42:23Z [load_day 2023-06-20] 2023-06-20 hour 16: 181329 events in 4 files, snapshot 8919718804606611833 (task 20459 ms: download 11589 ms overlapping gunzip 1115 ms, parse 4752 ms, sort 137 ms, write 13268 ms, index 568 ms: 3 candidates, 84234 repo-hours, 1014 releases; waiting 382 ms; commit 1962 ms)
2026-11-07T21:42:30Z [load_day 2023-06-20] 2023-06-20 hour 17: 182581 events in 4 files, snapshot 5106777391722929507 (task 20769 ms: download 12237 ms overlapping gunzip 1301 ms, parse 5633 ms, sort 113 ms, write 12689 ms, index 534 ms: 5 candidates, 81024 repo-hours, 847 releases; waiting 190 ms; commit 2164 ms)
2026-11-07T21:42:36Z [load_day 2023-06-20] 2023-06-20 hour 18: 186231 events in 4 files, snapshot 2667635910238813132 (task 21329 ms: download 11394 ms overlapping gunzip 962 ms, parse 4417 ms, sort 141 ms, write 13816 ms, index 1193 ms: 7 candidates, 85943 repo-hours, 986 releases; waiting 503 ms; commit 4213 ms)
2026-11-07T21:42:38Z [load_day 2023-06-20] 2023-06-20 hour 19: 173670 events in 4 files, snapshot 5570735921749734644 (task 19997 ms: download 11063 ms overlapping gunzip 1015 ms, parse 4698 ms, sort 163 ms, write 11642 ms, index 1701 ms: 11 candidates, 75051 repo-hours, 1031 releases; waiting 476 ms; commit 1881 ms)
2026-11-07T21:42:43Z [load_day 2023-06-20] 2023-06-20 hour 20: 172494 events in 4 files, snapshot 1636731885275136999 (task 18576 ms: download 10567 ms overlapping gunzip 872 ms, parse 3931 ms, sort 121 ms, write 12345 ms, index 475 ms: 10 candidates, 75346 repo-hours, 925 releases; waiting 533 ms; commit 1861 ms)
2026-11-07T21:42:46Z [load_day 2023-06-20] 2023-06-20 hour 21: 157032 events in 4 files, snapshot 6031749168484065098 (task 15786 ms: download 6761 ms overlapping gunzip 909 ms, parse 4042 ms, sort 94 ms, write 9501 ms, index 443 ms: 10 candidates, 65303 repo-hours, 1002 releases; waiting 510 ms; commit 1665 ms)
2026-11-07T21:42:49Z [load_day 2023-06-20] 2023-06-20 hour 22: 143217 events in 3 files, snapshot 4359013985608994771 (task 14411 ms: download 6454 ms overlapping gunzip 798 ms, parse 3356 ms, sort 92 ms, write 9029 ms, index 379 ms: 5 candidates, 58807 repo-hours, 964 releases; waiting 504 ms; commit 1717 ms)
2026-11-07T21:42:52Z [load_day 2023-06-20] 2023-06-20 hour 23: 135457 events in 3 files, snapshot 1043384733738630664 (task 13175 ms: download 5919 ms overlapping gunzip 708 ms, parse 3189 ms, sort 92 ms, write 7953 ms, index 390 ms: 2 candidates, 56963 repo-hours, 628 releases; waiting 569 ms; commit 1721 ms)
2026-11-07T21:43:00Z [load_day 2023-06-20] 2023-06-20: repo_hour merged from 24 files to 1 (1851601 rows, 7445 ms)
2026-11-07T21:43:02Z [load_day 2023-06-20] 2023-06-20: index committed in 9482 ms (24 + 1 + 24 files)
2026-11-07T21:43:02Z [load_day 2023-06-20] 2023-06-20: 3976983 events in 24 hours
2026-11-07T21:43:02Z [load_day 2023-06-20] attempt 1 succeeded