orcaLog in

Runs · run 1093

load_day 2023-05-16, attempt 1 succeeded

Host
caf251265124:372416
Started
2026-11-07T20:11:26Z
Ended
2026-11-07T20:14:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1093/load_day/2023-05-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:11:26Z [load_day 2023-05-16] attempt 1 started
2026-11-07T20:11:28Z [load_day 2023-05-16] 2023-05-16: 2 hours in flight, about 1200 MB
2026-11-07T20:11:43Z [load_day 2023-05-16] 2023-05-16 hour 0: 152727 events in 4 files, snapshot 7932328341474397974 (task 11889 ms: download 5629 ms overlapping gunzip 712 ms, parse 3178 ms, sort 96 ms, write 6220 ms, index 507 ms: 12 candidates, 82251 repo-hours, 875 releases; waiting 933 ms; commit 1598 ms)
2026-11-07T20:11:45Z [load_day 2023-05-16] 2023-05-16 hour 1: 161819 events in 4 files, snapshot 386866511913105274 (task 11640 ms: download 4729 ms overlapping gunzip 673 ms, parse 3090 ms, sort 96 ms, write 6384 ms, index 575 ms: 8 candidates, 89518 repo-hours, 773 releases; waiting 495 ms; commit 1873 ms)
2026-11-07T20:11:54Z [load_day 2023-05-16] 2023-05-16 hour 2: 139311 events in 3 files, snapshot 8752240320556918923 (task 10809 ms: download 4372 ms overlapping gunzip 625 ms, parse 2666 ms, sort 80 ms, write 5856 ms, index 420 ms: 5 candidates, 66550 repo-hours, 744 releases; waiting 534 ms; commit 1617 ms)
2026-11-07T20:11:56Z [load_day 2023-05-16] 2023-05-16 hour 3: 135941 events in 3 files, snapshot 91814244978131439 (task 10065 ms: download 4302 ms overlapping gunzip 594 ms, parse 2636 ms, sort 81 ms, write 5520 ms, index 395 ms: 6 candidates, 60241 repo-hours, 849 releases; waiting 546 ms; commit 1699 ms)
2026-11-07T20:12:05Z [load_day 2023-05-16] 2023-05-16 hour 4: 130878 events in 3 files, snapshot 5282799859467388139 (task 10075 ms: download 4434 ms overlapping gunzip 586 ms, parse 2587 ms, sort 76 ms, write 5657 ms, index 394 ms: 7 candidates, 56699 repo-hours, 655 releases; waiting 514 ms; commit 1668 ms)
2026-11-07T20:12:08Z [load_day 2023-05-16] 2023-05-16 hour 5: 141367 events in 3 files, snapshot 4865714108062048942 (task 10820 ms: download 4526 ms overlapping gunzip 645 ms, parse 2852 ms, sort 87 ms, write 5941 ms, index 404 ms: 11 candidates, 62557 repo-hours, 879 releases; waiting 558 ms; commit 1985 ms)
2026-11-07T20:12:20Z [load_day 2023-05-16] 2023-05-16 hour 6: 172137 events in 4 files, snapshot 4142097836357730440 (task 13269 ms: download 7750 ms overlapping gunzip 784 ms, parse 3433 ms, sort 100 ms, write 7408 ms, index 504 ms: 24 candidates, 83006 repo-hours, 1074 releases; waiting 698 ms; commit 1977 ms)
2026-11-07T20:12:22Z [load_day 2023-05-16] 2023-05-16 hour 7: 157082 events in 4 files, snapshot 9200253671837582555 (task 13054 ms: download 5433 ms overlapping gunzip 759 ms, parse 3408 ms, sort 93 ms, write 7455 ms, index 499 ms: 9 candidates, 74928 repo-hours, 1060 releases; waiting 513 ms; commit 1756 ms)
2026-11-07T20:12:36Z [load_day 2023-05-16] 2023-05-16 hour 8: 172256 events in 4 files, snapshot 8799484932550054244 (task 15142 ms: download 9104 ms overlapping gunzip 899 ms, parse 3972 ms, sort 109 ms, write 8646 ms, index 584 ms: 7 candidates, 84272 repo-hours, 967 releases; waiting 638 ms; commit 1719 ms)
2026-11-07T20:12:38Z [load_day 2023-05-16] 2023-05-16 hour 9: 181621 events in 4 files, snapshot 3006083826183632521 (task 15356 ms: download 9002 ms overlapping gunzip 932 ms, parse 4212 ms, sort 125 ms, write 8707 ms, index 591 ms: 10 candidates, 86793 repo-hours, 1160 releases; waiting 517 ms; commit 1870 ms)
2026-11-07T20:12:51Z [load_day 2023-05-16] 2023-05-16 hour 10: 175471 events in 4 files, snapshot 5393360530919937771 (task 14697 ms: download 8324 ms overlapping gunzip 875 ms, parse 3914 ms, sort 102 ms, write 8473 ms, index 530 ms: 7 candidates, 81869 repo-hours, 1075 releases; waiting 497 ms; commit 1766 ms)
2026-11-07T20:12:54Z [load_day 2023-05-16] 2023-05-16 hour 11: 176353 events in 4 files, snapshot 5010105130536387872 (task 14813 ms: download 8505 ms overlapping gunzip 877 ms, parse 3891 ms, sort 111 ms, write 8475 ms, index 541 ms: 15 candidates, 82028 repo-hours, 1061 releases; waiting 584 ms; commit 1735 ms)
2026-11-07T20:13:08Z [load_day 2023-05-16] 2023-05-16 hour 12: 208734 events in 5 files, snapshot 1518991243434226893 (task 16385 ms: download 8630 ms overlapping gunzip 869 ms, parse 4067 ms, sort 110 ms, write 9313 ms, index 794 ms: 18 candidates, 110109 repo-hours, 1048 releases; waiting 932 ms; commit 1665 ms)
2026-11-07T20:13:10Z [load_day 2023-05-16] 2023-05-16 hour 13: 195891 events in 4 files, snapshot 6102489475702186187 (task 15861 ms: download 8468 ms overlapping gunzip 922 ms, parse 4152 ms, sort 118 ms, write 9230 ms, index 672 ms: 10 candidates, 104068 repo-hours, 1312 releases; waiting 517 ms; commit 1765 ms)
2026-11-07T20:13:26Z [load_day 2023-05-16] 2023-05-16 hour 14: 189774 events in 4 files, snapshot 70383129454864226 (task 16424 ms: download 9268 ms overlapping gunzip 957 ms, parse 4252 ms, sort 110 ms, write 9555 ms, index 617 ms: 14 candidates, 92477 repo-hours, 1248 releases; waiting 562 ms; commit 1895 ms)
2026-11-07T20:13:28Z [load_day 2023-05-16] 2023-05-16 hour 15: 175193 events in 4 files, snapshot 222310993404292053 (task 15058 ms: download 8590 ms overlapping gunzip 879 ms, parse 3910 ms, sort 102 ms, write 8739 ms, index 577 ms: 10 candidates, 86932 repo-hours, 1137 releases; waiting 520 ms; commit 1936 ms)
2026-11-07T20:13:42Z [load_day 2023-05-16] 2023-05-16 hour 16: 183603 events in 4 files, snapshot 1114260568065664963 (task 15778 ms: download 9283 ms overlapping gunzip 937 ms, parse 4208 ms, sort 128 ms, write 9160 ms, index 583 ms: 10 candidates, 86248 repo-hours, 972 releases; waiting 515 ms; commit 1618 ms)
2026-11-07T20:13:44Z [load_day 2023-05-16] 2023-05-16 hour 17: 179030 events in 4 files, snapshot 716816217994502305 (task 15673 ms: download 9622 ms overlapping gunzip 918 ms, parse 4107 ms, sort 105 ms, write 8473 ms, index 547 ms: 14 candidates, 81645 repo-hours, 938 releases; waiting 1256 ms; commit 1661 ms)
2026-11-07T20:13:58Z [load_day 2023-05-16] 2023-05-16 hour 18: 190647 events in 4 files, snapshot 7849951455737389759 (task 15776 ms: download 8905 ms overlapping gunzip 927 ms, parse 4016 ms, sort 136 ms, write 9066 ms, index 567 ms: 9 candidates, 85921 repo-hours, 1143 releases; waiting 717 ms; commit 1545 ms)
2026-11-07T20:14:00Z [load_day 2023-05-16] 2023-05-16 hour 19: 175297 events in 4 files, snapshot 6224660488232968908 (task 14117 ms: download 8088 ms overlapping gunzip 818 ms, parse 3684 ms, sort 112 ms, write 8027 ms, index 541 ms: 10 candidates, 77057 repo-hours, 987 releases; waiting 632 ms; commit 1750 ms)
2026-11-07T20:14:14Z [load_day 2023-05-16] 2023-05-16 hour 20: 169168 events in 4 files, snapshot 925936019652638163 (task 14147 ms: download 8284 ms overlapping gunzip 821 ms, parse 3690 ms, sort 107 ms, write 8122 ms, index 539 ms: 9 candidates, 75262 repo-hours, 997 releases; waiting 558 ms; commit 1690 ms)
2026-11-07T20:14:15Z [load_day 2023-05-16] 2023-05-16 hour 21: 124125 events in 3 files, snapshot 8228262953174100341 (task 12076 ms: download 5683 ms overlapping gunzip 660 ms, parse 2902 ms, sort 79 ms, write 6370 ms, index 366 ms: 7 candidates, 55818 repo-hours, 814 releases; waiting 1095 ms; commit 1841 ms)
2026-11-07T20:14:26Z [load_day 2023-05-16] 2023-05-16 hour 22: 144574 events in 3 files, snapshot 6301662515259315812 (task 11990 ms: download 5275 ms overlapping gunzip 707 ms, parse 3109 ms, sort 88 ms, write 6758 ms, index 406 ms: 5 candidates, 60438 repo-hours, 836 releases; waiting 559 ms; commit 1596 ms)
2026-11-07T20:14:28Z [load_day 2023-05-16] 2023-05-16 hour 23: 126852 events in 3 files, snapshot 3770311886619396994 (task 10770 ms: download 5167 ms overlapping gunzip 610 ms, parse 2767 ms, sort 72 ms, write 5471 ms, index 366 ms: 7 candidates, 55557 repo-hours, 659 releases; waiting 1154 ms; commit 1759 ms)
2026-11-07T20:14:35Z [load_day 2023-05-16] 2023-05-16: repo_hour merged from 24 files to 1 (1882244 rows, 7708 ms)
2026-11-07T20:14:37Z [load_day 2023-05-16] 2023-05-16: index committed in 9681 ms (24 + 1 + 24 files)
2026-11-07T20:14:37Z [load_day 2023-05-16] 2023-05-16: 3959851 events in 24 hours
2026-11-07T20:14:37Z [load_day 2023-05-16] attempt 1 succeeded