orcaLog in

Runs · run 1077

load_day 2023-05-11, attempt 1 succeeded

Host
caf251265124:358022
Started
2026-11-07T19:58:17Z
Ended
2026-11-07T20:01:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1077/load_day/2023-05-11/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:58:17Z [load_day 2023-05-11] attempt 1 started
2026-11-07T19:58:18Z [load_day 2023-05-11] 2023-05-11: 2 hours in flight, about 1200 MB
2026-11-07T19:58:32Z [load_day 2023-05-11] 2023-05-11 hour 0: 146110 events in 3 files, snapshot 4862950142990740558 (task 10982 ms: download 4743 ms overlapping gunzip 621 ms, parse 2872 ms, sort 113 ms, write 6025 ms, index 516 ms: 12 candidates, 77732 repo-hours, 967 releases; waiting 501 ms; commit 1726 ms)
2026-11-07T19:58:34Z [load_day 2023-05-11] 2023-05-11 hour 1: 158816 events in 4 files, snapshot 8891207926667224176 (task 11187 ms: download 4578 ms overlapping gunzip 634 ms, parse 2902 ms, sort 87 ms, write 6223 ms, index 595 ms: 9 candidates, 89225 repo-hours, 773 releases; waiting 489 ms; commit 1761 ms)
2026-11-07T19:58:43Z [load_day 2023-05-11] 2023-05-11 hour 2: 133618 events in 3 files, snapshot 343852047626445211 (task 10266 ms: download 4566 ms overlapping gunzip 590 ms, parse 2574 ms, sort 78 ms, write 5504 ms, index 422 ms: 12 candidates, 63257 repo-hours, 756 releases; waiting 772 ms; commit 1568 ms)
2026-11-07T19:58:45Z [load_day 2023-05-11] 2023-05-11 hour 3: 130436 events in 3 files, snapshot 6860673251058532613 (task 10002 ms: download 4276 ms overlapping gunzip 550 ms, parse 2429 ms, sort 73 ms, write 5467 ms, index 543 ms: 8 candidates, 57908 repo-hours, 877 releases; waiting 631 ms; commit 2099 ms)
2026-11-07T19:58:53Z [load_day 2023-05-11] 2023-05-11 hour 4: 121790 events in 3 files, snapshot 5700437953622074118 (task 8609 ms: download 1697 ms overlapping gunzip 540 ms, parse 2355 ms, sort 79 ms, write 4786 ms, index 357 ms: 9 candidates, 53817 repo-hours, 666 releases; waiting 202 ms; commit 1681 ms)
2026-11-07T19:58:57Z [load_day 2023-05-11] 2023-05-11 hour 5: 133385 events in 3 files, snapshot 5766569580983524149 (task 10237 ms: download 4319 ms overlapping gunzip 598 ms, parse 2654 ms, sort 77 ms, write 5643 ms, index 410 ms: 5 candidates, 61050 repo-hours, 749 releases; waiting 540 ms; commit 1754 ms)
2026-11-07T19:59:06Z [load_day 2023-05-11] 2023-05-11 hour 6: 164065 events in 4 files, snapshot 5843767073973444651 (task 12549 ms: download 4974 ms overlapping gunzip 729 ms, parse 3237 ms, sort 108 ms, write 7111 ms, index 513 ms: 11 candidates, 77475 repo-hours, 928 releases; waiting 554 ms; commit 2121 ms)
2026-11-07T19:59:12Z [load_day 2023-05-11] 2023-05-11 hour 7: 162661 events in 4 files, snapshot 5327867614801318915 (task 14293 ms: download 5688 ms overlapping gunzip 781 ms, parse 3481 ms, sort 97 ms, write 8416 ms, index 557 ms: 15 candidates, 77897 repo-hours, 1009 releases; waiting 672 ms; commit 1697 ms)
2026-11-07T19:59:22Z [load_day 2023-05-11] 2023-05-11 hour 8: 175181 events in 4 files, snapshot 6446313062882901327 (task 14689 ms: download 8356 ms overlapping gunzip 868 ms, parse 3874 ms, sort 93 ms, write 8451 ms, index 589 ms: 12 candidates, 84106 repo-hours, 1035 releases; waiting 546 ms; commit 1730 ms)
2026-11-07T19:59:28Z [load_day 2023-05-11] 2023-05-11 hour 9: 183130 events in 4 files, snapshot 5214050868051024576 (task 15233 ms: download 8763 ms overlapping gunzip 916 ms, parse 4085 ms, sort 126 ms, write 8737 ms, index 559 ms: 3 candidates, 86132 repo-hours, 1250 releases; waiting 529 ms; commit 1785 ms)
2026-11-07T19:59:37Z [load_day 2023-05-11] 2023-05-11 hour 10: 174465 events in 4 files, snapshot 5587668165848923239 (task 14113 ms: download 8177 ms overlapping gunzip 853 ms, parse 3752 ms, sort 114 ms, write 8023 ms, index 520 ms: 8 candidates, 81241 repo-hours, 1057 releases; waiting 509 ms; commit 1607 ms)
2026-11-07T19:59:42Z [load_day 2023-05-11] 2023-05-11 hour 11: 172303 events in 4 files, snapshot 1714706341681142835 (task 13781 ms: download 7960 ms overlapping gunzip 840 ms, parse 3672 ms, sort 94 ms, write 7841 ms, index 527 ms: 12 candidates, 80879 repo-hours, 1025 releases; waiting 521 ms; commit 1673 ms)
2026-11-07T19:59:53Z [load_day 2023-05-11] 2023-05-11 hour 12: 208272 events in 5 files, snapshot 283061816324902636 (task 15343 ms: download 7886 ms overlapping gunzip 850 ms, parse 3884 ms, sort 112 ms, write 8945 ms, index 692 ms: 11 candidates, 108707 repo-hours, 1051 releases; waiting 518 ms; commit 1767 ms)
2026-11-07T19:59:55Z [load_day 2023-05-11] 2023-05-11 hour 13: 145770 events in 3 files, snapshot 7415341057329583390 (task 11886 ms: download 4672 ms overlapping gunzip 689 ms, parse 3050 ms, sort 86 ms, write 7035 ms, index 544 ms: 12 candidates, 86191 repo-hours, 760 releases; waiting 222 ms; commit 1856 ms)
2026-11-07T20:00:12Z [load_day 2023-05-11] 2023-05-11 hour 14: 189787 events in 4 files, snapshot 2139577673439648419 (task 18438 ms: download 11299 ms overlapping gunzip 981 ms, parse 4335 ms, sort 126 ms, write 9536 ms, index 608 ms: 11 candidates, 92940 repo-hours, 1099 releases; waiting 2542 ms; commit 1582 ms)
2026-11-07T20:00:14Z [load_day 2023-05-11] 2023-05-11 hour 15: 170000 events in 4 files, snapshot 8452567156254386633 (task 14756 ms: download 8653 ms overlapping gunzip 832 ms, parse 3675 ms, sort 102 ms, write 8821 ms, index 618 ms: 7 candidates, 84946 repo-hours, 1044 releases; waiting 404 ms; commit 1810 ms)
2026-11-07T20:00:28Z [load_day 2023-05-11] 2023-05-11 hour 16: 170985 events in 4 files, snapshot 4106363070367716933 (task 14839 ms: download 8811 ms overlapping gunzip 865 ms, parse 3795 ms, sort 94 ms, write 8583 ms, index 571 ms: 9 candidates, 81982 repo-hours, 944 releases; waiting 631 ms; commit 1550 ms)
2026-11-07T20:00:30Z [load_day 2023-05-11] 2023-05-11 hour 17: 171207 events in 4 files, snapshot 4472033208736512105 (task 14469 ms: download 8364 ms overlapping gunzip 835 ms, parse 3790 ms, sort 107 ms, write 8336 ms, index 559 ms: 5 candidates, 78748 repo-hours, 921 releases; waiting 541 ms; commit 1514 ms)
2026-11-07T20:00:43Z [load_day 2023-05-11] 2023-05-11 hour 18: 173694 events in 4 files, snapshot 3822606754826441098 (task 14324 ms: download 8294 ms overlapping gunzip 851 ms, parse 3721 ms, sort 119 ms, write 8162 ms, index 548 ms: 8 candidates, 82388 repo-hours, 1011 releases; waiting 560 ms; commit 1671 ms)
2026-11-07T20:00:45Z [load_day 2023-05-11] 2023-05-11 hour 19: 162625 events in 4 files, snapshot 3579448532258392635 (task 13806 ms: download 8345 ms overlapping gunzip 799 ms, parse 3571 ms, sort 97 ms, write 7745 ms, index 509 ms: 10 candidates, 72226 repo-hours, 1028 releases; waiting 745 ms; commit 1717 ms)
2026-11-07T20:00:59Z [load_day 2023-05-11] 2023-05-11 hour 20: 168691 events in 4 files, snapshot 1576520942870672656 (task 14687 ms: download 8550 ms overlapping gunzip 906 ms, parse 3974 ms, sort 92 ms, write 8337 ms, index 501 ms: 9 candidates, 75422 repo-hours, 939 releases; waiting 567 ms; commit 1691 ms)
2026-11-07T20:01:01Z [load_day 2023-05-11] 2023-05-11 hour 21: 144344 events in 3 files, snapshot 7523082209241954526 (task 12208 ms: download 5332 ms overlapping gunzip 758 ms, parse 3207 ms, sort 106 ms, write 6715 ms, index 449 ms: 4 candidates, 64156 repo-hours, 921 releases; waiting 654 ms; commit 1615 ms)
2026-11-07T20:01:11Z [load_day 2023-05-11] 2023-05-11 hour 22: 134958 events in 3 files, snapshot 622106219374178887 (task 10795 ms: download 4827 ms overlapping gunzip 644 ms, parse 2769 ms, sort 79 ms, write 6071 ms, index 390 ms: 7 candidates, 60577 repo-hours, 783 releases; waiting 528 ms; commit 1760 ms)
2026-11-07T20:01:12Z [load_day 2023-05-11] 2023-05-11 hour 23: 121829 events in 3 files, snapshot 5663585850053736871 (task 9659 ms: download 4291 ms overlapping gunzip 560 ms, parse 2572 ms, sort 70 ms, write 5215 ms, index 388 ms: 17 candidates, 55559 repo-hours, 713 releases; waiting 544 ms; commit 1592 ms)
2026-11-07T20:01:20Z [load_day 2023-05-11] 2023-05-11: repo_hour merged from 24 files to 1 (1834561 rows, 7675 ms)
2026-11-07T20:01:22Z [load_day 2023-05-11] 2023-05-11: index committed in 9568 ms (24 + 1 + 24 files)
2026-11-07T20:01:22Z [load_day 2023-05-11] 2023-05-11: 3818122 events in 24 hours
2026-11-07T20:01:22Z [load_day 2023-05-11] attempt 1 succeeded