orcaLog in

Runs · run 1122

load_day 2023-05-26, attempt 1 succeeded

Host
caf251265124:405158
Started
2026-11-07T20:40:13Z
Ended
2026-11-07T20:43:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1122/load_day/2023-05-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:40:13Z [load_day 2023-05-26] attempt 1 started
2026-11-07T20:40:14Z [load_day 2023-05-26] 2023-05-26: 2 hours in flight, about 1200 MB
2026-11-07T20:40:29Z [load_day 2023-05-26] 2023-05-26 hour 0: 147719 events in 3 files, snapshot 4444825830088566651 (task 12204 ms: download 6029 ms overlapping gunzip 669 ms, parse 3172 ms, sort 103 ms, write 5815 ms, index 491 ms: 5 candidates, 77999 repo-hours, 906 releases; waiting 1673 ms; commit 1756 ms)
2026-11-07T20:40:31Z [load_day 2023-05-26] 2023-05-26 hour 1: 156556 events in 4 files, snapshot 2137933053364924819 (task 11626 ms: download 4810 ms overlapping gunzip 640 ms, parse 2986 ms, sort 79 ms, write 6341 ms, index 571 ms: 6 candidates, 89546 repo-hours, 836 releases; waiting 688 ms; commit 1653 ms)
2026-11-07T20:40:40Z [load_day 2023-05-26] 2023-05-26 hour 2: 132928 events in 3 files, snapshot 3171057013262040303 (task 10046 ms: download 4033 ms overlapping gunzip 592 ms, parse 2577 ms, sort 79 ms, write 5544 ms, index 416 ms: 2 candidates, 62974 repo-hours, 757 releases; waiting 197 ms; commit 1842 ms)
2026-11-07T20:40:42Z [load_day 2023-05-26] 2023-05-26 hour 3: 128277 events in 3 files, snapshot 7494464842580166088 (task 9373 ms: download 3838 ms overlapping gunzip 534 ms, parse 2438 ms, sort 75 ms, write 5106 ms, index 360 ms: 5 candidates, 57080 repo-hours, 884 releases; waiting 501 ms; commit 1614 ms)
2026-11-07T20:40:50Z [load_day 2023-05-26] 2023-05-26 hour 4: 120528 events in 3 files, snapshot 3539740963756229585 (task 8852 ms: download 2180 ms overlapping gunzip 513 ms, parse 2267 ms, sort 66 ms, write 4829 ms, index 365 ms: 4 candidates, 53254 repo-hours, 575 releases; waiting 522 ms; commit 1741 ms)
2026-11-07T20:40:53Z [load_day 2023-05-26] 2023-05-26 hour 5: 136794 events in 3 files, snapshot 8150633579166530303 (task 10728 ms: download 4491 ms overlapping gunzip 631 ms, parse 2751 ms, sort 81 ms, write 5807 ms, index 398 ms: 4 candidates, 60127 repo-hours, 777 releases; waiting 672 ms; commit 1760 ms)
2026-11-07T20:41:05Z [load_day 2023-05-26] 2023-05-26 hour 6: 162633 events in 4 files, snapshot 4906246417127697301 (task 13069 ms: download 4504 ms overlapping gunzip 711 ms, parse 3160 ms, sort 94 ms, write 7262 ms, index 1431 ms: 7 candidates, 76686 repo-hours, 914 releases; waiting 198 ms; commit 3062 ms)
2026-11-07T20:41:09Z [load_day 2023-05-26] 2023-05-26 hour 7: 165996 events in 4 files, snapshot 1471576076533261471 (task 14683 ms: download 9093 ms overlapping gunzip 777 ms, parse 3446 ms, sort 99 ms, write 9001 ms, index 506 ms: 8 candidates, 75757 repo-hours, 1258 releases; waiting 548 ms; commit 1695 ms)
2026-11-07T20:41:19Z [load_day 2023-05-26] 2023-05-26 hour 8: 183406 events in 4 files, snapshot 9031694373763999592 (task 15102 ms: download 8401 ms overlapping gunzip 925 ms, parse 4163 ms, sort 124 ms, write 8730 ms, index 564 ms: 9 candidates, 83104 repo-hours, 1124 releases; waiting 322 ms; commit 1781 ms)
2026-11-07T20:41:26Z [load_day 2023-05-26] 2023-05-26 hour 9: 184874 events in 4 files, snapshot 6182435935464408063 (task 16303 ms: download 9466 ms overlapping gunzip 923 ms, parse 4069 ms, sort 113 ms, write 9177 ms, index 589 ms: 7 candidates, 83762 repo-hours, 1191 releases; waiting 1097 ms; commit 1826 ms)
2026-11-07T20:41:34Z [load_day 2023-05-26] 2023-05-26 hour 10: 174809 events in 4 files, snapshot 7917469059856374974 (task 13932 ms: download 7944 ms overlapping gunzip 822 ms, parse 3677 ms, sort 105 ms, write 7868 ms, index 588 ms: 3 candidates, 78570 repo-hours, 967 releases; waiting 536 ms; commit 1662 ms)
2026-11-07T20:41:40Z [load_day 2023-05-26] 2023-05-26 hour 11: 175855 events in 4 files, snapshot 2621967970996152990 (task 13628 ms: download 7601 ms overlapping gunzip 833 ms, parse 3704 ms, sort 103 ms, write 7888 ms, index 501 ms: 8 candidates, 77720 repo-hours, 1015 releases; waiting 294 ms; commit 1483 ms)
2026-11-07T20:41:51Z [load_day 2023-05-26] 2023-05-26 hour 12: 229063 events in 5 files, snapshot 2412965820087008322 (task 16301 ms: download 8446 ms overlapping gunzip 921 ms, parse 4197 ms, sort 132 ms, write 9158 ms, index 659 ms: 7 candidates, 109538 repo-hours, 1125 releases; waiting 873 ms; commit 1763 ms)
2026-11-07T20:41:57Z [load_day 2023-05-26] 2023-05-26 hour 13: 195748 events in 4 files, snapshot 7915880140619944255 (task 16005 ms: download 8768 ms overlapping gunzip 924 ms, parse 4139 ms, sort 119 ms, write 8794 ms, index 665 ms: 13 candidates, 98596 repo-hours, 1033 releases; waiting 932 ms; commit 1532 ms)
2026-11-07T20:42:07Z [load_day 2023-05-26] 2023-05-26 hour 14: 180477 events in 4 files, snapshot 7039591889915848737 (task 15038 ms: download 8590 ms overlapping gunzip 882 ms, parse 3927 ms, sort 106 ms, write 8747 ms, index 589 ms: 7 candidates, 84579 repo-hours, 1082 releases; waiting 517 ms; commit 1841 ms)
2026-11-07T20:42:11Z [load_day 2023-05-26] 2023-05-26 hour 15: 162873 events in 4 files, snapshot 7799687580285002510 (task 13449 ms: download 7772 ms overlapping gunzip 817 ms, parse 3598 ms, sort 109 ms, write 7720 ms, index 552 ms: 11 candidates, 78098 repo-hours, 1034 releases; waiting 352 ms; commit 1716 ms)
2026-11-07T20:42:22Z [load_day 2023-05-26] 2023-05-26 hour 16: 164769 events in 4 files, snapshot 7281726463615806468 (task 13949 ms: download 8330 ms overlapping gunzip 806 ms, parse 3572 ms, sort 97 ms, write 8199 ms, index 544 ms: 7 candidates, 76047 repo-hours, 1098 releases; waiting 508 ms; commit 1748 ms)
2026-11-07T20:42:27Z [load_day 2023-05-26] 2023-05-26 hour 17: 167116 events in 4 files, snapshot 9169418868739613519 (task 14588 ms: download 8924 ms overlapping gunzip 914 ms, parse 3937 ms, sort 119 ms, write 8107 ms, index 496 ms: 5 candidates, 72225 repo-hours, 932 releases; waiting 649 ms; commit 1908 ms)
2026-11-07T20:42:36Z [load_day 2023-05-26] 2023-05-26 hour 18: 171372 events in 4 files, snapshot 3797763699462688203 (task 13366 ms: download 7604 ms overlapping gunzip 795 ms, parse 3589 ms, sort 109 ms, write 7847 ms, index 512 ms: 7 candidates, 77374 repo-hours, 974 releases; waiting 205 ms; commit 1894 ms)
2026-11-07T20:42:41Z [load_day 2023-05-26] 2023-05-26 hour 19: 153178 events in 4 files, snapshot 7869181280313274402 (task 13647 ms: download 6167 ms overlapping gunzip 743 ms, parse 3300 ms, sort 105 ms, write 7295 ms, index 429 ms: 9 candidates, 65147 repo-hours, 963 releases; waiting 1313 ms; commit 1697 ms)
2026-11-07T20:42:50Z [load_day 2023-05-26] 2023-05-26 hour 20: 154112 events in 4 files, snapshot 4038271724843236716 (task 12673 ms: download 5627 ms overlapping gunzip 778 ms, parse 3385 ms, sort 93 ms, write 7010 ms, index 415 ms: 7 candidates, 65445 repo-hours, 953 releases; waiting 687 ms; commit 1757 ms)
2026-11-07T20:42:53Z [load_day 2023-05-26] 2023-05-26 hour 21: 134394 events in 3 files, snapshot 3149458386016143251 (task 11082 ms: download 4955 ms overlapping gunzip 647 ms, parse 2907 ms, sort 88 ms, write 6029 ms, index 419 ms: 7 candidates, 56034 repo-hours, 847 releases; waiting 692 ms; commit 1614 ms)
2026-11-07T20:43:00Z [load_day 2023-05-26] 2023-05-26 hour 22: 125614 events in 3 files, snapshot 6796043237306533363 (task 10249 ms: download 4695 ms overlapping gunzip 632 ms, parse 2756 ms, sort 88 ms, write 5588 ms, index 346 ms: 2 candidates, 52399 repo-hours, 865 releases; waiting 528 ms; commit 1603 ms)
2026-11-07T20:43:02Z [load_day 2023-05-26] 2023-05-26 hour 23: 106261 events in 3 files, snapshot 8212791070507331465 (task 7837 ms: download 1979 ms overlapping gunzip 471 ms, parse 2118 ms, sort 62 ms, write 4373 ms, index 309 ms: 2 candidates, 45273 repo-hours, 708 releases; waiting 211 ms; commit 1725 ms)
2026-11-07T20:43:10Z [load_day 2023-05-26] 2023-05-26: repo_hour merged from 24 files to 1 (1757334 rows, 7231 ms)
2026-11-07T20:43:11Z [load_day 2023-05-26] 2023-05-26: index committed in 8959 ms (24 + 1 + 24 files)
2026-11-07T20:43:11Z [load_day 2023-05-26] 2023-05-26: 3815352 events in 24 hours
2026-11-07T20:43:11Z [load_day 2023-05-26] attempt 1 succeeded