orcaLog in

Runs · run 885

load_day 2023-03-08, attempt 1 succeeded

Host
caf251265124:137298
Started
2026-11-07T16:45:09Z
Ended
2026-11-07T16:48:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/885/load_day/2023-03-08/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:45:09Z [load_day 2023-03-08] attempt 1 started
2026-11-07T16:45:11Z [load_day 2023-03-08] 2023-03-08: 2 hours in flight, about 1200 MB
2026-11-07T16:45:27Z [load_day 2023-03-08] 2023-03-08 hour 0: 179015 events in 4 files, snapshot 6503243420369932941 (task 13385 ms: download 7862 ms overlapping gunzip 790 ms, parse 3467 ms, sort 110 ms, write 7586 ms, index 672 ms: 7 candidates, 90241 repo-hours, 930 releases; waiting 463 ms; commit 1327 ms)
2026-11-07T16:45:29Z [load_day 2023-03-08] 2023-03-08 hour 1: 198744 events in 4 files, snapshot 3171153745756418265 (task 14032 ms: download 7600 ms overlapping gunzip 881 ms, parse 3627 ms, sort 111 ms, write 7825 ms, index 668 ms: 7 candidates, 106119 repo-hours, 938 releases; waiting 594 ms; commit 1722 ms)
2026-11-07T16:45:40Z [load_day 2023-03-08] 2023-03-08 hour 2: 156822 events in 4 files, snapshot 2191663977549601834 (task 11676 ms: download 5102 ms overlapping gunzip 690 ms, parse 2921 ms, sort 98 ms, write 6522 ms, index 522 ms: 2 candidates, 81862 repo-hours, 697 releases; waiting 602 ms; commit 1581 ms)
2026-11-07T16:45:41Z [load_day 2023-03-08] 2023-03-08 hour 3: 178299 events in 4 files, snapshot 4204842647458651695 (task 11613 ms: download 4605 ms overlapping gunzip 698 ms, parse 2968 ms, sort 117 ms, write 6385 ms, index 577 ms: 2 candidates, 92975 repo-hours, 825 releases; waiting 547 ms; commit 1420 ms)
2026-11-07T16:45:51Z [load_day 2023-03-08] 2023-03-08 hour 4: 158363 events in 4 files, snapshot 6857757586130520746 (task 10338 ms: download 4132 ms overlapping gunzip 626 ms, parse 2655 ms, sort 89 ms, write 5619 ms, index 523 ms: 18 candidates, 84504 repo-hours, 581 releases; waiting 509 ms; commit 1519 ms)
2026-11-07T16:45:52Z [load_day 2023-03-08] 2023-03-08 hour 5: 145234 events in 3 files, snapshot 8958368436177620886 (task 10257 ms: download 4123 ms overlapping gunzip 625 ms, parse 2647 ms, sort 84 ms, write 5537 ms, index 526 ms: 2 candidates, 66564 repo-hours, 802 releases; waiting 530 ms; commit 1455 ms)
2026-11-07T16:46:03Z [load_day 2023-03-08] 2023-03-08 hour 6: 154548 events in 4 files, snapshot 417611676903202217 (task 11634 ms: download 4819 ms overlapping gunzip 708 ms, parse 2973 ms, sort 109 ms, write 6256 ms, index 561 ms: 7 candidates, 70638 repo-hours, 811 releases; waiting 688 ms; commit 1431 ms)
2026-11-07T16:46:05Z [load_day 2023-03-08] 2023-03-08 hour 7: 173364 events in 4 files, snapshot 7045025518969689018 (task 12410 ms: download 6643 ms overlapping gunzip 704 ms, parse 2990 ms, sort 100 ms, write 6953 ms, index 492 ms: 7 candidates, 86055 repo-hours, 717 releases; waiting 812 ms; commit 1501 ms)
2026-11-07T16:46:19Z [load_day 2023-03-08] 2023-03-08 hour 8: 175414 events in 4 files, snapshot 8004625840211601098 (task 14197 ms: download 8362 ms overlapping gunzip 842 ms, parse 3547 ms, sort 93 ms, write 8203 ms, index 510 ms: 6 candidates, 79805 repo-hours, 898 releases; waiting 710 ms; commit 1721 ms)
2026-11-07T16:46:22Z [load_day 2023-03-08] 2023-03-08 hour 9: 190030 events in 4 files, snapshot 2977358467598379613 (task 15500 ms: download 8642 ms overlapping gunzip 927 ms, parse 3971 ms, sort 113 ms, write 8949 ms, index 537 ms: 5 candidates, 83148 repo-hours, 1064 releases; waiting 544 ms; commit 1449 ms)
2026-11-07T16:46:34Z [load_day 2023-03-08] 2023-03-08 hour 10: 193563 events in 4 files, snapshot 1080791801413065782 (task 15423 ms: download 8587 ms overlapping gunzip 912 ms, parse 3977 ms, sort 114 ms, write 8672 ms, index 580 ms: 1 candidates, 85323 repo-hours, 1123 releases; waiting 866 ms; commit 1438 ms)
2026-11-07T16:46:39Z [load_day 2023-03-08] 2023-03-08 hour 11: 189803 events in 4 files, snapshot 7607014875891281645 (task 16578 ms: download 10169 ms overlapping gunzip 928 ms, parse 4091 ms, sort 139 ms, write 8306 ms, index 596 ms: 5 candidates, 79950 repo-hours, 1090 releases; waiting 2223 ms; commit 1500 ms)
2026-11-07T16:46:51Z [load_day 2023-03-08] 2023-03-08 hour 12: 241002 events in 5 files, snapshot 6046142859630978991 (task 16307 ms: download 9957 ms overlapping gunzip 920 ms, parse 4105 ms, sort 152 ms, write 9166 ms, index 751 ms: 6 candidates, 127714 repo-hours, 976 releases; waiting 749 ms; commit 1333 ms)
2026-11-07T16:46:57Z [load_day 2023-03-08] 2023-03-08 hour 13: 232788 events in 5 files, snapshot 8998488813349034703 (task 16788 ms: download 10243 ms overlapping gunzip 987 ms, parse 4318 ms, sort 128 ms, write 9728 ms, index 710 ms: 8 candidates, 118647 repo-hours, 1001 releases; waiting 554 ms; commit 1650 ms)
2026-11-07T16:47:10Z [load_day 2023-03-08] 2023-03-08 hour 14: 225647 events in 5 files, snapshot 2084208069698514629 (task 17964 ms: download 11797 ms overlapping gunzip 1098 ms, parse 4711 ms, sort 147 ms, write 10670 ms, index 673 ms: 2 candidates, 106342 repo-hours, 1303 releases; waiting 380 ms; commit 1651 ms)
2026-11-07T16:47:15Z [load_day 2023-03-08] 2023-03-08 hour 15: 230383 events in 5 files, snapshot 3049571891294144692 (task 18171 ms: download 11683 ms overlapping gunzip 1056 ms, parse 4637 ms, sort 142 ms, write 10512 ms, index 729 ms: 6 candidates, 109579 repo-hours, 1362 releases; waiting 764 ms; commit 1474 ms)
2026-11-07T16:47:28Z [load_day 2023-03-08] 2023-03-08 hour 16: 216996 events in 5 files, snapshot 6745056977715847393 (task 16258 ms: download 8485 ms overlapping gunzip 897 ms, parse 3986 ms, sort 129 ms, write 9713 ms, index 689 ms: 7 candidates, 119068 repo-hours, 1052 releases; waiting 536 ms; commit 2349 ms)
2026-11-07T16:47:34Z [load_day 2023-03-08] 2023-03-08 hour 17: 210930 events in 5 files, snapshot 7689854447318569615 (task 17595 ms: download 11983 ms overlapping gunzip 1115 ms, parse 4650 ms, sort 127 ms, write 10112 ms, index 607 ms: 8 candidates, 88620 repo-hours, 1054 releases; waiting 513 ms; commit 1374 ms)
2026-11-07T16:47:48Z [load_day 2023-03-08] 2023-03-08 hour 18: 212993 events in 5 files, snapshot 9074597251125641809 (task 19438 ms: download 11716 ms overlapping gunzip 1098 ms, parse 4616 ms, sort 142 ms, write 9721 ms, index 618 ms: 9 candidates, 93229 repo-hours, 1145 releases; waiting 2915 ms; commit 1410 ms)
2026-11-07T16:47:52Z [load_day 2023-03-08] 2023-03-08 hour 19: 217194 events in 5 files, snapshot 1297192770898930793 (task 17194 ms: download 11546 ms overlapping gunzip 1099 ms, parse 4571 ms, sort 133 ms, write 9973 ms, index 594 ms: 10 candidates, 94092 repo-hours, 967 releases; waiting 534 ms; commit 1602 ms)
2026-11-07T16:48:07Z [load_day 2023-03-08] 2023-03-08 hour 20: 218256 events in 5 files, snapshot 3395256042643470504 (task 17580 ms: download 11754 ms overlapping gunzip 1163 ms, parse 4738 ms, sort 144 ms, write 9990 ms, index 622 ms: 11 candidates, 96252 repo-hours, 989 releases; waiting 589 ms; commit 1345 ms)
2026-11-07T16:48:10Z [load_day 2023-03-08] 2023-03-08 hour 21: 217120 events in 5 files, snapshot 3331391964111612089 (task 17301 ms: download 11712 ms overlapping gunzip 1122 ms, parse 4647 ms, sort 135 ms, write 9862 ms, index 731 ms: 9 candidates, 99598 repo-hours, 1012 releases; waiting 509 ms; commit 1360 ms)
2026-11-07T16:48:24Z [load_day 2023-03-08] 2023-03-08 hour 22: 212854 events in 5 files, snapshot 6291393498871128145 (task 16119 ms: download 9470 ms overlapping gunzip 909 ms, parse 3730 ms, sort 143 ms, write 8416 ms, index 662 ms: 9 candidates, 111282 repo-hours, 860 releases; waiting 1950 ms; commit 1629 ms)
2026-11-07T16:48:25Z [load_day 2023-03-08] 2023-03-08 hour 23: 213272 events in 5 files, snapshot 4674374073323642934 (task 14461 ms: download 9494 ms overlapping gunzip 856 ms, parse 3414 ms, sort 136 ms, write 8064 ms, index 677 ms: 1 candidates, 118400 repo-hours, 758 releases; waiting 955 ms; commit 1517 ms)
2026-11-07T16:48:34Z [load_day 2023-03-08] 2023-03-08: repo_hour merged from 24 files to 1 (2290007 rows, 9039 ms)
2026-11-07T16:48:36Z [load_day 2023-03-08] 2023-03-08: index committed in 11047 ms (24 + 1 + 24 files)
2026-11-07T16:48:36Z [load_day 2023-03-08] 2023-03-08: 4742634 events in 24 hours
2026-11-07T16:48:36Z [load_day 2023-03-08] attempt 1 succeeded