orcaLog in

Runs · run 906

load_day 2023-03-15, attempt 1 succeeded

Host
caf251265124:164278
Started
2026-11-07T17:07:58Z
Ended
2026-11-07T17:11:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/906/load_day/2023-03-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:07:58Z [load_day 2023-03-15] attempt 1 started
2026-11-07T17:07:59Z [load_day 2023-03-15] 2023-03-15: 2 hours in flight, about 1200 MB
2026-11-07T17:08:17Z [load_day 2023-03-15] 2023-03-15 hour 0: 171092 events in 4 files, snapshot 412512482587720094 (task 14614 ms: download 6039 ms overlapping gunzip 796 ms, parse 3547 ms, sort 103 ms, write 7044 ms, index 1685 ms: 6 candidates, 79448 repo-hours, 1007 releases; waiting 961 ms; commit 1354 ms)
2026-11-07T17:08:18Z [load_day 2023-03-15] 2023-03-15 hour 1: 176844 events in 4 files, snapshot 5728217595971549767 (task 15147 ms: download 5422 ms overlapping gunzip 805 ms, parse 3510 ms, sort 106 ms, write 9311 ms, index 575 ms: 6 candidates, 86932 repo-hours, 864 releases; waiting 509 ms; commit 1411 ms)
2026-11-07T17:08:30Z [load_day 2023-03-15] 2023-03-15 hour 2: 164960 events in 4 files, snapshot 5210660644698000069 (task 12222 ms: download 5280 ms overlapping gunzip 770 ms, parse 3244 ms, sort 108 ms, write 6756 ms, index 462 ms: 3 candidates, 73043 repo-hours, 708 releases; waiting 573 ms; commit 1617 ms)
2026-11-07T17:08:31Z [load_day 2023-03-15] 2023-03-15 hour 3: 148503 events in 3 files, snapshot 7712695678251021225 (task 10926 ms: download 4750 ms overlapping gunzip 699 ms, parse 2911 ms, sort 91 ms, write 6016 ms, index 388 ms: 3 candidates, 62465 repo-hours, 892 releases; waiting 527 ms; commit 1561 ms)
2026-11-07T17:08:42Z [load_day 2023-03-15] 2023-03-15 hour 4: 141845 events in 3 files, snapshot 7393400706097527381 (task 10833 ms: download 4830 ms overlapping gunzip 697 ms, parse 2897 ms, sort 95 ms, write 5906 ms, index 395 ms: 1 candidates, 60000 repo-hours, 656 releases; waiting 537 ms; commit 1837 ms)
2026-11-07T17:08:43Z [load_day 2023-03-15] 2023-03-15 hour 5: 147188 events in 3 files, snapshot 4370727953306393927 (task 10925 ms: download 4413 ms overlapping gunzip 714 ms, parse 2982 ms, sort 91 ms, write 6201 ms, index 411 ms: 4 candidates, 62536 repo-hours, 743 releases; waiting 195 ms; commit 1300 ms)
2026-11-07T17:08:56Z [load_day 2023-03-15] 2023-03-15 hour 6: 164886 events in 4 files, snapshot 6595504374095364305 (task 12873 ms: download 7780 ms overlapping gunzip 771 ms, parse 3263 ms, sort 90 ms, write 7121 ms, index 499 ms: 5 candidates, 74335 repo-hours, 808 releases; waiting 778 ms; commit 1500 ms)
2026-11-07T17:08:57Z [load_day 2023-03-15] 2023-03-15 hour 7: 173839 events in 4 files, snapshot 3181251113380910485 (task 13544 ms: download 7770 ms overlapping gunzip 826 ms, parse 3526 ms, sort 116 ms, write 7705 ms, index 501 ms: 6 candidates, 75754 repo-hours, 867 releases; waiting 539 ms; commit 1452 ms)
2026-11-07T17:09:16Z [load_day 2023-03-15] 2023-03-15 hour 8: 204604 events in 5 files, snapshot 5358790456304119330 (task 19264 ms: download 11713 ms overlapping gunzip 1104 ms, parse 4589 ms, sort 144 ms, write 9292 ms, index 623 ms: 7 candidates, 98176 repo-hours, 882 releases; waiting 3003 ms; commit 1528 ms)
2026-11-07T17:09:19Z [load_day 2023-03-15] 2023-03-15 hour 9: 206029 events in 5 files, snapshot 7419872704753530268 (task 17133 ms: download 9638 ms overlapping gunzip 1088 ms, parse 4718 ms, sort 129 ms, write 9767 ms, index 615 ms: 8 candidates, 88809 repo-hours, 1207 releases; waiting 505 ms; commit 2960 ms)
2026-11-07T17:09:33Z [load_day 2023-03-15] 2023-03-15 hour 10: 212643 events in 5 files, snapshot 5801024469566567719 (task 17049 ms: download 11240 ms overlapping gunzip 1071 ms, parse 4683 ms, sort 138 ms, write 10348 ms, index 579 ms: 6 candidates, 89810 repo-hours, 1002 releases; waiting 23 ms; commit 1574 ms)
2026-11-07T17:09:35Z [load_day 2023-03-15] 2023-03-15 hour 11: 200216 events in 5 files, snapshot 7691819788506824670 (task 15871 ms: download 8765 ms overlapping gunzip 1009 ms, parse 4422 ms, sort 140 ms, write 9470 ms, index 600 ms: 3 candidates, 86083 repo-hours, 1040 releases; waiting 18 ms; commit 1728 ms)
2026-11-07T17:09:51Z [load_day 2023-03-15] 2023-03-15 hour 12: 234682 events in 5 files, snapshot 9101232896540690050 (task 16485 ms: download 10287 ms overlapping gunzip 1032 ms, parse 4605 ms, sort 129 ms, write 9801 ms, index 698 ms: 5 candidates, 112730 repo-hours, 1009 releases; waiting 14 ms; commit 1758 ms)
2026-11-07T17:09:53Z [load_day 2023-03-15] 2023-03-15 hour 13: 216606 events in 5 files, snapshot 3007183154349157886 (task 17316 ms: download 11483 ms overlapping gunzip 1067 ms, parse 4565 ms, sort 135 ms, write 9966 ms, index 744 ms: 5 candidates, 107203 repo-hours, 1093 releases; waiting 516 ms; commit 1476 ms)
2026-11-07T17:10:09Z [load_day 2023-03-15] 2023-03-15 hour 14: 228897 events in 5 files, snapshot 6081113946266086950 (task 17973 ms: download 11249 ms overlapping gunzip 1097 ms, parse 4707 ms, sort 159 ms, write 11034 ms, index 735 ms: 3 candidates, 115900 repo-hours, 1136 releases; waiting 18 ms; commit 1454 ms)
2026-11-07T17:10:12Z [load_day 2023-03-15] 2023-03-15 hour 15: 234746 events in 5 files, snapshot 1334634759200466454 (task 18031 ms: download 11479 ms overlapping gunzip 1079 ms, parse 4659 ms, sort 158 ms, write 11156 ms, index 710 ms: 6 candidates, 121584 repo-hours, 1254 releases; waiting 14 ms; commit 1784 ms)
2026-11-07T17:10:30Z [load_day 2023-03-15] 2023-03-15 hour 16: 213131 events in 5 files, snapshot 3376890974459103655 (task 19415 ms: download 13535 ms overlapping gunzip 1172 ms, parse 5030 ms, sort 165 ms, write 11461 ms, index 636 ms: 9 candidates, 96098 repo-hours, 1113 releases; waiting 641 ms; commit 1503 ms)
2026-11-07T17:10:32Z [load_day 2023-03-15] 2023-03-15 hour 17: 213635 events in 5 files, snapshot 6828627302229945830 (task 17448 ms: download 11904 ms overlapping gunzip 1111 ms, parse 4772 ms, sort 138 ms, write 10621 ms, index 597 ms: 6 candidates, 91262 repo-hours, 1060 releases; waiting 17 ms; commit 1745 ms)
2026-11-07T17:10:47Z [load_day 2023-03-15] 2023-03-15 hour 18: 203764 events in 5 files, snapshot 8933304633038287130 (task 16822 ms: download 8767 ms overlapping gunzip 999 ms, parse 4280 ms, sort 129 ms, write 10552 ms, index 631 ms: 6 candidates, 89908 repo-hours, 1083 releases; waiting 16 ms; commit 1464 ms)
2026-11-07T17:10:49Z [load_day 2023-03-15] 2023-03-15 hour 19: 194302 events in 4 files, snapshot 3799224852408139931 (task 15196 ms: download 8151 ms overlapping gunzip 938 ms, parse 4044 ms, sort 125 ms, write 9246 ms, index 597 ms: 8 candidates, 81694 repo-hours, 1017 releases; waiting 17 ms; commit 1379 ms)
2026-11-07T17:11:03Z [load_day 2023-03-15] 2023-03-15 hour 20: 195202 events in 4 files, snapshot 662851477820104782 (task 15254 ms: download 8359 ms overlapping gunzip 958 ms, parse 4135 ms, sort 132 ms, write 9246 ms, index 546 ms: 7 candidates, 84897 repo-hours, 1009 releases; waiting 24 ms; commit 1470 ms)
2026-11-07T17:11:05Z [load_day 2023-03-15] 2023-03-15 hour 21: 178236 events in 4 files, snapshot 7085777218705858018 (task 14481 ms: download 8264 ms overlapping gunzip 920 ms, parse 4141 ms, sort 103 ms, write 8579 ms, index 485 ms: 8 candidates, 70960 repo-hours, 1054 releases; waiting 20 ms; commit 1782 ms)
2026-11-07T17:11:18Z [load_day 2023-03-15] 2023-03-15 hour 22: 165987 events in 4 files, snapshot 6182790041486451226 (task 13566 ms: download 8281 ms overlapping gunzip 893 ms, parse 3785 ms, sort 120 ms, write 8080 ms, index 438 ms: 6 candidates, 65510 repo-hours, 928 releases; waiting 26 ms; commit 1482 ms)
2026-11-07T17:11:19Z [load_day 2023-03-15] 2023-03-15 hour 23: 153097 events in 4 files, snapshot 7254359256012797025 (task 11817 ms: download 4863 ms overlapping gunzip 775 ms, parse 3211 ms, sort 111 ms, write 7072 ms, index 404 ms: 4 candidates, 62195 repo-hours, 789 releases; waiting 17 ms; commit 1382 ms)
2026-11-07T17:11:27Z [load_day 2023-03-15] 2023-03-15: repo_hour merged from 24 files to 1 (2037332 rows, 8391 ms)
2026-11-07T17:11:29Z [load_day 2023-03-15] 2023-03-15: index committed in 10278 ms (24 + 1 + 24 files)
2026-11-07T17:11:29Z [load_day 2023-03-15] 2023-03-15: 4544934 events in 24 hours
2026-11-07T17:11:29Z [load_day 2023-03-15] attempt 1 succeeded