orcaLog in

Runs · run 984

load_day 2023-04-10, attempt 1 succeeded

Host
caf251265124:250956
Started
2026-11-07T18:24:56Z
Ended
2026-11-07T18:28:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/984/load_day/2023-04-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:24:56Z [load_day 2023-04-10] attempt 1 started
2026-11-07T18:24:58Z [load_day 2023-04-10] 2023-04-10: 2 hours in flight, about 1200 MB
2026-11-07T18:25:11Z [load_day 2023-04-10] 2023-04-10 hour 0: 134620 events in 3 files, snapshot 6286581973376174940 (task 10679 ms: download 3747 ms overlapping gunzip 538 ms, parse 2423 ms, sort 83 ms, write 4866 ms, index 458 ms: 7 candidates, 71009 repo-hours, 800 releases; waiting 2011 ms; commit 1650 ms)
2026-11-07T18:25:15Z [load_day 2023-04-10] 2023-04-10 hour 1: 170925 events in 4 files, snapshot 4455149053466345745 (task 14868 ms: download 7603 ms overlapping gunzip 913 ms, parse 3812 ms, sort 113 ms, write 7057 ms, index 550 ms: 4 candidates, 86125 repo-hours, 744 releases; waiting 2142 ms; commit 1529 ms)
2026-11-07T18:25:23Z [load_day 2023-04-10] 2023-04-10 hour 2: 144283 events in 3 files, snapshot 8649342454659591779 (task 10943 ms: download 4870 ms overlapping gunzip 708 ms, parse 2880 ms, sort 89 ms, write 6029 ms, index 406 ms: 5 candidates, 63175 repo-hours, 758 releases; waiting 530 ms; commit 1645 ms)
2026-11-07T18:25:28Z [load_day 2023-04-10] 2023-04-10 hour 3: 142255 events in 3 files, snapshot 4897112931452708286 (task 11222 ms: download 4998 ms overlapping gunzip 722 ms, parse 2958 ms, sort 89 ms, write 6158 ms, index 423 ms: 4 candidates, 60403 repo-hours, 879 releases; waiting 544 ms; commit 1687 ms)
2026-11-07T18:25:34Z [load_day 2023-04-10] 2023-04-10 hour 4: 127803 events in 3 files, snapshot 3145335702080665359 (task 9819 ms: download 4394 ms overlapping gunzip 622 ms, parse 2559 ms, sort 76 ms, write 5176 ms, index 336 ms: 2 candidates, 52647 repo-hours, 610 releases; waiting 683 ms; commit 1796 ms)
2026-11-07T18:25:41Z [load_day 2023-04-10] 2023-04-10 hour 5: 146687 events in 3 files, snapshot 2030252101865117008 (task 12534 ms: download 5950 ms overlapping gunzip 787 ms, parse 3262 ms, sort 106 ms, write 6507 ms, index 397 ms: 4 candidates, 59631 repo-hours, 715 releases; waiting 1151 ms; commit 1585 ms)
2026-11-07T18:25:48Z [load_day 2023-04-10] 2023-04-10 hour 6: 162008 events in 4 files, snapshot 109536233331052212 (task 13111 ms: download 6180 ms overlapping gunzip 773 ms, parse 3294 ms, sort 95 ms, write 6812 ms, index 463 ms: 5 candidates, 72802 repo-hours, 870 releases; waiting 1431 ms; commit 1676 ms)
2026-11-07T18:25:55Z [load_day 2023-04-10] 2023-04-10 hour 7: 166621 events in 4 files, snapshot 4100891779501082046 (task 12906 ms: download 5741 ms overlapping gunzip 786 ms, parse 3360 ms, sort 106 ms, write 7067 ms, index 450 ms: 2 candidates, 71598 repo-hours, 819 releases; waiting 801 ms; commit 1562 ms)
2026-11-07T18:26:04Z [load_day 2023-04-10] 2023-04-10 hour 8: 177462 events in 4 files, snapshot 5758935026262618677 (task 15100 ms: download 9370 ms overlapping gunzip 877 ms, parse 3654 ms, sort 118 ms, write 7602 ms, index 550 ms: 2 candidates, 78049 repo-hours, 816 releases; waiting 1973 ms; commit 1738 ms)
2026-11-07T18:26:10Z [load_day 2023-04-10] 2023-04-10 hour 9: 176207 events in 4 files, snapshot 7635396480332108857 (task 14129 ms: download 8129 ms overlapping gunzip 873 ms, parse 3700 ms, sort 112 ms, write 8154 ms, index 516 ms: 6 candidates, 76445 repo-hours, 998 releases; waiting 523 ms; commit 1679 ms)
2026-11-07T18:26:18Z [load_day 2023-04-10] 2023-04-10 hour 10: 173420 events in 4 files, snapshot 5117801687703796651 (task 13591 ms: download 8010 ms overlapping gunzip 851 ms, parse 3640 ms, sort 118 ms, write 7584 ms, index 476 ms: 2 candidates, 73525 repo-hours, 799 releases; waiting 652 ms; commit 1658 ms)
2026-11-07T18:26:24Z [load_day 2023-04-10] 2023-04-10 hour 11: 181856 events in 4 files, snapshot 3703530185958498747 (task 13903 ms: download 8156 ms overlapping gunzip 850 ms, parse 3609 ms, sort 111 ms, write 7648 ms, index 515 ms: 2 candidates, 80754 repo-hours, 980 releases; waiting 862 ms; commit 1599 ms)
2026-11-07T18:26:34Z [load_day 2023-04-10] 2023-04-10 hour 12: 229948 events in 5 files, snapshot 5220538237509700353 (task 15326 ms: download 7850 ms overlapping gunzip 912 ms, parse 4049 ms, sort 123 ms, write 8689 ms, index 664 ms: 8 candidates, 106293 repo-hours, 1366 releases; waiting 536 ms; commit 1546 ms)
2026-11-07T18:26:41Z [load_day 2023-04-10] 2023-04-10 hour 13: 203650 events in 5 files, snapshot 5139030358676796384 (task 15525 ms: download 8310 ms overlapping gunzip 966 ms, parse 4105 ms, sort 135 ms, write 8885 ms, index 610 ms: 10 candidates, 100063 repo-hours, 891 releases; waiting 553 ms; commit 1667 ms)
2026-11-07T18:26:52Z [load_day 2023-04-10] 2023-04-10 hour 14: 198277 events in 4 files, snapshot 922969731794718395 (task 16487 ms: download 9417 ms overlapping gunzip 1016 ms, parse 4368 ms, sort 145 ms, write 9278 ms, index 607 ms: 3 candidates, 88422 repo-hours, 1044 releases; waiting 756 ms; commit 1664 ms)
2026-11-07T18:26:56Z [load_day 2023-04-10] 2023-04-10 hour 15: 177725 events in 4 files, snapshot 8340343101256485245 (task 14207 ms: download 8133 ms overlapping gunzip 860 ms, parse 3660 ms, sort 100 ms, write 8393 ms, index 566 ms: 6 candidates, 81537 repo-hours, 993 releases; waiting 322 ms; commit 1573 ms)
2026-11-07T18:27:07Z [load_day 2023-04-10] 2023-04-10 hour 16: 183526 events in 4 files, snapshot 4726885811603091347 (task 14838 ms: download 8503 ms overlapping gunzip 888 ms, parse 3805 ms, sort 111 ms, write 8649 ms, index 546 ms: 7 candidates, 84874 repo-hours, 896 releases; waiting 555 ms; commit 1792 ms)
2026-11-07T18:27:12Z [load_day 2023-04-10] 2023-04-10 hour 17: 177333 events in 4 files, snapshot 4867812824725852398 (task 14906 ms: download 8696 ms overlapping gunzip 897 ms, parse 3913 ms, sort 112 ms, write 8570 ms, index 553 ms: 9 candidates, 79153 repo-hours, 882 releases; waiting 590 ms; commit 2039 ms)
2026-11-07T18:27:24Z [load_day 2023-04-10] 2023-04-10 hour 18: 189914 events in 4 files, snapshot 7436626116567917261 (task 16020 ms: download 9382 ms overlapping gunzip 948 ms, parse 4053 ms, sort 108 ms, write 9584 ms, index 580 ms: 6 candidates, 87772 repo-hours, 982 releases; waiting 514 ms; commit 1427 ms)
2026-11-07T18:27:28Z [load_day 2023-04-10] 2023-04-10 hour 19: 180953 events in 4 files, snapshot 3682888081266431680 (task 14924 ms: download 8907 ms overlapping gunzip 929 ms, parse 3954 ms, sort 120 ms, write 8569 ms, index 520 ms: 6 candidates, 75828 repo-hours, 929 releases; waiting 613 ms; commit 1784 ms)
2026-11-07T18:27:39Z [load_day 2023-04-10] 2023-04-10 hour 20: 164822 events in 4 files, snapshot 1527468387618104591 (task 14018 ms: download 8607 ms overlapping gunzip 879 ms, parse 3636 ms, sort 111 ms, write 7923 ms, index 506 ms: 10 candidates, 74733 repo-hours, 835 releases; waiting 684 ms; commit 1874 ms)
2026-11-07T18:27:41Z [load_day 2023-04-10] 2023-04-10 hour 21: 150564 events in 4 files, snapshot 5547701454821723129 (task 12751 ms: download 5777 ms overlapping gunzip 808 ms, parse 3395 ms, sort 106 ms, write 7165 ms, index 475 ms: 4 candidates, 69474 repo-hours, 856 releases; waiting 525 ms; commit 1734 ms)
2026-11-07T18:27:53Z [load_day 2023-04-10] 2023-04-10 hour 22: 143738 events in 3 files, snapshot 1601712530439302063 (task 13755 ms: download 6965 ms overlapping gunzip 890 ms, parse 3580 ms, sort 93 ms, write 7061 ms, index 403 ms: 11 candidates, 60248 repo-hours, 786 releases; waiting 1362 ms; commit 1570 ms)
2026-11-07T18:27:55Z [load_day 2023-04-10] 2023-04-10 hour 23: 136513 events in 3 files, snapshot 1512578409718864605 (task 11155 ms: download 5169 ms overlapping gunzip 703 ms, parse 2951 ms, sort 75 ms, write 6157 ms, index 369 ms: 3 candidates, 58430 repo-hours, 663 releases; waiting 583 ms; commit 1668 ms)
2026-11-07T18:28:04Z [load_day 2023-04-10] 2023-04-10: repo_hour merged from 24 files to 1 (1812990 rows, 8539 ms)
2026-11-07T18:28:07Z [load_day 2023-04-10] 2023-04-10: index committed in 12279 ms (24 + 1 + 24 files)
2026-11-07T18:28:07Z [load_day 2023-04-10] 2023-04-10: 4041110 events in 24 hours
2026-11-07T18:28:07Z [load_day 2023-04-10] attempt 1 succeeded