orcaLog in

Runs · run 1144

load_day 2023-06-02, attempt 1 succeeded

Host
caf251265124:427166
Started
2026-11-07T20:59:49Z
Ended
2026-11-07T21:02:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1144/load_day/2023-06-02/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:59:49Z [load_day 2023-06-02] attempt 1 started
2026-11-07T20:59:51Z [load_day 2023-06-02] 2023-06-02: 2 hours in flight, about 1200 MB
2026-11-07T21:00:06Z [load_day 2023-06-02] 2023-06-02 hour 0: 145905 events in 3 files, snapshot 7271666483349202106 (task 12233 ms: download 5729 ms overlapping gunzip 704 ms, parse 3201 ms, sort 107 ms, write 6323 ms, index 542 ms: 5 candidates, 76332 repo-hours, 796 releases; waiting 1004 ms; commit 1903 ms)
2026-11-07T21:00:08Z [load_day 2023-06-02] 2023-06-02 hour 1: 158109 events in 4 files, snapshot 1330238289509790040 (task 11546 ms: download 4250 ms overlapping gunzip 649 ms, parse 3023 ms, sort 95 ms, write 6316 ms, index 602 ms: 7 candidates, 87578 repo-hours, 943 releases; waiting 246 ms; commit 1791 ms)
2026-11-07T21:00:18Z [load_day 2023-06-02] 2023-06-02 hour 2: 139150 events in 3 files, snapshot 1266660897723965381 (task 10379 ms: download 4124 ms overlapping gunzip 613 ms, parse 2704 ms, sort 94 ms, write 5855 ms, index 449 ms: 6 candidates, 69468 repo-hours, 697 releases; waiting 357 ms; commit 2104 ms)
2026-11-07T21:00:19Z [load_day 2023-06-02] 2023-06-02 hour 3: 128188 events in 3 files, snapshot 6029066055812950018 (task 9626 ms: download 3959 ms overlapping gunzip 557 ms, parse 2488 ms, sort 76 ms, write 5245 ms, index 388 ms: 4 candidates, 57052 repo-hours, 913 releases; waiting 524 ms; commit 1602 ms)
2026-11-07T21:00:28Z [load_day 2023-06-02] 2023-06-02 hour 4: 119480 events in 3 files, snapshot 7359035882275489750 (task 8915 ms: download 2102 ms overlapping gunzip 522 ms, parse 2299 ms, sort 67 ms, write 4805 ms, index 347 ms: 6 candidates, 52108 repo-hours, 659 releases; waiting 653 ms; commit 1714 ms)
2026-11-07T21:00:31Z [load_day 2023-06-02] 2023-06-02 hour 5: 130941 events in 3 files, snapshot 8057659210256750227 (task 10144 ms: download 4370 ms overlapping gunzip 623 ms, parse 2780 ms, sort 81 ms, write 5479 ms, index 376 ms: 5 candidates, 58407 repo-hours, 773 releases; waiting 508 ms; commit 1787 ms)
2026-11-07T21:00:41Z [load_day 2023-06-02] 2023-06-02 hour 6: 157777 events in 4 files, snapshot 9080050602692992941 (task 11980 ms: download 4721 ms overlapping gunzip 727 ms, parse 3275 ms, sort 107 ms, write 6756 ms, index 482 ms: 17 candidates, 73744 repo-hours, 898 releases; waiting 251 ms; commit 1854 ms)
2026-11-07T21:00:46Z [load_day 2023-06-02] 2023-06-02 hour 7: 162848 events in 4 files, snapshot 6368198197935668949 (task 13493 ms: download 5665 ms overlapping gunzip 796 ms, parse 3448 ms, sort 89 ms, write 7838 ms, index 471 ms: 12 candidates, 73318 repo-hours, 829 releases; waiting 510 ms; commit 2208 ms)
2026-11-07T21:00:56Z [load_day 2023-06-02] 2023-06-02 hour 8: 177551 events in 4 files, snapshot 6723864293058630860 (task 14661 ms: download 8423 ms overlapping gunzip 879 ms, parse 3860 ms, sort 108 ms, write 8454 ms, index 536 ms: 11 candidates, 81138 repo-hours, 991 releases; waiting 563 ms; commit 1696 ms)
2026-11-07T21:01:01Z [load_day 2023-06-02] 2023-06-02 hour 9: 178770 events in 4 files, snapshot 7178465459317332030 (task 14657 ms: download 8288 ms overlapping gunzip 918 ms, parse 4006 ms, sort 114 ms, write 8633 ms, index 533 ms: 3 candidates, 80715 repo-hours, 1186 releases; waiting 205 ms; commit 1927 ms)
2026-11-07T21:01:11Z [load_day 2023-06-02] 2023-06-02 hour 10: 169437 events in 4 files, snapshot 6226572524512393109 (task 14006 ms: download 8164 ms overlapping gunzip 832 ms, parse 3662 ms, sort 105 ms, write 7889 ms, index 498 ms: 5 candidates, 75495 repo-hours, 977 releases; waiting 679 ms; commit 1660 ms)
2026-11-07T21:01:16Z [load_day 2023-06-02] 2023-06-02 hour 11: 171326 events in 4 files, snapshot 7234980696350782295 (task 14209 ms: download 8383 ms overlapping gunzip 901 ms, parse 3893 ms, sort 109 ms, write 7982 ms, index 512 ms: 13 candidates, 73208 repo-hours, 975 releases; waiting 530 ms; commit 1897 ms)
2026-11-07T21:01:27Z [load_day 2023-06-02] 2023-06-02 hour 12: 205369 events in 5 files, snapshot 8615229148040066928 (task 15769 ms: download 8654 ms overlapping gunzip 912 ms, parse 4107 ms, sort 128 ms, write 8895 ms, index 650 ms: 6 candidates, 101959 repo-hours, 1138 releases; waiting 808 ms; commit 1593 ms)
2026-11-07T21:01:34Z [load_day 2023-06-02] 2023-06-02 hour 13: 191694 events in 4 files, snapshot 1116985063805442264 (task 17031 ms: download 9492 ms overlapping gunzip 955 ms, parse 4234 ms, sort 109 ms, write 9438 ms, index 628 ms: 11 candidates, 97156 repo-hours, 1020 releases; waiting 1422 ms; commit 1775 ms)
2026-11-07T21:01:45Z [load_day 2023-06-02] 2023-06-02 hour 14: 180885 events in 4 files, snapshot 5621190644247079682 (task 16161 ms: download 9501 ms overlapping gunzip 944 ms, parse 4197 ms, sort 112 ms, write 9307 ms, index 574 ms: 8 candidates, 85903 repo-hours, 1093 releases; waiting 690 ms; commit 1801 ms)
2026-11-07T21:01:50Z [load_day 2023-06-02] 2023-06-02 hour 15: 164260 events in 4 files, snapshot 2311118102331141418 (task 14327 ms: download 8484 ms overlapping gunzip 859 ms, parse 3752 ms, sort 109 ms, write 8218 ms, index 541 ms: 3 candidates, 78998 repo-hours, 1022 releases; waiting 566 ms; commit 1907 ms)
2026-11-07T21:01:59Z [load_day 2023-06-02] 2023-06-02 hour 16: 160231 events in 4 files, snapshot 6722176681047775298 (task 13591 ms: download 5681 ms overlapping gunzip 792 ms, parse 3488 ms, sort 96 ms, write 7899 ms, index 500 ms: 4 candidates, 78204 repo-hours, 859 releases; waiting 520 ms; commit 1832 ms)
2026-11-07T21:02:05Z [load_day 2023-06-02] 2023-06-02 hour 17: 170427 events in 4 files, snapshot 918403478675474220 (task 14532 ms: download 8470 ms overlapping gunzip 860 ms, parse 3797 ms, sort 98 ms, write 8522 ms, index 624 ms: 5 candidates, 75994 repo-hours, 940 releases; waiting 373 ms; commit 1728 ms)
2026-11-07T21:02:16Z [load_day 2023-06-02] 2023-06-02 hour 18: 172813 events in 4 files, snapshot 6052406995478805175 (task 16533 ms: download 10608 ms overlapping gunzip 903 ms, parse 3993 ms, sort 112 ms, write 8035 ms, index 507 ms: 8 candidates, 77021 repo-hours, 939 releases; waiting 2669 ms; commit 1686 ms)
2026-11-07T21:02:19Z [load_day 2023-06-02] 2023-06-02 hour 19: 165955 events in 4 files, snapshot 8364267759933335066 (task 13192 ms: download 5660 ms overlapping gunzip 819 ms, parse 3577 ms, sort 117 ms, write 7464 ms, index 481 ms: 3 candidates, 76337 repo-hours, 919 releases; waiting 511 ms; commit 1955 ms)
2026-11-07T21:02:30Z [load_day 2023-06-02] 2023-06-02 hour 20: 156804 events in 4 files, snapshot 5810850071878564067 (task 13327 ms: download 5708 ms overlapping gunzip 821 ms, parse 3525 ms, sort 99 ms, write 7604 ms, index 443 ms: 8 candidates, 68219 repo-hours, 845 releases; waiting 576 ms; commit 1711 ms)
2026-11-07T21:02:32Z [load_day 2023-06-02] 2023-06-02 hour 21: 137589 events in 3 files, snapshot 439675191622107763 (task 12043 ms: download 5483 ms overlapping gunzip 686 ms, parse 3030 ms, sort 85 ms, write 6420 ms, index 413 ms: 6 candidates, 58189 repo-hours, 953 releases; waiting 992 ms; commit 2115 ms)
2026-11-07T21:02:41Z [load_day 2023-06-02] 2023-06-02 hour 22: 120376 events in 3 files, snapshot 6221652550326982594 (task 9647 ms: download 4353 ms overlapping gunzip 595 ms, parse 2566 ms, sort 66 ms, write 5441 ms, index 329 ms: 3 candidates, 51022 repo-hours, 797 releases; waiting 367 ms; commit 1781 ms)
2026-11-07T21:02:43Z [load_day 2023-06-02] 2023-06-02 hour 23: 104965 events in 3 files, snapshot 6301874895044801529 (task 8419 ms: download 2527 ms overlapping gunzip 502 ms, parse 2262 ms, sort 64 ms, write 4459 ms, index 323 ms: 3 candidates, 46137 repo-hours, 628 releases; waiting 509 ms; commit 1707 ms)
2026-11-07T21:02:50Z [load_day 2023-06-02] 2023-06-02: repo_hour merged from 24 files to 1 (1753702 rows, 7284 ms)
2026-11-07T21:02:52Z [load_day 2023-06-02] 2023-06-02: index committed in 9071 ms (24 + 1 + 24 files)
2026-11-07T21:02:52Z [load_day 2023-06-02] 2023-06-02: 3770850 events in 24 hours
2026-11-07T21:02:52Z [load_day 2023-06-02] attempt 1 succeeded