orcaLog in

Runs · run 987

load_day 2023-04-11, attempt 1 succeeded

Host
caf251265124:254782
Started
2026-11-07T18:28:08Z
Ended
2026-11-07T18:31:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/987/load_day/2023-04-11/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:28:08Z [load_day 2023-04-11] attempt 1 started
2026-11-07T18:28:10Z [load_day 2023-04-11] 2023-04-11: 2 hours in flight, about 1200 MB
2026-11-07T18:28:25Z [load_day 2023-04-11] 2023-04-11 hour 0: 161205 events in 4 files, snapshot 6650648410894969951 (task 12135 ms: download 5339 ms overlapping gunzip 711 ms, parse 3252 ms, sort 99 ms, write 6733 ms, index 517 ms: 5 candidates, 81623 repo-hours, 892 releases; waiting 518 ms; commit 1651 ms)
2026-11-07T18:28:26Z [load_day 2023-04-11] 2023-04-11 hour 1: 177824 events in 4 files, snapshot 6912364779708843491 (task 12341 ms: download 5046 ms overlapping gunzip 719 ms, parse 3295 ms, sort 110 ms, write 6686 ms, index 633 ms: 6 candidates, 96919 repo-hours, 795 releases; waiting 571 ms; commit 1542 ms)
2026-11-07T18:28:36Z [load_day 2023-04-11] 2023-04-11 hour 2: 159293 events in 4 files, snapshot 7028047352992278120 (task 11277 ms: download 4776 ms overlapping gunzip 649 ms, parse 2829 ms, sort 104 ms, write 6271 ms, index 487 ms: 4 candidates, 78162 repo-hours, 797 releases; waiting 674 ms; commit 1470 ms)
2026-11-07T18:28:38Z [load_day 2023-04-11] 2023-04-11 hour 3: 144642 events in 3 files, snapshot 922378028585589347 (task 10803 ms: download 4683 ms overlapping gunzip 614 ms, parse 2710 ms, sort 84 ms, write 5862 ms, index 411 ms: 5 candidates, 65252 repo-hours, 912 releases; waiting 779 ms; commit 1641 ms)
2026-11-07T18:28:47Z [load_day 2023-04-11] 2023-04-11 hour 4: 134291 events in 3 files, snapshot 1511175082206689514 (task 10331 ms: download 4696 ms overlapping gunzip 580 ms, parse 2516 ms, sort 81 ms, write 5926 ms, index 371 ms: 5 candidates, 57747 repo-hours, 707 releases; waiting 552 ms; commit 1518 ms)
2026-11-07T18:28:49Z [load_day 2023-04-11] 2023-04-11 hour 5: 60037 events in 2 files, snapshot 6705954552141955623 (task 5106 ms: download 1737 ms overlapping gunzip 270 ms, parse 1177 ms, sort 32 ms, write 2456 ms, index 217 ms: 1 candidates, 31040 repo-hours, 295 releases; waiting 610 ms; commit 1530 ms)
2026-11-07T18:28:54Z [load_day 2023-04-11] 2023-04-11 hour 6: 67850 events in 2 files, snapshot 3651064169645693233 (task 5896 ms: download 1681 ms overlapping gunzip 316 ms, parse 1368 ms, sort 35 ms, write 2965 ms, index 265 ms: 4 candidates, 36703 repo-hours, 330 releases; waiting 678 ms; commit 1594 ms)
2026-11-07T18:29:04Z [load_day 2023-04-11] 2023-04-11 hour 7: 164479 events in 4 files, snapshot 1415491209069089929 (task 14035 ms: download 8235 ms overlapping gunzip 828 ms, parse 3651 ms, sort 109 ms, write 7993 ms, index 514 ms: 4 candidates, 76279 repo-hours, 877 releases; waiting 560 ms; commit 1698 ms)
2026-11-07T18:29:10Z [load_day 2023-04-11] 2023-04-11 hour 8: 177891 events in 4 files, snapshot 2183863822974978163 (task 14835 ms: download 8486 ms overlapping gunzip 897 ms, parse 3776 ms, sort 104 ms, write 8677 ms, index 557 ms: 8 candidates, 83063 repo-hours, 1055 releases; waiting 517 ms; commit 1569 ms)
2026-11-07T18:29:19Z [load_day 2023-04-11] 2023-04-11 hour 9: 181951 events in 4 files, snapshot 7887365885611012514 (task 14807 ms: download 8463 ms overlapping gunzip 861 ms, parse 3736 ms, sort 129 ms, write 8683 ms, index 593 ms: 3 candidates, 88012 repo-hours, 1042 releases; waiting 513 ms; commit 1449 ms)
2026-11-07T18:29:25Z [load_day 2023-04-11] 2023-04-11 hour 10: 172073 events in 4 files, snapshot 7193989834148638905 (task 14562 ms: download 8617 ms overlapping gunzip 859 ms, parse 3729 ms, sort 111 ms, write 8177 ms, index 584 ms: 4 candidates, 78025 repo-hours, 1028 releases; waiting 664 ms; commit 1711 ms)
2026-11-07T18:29:35Z [load_day 2023-04-11] 2023-04-11 hour 11: 179429 events in 4 files, snapshot 3806852193626444405 (task 14979 ms: download 8615 ms overlapping gunzip 855 ms, parse 3664 ms, sort 130 ms, write 8595 ms, index 574 ms: 7 candidates, 87752 repo-hours, 939 releases; waiting 808 ms; commit 1538 ms)
2026-11-07T18:29:41Z [load_day 2023-04-11] 2023-04-11 hour 12: 213017 events in 5 files, snapshot 6858406830289442810 (task 15937 ms: download 8226 ms overlapping gunzip 918 ms, parse 4028 ms, sort 123 ms, write 9309 ms, index 726 ms: 6 candidates, 108345 repo-hours, 938 releases; waiting 521 ms; commit 1424 ms)
2026-11-07T18:29:51Z [load_day 2023-04-11] 2023-04-11 hour 13: 180481 events in 4 files, snapshot 7221107188655755419 (task 15057 ms: download 8306 ms overlapping gunzip 856 ms, parse 3798 ms, sort 106 ms, write 8700 ms, index 636 ms: 6 candidates, 96409 repo-hours, 915 releases; waiting 596 ms; commit 1613 ms)
2026-11-07T18:29:56Z [load_day 2023-04-11] 2023-04-11 hour 14: 161744 events in 4 files, snapshot 8632128740681087130 (task 14286 ms: download 6228 ms overlapping gunzip 799 ms, parse 3438 ms, sort 96 ms, write 8001 ms, index 615 ms: 5 candidates, 88640 repo-hours, 888 releases; waiting 912 ms; commit 1673 ms)
2026-11-07T18:30:08Z [load_day 2023-04-11] 2023-04-11 hour 15: 195651 events in 4 files, snapshot 8257636099053719884 (task 16703 ms: download 9093 ms overlapping gunzip 972 ms, parse 4367 ms, sort 146 ms, write 9599 ms, index 701 ms: 1 candidates, 100323 repo-hours, 1268 releases; waiting 567 ms; commit 1521 ms)
2026-11-07T18:30:15Z [load_day 2023-04-11] 2023-04-11 hour 16: 178660 events in 4 files, snapshot 2136665221168139546 (task 17691 ms: download 11333 ms overlapping gunzip 930 ms, parse 4032 ms, sort 126 ms, write 8806 ms, index 586 ms: 2 candidates, 87777 repo-hours, 940 releases; waiting 2940 ms; commit 1734 ms)
2026-11-07T18:30:22Z [load_day 2023-04-11] 2023-04-11 hour 17: 144373 events in 3 files, snapshot 6738334084739985373 (task 13158 ms: download 6046 ms overlapping gunzip 742 ms, parse 3218 ms, sort 105 ms, write 7196 ms, index 479 ms: 4 candidates, 71017 repo-hours, 771 releases; waiting 1148 ms; commit 1610 ms)
2026-11-07T18:30:29Z [load_day 2023-04-11] 2023-04-11 hour 18: 160267 events in 4 files, snapshot 4455594142078191932 (task 13364 ms: download 5373 ms overlapping gunzip 755 ms, parse 3367 ms, sort 107 ms, write 7660 ms, index 551 ms: 3 candidates, 79070 repo-hours, 922 releases; waiting 582 ms; commit 1872 ms)
2026-11-07T18:30:36Z [load_day 2023-04-11] 2023-04-11 hour 19: 153855 events in 4 files, snapshot 5917230764590444490 (task 13057 ms: download 5960 ms overlapping gunzip 745 ms, parse 3285 ms, sort 85 ms, write 7140 ms, index 480 ms: 3 candidates, 74028 repo-hours, 800 releases; waiting 1087 ms; commit 1475 ms)
2026-11-07T18:30:43Z [load_day 2023-04-11] 2023-04-11 hour 20: 151270 events in 4 files, snapshot 3672450397461778121 (task 13049 ms: download 5540 ms overlapping gunzip 769 ms, parse 3308 ms, sort 97 ms, write 7538 ms, index 474 ms: 2 candidates, 68716 repo-hours, 763 releases; waiting 537 ms; commit 1540 ms)
2026-11-07T18:30:51Z [load_day 2023-04-11] 2023-04-11 hour 21: 162122 events in 4 files, snapshot 208745576715025474 (task 14020 ms: download 6310 ms overlapping gunzip 791 ms, parse 3368 ms, sort 118 ms, write 7658 ms, index 509 ms: 5 candidates, 76870 repo-hours, 909 releases; waiting 1308 ms; commit 1741 ms)
2026-11-07T18:30:57Z [load_day 2023-04-11] 2023-04-11 hour 22: 156104 events in 4 files, snapshot 1988629220808393745 (task 13820 ms: download 8717 ms overlapping gunzip 937 ms, parse 3679 ms, sort 102 ms, write 7707 ms, index 410 ms: 5 candidates, 63464 repo-hours, 806 releases; waiting 523 ms; commit 1496 ms)
2026-11-07T18:31:24Z [load_day 2023-04-11] 2023-04-11 hour 23: 211539 events in 5 files, snapshot 3101647036251828573 (task 32233 ms: download 25529 ms overlapping gunzip 2182 ms, parse 8581 ms, sort 124 ms, write 14066 ms, index 509 ms: 2 candidates, 77025 repo-hours, 652 releases; waiting 6408 ms; commit 1585 ms)
2026-11-07T18:31:32Z [load_day 2023-04-11] 2023-04-11: repo_hour merged from 24 files to 1 (1852261 rows, 7709 ms)
2026-11-07T18:31:34Z [load_day 2023-04-11] 2023-04-11: index committed in 9575 ms (24 + 1 + 24 files)
2026-11-07T18:31:34Z [load_day 2023-04-11] 2023-04-11: 3850048 events in 24 hours
2026-11-07T18:31:34Z [load_day 2023-04-11] attempt 1 succeeded