orcaLog in

Runs · run 1059

load_day 2023-05-05, attempt 1 succeeded

Host
caf251265124:337620
Started
2026-11-07T19:40:29Z
Ended
2026-11-07T19:43:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1059/load_day/2023-05-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:40:29Z [load_day 2023-05-05] attempt 1 started
2026-11-07T19:40:31Z [load_day 2023-05-05] 2023-05-05: 2 hours in flight, about 1200 MB
2026-11-07T19:40:45Z [load_day 2023-05-05] 2023-05-05 hour 0: 156562 events in 4 files, snapshot 509016062380580046 (task 11428 ms: download 4981 ms overlapping gunzip 685 ms, parse 3169 ms, sort 90 ms, write 6184 ms, index 495 ms: 7 candidates, 78779 repo-hours, 1063 releases; waiting 504 ms; commit 1640 ms)
2026-11-07T19:40:47Z [load_day 2023-05-05] 2023-05-05 hour 1: 182005 events in 4 files, snapshot 4961665179423369654 (task 13446 ms: download 7764 ms overlapping gunzip 850 ms, parse 3806 ms, sort 129 ms, write 7295 ms, index 566 ms: 7 candidates, 86102 repo-hours, 810 releases; waiting 503 ms; commit 1676 ms)
2026-11-07T19:40:59Z [load_day 2023-05-05] 2023-05-05 hour 2: 156426 events in 4 files, snapshot 8549585379769426636 (task 12827 ms: download 5528 ms overlapping gunzip 809 ms, parse 3418 ms, sort 89 ms, write 7001 ms, index 398 ms: 5 candidates, 65088 repo-hours, 721 releases; waiting 729 ms; commit 1811 ms)
2026-11-07T19:41:01Z [load_day 2023-05-05] 2023-05-05 hour 3: 139879 events in 3 files, snapshot 7115949434774766213 (task 9815 ms: download 4031 ms overlapping gunzip 594 ms, parse 2569 ms, sort 83 ms, write 5457 ms, index 356 ms: 8 candidates, 58730 repo-hours, 782 releases; waiting 521 ms; commit 1614 ms)
2026-11-07T19:41:10Z [load_day 2023-05-05] 2023-05-05 hour 4: 125919 events in 3 files, snapshot 7842510630476882440 (task 9448 ms: download 4095 ms overlapping gunzip 536 ms, parse 2396 ms, sort 70 ms, write 5070 ms, index 340 ms: 12 candidates, 52591 repo-hours, 609 releases; waiting 720 ms; commit 1720 ms)
2026-11-07T19:41:12Z [load_day 2023-05-05] 2023-05-05 hour 5: 143123 events in 3 files, snapshot 5637723181426150482 (task 10632 ms: download 4402 ms overlapping gunzip 654 ms, parse 2863 ms, sort 128 ms, write 5914 ms, index 393 ms: 4 candidates, 59483 repo-hours, 754 releases; waiting 404 ms; commit 1673 ms)
2026-11-07T19:41:26Z [load_day 2023-05-05] 2023-05-05 hour 6: 167049 events in 4 files, snapshot 7245318962695616167 (task 15308 ms: download 7966 ms overlapping gunzip 765 ms, parse 3395 ms, sort 95 ms, write 6916 ms, index 491 ms: 6 candidates, 76369 repo-hours, 877 releases; waiting 3349 ms; commit 1660 ms)
2026-11-07T19:41:27Z [load_day 2023-05-05] 2023-05-05 hour 7: 174722 events in 4 files, snapshot 6695054842816853706 (task 13873 ms: download 8016 ms overlapping gunzip 834 ms, parse 3713 ms, sort 101 ms, write 7881 ms, index 567 ms: 11 candidates, 77992 repo-hours, 959 releases; waiting 536 ms; commit 1521 ms)
2026-11-07T19:41:42Z [load_day 2023-05-05] 2023-05-05 hour 8: 192313 events in 4 files, snapshot 2982784801269287419 (task 15604 ms: download 8665 ms overlapping gunzip 918 ms, parse 4127 ms, sort 123 ms, write 8761 ms, index 592 ms: 21 candidates, 86286 repo-hours, 1065 releases; waiting 755 ms; commit 1704 ms)
2026-11-07T19:41:45Z [load_day 2023-05-05] 2023-05-05 hour 9: 191536 events in 4 files, snapshot 6866307108670481083 (task 16587 ms: download 9163 ms overlapping gunzip 945 ms, parse 4152 ms, sort 114 ms, write 9398 ms, index 533 ms: 27 candidates, 84186 repo-hours, 1326 releases; waiting 636 ms; commit 1708 ms)
2026-11-07T19:41:59Z [load_day 2023-05-05] 2023-05-05 hour 10: 181133 events in 4 files, snapshot 8676649371904866089 (task 15831 ms: download 9755 ms overlapping gunzip 872 ms, parse 3958 ms, sort 101 ms, write 8722 ms, index 523 ms: 15 candidates, 80239 repo-hours, 1178 releases; waiting 1274 ms; commit 1695 ms)
2026-11-07T19:42:01Z [load_day 2023-05-05] 2023-05-05 hour 11: 180319 events in 4 files, snapshot 3092981738414438490 (task 13922 ms: download 7889 ms overlapping gunzip 840 ms, parse 3696 ms, sort 103 ms, write 8098 ms, index 530 ms: 12 candidates, 78293 repo-hours, 1053 releases; waiting 354 ms; commit 1738 ms)
2026-11-07T19:42:15Z [load_day 2023-05-05] 2023-05-05 hour 12: 213777 events in 5 files, snapshot 3928305775085684263 (task 14893 ms: download 7686 ms overlapping gunzip 864 ms, parse 3866 ms, sort 128 ms, write 8880 ms, index 640 ms: 17 candidates, 105078 repo-hours, 1027 releases; waiting 206 ms; commit 1731 ms)
2026-11-07T19:42:17Z [load_day 2023-05-05] 2023-05-05 hour 13: 193275 events in 4 files, snapshot 4220949159158332662 (task 16152 ms: download 8654 ms overlapping gunzip 949 ms, parse 4205 ms, sort 128 ms, write 8984 ms, index 662 ms: 16 candidates, 99158 repo-hours, 875 releases; waiting 603 ms; commit 1705 ms)
2026-11-07T19:42:31Z [load_day 2023-05-05] 2023-05-05 hour 14: 183359 events in 4 files, snapshot 1650834508066495510 (task 15700 ms: download 8943 ms overlapping gunzip 915 ms, parse 4038 ms, sort 118 ms, write 9022 ms, index 602 ms: 13 candidates, 86744 repo-hours, 1025 releases; waiting 578 ms; commit 1682 ms)
2026-11-07T19:42:33Z [load_day 2023-05-05] 2023-05-05 hour 15: 165544 events in 4 files, snapshot 775069054650078951 (task 14776 ms: download 9018 ms overlapping gunzip 835 ms, parse 3567 ms, sort 103 ms, write 8192 ms, index 566 ms: 16 candidates, 81372 repo-hours, 1059 releases; waiting 1173 ms; commit 1680 ms)
2026-11-07T19:42:46Z [load_day 2023-05-05] 2023-05-05 hour 16: 165530 events in 4 files, snapshot 563979608638596963 (task 14345 ms: download 8534 ms overlapping gunzip 812 ms, parse 3596 ms, sort 100 ms, write 8105 ms, index 535 ms: 12 candidates, 80274 repo-hours, 921 releases; waiting 787 ms; commit 1760 ms)
2026-11-07T19:42:48Z [load_day 2023-05-05] 2023-05-05 hour 17: 164494 events in 4 files, snapshot 1899635821950771732 (task 13320 ms: download 5475 ms overlapping gunzip 778 ms, parse 3430 ms, sort 94 ms, write 7654 ms, index 532 ms: 6 candidates, 73909 repo-hours, 848 releases; waiting 516 ms; commit 1861 ms)
2026-11-07T19:43:00Z [load_day 2023-05-05] 2023-05-05 hour 18: 166774 events in 4 files, snapshot 8620632732733674030 (task 13375 ms: download 7815 ms overlapping gunzip 811 ms, parse 3558 ms, sort 102 ms, write 7539 ms, index 555 ms: 12 candidates, 76707 repo-hours, 990 releases; waiting 515 ms; commit 1894 ms)
2026-11-07T19:43:02Z [load_day 2023-05-05] 2023-05-05 hour 19: 160340 events in 4 files, snapshot 935118105249174243 (task 13252 ms: download 5775 ms overlapping gunzip 822 ms, parse 3611 ms, sort 98 ms, write 7444 ms, index 481 ms: 12 candidates, 71469 repo-hours, 877 releases; waiting 460 ms; commit 1769 ms)
2026-11-07T19:43:14Z [load_day 2023-05-05] 2023-05-05 hour 20: 162772 events in 4 files, snapshot 7803131752427455754 (task 12956 ms: download 5216 ms overlapping gunzip 749 ms, parse 3345 ms, sort 109 ms, write 7375 ms, index 512 ms: 7 candidates, 72554 repo-hours, 959 releases; waiting 534 ms; commit 2091 ms)
2026-11-07T19:43:16Z [load_day 2023-05-05] 2023-05-05 hour 21: 146852 events in 3 files, snapshot 6763169503073242560 (task 12165 ms: download 5429 ms overlapping gunzip 767 ms, parse 3269 ms, sort 135 ms, write 6854 ms, index 383 ms: 17 candidates, 59698 repo-hours, 919 releases; waiting 516 ms; commit 1749 ms)
2026-11-07T19:43:26Z [load_day 2023-05-05] 2023-05-05 hour 22: 134733 events in 3 files, snapshot 6932337339301107813 (task 11093 ms: download 5151 ms overlapping gunzip 694 ms, parse 2903 ms, sort 87 ms, write 6237 ms, index 349 ms: 9 candidates, 53576 repo-hours, 1134 releases; waiting 510 ms; commit 1824 ms)
2026-11-07T19:43:28Z [load_day 2023-05-05] 2023-05-05 hour 23: 119685 events in 3 files, snapshot 5568931415902498513 (task 9702 ms: download 4524 ms overlapping gunzip 580 ms, parse 2461 ms, sort 84 ms, write 5226 ms, index 321 ms: 10 candidates, 50451 repo-hours, 801 releases; waiting 671 ms; commit 1697 ms)
2026-11-07T19:43:35Z [load_day 2023-05-05] 2023-05-05: repo_hour merged from 24 files to 1 (1795128 rows, 7542 ms)
2026-11-07T19:43:37Z [load_day 2023-05-05] 2023-05-05: index committed in 9342 ms (24 + 1 + 24 files)
2026-11-07T19:43:37Z [load_day 2023-05-05] 2023-05-05: 3968121 events in 24 hours
2026-11-07T19:43:37Z [load_day 2023-05-05] attempt 1 succeeded