orcaLog in

Runs · run 1134

load_day 2023-05-30, attempt 1 succeeded

Host
caf251265124:415940
Started
2026-11-07T20:50:23Z
Ended
2026-11-07T20:53:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1134/load_day/2023-05-30/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:50:23Z [load_day 2023-05-30] attempt 1 started
2026-11-07T20:50:25Z [load_day 2023-05-30] 2023-05-30: 2 hours in flight, about 1200 MB
2026-11-07T20:50:38Z [load_day 2023-05-30] 2023-05-30 hour 0: 141691 events in 3 files, snapshot 8720551770094821559 (task 10071 ms: download 4521 ms overlapping gunzip 596 ms, parse 2733 ms, sort 82 ms, write 5210 ms, index 494 ms: 11 candidates, 74560 repo-hours, 782 releases; waiting 594 ms; commit 1824 ms)
2026-11-07T20:50:40Z [load_day 2023-05-30] 2023-05-30 hour 1: 148411 events in 3 files, snapshot 5252460005139968064 (task 9966 ms: download 3929 ms overlapping gunzip 560 ms, parse 2555 ms, sort 86 ms, write 5372 ms, index 567 ms: 5 candidates, 84107 repo-hours, 696 releases; waiting 506 ms; commit 1748 ms)
2026-11-07T20:50:48Z [load_day 2023-05-30] 2023-05-30 hour 2: 132845 events in 3 files, snapshot 1640398231335183997 (task 9676 ms: download 4184 ms overlapping gunzip 607 ms, parse 2654 ms, sort 68 ms, write 5058 ms, index 464 ms: 8 candidates, 67231 repo-hours, 727 releases; waiting 515 ms; commit 1722 ms)
2026-11-07T20:50:50Z [load_day 2023-05-30] 2023-05-30 hour 3: 125713 events in 3 files, snapshot 2726762282191654364 (task 9172 ms: download 4088 ms overlapping gunzip 574 ms, parse 2499 ms, sort 78 ms, write 4886 ms, index 366 ms: 1 candidates, 57136 repo-hours, 822 releases; waiting 497 ms; commit 1755 ms)
2026-11-07T20:50:57Z [load_day 2023-05-30] 2023-05-30 hour 4: 118277 events in 3 files, snapshot 1077582733004096912 (task 8499 ms: download 1902 ms overlapping gunzip 498 ms, parse 2182 ms, sort 78 ms, write 4615 ms, index 352 ms: 4 candidates, 53159 repo-hours, 565 releases; waiting 521 ms; commit 1689 ms)
2026-11-07T20:51:01Z [load_day 2023-05-30] 2023-05-30 hour 5: 137498 events in 3 files, snapshot 7262387057576250565 (task 10276 ms: download 4121 ms overlapping gunzip 626 ms, parse 2735 ms, sort 91 ms, write 5931 ms, index 423 ms: 9 candidates, 60742 repo-hours, 695 releases; waiting 195 ms; commit 1701 ms)
2026-11-07T20:51:10Z [load_day 2023-05-30] 2023-05-30 hour 6: 163050 events in 4 files, snapshot 3606075875529125990 (task 12198 ms: download 4860 ms overlapping gunzip 738 ms, parse 3233 ms, sort 97 ms, write 7006 ms, index 505 ms: 5 candidates, 76748 repo-hours, 875 releases; waiting 296 ms; commit 1593 ms)
2026-11-07T20:51:15Z [load_day 2023-05-30] 2023-05-30 hour 7: 151984 events in 4 files, snapshot 5501866001093357837 (task 12749 ms: download 5407 ms overlapping gunzip 749 ms, parse 3354 ms, sort 89 ms, write 7185 ms, index 504 ms: 7 candidates, 72704 repo-hours, 836 releases; waiting 567 ms; commit 1662 ms)
2026-11-07T20:51:26Z [load_day 2023-05-30] 2023-05-30 hour 8: 164877 events in 4 files, snapshot 6710738681867542323 (task 14565 ms: download 8842 ms overlapping gunzip 843 ms, parse 3622 ms, sort 99 ms, write 8378 ms, index 514 ms: 7 candidates, 80949 repo-hours, 980 releases; waiting 786 ms; commit 1743 ms)
2026-11-07T20:51:30Z [load_day 2023-05-30] 2023-05-30 hour 9: 167328 events in 4 files, snapshot 6665327025966479441 (task 14485 ms: download 8433 ms overlapping gunzip 882 ms, parse 3942 ms, sort 108 ms, write 8174 ms, index 565 ms: 8 candidates, 78844 repo-hours, 1005 releases; waiting 514 ms; commit 2176 ms)
2026-11-07T20:51:41Z [load_day 2023-05-30] 2023-05-30 hour 10: 164622 events in 4 files, snapshot 4489569229133594545 (task 13743 ms: download 8138 ms overlapping gunzip 824 ms, parse 3663 ms, sort 104 ms, write 7824 ms, index 517 ms: 5 candidates, 77323 repo-hours, 918 releases; waiting 518 ms; commit 1785 ms)
2026-11-07T20:51:45Z [load_day 2023-05-30] 2023-05-30 hour 11: 168074 events in 4 files, snapshot 5699779320183923250 (task 14010 ms: download 8108 ms overlapping gunzip 813 ms, parse 3636 ms, sort 99 ms, write 8094 ms, index 536 ms: 5 candidates, 77531 repo-hours, 932 releases; waiting 526 ms; commit 1646 ms)
2026-11-07T20:51:56Z [load_day 2023-05-30] 2023-05-30 hour 12: 199638 events in 4 files, snapshot 8524284504886179265 (task 15313 ms: download 8397 ms overlapping gunzip 872 ms, parse 4013 ms, sort 121 ms, write 8656 ms, index 656 ms: 6 candidates, 104336 repo-hours, 958 releases; waiting 616 ms; commit 1795 ms)
2026-11-07T20:52:01Z [load_day 2023-05-30] 2023-05-30 hour 13: 184176 events in 4 files, snapshot 5779328480320002082 (task 14814 ms: download 7906 ms overlapping gunzip 855 ms, parse 3794 ms, sort 103 ms, write 8772 ms, index 678 ms: 8 candidates, 96875 repo-hours, 1059 releases; waiting 294 ms; commit 1595 ms)
2026-11-07T20:52:13Z [load_day 2023-05-30] 2023-05-30 hour 14: 179412 events in 4 files, snapshot 7427088570611888036 (task 15597 ms: download 9146 ms overlapping gunzip 951 ms, parse 4074 ms, sort 113 ms, write 9009 ms, index 583 ms: 6 candidates, 88272 repo-hours, 1134 releases; waiting 564 ms; commit 1684 ms)
2026-11-07T20:52:16Z [load_day 2023-05-30] 2023-05-30 hour 15: 167763 events in 4 files, snapshot 6932256911937104918 (task 14364 ms: download 8383 ms overlapping gunzip 851 ms, parse 3719 ms, sort 101 ms, write 8304 ms, index 540 ms: 3 candidates, 84246 repo-hours, 1128 releases; waiting 537 ms; commit 1993 ms)
2026-11-07T20:52:30Z [load_day 2023-05-30] 2023-05-30 hour 16: 164745 events in 4 files, snapshot 2828692651763763753 (task 16444 ms: download 10783 ms overlapping gunzip 914 ms, parse 3940 ms, sort 95 ms, write 7853 ms, index 587 ms: 7 candidates, 80174 repo-hours, 908 releases; waiting 2833 ms; commit 2030 ms)
2026-11-07T20:52:32Z [load_day 2023-05-30] 2023-05-30 hour 17: 170525 events in 4 files, snapshot 1844539857053378038 (task 14009 ms: download 8072 ms overlapping gunzip 866 ms, parse 3808 ms, sort 97 ms, write 8252 ms, index 546 ms: 6 candidates, 78155 repo-hours, 901 releases; waiting 179 ms; commit 1726 ms)
2026-11-07T20:52:45Z [load_day 2023-05-30] 2023-05-30 hour 18: 177742 events in 4 files, snapshot 6697220620664068558 (task 14272 ms: download 8161 ms overlapping gunzip 849 ms, parse 3840 ms, sort 93 ms, write 8238 ms, index 533 ms: 5 candidates, 84930 repo-hours, 950 releases; waiting 392 ms; commit 1541 ms)
2026-11-07T20:52:48Z [load_day 2023-05-30] 2023-05-30 hour 19: 172105 events in 4 files, snapshot 811854409511569100 (task 15008 ms: download 8850 ms overlapping gunzip 901 ms, parse 4164 ms, sort 91 ms, write 8508 ms, index 533 ms: 10 candidates, 77016 repo-hours, 918 releases; waiting 502 ms; commit 1855 ms)
2026-11-07T20:53:02Z [load_day 2023-05-30] 2023-05-30 hour 20: 170152 events in 4 files, snapshot 2231440274941028289 (task 16059 ms: download 10158 ms overlapping gunzip 913 ms, parse 4137 ms, sort 96 ms, write 8317 ms, index 541 ms: 10 candidates, 75660 repo-hours, 987 releases; waiting 1789 ms; commit 1635 ms)
2026-11-07T20:53:04Z [load_day 2023-05-30] 2023-05-30 hour 21: 148097 events in 3 files, snapshot 3560943943976381296 (task 12064 ms: download 5203 ms overlapping gunzip 719 ms, parse 3163 ms, sort 95 ms, write 6819 ms, index 407 ms: 6 candidates, 64035 repo-hours, 901 releases; waiting 553 ms; commit 1801 ms)
2026-11-07T20:53:15Z [load_day 2023-05-30] 2023-05-30 hour 22: 138839 events in 3 files, snapshot 3377840234208823766 (task 12594 ms: download 6578 ms overlapping gunzip 699 ms, parse 3047 ms, sort 83 ms, write 6100 ms, index 379 ms: 3 candidates, 57737 repo-hours, 967 releases; waiting 2014 ms; commit 1689 ms)
2026-11-07T20:53:17Z [load_day 2023-05-30] 2023-05-30 hour 23: 125937 events in 3 files, snapshot 5820185075492155879 (task 10563 ms: download 4858 ms overlapping gunzip 595 ms, parse 2714 ms, sort 85 ms, write 5685 ms, index 355 ms: 5 candidates, 55813 repo-hours, 719 releases; waiting 850 ms; commit 1922 ms)
2026-11-07T20:53:24Z [load_day 2023-05-30] 2023-05-30: repo_hour merged from 24 files to 1 (1808283 rows, 7418 ms)
2026-11-07T20:53:26Z [load_day 2023-05-30] 2023-05-30: index committed in 9322 ms (24 + 1 + 24 files)
2026-11-07T20:53:26Z [load_day 2023-05-30] 2023-05-30: 3783501 events in 24 hours
2026-11-07T20:53:26Z [load_day 2023-05-30] attempt 1 succeeded