orcaLog in

Runs · run 1137

load_day 2023-05-31, attempt 1 succeeded

Host
caf251265124:419514
Started
2026-11-07T20:53:27Z
Ended
2026-11-07T20:56:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1137/load_day/2023-05-31/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:53:27Z [load_day 2023-05-31] attempt 1 started
2026-11-07T20:53:29Z [load_day 2023-05-31] 2023-05-31: 2 hours in flight, about 1200 MB
2026-11-07T20:53:43Z [load_day 2023-05-31] 2023-05-31 hour 0: 146485 events in 3 files, snapshot 7533232818880273053 (task 10812 ms: download 4790 ms overlapping gunzip 648 ms, parse 3005 ms, sort 100 ms, write 5792 ms, index 468 ms: 4 candidates, 74187 repo-hours, 893 releases; waiting 494 ms; commit 1891 ms)
2026-11-07T20:53:44Z [load_day 2023-05-31] 2023-05-31 hour 1: 159837 events in 4 files, snapshot 8993595144609620294 (task 11248 ms: download 4726 ms overlapping gunzip 647 ms, parse 2946 ms, sort 88 ms, write 6027 ms, index 541 ms: 6 candidates, 87163 repo-hours, 812 releases; waiting 697 ms; commit 1592 ms)
2026-11-07T20:53:54Z [load_day 2023-05-31] 2023-05-31 hour 2: 144167 events in 3 files, snapshot 6269941217928430416 (task 10535 ms: download 4313 ms overlapping gunzip 623 ms, parse 2740 ms, sort 86 ms, write 5848 ms, index 488 ms: 11 candidates, 73693 repo-hours, 754 releases; waiting 458 ms; commit 1835 ms)
2026-11-07T20:53:56Z [load_day 2023-05-31] 2023-05-31 hour 3: 135517 events in 3 files, snapshot 4094042272780437729 (task 10107 ms: download 4263 ms overlapping gunzip 586 ms, parse 2609 ms, sort 82 ms, write 5582 ms, index 394 ms: 6 candidates, 61925 repo-hours, 952 releases; waiting 567 ms; commit 1603 ms)
2026-11-07T20:54:04Z [load_day 2023-05-31] 2023-05-31 hour 4: 125331 events in 3 files, snapshot 2720934964487703926 (task 9466 ms: download 4066 ms overlapping gunzip 564 ms, parse 2490 ms, sort 65 ms, write 5226 ms, index 364 ms: 5 candidates, 55965 repo-hours, 639 releases; waiting 538 ms; commit 1626 ms)
2026-11-07T20:54:07Z [load_day 2023-05-31] 2023-05-31 hour 5: 139824 events in 3 files, snapshot 7642724822776208403 (task 10651 ms: download 4454 ms overlapping gunzip 625 ms, parse 2776 ms, sort 75 ms, write 5911 ms, index 406 ms: 5 candidates, 62597 repo-hours, 790 releases; waiting 527 ms; commit 1738 ms)
2026-11-07T20:54:18Z [load_day 2023-05-31] 2023-05-31 hour 6: 168305 events in 4 files, snapshot 872004634437318232 (task 13272 ms: download 7617 ms overlapping gunzip 780 ms, parse 3555 ms, sort 103 ms, write 7492 ms, index 513 ms: 9 candidates, 80389 repo-hours, 962 releases; waiting 515 ms; commit 1656 ms)
2026-11-07T20:54:23Z [load_day 2023-05-31] 2023-05-31 hour 7: 168203 events in 4 files, snapshot 1740115400175472150 (task 14698 ms: download 8541 ms overlapping gunzip 886 ms, parse 3877 ms, sort 129 ms, write 8471 ms, index 515 ms: 5 candidates, 78567 repo-hours, 992 releases; waiting 525 ms; commit 1630 ms)
2026-11-07T20:54:34Z [load_day 2023-05-31] 2023-05-31 hour 8: 177355 events in 4 files, snapshot 2173222908591197168 (task 15144 ms: download 8864 ms overlapping gunzip 904 ms, parse 3929 ms, sort 93 ms, write 8693 ms, index 555 ms: 5 candidates, 83193 repo-hours, 994 releases; waiting 640 ms; commit 1545 ms)
2026-11-07T20:54:39Z [load_day 2023-05-31] 2023-05-31 hour 9: 175816 events in 4 files, snapshot 3134560210173624014 (task 14908 ms: download 8707 ms overlapping gunzip 892 ms, parse 3935 ms, sort 108 ms, write 8598 ms, index 548 ms: 11 candidates, 84034 repo-hours, 1170 releases; waiting 510 ms; commit 1904 ms)
2026-11-07T20:54:49Z [load_day 2023-05-31] 2023-05-31 hour 10: 169102 events in 4 files, snapshot 6223782501160979390 (task 13846 ms: download 8221 ms overlapping gunzip 819 ms, parse 3699 ms, sort 137 ms, write 7852 ms, index 514 ms: 6 candidates, 79963 repo-hours, 1019 releases; waiting 519 ms; commit 1775 ms)
2026-11-07T20:54:54Z [load_day 2023-05-31] 2023-05-31 hour 11: 183463 events in 4 files, snapshot 2255125934196304145 (task 14693 ms: download 8196 ms overlapping gunzip 873 ms, parse 3811 ms, sort 108 ms, write 8460 ms, index 593 ms: 9 candidates, 86322 repo-hours, 1019 releases; waiting 523 ms; commit 1694 ms)
2026-11-07T20:55:05Z [load_day 2023-05-31] 2023-05-31 hour 12: 211116 events in 5 files, snapshot 9172811534956764319 (task 15775 ms: download 8085 ms overlapping gunzip 901 ms, parse 4098 ms, sort 134 ms, write 9174 ms, index 683 ms: 6 candidates, 109781 repo-hours, 1051 releases; waiting 510 ms; commit 1657 ms)
2026-11-07T20:55:15Z [load_day 2023-05-31] 2023-05-31 hour 13: 194597 events in 4 files, snapshot 2539835667238882400 (task 16492 ms: download 8621 ms overlapping gunzip 946 ms, parse 4271 ms, sort 115 ms, write 9794 ms, index 717 ms: 3 candidates, 102058 repo-hours, 1165 releases; waiting 373 ms; commit 5513 ms)
2026-11-07T20:55:22Z [load_day 2023-05-31] 2023-05-31 hour 14: 187147 events in 4 files, snapshot 3112523600368172236 (task 16058 ms: download 9120 ms overlapping gunzip 940 ms, parse 4134 ms, sort 106 ms, write 9597 ms, index 570 ms: 5 candidates, 90913 repo-hours, 1324 releases; waiting 386 ms; commit 1659 ms)
2026-11-07T20:55:27Z [load_day 2023-05-31] 2023-05-31 hour 15: 167717 events in 4 files, snapshot 474374388460162310 (task 14866 ms: download 8894 ms overlapping gunzip 849 ms, parse 3825 ms, sort 107 ms, write 8671 ms, index 645 ms: 5 candidates, 83862 repo-hours, 1253 releases; waiting 520 ms; commit 1741 ms)
2026-11-07T20:55:39Z [load_day 2023-05-31] 2023-05-31 hour 16: 170519 events in 4 files, snapshot 8740101875748302961 (task 15592 ms: download 9658 ms overlapping gunzip 889 ms, parse 3945 ms, sort 99 ms, write 8474 ms, index 544 ms: 11 candidates, 82669 repo-hours, 1158 releases; waiting 1388 ms; commit 1708 ms)
2026-11-07T20:55:43Z [load_day 2023-05-31] 2023-05-31 hour 17: 158919 events in 4 files, snapshot 2912298552084226219 (task 14869 ms: download 6770 ms overlapping gunzip 813 ms, parse 3596 ms, sort 99 ms, write 7973 ms, index 519 ms: 4 candidates, 76239 repo-hours, 876 releases; waiting 1408 ms; commit 1657 ms)
2026-11-07T20:55:54Z [load_day 2023-05-31] 2023-05-31 hour 18: 169978 events in 4 files, snapshot 6853510445218512233 (task 14326 ms: download 8272 ms overlapping gunzip 847 ms, parse 3865 ms, sort 91 ms, write 8491 ms, index 545 ms: 7 candidates, 80778 repo-hours, 1015 releases; waiting 221 ms; commit 1785 ms)
2026-11-07T20:55:58Z [load_day 2023-05-31] 2023-05-31 hour 19: 159789 events in 4 files, snapshot 6884580497445463551 (task 13906 ms: download 6193 ms overlapping gunzip 803 ms, parse 3677 ms, sort 105 ms, write 7609 ms, index 537 ms: 6 candidates, 72527 repo-hours, 884 releases; waiting 841 ms; commit 1631 ms)
2026-11-07T20:56:10Z [load_day 2023-05-31] 2023-05-31 hour 20: 166070 events in 4 files, snapshot 6812826594304662482 (task 14393 ms: download 8565 ms overlapping gunzip 875 ms, parse 3972 ms, sort 103 ms, write 8272 ms, index 525 ms: 4 candidates, 73920 repo-hours, 863 releases; waiting 363 ms; commit 2077 ms)
2026-11-07T20:56:12Z [load_day 2023-05-31] 2023-05-31 hour 21: 145165 events in 3 files, snapshot 4712467355518329599 (task 12618 ms: download 5744 ms overlapping gunzip 739 ms, parse 3255 ms, sort 82 ms, write 6986 ms, index 412 ms: 4 candidates, 63661 repo-hours, 905 releases; waiting 861 ms; commit 1815 ms)
2026-11-07T20:56:21Z [load_day 2023-05-31] 2023-05-31 hour 22: 132832 events in 3 files, snapshot 7357068959971020924 (task 11052 ms: download 4958 ms overlapping gunzip 688 ms, parse 2995 ms, sort 80 ms, write 6077 ms, index 370 ms: 4 candidates, 56588 repo-hours, 806 releases; waiting 533 ms; commit 1607 ms)
2026-11-07T20:56:23Z [load_day 2023-05-31] 2023-05-31 hour 23: 125261 events in 3 files, snapshot 2828928648029711683 (task 9713 ms: download 4266 ms overlapping gunzip 583 ms, parse 2609 ms, sort 79 ms, write 5321 ms, index 371 ms: 1 candidates, 53661 repo-hours, 720 releases; waiting 533 ms; commit 1622 ms)
2026-11-07T20:56:31Z [load_day 2023-05-31] 2023-05-31: repo_hour merged from 24 files to 1 (1854655 rows, 7668 ms)
2026-11-07T20:56:32Z [load_day 2023-05-31] 2023-05-31: index committed in 9531 ms (24 + 1 + 24 files)
2026-11-07T20:56:32Z [load_day 2023-05-31] 2023-05-31: 3882515 events in 24 hours
2026-11-07T20:56:32Z [load_day 2023-05-31] attempt 1 succeeded