orcaLog in

Runs · run 1203

load_day 2023-06-22, attempt 1 succeeded

Host
3c2b29713ce8:17903
Started
2026-11-07T21:48:35Z
Ended
2026-11-07T21:53:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1203/load_day/2023-06-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:48:35Z [load_day 2023-06-22] attempt 1 started
2026-11-07T21:48:36Z [load_day 2023-06-22] 2023-06-22: 1 hours in flight, about 750 MB
2026-11-07T21:48:49Z [load_day 2023-06-22] 2023-06-22 hour 0: 143149 events in 3 files, snapshot 56072338935366417 (task 9894 ms: download 4382 ms overlapping gunzip 651 ms, parse 2916 ms, sort 90 ms, write 4954 ms, index 439 ms: 5 candidates, 69850 repo-hours, 854 releases; waiting 520 ms; commit 1737 ms)
2026-11-07T21:49:00Z [load_day 2023-06-22] 2023-06-22 hour 1: 146702 events in 3 files, snapshot 2781203155672185880 (task 9682 ms: download 4169 ms overlapping gunzip 641 ms, parse 2775 ms, sort 88 ms, write 4698 ms, index 496 ms: 8 candidates, 77112 repo-hours, 796 releases; waiting 677 ms; commit 1938 ms)
2026-11-07T21:49:09Z [load_day 2023-06-22] 2023-06-22 hour 2: 128395 events in 3 files, snapshot 5603305351060500441 (task 9210 ms: download 3900 ms overlapping gunzip 553 ms, parse 2373 ms, sort 74 ms, write 4618 ms, index 398 ms: 6 candidates, 61342 repo-hours, 645 releases; waiting 744 ms; commit 1771 ms)
2026-11-07T21:49:18Z [load_day 2023-06-22] 2023-06-22 hour 3: 116083 events in 3 files, snapshot 7530370205280246554 (task 7590 ms: download 2339 ms overlapping gunzip 487 ms, parse 2178 ms, sort 71 ms, write 3677 ms, index 307 ms: 3 candidates, 49078 repo-hours, 738 releases; waiting 570 ms; commit 1761 ms)
2026-11-07T21:49:28Z [load_day 2023-06-22] 2023-06-22 hour 4: 118525 events in 3 files, snapshot 4354491072463422860 (task 8295 ms: download 3388 ms overlapping gunzip 499 ms, parse 2174 ms, sort 72 ms, write 3801 ms, index 364 ms: 4 candidates, 50973 repo-hours, 635 releases; waiting 915 ms; commit 2614 ms)
2026-11-07T21:49:38Z [load_day 2023-06-22] 2023-06-22 hour 5: 128308 events in 3 files, snapshot 8371204909658372323 (task 9287 ms: download 4169 ms overlapping gunzip 594 ms, parse 2602 ms, sort 83 ms, write 4783 ms, index 349 ms: 4 candidates, 55595 repo-hours, 802 releases; waiting 583 ms; commit 1894 ms)
2026-11-07T21:49:49Z [load_day 2023-06-22] 2023-06-22 hour 6: 151739 events in 4 files, snapshot 5275179625086540901 (task 10185 ms: download 4142 ms overlapping gunzip 653 ms, parse 2924 ms, sort 93 ms, write 5226 ms, index 453 ms: 6 candidates, 68532 repo-hours, 775 releases; waiting 581 ms; commit 1957 ms)
2026-11-07T21:50:02Z [load_day 2023-06-22] 2023-06-22 hour 7: 164728 events in 4 files, snapshot 6453367120508270424 (task 12197 ms: download 7254 ms overlapping gunzip 830 ms, parse 3733 ms, sort 94 ms, write 6229 ms, index 491 ms: 6 candidates, 71882 repo-hours, 847 releases; waiting 514 ms; commit 1671 ms)
2026-11-07T21:50:16Z [load_day 2023-06-22] 2023-06-22 hour 8: 175065 events in 4 files, snapshot 3803532201443949338 (task 13530 ms: download 7857 ms overlapping gunzip 872 ms, parse 3919 ms, sort 107 ms, write 7034 ms, index 542 ms: 5 candidates, 77756 repo-hours, 938 releases; waiting 705 ms; commit 1839 ms)
2026-11-07T21:50:30Z [load_day 2023-06-22] 2023-06-22 hour 9: 177036 events in 4 files, snapshot 7787377427806001812 (task 13247 ms: download 7851 ms overlapping gunzip 874 ms, parse 4037 ms, sort 99 ms, write 6776 ms, index 530 ms: 7 candidates, 77421 repo-hours, 1164 releases; waiting 665 ms; commit 1979 ms)
2026-11-07T21:50:43Z [load_day 2023-06-22] 2023-06-22 hour 10: 174557 events in 4 files, snapshot 1097533604660158928 (task 12100 ms: download 6755 ms overlapping gunzip 810 ms, parse 3667 ms, sort 107 ms, write 6571 ms, index 501 ms: 3 candidates, 78289 repo-hours, 925 releases; waiting 192 ms; commit 1859 ms)
2026-11-07T21:50:56Z [load_day 2023-06-22] 2023-06-22 hour 11: 176207 events in 4 files, snapshot 5947562791601087459 (task 12058 ms: download 6776 ms overlapping gunzip 828 ms, parse 3737 ms, sort 98 ms, write 6467 ms, index 495 ms: 2 candidates, 76484 repo-hours, 1027 releases; waiting 213 ms; commit 2049 ms)
2026-11-07T21:51:11Z [load_day 2023-06-22] 2023-06-22 hour 12: 223060 events in 5 files, snapshot 3721962412091517983 (task 14323 ms: download 7514 ms overlapping gunzip 890 ms, parse 4153 ms, sort 136 ms, write 7446 ms, index 639 ms: 11 candidates, 107526 repo-hours, 995 releases; waiting 721 ms; commit 2028 ms)
2026-11-07T21:51:26Z [load_day 2023-06-22] 2023-06-22 hour 13: 188848 events in 4 files, snapshot 26666318600958194 (task 13656 ms: download 7510 ms overlapping gunzip 878 ms, parse 3983 ms, sort 107 ms, write 7236 ms, index 632 ms: 9 candidates, 98130 repo-hours, 991 releases; waiting 488 ms; commit 1879 ms)
2026-11-07T21:51:40Z [load_day 2023-06-22] 2023-06-22 hour 14: 178350 events in 4 files, snapshot 4179882748223714112 (task 13448 ms: download 7832 ms overlapping gunzip 908 ms, parse 4039 ms, sort 100 ms, write 7029 ms, index 532 ms: 9 candidates, 85154 repo-hours, 1052 releases; waiting 502 ms; commit 1798 ms)
2026-11-07T21:51:54Z [load_day 2023-06-22] 2023-06-22 hour 15: 168948 events in 4 files, snapshot 1340906081518592937 (task 12611 ms: download 7598 ms overlapping gunzip 834 ms, parse 3742 ms, sort 101 ms, write 6678 ms, index 511 ms: 6 candidates, 80923 repo-hours, 1051 releases; waiting 504 ms; commit 2102 ms)
2026-11-07T21:52:11Z [load_day 2023-06-22] 2023-06-22 hour 16: 176536 events in 4 files, snapshot 8112621031036738497 (task 14113 ms: download 7350 ms overlapping gunzip 852 ms, parse 3767 ms, sort 121 ms, write 8245 ms, index 541 ms: 9 candidates, 81256 repo-hours, 1025 releases; waiting 311 ms; commit 4351 ms)
2026-11-07T21:52:24Z [load_day 2023-06-22] 2023-06-22 hour 17: 175513 events in 4 files, snapshot 4417804752512757040 (task 12654 ms: download 7508 ms overlapping gunzip 850 ms, parse 3844 ms, sort 85 ms, write 6551 ms, index 500 ms: 6 candidates, 76824 repo-hours, 911 releases; waiting 521 ms; commit 1873 ms)
2026-11-07T21:52:38Z [load_day 2023-06-22] 2023-06-22 hour 18: 181472 events in 4 files, snapshot 249778678842477846 (task 13217 ms: download 7712 ms overlapping gunzip 887 ms, parse 3890 ms, sort 113 ms, write 6612 ms, index 529 ms: 6 candidates, 80834 repo-hours, 1011 releases; waiting 832 ms; commit 1699 ms)
2026-11-07T21:52:51Z [load_day 2023-06-22] 2023-06-22 hour 19: 172324 events in 4 files, snapshot 3853685569552352051 (task 12095 ms: download 7129 ms overlapping gunzip 803 ms, parse 3578 ms, sort 97 ms, write 6244 ms, index 480 ms: 6 candidates, 71267 repo-hours, 974 releases; waiting 541 ms; commit 1831 ms)
2026-11-07T21:53:04Z [load_day 2023-06-22] 2023-06-22 hour 20: 173088 events in 4 files, snapshot 584544946076345175 (task 11882 ms: download 6916 ms overlapping gunzip 789 ms, parse 3467 ms, sort 92 ms, write 6280 ms, index 458 ms: 6 candidates, 71156 repo-hours, 872 releases; waiting 507 ms; commit 1959 ms)
2026-11-07T21:53:16Z [load_day 2023-06-22] 2023-06-22 hour 21: 157955 events in 4 files, snapshot 4682183067564929553 (task 11137 ms: download 4735 ms overlapping gunzip 773 ms, parse 3335 ms, sort 109 ms, write 5915 ms, index 418 ms: 3 candidates, 62828 repo-hours, 982 releases; waiting 306 ms; commit 1778 ms)
2026-11-07T21:53:26Z [load_day 2023-06-22] 2023-06-22 hour 22: 138406 events in 3 files, snapshot 7206129718120353186 (task 9714 ms: download 4439 ms overlapping gunzip 688 ms, parse 2973 ms, sort 83 ms, write 4815 ms, index 351 ms: 4 candidates, 56324 repo-hours, 796 releases; waiting 513 ms; commit 1822 ms)
2026-11-07T21:53:36Z [load_day 2023-06-22] 2023-06-22 hour 23: 127695 events in 3 files, snapshot 6271441711999078649 (task 8885 ms: download 4038 ms overlapping gunzip 587 ms, parse 2546 ms, sort 82 ms, write 4499 ms, index 330 ms: 0 candidates, 53225 repo-hours, 616 releases; waiting 573 ms; commit 1818 ms)
2026-11-07T21:53:43Z [load_day 2023-06-22] 2023-06-22: repo_hour merged from 24 files to 1 (1739761 rows, 7252 ms)
2026-11-07T21:53:45Z [load_day 2023-06-22] 2023-06-22: index committed in 9209 ms (23 + 1 + 24 files)
2026-11-07T21:53:45Z [load_day 2023-06-22] 2023-06-22: 3862689 events in 24 hours
2026-11-07T21:53:45Z [load_day 2023-06-22] attempt 1 succeeded