orcaLog in

Runs · run 1152

load_day 2023-06-05, attempt 1 succeeded

Host
caf251265124:434592
Started
2026-11-07T21:06:55Z
Ended
2026-11-07T21:10:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1152/load_day/2023-06-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:06:55Z [load_day 2023-06-05] attempt 1 started
2026-11-07T21:06:56Z [load_day 2023-06-05] 2023-06-05: 2 hours in flight, about 1200 MB
2026-11-07T21:07:08Z [load_day 2023-06-05] 2023-06-05 hour 0: 121264 events in 3 files, snapshot 8449884753078556594 (task 8786 ms: download 3041 ms overlapping gunzip 471 ms, parse 2224 ms, sort 74 ms, write 4446 ms, index 383 ms: 7 candidates, 63062 repo-hours, 931 releases; waiting 763 ms; commit 1682 ms)
2026-11-07T21:07:11Z [load_day 2023-06-05] 2023-06-05 hour 1: 145459 events in 3 files, snapshot 2978435821999591867 (task 11684 ms: download 5014 ms overlapping gunzip 715 ms, parse 3191 ms, sort 92 ms, write 6409 ms, index 478 ms: 7 candidates, 76785 repo-hours, 917 releases; waiting 503 ms; commit 1758 ms)
2026-11-07T21:07:20Z [load_day 2023-06-05] 2023-06-05 hour 2: 137105 events in 3 files, snapshot 4854592121348420793 (task 11145 ms: download 5023 ms overlapping gunzip 714 ms, parse 2988 ms, sort 86 ms, write 6018 ms, index 467 ms: 10 candidates, 67493 repo-hours, 751 releases; waiting 532 ms; commit 1749 ms)
2026-11-07T21:07:22Z [load_day 2023-06-05] 2023-06-05 hour 3: 131685 events in 3 files, snapshot 4267918355517037314 (task 9945 ms: download 4490 ms overlapping gunzip 615 ms, parse 2613 ms, sort 78 ms, write 5458 ms, index 371 ms: 4 candidates, 55850 repo-hours, 937 releases; waiting 529 ms; commit 1690 ms)
2026-11-07T21:07:31Z [load_day 2023-06-05] 2023-06-05 hour 4: 132157 events in 3 files, snapshot 3867141814528370617 (task 10471 ms: download 4967 ms overlapping gunzip 696 ms, parse 2873 ms, sort 86 ms, write 5593 ms, index 375 ms: 5 candidates, 57867 repo-hours, 662 releases; waiting 548 ms; commit 1923 ms)
2026-11-07T21:07:34Z [load_day 2023-06-05] 2023-06-05 hour 5: 142316 events in 3 files, snapshot 9091592021570572234 (task 11533 ms: download 5280 ms overlapping gunzip 729 ms, parse 3068 ms, sort 91 ms, write 6432 ms, index 417 ms: 3 candidates, 60750 repo-hours, 820 releases; waiting 535 ms; commit 1708 ms)
2026-11-07T21:07:46Z [load_day 2023-06-05] 2023-06-05 hour 6: 169108 events in 4 files, snapshot 9166019929622364150 (task 13555 ms: download 7825 ms overlapping gunzip 878 ms, parse 3692 ms, sort 106 ms, write 7748 ms, index 501 ms: 10 candidates, 77914 repo-hours, 883 releases; waiting 325 ms; commit 2039 ms)
2026-11-07T21:07:50Z [load_day 2023-06-05] 2023-06-05 hour 7: 172378 events in 4 files, snapshot 2627672835311749489 (task 14877 ms: download 8710 ms overlapping gunzip 939 ms, parse 3932 ms, sort 100 ms, write 8474 ms, index 529 ms: 4 candidates, 81343 repo-hours, 983 releases; waiting 552 ms; commit 1863 ms)
2026-11-07T21:08:02Z [load_day 2023-06-05] 2023-06-05 hour 8: 177087 events in 4 files, snapshot 996676821421959619 (task 16007 ms: download 9657 ms overlapping gunzip 956 ms, parse 4054 ms, sort 101 ms, write 9568 ms, index 533 ms: 12 candidates, 81668 repo-hours, 1052 releases; waiting 523 ms; commit 1758 ms)
2026-11-07T21:08:08Z [load_day 2023-06-05] 2023-06-05 hour 9: 182352 events in 4 files, snapshot 7801989162334188357 (task 16397 ms: download 9548 ms overlapping gunzip 971 ms, parse 4190 ms, sort 126 ms, write 9467 ms, index 571 ms: 24 candidates, 86427 repo-hours, 1203 releases; waiting 760 ms; commit 1852 ms)
2026-11-07T21:08:19Z [load_day 2023-06-05] 2023-06-05 hour 10: 186855 events in 4 files, snapshot 4386863643818510515 (task 16296 ms: download 9690 ms overlapping gunzip 986 ms, parse 4187 ms, sort 124 ms, write 9084 ms, index 594 ms: 7 candidates, 89527 repo-hours, 1074 releases; waiting 961 ms; commit 1860 ms)
2026-11-07T21:08:25Z [load_day 2023-06-05] 2023-06-05 hour 11: 190016 events in 4 files, snapshot 454305022728878645 (task 16029 ms: download 9126 ms overlapping gunzip 1013 ms, parse 4377 ms, sort 140 ms, write 9160 ms, index 543 ms: 6 candidates, 87992 repo-hours, 1061 releases; waiting 509 ms; commit 1699 ms)
2026-11-07T21:08:37Z [load_day 2023-06-05] 2023-06-05 hour 12: 209174 events in 5 files, snapshot 2771344397275144321 (task 16989 ms: download 9132 ms overlapping gunzip 1024 ms, parse 4498 ms, sort 134 ms, write 9942 ms, index 675 ms: 7 candidates, 106913 repo-hours, 1130 releases; waiting 510 ms; commit 1744 ms)
2026-11-07T21:08:42Z [load_day 2023-06-05] 2023-06-05 hour 13: 192725 events in 4 files, snapshot 5794196951822467157 (task 16814 ms: download 9354 ms overlapping gunzip 1033 ms, parse 4326 ms, sort 124 ms, write 9862 ms, index 649 ms: 6 candidates, 104126 repo-hours, 1045 releases; waiting 541 ms; commit 1626 ms)
2026-11-07T21:08:54Z [load_day 2023-06-05] 2023-06-05 hour 14: 185424 events in 4 files, snapshot 5204059470665022765 (task 15901 ms: download 9056 ms overlapping gunzip 945 ms, parse 4081 ms, sort 125 ms, write 9324 ms, index 595 ms: 7 candidates, 96405 repo-hours, 994 releases; waiting 545 ms; commit 1774 ms)
2026-11-07T21:09:02Z [load_day 2023-06-05] 2023-06-05 hour 15: 173276 events in 4 files, snapshot 3967156472515579223 (task 15765 ms: download 9008 ms overlapping gunzip 960 ms, parse 4118 ms, sort 105 ms, write 9097 ms, index 577 ms: 9 candidates, 84470 repo-hours, 944 releases; waiting 345 ms; commit 4723 ms)
2026-11-07T21:09:11Z [load_day 2023-06-05] 2023-06-05 hour 16: 178419 events in 4 files, snapshot 3241439654161497126 (task 15946 ms: download 9331 ms overlapping gunzip 967 ms, parse 4166 ms, sort 111 ms, write 9171 ms, index 622 ms: 11 candidates, 84238 repo-hours, 893 releases; waiting 562 ms; commit 2019 ms)
2026-11-07T21:09:14Z [load_day 2023-06-05] 2023-06-05 hour 17: 161540 events in 4 files, snapshot 2515482163846284357 (task 14236 ms: download 8742 ms overlapping gunzip 864 ms, parse 3744 ms, sort 101 ms, write 8215 ms, index 494 ms: 10 candidates, 76059 repo-hours, 766 releases; waiting 533 ms; commit 1698 ms)
2026-11-07T21:09:29Z [load_day 2023-06-05] 2023-06-05 hour 18: 177888 events in 4 files, snapshot 6954766046821773989 (task 17243 ms: download 10854 ms overlapping gunzip 982 ms, parse 4184 ms, sort 121 ms, write 8863 ms, index 595 ms: 7 candidates, 83874 repo-hours, 978 releases; waiting 2102 ms; commit 2206 ms)
2026-11-07T21:09:32Z [load_day 2023-06-05] 2023-06-05 hour 19: 169756 events in 4 files, snapshot 2637679915545305241 (task 14402 ms: download 8615 ms overlapping gunzip 874 ms, parse 3757 ms, sort 100 ms, write 8412 ms, index 504 ms: 6 candidates, 77404 repo-hours, 960 releases; waiting 514 ms; commit 2328 ms)
2026-11-07T21:09:45Z [load_day 2023-06-05] 2023-06-05 hour 20: 164636 events in 4 files, snapshot 1011105816788176094 (task 14329 ms: download 8766 ms overlapping gunzip 879 ms, parse 3781 ms, sort 99 ms, write 8198 ms, index 499 ms: 5 candidates, 73529 repo-hours, 1037 releases; waiting 537 ms; commit 1865 ms)
2026-11-07T21:09:47Z [load_day 2023-06-05] 2023-06-05 hour 21: 154632 events in 4 files, snapshot 7511690540960833846 (task 13698 ms: download 6279 ms overlapping gunzip 846 ms, parse 3774 ms, sort 102 ms, write 7691 ms, index 452 ms: 5 candidates, 65633 repo-hours, 1024 releases; waiting 545 ms; commit 1974 ms)
2026-11-07T21:09:59Z [load_day 2023-06-05] 2023-06-05 hour 22: 143924 events in 3 files, snapshot 2689713048006164340 (task 12903 ms: download 6211 ms overlapping gunzip 836 ms, parse 3508 ms, sort 85 ms, write 7157 ms, index 396 ms: 6 candidates, 57676 repo-hours, 912 releases; waiting 560 ms; commit 1803 ms)
2026-11-07T21:10:00Z [load_day 2023-06-05] 2023-06-05 hour 23: 132753 events in 3 files, snapshot 2655677237161442795 (task 11534 ms: download 5326 ms overlapping gunzip 727 ms, parse 3144 ms, sort 83 ms, write 6415 ms, index 346 ms: 4 candidates, 54735 repo-hours, 814 releases; waiting 522 ms; commit 1757 ms)
2026-11-07T21:10:08Z [load_day 2023-06-05] 2023-06-05: repo_hour merged from 24 files to 1 (1851740 rows, 7717 ms)
2026-11-07T21:10:10Z [load_day 2023-06-05] 2023-06-05: index committed in 9795 ms (24 + 1 + 24 files)
2026-11-07T21:10:10Z [load_day 2023-06-05] 2023-06-05: 3931929 events in 24 hours
2026-11-07T21:10:10Z [load_day 2023-06-05] attempt 1 succeeded