orcaLog in

Runs · run 1550

load_day 2023-09-25, attempt 1 succeeded

Host
3c2b29713ce8:365710
Started
2026-11-08T01:08:40Z
Ended
2026-11-08T01:13:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1550/load_day/2023-09-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:08:40Z [load_day 2023-09-25] attempt 1 started
2026-11-08T01:08:42Z [load_day 2023-09-25] 2023-09-25: 2 hours in flight, about 1200 MB
2026-11-08T01:09:08Z [load_day 2023-09-25] 2023-09-25 hour 0: 150546 events in 4 files, snapshot 8715362051090364629 (task 14287 ms: download 5954 ms overlapping gunzip 794 ms, parse 3680 ms, sort 97 ms, write 8383 ms, index 567 ms: 15 candidates, 81169 repo-hours, 878 releases; waiting 506 ms; commit 9736 ms)
2026-11-08T01:09:10Z [load_day 2023-09-25] 2023-09-25 hour 1: 162633 events in 4 files, snapshot 7905026698348328884 (task 16074 ms: download 6632 ms overlapping gunzip 1129 ms, parse 4627 ms, sort 103 ms, write 8735 ms, index 697 ms: 11 candidates, 89564 repo-hours, 662 releases; waiting 502 ms; commit 2717 ms)
2026-11-08T01:09:16Z [load_day 2023-09-25] 2023-09-25 hour 2: 137579 events in 3 files, snapshot 189682715666961695 (task 13512 ms: download 5397 ms overlapping gunzip 749 ms, parse 3077 ms, sort 141 ms, write 8060 ms, index 566 ms: 12 candidates, 57318 repo-hours, 763 releases; waiting 522 ms; commit 2852 ms)
2026-11-08T01:09:26Z [load_day 2023-09-25] 2023-09-25 hour 3: 134553 events in 3 files, snapshot 1541400647461751788 (task 14007 ms: download 5918 ms overlapping gunzip 892 ms, parse 3736 ms, sort 98 ms, write 7893 ms, index 573 ms: 10 candidates, 56374 repo-hours, 833 releases; waiting 518 ms; commit 2968 ms)
2026-11-08T01:09:31Z [load_day 2023-09-25] 2023-09-25 hour 4: 134263 events in 3 files, snapshot 3404663778771850896 (task 14940 ms: download 6610 ms overlapping gunzip 1108 ms, parse 4389 ms, sort 86 ms, write 8049 ms, index 510 ms: 9 candidates, 54074 repo-hours, 656 releases; waiting 488 ms; commit 2427 ms)
2026-11-08T01:09:42Z [load_day 2023-09-25] 2023-09-25 hour 5: 145546 events in 3 files, snapshot 385098373070989352 (task 15297 ms: download 6772 ms overlapping gunzip 943 ms, parse 3767 ms, sort 144 ms, write 9022 ms, index 641 ms: 14 candidates, 59501 repo-hours, 727 releases; waiting 515 ms; commit 3087 ms)
2026-11-08T01:09:52Z [load_day 2023-09-25] 2023-09-25 hour 6: 175132 events in 4 files, snapshot 1756468818880566 (task 19082 ms: download 11311 ms overlapping gunzip 1170 ms, parse 4997 ms, sort 193 ms, write 11470 ms, index 516 ms: 11 candidates, 78973 repo-hours, 830 releases; waiting 512 ms; commit 3129 ms)
2026-11-08T01:10:07Z [load_day 2023-09-25] 2023-09-25 hour 7: 185265 events in 4 files, snapshot 2595262179238424577 (task 20647 ms: download 12072 ms overlapping gunzip 1357 ms, parse 5741 ms, sort 176 ms, write 11752 ms, index 884 ms: 7 candidates, 79079 repo-hours, 994 releases; waiting 512 ms; commit 5560 ms)
2026-11-08T01:10:18Z [load_day 2023-09-25] 2023-09-25 hour 8: 194563 events in 4 files, snapshot 6498859521942477982 (task 22447 ms: download 12005 ms overlapping gunzip 1273 ms, parse 5483 ms, sort 184 ms, write 13867 ms, index 777 ms: 12 candidates, 85040 repo-hours, 1077 releases; waiting 530 ms; commit 4809 ms)
2026-11-08T01:10:29Z [load_day 2023-09-25] 2023-09-25 hour 9: 192992 events in 4 files, snapshot 5191701199061939540 (task 23322 ms: download 13058 ms overlapping gunzip 1578 ms, parse 6577 ms, sort 198 ms, write 13503 ms, index 625 ms: 6 candidates, 84044 repo-hours, 1082 releases; waiting 560 ms; commit 2428 ms)
2026-11-08T01:10:39Z [load_day 2023-09-25] 2023-09-25 hour 10: 191539 events in 4 files, snapshot 1900176557446861911 (task 22836 ms: download 13265 ms overlapping gunzip 1284 ms, parse 5455 ms, sort 124 ms, write 14600 ms, index 618 ms: 7 candidates, 82493 repo-hours, 1018 releases; waiting 493 ms; commit 2414 ms)
2026-11-08T01:10:53Z [load_day 2023-09-25] 2023-09-25 hour 11: 198147 events in 4 files, snapshot 5752083995964444998 (task 21772 ms: download 12225 ms overlapping gunzip 1556 ms, parse 6301 ms, sort 134 ms, write 12190 ms, index 664 ms: 6 candidates, 82680 repo-hours, 1102 releases; waiting 530 ms; commit 3212 ms)
2026-11-08T01:11:03Z [load_day 2023-09-25] 2023-09-25 hour 12: 245288 events in 5 files, snapshot 4384234828207761517 (task 22889 ms: download 14145 ms overlapping gunzip 1248 ms, parse 5771 ms, sort 234 ms, write 14043 ms, index 760 ms: 9 candidates, 117024 repo-hours, 1152 releases; waiting 526 ms; commit 2751 ms)
2026-11-08T01:11:16Z [load_day 2023-09-25] 2023-09-25 hour 13: 224226 events in 5 files, snapshot 7359214198991408959 (task 22223 ms: download 15394 ms overlapping gunzip 1419 ms, parse 6047 ms, sort 156 ms, write 13079 ms, index 756 ms: 16 candidates, 109731 repo-hours, 1050 releases; waiting 514 ms; commit 2682 ms)
2026-11-08T01:11:26Z [load_day 2023-09-25] 2023-09-25 hour 14: 216990 events in 5 files, snapshot 791486560080856195 (task 20963 ms: download 13594 ms overlapping gunzip 1307 ms, parse 5498 ms, sort 153 ms, write 11989 ms, index 1267 ms: 12 candidates, 97758 repo-hours, 1116 releases; waiting 393 ms; commit 2806 ms)
2026-11-08T01:11:39Z [load_day 2023-09-25] 2023-09-25 hour 15: 191618 events in 4 files, snapshot 2588183215956512720 (task 22093 ms: download 11779 ms overlapping gunzip 1192 ms, parse 5268 ms, sort 186 ms, write 14024 ms, index 713 ms: 11 candidates, 89852 repo-hours, 1241 releases; waiting 499 ms; commit 2680 ms)
2026-11-08T01:11:49Z [load_day 2023-09-25] 2023-09-25 hour 16: 196572 events in 4 files, snapshot 9024770149769053907 (task 22956 ms: download 12849 ms overlapping gunzip 1290 ms, parse 5550 ms, sort 160 ms, write 14433 ms, index 662 ms: 9 candidates, 88500 repo-hours, 984 releases; waiting 514 ms; commit 2587 ms)
2026-11-08T01:12:04Z [load_day 2023-09-25] 2023-09-25 hour 17: 199021 events in 4 files, snapshot 4110342468370373873 (task 23592 ms: download 12415 ms overlapping gunzip 1241 ms, parse 5610 ms, sort 247 ms, write 15025 ms, index 730 ms: 7 candidates, 85661 repo-hours, 976 releases; waiting 522 ms; commit 3439 ms)
2026-11-08T01:12:14Z [load_day 2023-09-25] 2023-09-25 hour 18: 203181 events in 5 files, snapshot 3379493342748865660 (task 23453 ms: download 12217 ms overlapping gunzip 1357 ms, parse 5957 ms, sort 149 ms, write 14075 ms, index 748 ms: 6 candidates, 89527 repo-hours, 1042 releases; waiting 514 ms; commit 2771 ms)
2026-11-08T01:12:27Z [load_day 2023-09-25] 2023-09-25 hour 19: 192907 events in 4 files, snapshot 3688265886618276401 (task 22739 ms: download 12597 ms overlapping gunzip 1338 ms, parse 5884 ms, sort 168 ms, write 13923 ms, index 621 ms: 9 candidates, 79784 repo-hours, 942 releases; waiting 517 ms; commit 2501 ms)
2026-11-08T01:12:36Z [load_day 2023-09-25] 2023-09-25 hour 20: 183422 events in 4 files, snapshot 1081048861570914103 (task 21142 ms: download 12573 ms overlapping gunzip 1169 ms, parse 4864 ms, sort 128 ms, write 13522 ms, index 690 ms: 3 candidates, 76884 repo-hours, 998 releases; waiting 514 ms; commit 2389 ms)
2026-11-08T01:12:49Z [load_day 2023-09-25] 2023-09-25 hour 21: 173346 events in 4 files, snapshot 2715076105608036998 (task 20516 ms: download 11927 ms overlapping gunzip 1393 ms, parse 5838 ms, sort 166 ms, write 11603 ms, index 603 ms: 6 candidates, 69308 repo-hours, 967 releases; waiting 593 ms; commit 2736 ms)
2026-11-08T01:12:58Z [load_day 2023-09-25] 2023-09-25 hour 22: 154514 events in 4 files, snapshot 7783046489509457501 (task 18176 ms: download 11015 ms overlapping gunzip 986 ms, parse 4109 ms, sort 109 ms, write 11672 ms, index 511 ms: 9 candidates, 61007 repo-hours, 835 releases; waiting 515 ms; commit 4633 ms)
2026-11-08T01:13:04Z [load_day 2023-09-25] 2023-09-25 hour 23: 142900 events in 3 files, snapshot 4381052242626054252 (task 14358 ms: download 6529 ms overlapping gunzip 935 ms, parse 3887 ms, sort 95 ms, write 7943 ms, index 437 ms: 6 candidates, 56846 repo-hours, 683 releases; waiting 778 ms; commit 2442 ms)
2026-11-08T01:13:12Z [load_day 2023-09-25] 2023-09-25: repo_hour merged from 24 files to 1 (1912191 rows, 8453 ms)
2026-11-08T01:13:19Z [load_day 2023-09-25] 2023-09-25: index committed in 14947 ms (24 + 1 + 24 files)
2026-11-08T01:13:19Z [load_day 2023-09-25] 2023-09-25: 4326743 events in 24 hours
2026-11-08T01:13:19Z [load_day 2023-09-25] attempt 1 succeeded