orcaLog in

Runs · run 1032

load_day 2023-04-26, attempt 1 succeeded

Host
caf251265124:307914
Started
2026-11-07T19:14:11Z
Ended
2026-11-07T19:17:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1032/load_day/2023-04-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:14:11Z [load_day 2023-04-26] attempt 1 started
2026-11-07T19:14:13Z [load_day 2023-04-26] 2023-04-26: 2 hours in flight, about 1200 MB
2026-11-07T19:14:27Z [load_day 2023-04-26] 2023-04-26 hour 0: 156335 events in 4 files, snapshot 7609645700542529026 (task 11811 ms: download 4971 ms overlapping gunzip 696 ms, parse 3095 ms, sort 115 ms, write 6528 ms, index 513 ms: 5 candidates, 79456 repo-hours, 1025 releases; waiting 558 ms; commit 1508 ms)
2026-11-07T19:14:29Z [load_day 2023-04-26] 2023-04-26 hour 1: 164285 events in 4 files, snapshot 4733622863749287003 (task 11874 ms: download 4677 ms overlapping gunzip 675 ms, parse 3040 ms, sort 103 ms, write 6627 ms, index 589 ms: 3 candidates, 89974 repo-hours, 933 releases; waiting 521 ms; commit 1668 ms)
2026-11-07T19:14:40Z [load_day 2023-04-26] 2023-04-26 hour 2: 145129 events in 3 files, snapshot 8917116499140128455 (task 11640 ms: download 5029 ms overlapping gunzip 661 ms, parse 2829 ms, sort 105 ms, write 6351 ms, index 431 ms: 0 candidates, 67287 repo-hours, 738 releases; waiting 781 ms; commit 1661 ms)
2026-11-07T19:14:41Z [load_day 2023-04-26] 2023-04-26 hour 3: 137312 events in 3 files, snapshot 7671214980192045757 (task 10563 ms: download 4712 ms overlapping gunzip 626 ms, parse 2740 ms, sort 84 ms, write 5685 ms, index 399 ms: 3 candidates, 61162 repo-hours, 853 releases; waiting 713 ms; commit 1604 ms)
2026-11-07T19:14:51Z [load_day 2023-04-26] 2023-04-26 hour 4: 131991 events in 3 files, snapshot 940025738248708121 (task 10489 ms: download 4551 ms overlapping gunzip 580 ms, parse 2464 ms, sort 81 ms, write 5734 ms, index 395 ms: 3 candidates, 59060 repo-hours, 722 releases; waiting 878 ms; commit 1719 ms)
2026-11-07T19:14:54Z [load_day 2023-04-26] 2023-04-26 hour 5: 142242 events in 3 files, snapshot 3091731136038319424 (task 11434 ms: download 4717 ms overlapping gunzip 663 ms, parse 2857 ms, sort 98 ms, write 6504 ms, index 499 ms: 3 candidates, 62674 repo-hours, 786 releases; waiting 523 ms; commit 1613 ms)
2026-11-07T19:15:04Z [load_day 2023-04-26] 2023-04-26 hour 6: 168518 events in 4 files, snapshot 9069435755531886572 (task 12858 ms: download 7046 ms overlapping gunzip 763 ms, parse 3280 ms, sort 102 ms, write 7548 ms, index 560 ms: 3 candidates, 78907 repo-hours, 943 releases; waiting 265 ms; commit 1611 ms)
2026-11-07T19:15:08Z [load_day 2023-04-26] 2023-04-26 hour 7: 162331 events in 4 files, snapshot 1593704250809250086 (task 13561 ms: download 5386 ms overlapping gunzip 796 ms, parse 3548 ms, sort 106 ms, write 7772 ms, index 549 ms: 8 candidates, 77955 repo-hours, 835 releases; waiting 499 ms; commit 1779 ms)
2026-11-07T19:15:21Z [load_day 2023-04-26] 2023-04-26 hour 8: 172419 events in 4 files, snapshot 1264200262045239945 (task 15404 ms: download 9178 ms overlapping gunzip 886 ms, parse 3870 ms, sort 101 ms, write 8385 ms, index 576 ms: 4 candidates, 84140 repo-hours, 1012 releases; waiting 988 ms; commit 1623 ms)
2026-11-07T19:15:24Z [load_day 2023-04-26] 2023-04-26 hour 9: 185907 events in 4 files, snapshot 5242776317358162818 (task 15486 ms: download 8852 ms overlapping gunzip 959 ms, parse 4182 ms, sort 117 ms, write 8869 ms, index 594 ms: 5 candidates, 86221 repo-hours, 1053 releases; waiting 475 ms; commit 1718 ms)
2026-11-07T19:15:36Z [load_day 2023-04-26] 2023-04-26 hour 10: 176905 events in 4 files, snapshot 1909417212661176900 (task 14593 ms: download 8356 ms overlapping gunzip 853 ms, parse 3713 ms, sort 114 ms, write 8462 ms, index 603 ms: 3 candidates, 84963 repo-hours, 946 releases; waiting 529 ms; commit 1710 ms)
2026-11-07T19:15:40Z [load_day 2023-04-26] 2023-04-26 hour 11: 172060 events in 4 files, snapshot 3198310018663575680 (task 14283 ms: download 8257 ms overlapping gunzip 866 ms, parse 3697 ms, sort 106 ms, write 8223 ms, index 515 ms: 0 candidates, 80372 repo-hours, 923 releases; waiting 584 ms; commit 1748 ms)
2026-11-07T19:15:53Z [load_day 2023-04-26] 2023-04-26 hour 12: 219614 events in 5 files, snapshot 2036450004921307874 (task 16340 ms: download 8545 ms overlapping gunzip 926 ms, parse 4164 ms, sort 135 ms, write 9587 ms, index 714 ms: 5 candidates, 110441 repo-hours, 1088 releases; waiting 517 ms; commit 1653 ms)
2026-11-07T19:15:58Z [load_day 2023-04-26] 2023-04-26 hour 13: 207085 events in 5 files, snapshot 6846164414475875084 (task 17004 ms: download 8730 ms overlapping gunzip 981 ms, parse 4358 ms, sort 127 ms, write 9837 ms, index 676 ms: 2 candidates, 106425 repo-hours, 1118 releases; waiting 605 ms; commit 1611 ms)
2026-11-07T19:16:12Z [load_day 2023-04-26] 2023-04-26 hour 14: 196818 events in 4 files, snapshot 7691865107702767173 (task 18013 ms: download 10549 ms overlapping gunzip 1032 ms, parse 4630 ms, sort 123 ms, write 9803 ms, index 627 ms: 5 candidates, 97732 repo-hours, 1147 releases; waiting 1467 ms; commit 1648 ms)
2026-11-07T19:16:14Z [load_day 2023-04-26] 2023-04-26 hour 15: 176707 events in 4 files, snapshot 299724726254023315 (task 15378 ms: download 8767 ms overlapping gunzip 896 ms, parse 3903 ms, sort 106 ms, write 8935 ms, index 653 ms: 3 candidates, 89318 repo-hours, 1065 releases; waiting 553 ms; commit 1612 ms)
2026-11-07T19:16:28Z [load_day 2023-04-26] 2023-04-26 hour 16: 171150 events in 4 files, snapshot 4001683620609488795 (task 15094 ms: download 9164 ms overlapping gunzip 859 ms, parse 3862 ms, sort 111 ms, write 8844 ms, index 524 ms: 3 candidates, 84838 repo-hours, 977 releases; waiting 557 ms; commit 1769 ms)
2026-11-07T19:16:30Z [load_day 2023-04-26] 2023-04-26 hour 17: 180023 events in 4 files, snapshot 6498474639979831028 (task 15063 ms: download 8694 ms overlapping gunzip 894 ms, parse 3878 ms, sort 106 ms, write 8764 ms, index 641 ms: 1 candidates, 82650 repo-hours, 901 releases; waiting 503 ms; commit 1771 ms)
2026-11-07T19:16:44Z [load_day 2023-04-26] 2023-04-26 hour 18: 185585 events in 4 files, snapshot 2129422933830260968 (task 15551 ms: download 8901 ms overlapping gunzip 909 ms, parse 4076 ms, sort 128 ms, write 9021 ms, index 603 ms: 9 candidates, 87718 repo-hours, 991 releases; waiting 523 ms; commit 1826 ms)
2026-11-07T19:16:46Z [load_day 2023-04-26] 2023-04-26 hour 19: 174429 events in 4 files, snapshot 5915901194962237356 (task 14176 ms: download 8316 ms overlapping gunzip 847 ms, parse 3698 ms, sort 119 ms, write 8082 ms, index 515 ms: 6 candidates, 76001 repo-hours, 946 releases; waiting 559 ms; commit 1690 ms)
2026-11-07T19:16:59Z [load_day 2023-04-26] 2023-04-26 hour 20: 169417 events in 4 files, snapshot 4909734258024056289 (task 13752 ms: download 7921 ms overlapping gunzip 810 ms, parse 3575 ms, sort 103 ms, write 7952 ms, index 520 ms: 4 candidates, 75778 repo-hours, 886 releases; waiting 441 ms; commit 1795 ms)
2026-11-07T19:17:00Z [load_day 2023-04-26] 2023-04-26 hour 21: 155227 events in 4 files, snapshot 2246443804341609754 (task 12370 ms: download 4991 ms overlapping gunzip 735 ms, parse 3254 ms, sort 104 ms, write 7217 ms, index 514 ms: 5 candidates, 66482 repo-hours, 992 releases; waiting 246 ms; commit 1600 ms)
2026-11-07T19:17:12Z [load_day 2023-04-26] 2023-04-26 hour 22: 137895 events in 3 files, snapshot 4758166610024772213 (task 12568 ms: download 6438 ms overlapping gunzip 675 ms, parse 2914 ms, sort 95 ms, write 6233 ms, index 394 ms: 3 candidates, 59260 repo-hours, 838 releases; waiting 1928 ms; commit 1955 ms)
2026-11-07T19:17:14Z [load_day 2023-04-26] 2023-04-26 hour 23: 128232 events in 3 files, snapshot 4130017086495770347 (task 10236 ms: download 4487 ms overlapping gunzip 578 ms, parse 2635 ms, sort 77 ms, write 5650 ms, index 404 ms: 5 candidates, 55340 repo-hours, 689 releases; waiting 565 ms; commit 1638 ms)
2026-11-07T19:17:23Z [load_day 2023-04-26] 2023-04-26: repo_hour merged from 24 files to 1 (1904154 rows, 8537 ms)
2026-11-07T19:17:24Z [load_day 2023-04-26] 2023-04-26: index committed in 10083 ms (22 + 1 + 24 files)
2026-11-07T19:17:24Z [load_day 2023-04-26] 2023-04-26: 4017616 events in 24 hours
2026-11-07T19:17:24Z [load_day 2023-04-26] attempt 1 succeeded