orcaLog in

Runs · run 888

load_day 2023-03-09, attempt 1 succeeded

Host
caf251265124:141394
Started
2026-11-07T16:48:37Z
Ended
2026-11-07T16:52:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/888/load_day/2023-03-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:48:37Z [load_day 2023-03-09] attempt 1 started
2026-11-07T16:48:39Z [load_day 2023-03-09] 2023-03-09: 2 hours in flight, about 1200 MB
2026-11-07T16:48:59Z [load_day 2023-03-09] 2023-03-09 hour 0: 216609 events in 5 files, snapshot 1166949524202065913 (task 17839 ms: download 12460 ms overlapping gunzip 1295 ms, parse 4901 ms, sort 139 ms, write 9787 ms, index 711 ms: 3 candidates, 107166 repo-hours, 916 releases; waiting 620 ms; commit 1396 ms)
2026-11-07T16:49:01Z [load_day 2023-03-09] 2023-03-09 hour 1: 219533 events in 5 files, snapshot 6757305073659210034 (task 16955 ms: download 9260 ms overlapping gunzip 1163 ms, parse 4679 ms, sort 135 ms, write 9337 ms, index 759 ms: 5 candidates, 117030 repo-hours, 854 releases; waiting 562 ms; commit 1462 ms)
2026-11-07T16:49:13Z [load_day 2023-03-09] 2023-03-09 hour 2: 184547 events in 4 files, snapshot 8800294735648931553 (task 12950 ms: download 6986 ms overlapping gunzip 743 ms, parse 3217 ms, sort 105 ms, write 7414 ms, index 655 ms: 9 candidates, 98484 repo-hours, 741 releases; waiting 521 ms; commit 1487 ms)
2026-11-07T16:49:23Z [load_day 2023-03-09] 2023-03-09 hour 3: 197533 events in 4 files, snapshot 6905606846160365101 (task 16674 ms: download 11155 ms overlapping gunzip 1178 ms, parse 4674 ms, sort 117 ms, write 8941 ms, index 871 ms: 3 candidates, 93694 repo-hours, 822 releases; waiting 539 ms; commit 6841 ms)
2026-11-07T16:49:29Z [load_day 2023-03-09] 2023-03-09 hour 4: 164818 events in 4 files, snapshot 1575466787107897441 (task 14731 ms: download 7465 ms overlapping gunzip 996 ms, parse 4070 ms, sort 92 ms, write 7306 ms, index 483 ms: 5 candidates, 73239 repo-hours, 692 releases; waiting 1480 ms; commit 1611 ms)
2026-11-07T16:49:35Z [load_day 2023-03-09] 2023-03-09 hour 5: 143891 events in 3 files, snapshot 6325023962654563853 (task 11224 ms: download 4955 ms overlapping gunzip 745 ms, parse 2928 ms, sort 106 ms, write 6161 ms, index 458 ms: 6 candidates, 61842 repo-hours, 778 releases; waiting 596 ms; commit 1518 ms)
2026-11-07T16:49:52Z [load_day 2023-03-09] 2023-03-09 hour 6: 218959 events in 5 files, snapshot 7145999176186573114 (task 22466 ms: download 15866 ms overlapping gunzip 1894 ms, parse 7061 ms, sort 127 ms, write 12242 ms, index 539 ms: 6 candidates, 86920 repo-hours, 809 releases; waiting 238 ms; commit 1455 ms)
2026-11-07T16:50:04Z [load_day 2023-03-09] 2023-03-09 hour 7: 242094 events in 5 files, snapshot 2001361019432552436 (task 28553 ms: download 23458 ms overlapping gunzip 2289 ms, parse 8577 ms, sort 153 ms, write 14716 ms, index 618 ms: 8 candidates, 91479 repo-hours, 829 releases; waiting 1897 ms; commit 1686 ms)
2026-11-07T16:50:18Z [load_day 2023-03-09] 2023-03-09 hour 8: 220162 events in 5 files, snapshot 9018945828910691796 (task 24980 ms: download 18208 ms overlapping gunzip 2025 ms, parse 7541 ms, sort 117 ms, write 13601 ms, index 590 ms: 4 candidates, 91875 repo-hours, 791 releases; waiting 764 ms; commit 1662 ms)
2026-11-07T16:50:30Z [load_day 2023-03-09] 2023-03-09 hour 9: 233297 events in 5 files, snapshot 7380761777048209927 (task 24923 ms: download 20380 ms overlapping gunzip 2018 ms, parse 7479 ms, sort 140 ms, write 13536 ms, index 608 ms: 1 candidates, 106165 repo-hours, 901 releases; waiting 833 ms; commit 1511 ms)
2026-11-07T16:50:51Z [load_day 2023-03-09] 2023-03-09 hour 10: 249133 events in 5 files, snapshot 2555393346961385385 (task 32314 ms: download 26902 ms overlapping gunzip 2416 ms, parse 8923 ms, sort 162 ms, write 14717 ms, index 603 ms: 4 candidates, 97218 repo-hours, 956 releases; waiting 5150 ms; commit 1440 ms)
2026-11-07T16:50:58Z [load_day 2023-03-09] 2023-03-09 hour 11: 254110 events in 6 files, snapshot 4346846902386413967 (task 27760 ms: download 21782 ms overlapping gunzip 2265 ms, parse 8713 ms, sort 149 ms, write 15137 ms, index 638 ms: 3 candidates, 102318 repo-hours, 972 releases; waiting 547 ms; commit 1472 ms)
2026-11-07T16:51:19Z [load_day 2023-03-09] 2023-03-09 hour 12: 271158 events in 6 files, snapshot 6519178073644432022 (task 27642 ms: download 21023 ms overlapping gunzip 2274 ms, parse 8333 ms, sort 172 ms, write 15334 ms, index 816 ms: 13 candidates, 119806 repo-hours, 1018 releases; waiting 357 ms; commit 1673 ms)
2026-11-07T16:51:21Z [load_day 2023-03-09] 2023-03-09 hour 13: 241365 events in 5 files, snapshot 3372546037235444138 (task 22089 ms: download 14962 ms overlapping gunzip 1511 ms, parse 5896 ms, sort 157 ms, write 12351 ms, index 771 ms: 8 candidates, 110262 repo-hours, 1074 releases; waiting 931 ms; commit 1538 ms)
2026-11-07T16:51:38Z [load_day 2023-03-09] 2023-03-09 hour 14: 220337 events in 5 files, snapshot 123856194123754329 (task 17683 ms: download 11864 ms overlapping gunzip 1098 ms, parse 4667 ms, sort 146 ms, write 10276 ms, index 634 ms: 5 candidates, 100046 repo-hours, 1118 releases; waiting 566 ms; commit 1512 ms)
2026-11-07T16:51:40Z [load_day 2023-03-09] 2023-03-09 hour 15: 216213 events in 5 files, snapshot 8723951479439896203 (task 17936 ms: download 12158 ms overlapping gunzip 1058 ms, parse 4635 ms, sort 144 ms, write 10302 ms, index 689 ms: 4 candidates, 99900 repo-hours, 1318 releases; waiting 782 ms; commit 1540 ms)
2026-11-07T16:51:56Z [load_day 2023-03-09] 2023-03-09 hour 16: 206200 events in 5 files, snapshot 4051369843643855494 (task 17081 ms: download 9397 ms overlapping gunzip 1038 ms, parse 4475 ms, sort 135 ms, write 9964 ms, index 624 ms: 7 candidates, 94927 repo-hours, 1047 releases; waiting 514 ms; commit 1583 ms)
2026-11-07T16:51:57Z [load_day 2023-03-09] 2023-03-09 hour 17: 213848 events in 5 files, snapshot 239066090563761531 (task 16349 ms: download 8977 ms overlapping gunzip 959 ms, parse 4224 ms, sort 141 ms, write 9580 ms, index 608 ms: 10 candidates, 101129 repo-hours, 1063 releases; waiting 534 ms; commit 1470 ms)
2026-11-07T16:52:13Z [load_day 2023-03-09] 2023-03-09 hour 18: 205420 events in 5 files, snapshot 4006541462009070310 (task 16355 ms: download 8791 ms overlapping gunzip 981 ms, parse 4272 ms, sort 141 ms, write 9416 ms, index 601 ms: 9 candidates, 90988 repo-hours, 994 releases; waiting 613 ms; commit 1583 ms)
2026-11-07T16:52:14Z [load_day 2023-03-09] 2023-03-09 hour 19: 199494 events in 4 files, snapshot 1619881851366112936 (task 15980 ms: download 8956 ms overlapping gunzip 946 ms, parse 4171 ms, sort 148 ms, write 9171 ms, index 551 ms: 15 candidates, 83931 repo-hours, 953 releases; waiting 687 ms; commit 1534 ms)
2026-11-07T16:52:28Z [load_day 2023-03-09] 2023-03-09 hour 20: 192939 events in 4 files, snapshot 1775820277420792112 (task 14974 ms: download 8204 ms overlapping gunzip 930 ms, parse 4063 ms, sort 125 ms, write 8499 ms, index 522 ms: 9 candidates, 79996 repo-hours, 970 releases; waiting 534 ms; commit 1386 ms)
2026-11-07T16:52:30Z [load_day 2023-03-09] 2023-03-09 hour 21: 192590 events in 4 files, snapshot 5695801379320695054 (task 14266 ms: download 7335 ms overlapping gunzip 821 ms, parse 3674 ms, sort 136 ms, write 7770 ms, index 607 ms: 12 candidates, 91683 repo-hours, 1046 releases; waiting 820 ms; commit 1855 ms)
2026-11-07T16:52:44Z [load_day 2023-03-09] 2023-03-09 hour 22: 171589 events in 4 files, snapshot 1465523532982376826 (task 14072 ms: download 8309 ms overlapping gunzip 824 ms, parse 3572 ms, sort 107 ms, write 8106 ms, index 516 ms: 8 candidates, 68105 repo-hours, 988 releases; waiting 575 ms; commit 1651 ms)
2026-11-07T16:52:45Z [load_day 2023-03-09] 2023-03-09 hour 23: 160028 events in 4 files, snapshot 7153755231400030524 (task 12607 ms: download 5496 ms overlapping gunzip 755 ms, parse 3268 ms, sort 112 ms, write 7037 ms, index 422 ms: 5 candidates, 63137 repo-hours, 762 releases; waiting 673 ms; commit 1372 ms)
2026-11-07T16:52:54Z [load_day 2023-03-09] 2023-03-09: repo_hour merged from 24 files to 1 (2231340 rows, 9286 ms)
2026-11-07T16:52:56Z [load_day 2023-03-09] 2023-03-09: index committed in 11407 ms (24 + 1 + 24 files)
2026-11-07T16:52:56Z [load_day 2023-03-09] 2023-03-09: 5035867 events in 24 hours
2026-11-07T16:52:56Z [load_day 2023-03-09] attempt 1 succeeded