orcaLog in

Runs · run 1215

load_day 2023-06-26, attempt 1 succeeded

Host
3c2b29713ce8:40208
Started
2026-11-07T22:05:14Z
Ended
2026-11-07T22:10:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1215/load_day/2023-06-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:05:14Z [load_day 2023-06-26] attempt 1 started
2026-11-07T22:05:15Z [load_day 2023-06-26] 2023-06-26: 1 hours in flight, about 750 MB
2026-11-07T22:05:26Z [load_day 2023-06-26] 2023-06-26 hour 0: 117829 events in 3 files, snapshot 8867828468670212683 (task 7458 ms: download 1788 ms overlapping gunzip 460 ms, parse 2211 ms, sort 76 ms, write 3616 ms, index 388 ms: 9 candidates, 59518 repo-hours, 851 releases; waiting 387 ms; commit 1995 ms)
2026-11-07T22:05:38Z [load_day 2023-06-26] 2023-06-26 hour 1: 167759 events in 4 files, snapshot 732056565801993333 (task 11504 ms: download 6744 ms overlapping gunzip 808 ms, parse 3477 ms, sort 99 ms, write 5773 ms, index 526 ms: 4 candidates, 81894 repo-hours, 791 releases; waiting 501 ms; commit 1941 ms)
2026-11-07T22:05:47Z [load_day 2023-06-26] 2023-06-26 hour 2: 131750 events in 3 files, snapshot 245123690047742685 (task 8700 ms: download 3767 ms overlapping gunzip 570 ms, parse 2527 ms, sort 71 ms, write 4312 ms, index 418 ms: 8 candidates, 67309 repo-hours, 740 releases; waiting 499 ms; commit 1818 ms)
2026-11-07T22:05:58Z [load_day 2023-06-26] 2023-06-26 hour 3: 128679 events in 3 files, snapshot 5972458566420871555 (task 9165 ms: download 4380 ms overlapping gunzip 601 ms, parse 2608 ms, sort 68 ms, write 4340 ms, index 381 ms: 5 candidates, 57449 repo-hours, 843 releases; waiting 820 ms; commit 1858 ms)
2026-11-07T22:06:07Z [load_day 2023-06-26] 2023-06-26 hour 4: 124080 events in 3 files, snapshot 1375953763536861960 (task 8827 ms: download 3817 ms overlapping gunzip 593 ms, parse 2550 ms, sort 73 ms, write 4432 ms, index 330 ms: 4 candidates, 52361 repo-hours, 638 releases; waiting 465 ms; commit 1757 ms)
2026-11-07T22:06:18Z [load_day 2023-06-26] 2023-06-26 hour 5: 142369 events in 3 files, snapshot 3620059566049054918 (task 10241 ms: download 4690 ms overlapping gunzip 725 ms, parse 3055 ms, sort 95 ms, write 5200 ms, index 396 ms: 5 candidates, 59915 repo-hours, 757 releases; waiting 513 ms; commit 1826 ms)
2026-11-07T22:06:31Z [load_day 2023-06-26] 2023-06-26 hour 6: 167733 events in 4 files, snapshot 8751732589222396679 (task 11876 ms: download 6985 ms overlapping gunzip 847 ms, parse 3737 ms, sort 102 ms, write 6010 ms, index 488 ms: 7 candidates, 76382 repo-hours, 981 releases; waiting 388 ms; commit 1743 ms)
2026-11-07T22:06:44Z [load_day 2023-06-26] 2023-06-26 hour 7: 174251 events in 4 files, snapshot 1679217390179463474 (task 12920 ms: download 7632 ms overlapping gunzip 893 ms, parse 3840 ms, sort 105 ms, write 6775 ms, index 535 ms: 3 candidates, 79095 repo-hours, 1017 releases; waiting 536 ms; commit 1749 ms)
2026-11-07T22:07:00Z [load_day 2023-06-26] 2023-06-26 hour 8: 181451 events in 4 files, snapshot 8191927718574129524 (task 14237 ms: download 8402 ms overlapping gunzip 962 ms, parse 4235 ms, sort 102 ms, write 7234 ms, index 570 ms: 8 candidates, 84471 repo-hours, 994 releases; waiting 782 ms; commit 1871 ms)
2026-11-07T22:07:16Z [load_day 2023-06-26] 2023-06-26 hour 9: 187397 events in 4 files, snapshot 1310664451111287866 (task 14952 ms: download 9024 ms overlapping gunzip 1021 ms, parse 4502 ms, sort 119 ms, write 7497 ms, index 528 ms: 7 candidates, 84354 repo-hours, 1123 releases; waiting 989 ms; commit 2373 ms)
2026-11-07T22:07:30Z [load_day 2023-06-26] 2023-06-26 hour 10: 180200 events in 4 files, snapshot 6721486101738417607 (task 13246 ms: download 7716 ms overlapping gunzip 919 ms, parse 4005 ms, sort 100 ms, write 6861 ms, index 530 ms: 1 candidates, 82177 repo-hours, 984 releases; waiting 541 ms; commit 2172 ms)
2026-11-07T22:07:45Z [load_day 2023-06-26] 2023-06-26 hour 11: 187827 events in 4 files, snapshot 2624810034078444309 (task 14145 ms: download 8248 ms overlapping gunzip 961 ms, parse 4240 ms, sort 115 ms, write 7445 ms, index 552 ms: 3 candidates, 81238 repo-hours, 1008 releases; waiting 512 ms; commit 2131 ms)
2026-11-07T22:08:01Z [load_day 2023-06-26] 2023-06-26 hour 12: 224232 events in 5 files, snapshot 5450900316979502528 (task 15578 ms: download 9961 ms overlapping gunzip 1026 ms, parse 4571 ms, sort 122 ms, write 7995 ms, index 888 ms: 4 candidates, 112324 repo-hours, 1085 releases; waiting 569 ms; commit 1883 ms)
2026-11-07T22:08:17Z [load_day 2023-06-26] 2023-06-26 hour 13: 204727 events in 5 files, snapshot 8158978235393801441 (task 15123 ms: download 8451 ms overlapping gunzip 1033 ms, parse 4582 ms, sort 129 ms, write 7942 ms, index 672 ms: 4 candidates, 104446 repo-hours, 1112 releases; waiting 514 ms; commit 1874 ms)
2026-11-07T22:08:32Z [load_day 2023-06-26] 2023-06-26 hour 14: 176255 events in 4 files, snapshot 8834889818816296345 (task 13798 ms: download 8207 ms overlapping gunzip 931 ms, parse 4092 ms, sort 106 ms, write 7325 ms, index 543 ms: 2 candidates, 86094 repo-hours, 1074 releases; waiting 514 ms; commit 1838 ms)
2026-11-07T22:08:46Z [load_day 2023-06-26] 2023-06-26 hour 15: 174134 events in 4 files, snapshot 3027110640309725779 (task 13657 ms: download 8149 ms overlapping gunzip 929 ms, parse 3969 ms, sort 102 ms, write 7306 ms, index 551 ms: 2 candidates, 83448 repo-hours, 1125 releases; waiting 523 ms; commit 1922 ms)
2026-11-07T22:09:00Z [load_day 2023-06-26] 2023-06-26 hour 16: 173849 events in 4 files, snapshot 881657927355940723 (task 13565 ms: download 8132 ms overlapping gunzip 947 ms, parse 4060 ms, sort 126 ms, write 7086 ms, index 543 ms: 3 candidates, 81419 repo-hours, 932 releases; waiting 504 ms; commit 1934 ms)
2026-11-07T22:09:15Z [load_day 2023-06-26] 2023-06-26 hour 17: 178562 events in 4 files, snapshot 4474110339689265278 (task 13925 ms: download 8274 ms overlapping gunzip 951 ms, parse 4110 ms, sort 113 ms, write 7457 ms, index 507 ms: 4 candidates, 78186 repo-hours, 914 releases; waiting 524 ms; commit 1777 ms)
2026-11-07T22:09:30Z [load_day 2023-06-26] 2023-06-26 hour 18: 184137 events in 4 files, snapshot 1098275131493733559 (task 13608 ms: download 7955 ms overlapping gunzip 930 ms, parse 4096 ms, sort 101 ms, write 6966 ms, index 524 ms: 5 candidates, 83047 repo-hours, 1010 releases; waiting 717 ms; commit 1742 ms)
2026-11-07T22:09:43Z [load_day 2023-06-26] 2023-06-26 hour 19: 173686 events in 4 files, snapshot 5097346299826210180 (task 12987 ms: download 7758 ms overlapping gunzip 889 ms, parse 3917 ms, sort 105 ms, write 6718 ms, index 469 ms: 9 candidates, 73791 repo-hours, 938 releases; waiting 549 ms; commit 1920 ms)
2026-11-07T22:09:57Z [load_day 2023-06-26] 2023-06-26 hour 20: 177508 events in 4 files, snapshot 7534081768459191243 (task 13284 ms: download 7978 ms overlapping gunzip 957 ms, parse 4164 ms, sort 91 ms, write 6814 ms, index 473 ms: 8 candidates, 73569 repo-hours, 993 releases; waiting 528 ms; commit 1798 ms)
2026-11-07T22:10:12Z [load_day 2023-06-26] 2023-06-26 hour 21: 160184 events in 4 files, snapshot 4048169581338160865 (task 13886 ms: download 8873 ms overlapping gunzip 900 ms, parse 3863 ms, sort 103 ms, write 6328 ms, index 426 ms: 1 candidates, 65667 repo-hours, 943 releases; waiting 1821 ms; commit 1890 ms)
2026-11-07T22:10:24Z [load_day 2023-06-26] 2023-06-26 hour 22: 148618 events in 3 files, snapshot 7782042369951128081 (task 11321 ms: download 5137 ms overlapping gunzip 786 ms, parse 3404 ms, sort 85 ms, write 5777 ms, index 396 ms: 4 candidates, 59659 repo-hours, 826 releases; waiting 551 ms; commit 1746 ms)
2026-11-07T22:10:35Z [load_day 2023-06-26] 2023-06-26 hour 23: 136808 events in 3 files, snapshot 8670416347522808885 (task 10521 ms: download 5146 ms overlapping gunzip 719 ms, parse 3155 ms, sort 88 ms, write 5300 ms, index 357 ms: 4 candidates, 55248 repo-hours, 693 releases; waiting 645 ms; commit 1763 ms)
2026-11-07T22:10:43Z [load_day 2023-06-26] 2023-06-26: repo_hour merged from 24 files to 1 (1823061 rows, 7519 ms)
2026-11-07T22:10:45Z [load_day 2023-06-26] 2023-06-26: index committed in 9369 ms (24 + 1 + 24 files)
2026-11-07T22:10:45Z [load_day 2023-06-26] 2023-06-26: 4004025 events in 24 hours
2026-11-07T22:10:45Z [load_day 2023-06-26] attempt 1 succeeded