orcaLog in

Runs · run 759

load_day 2023-01-25, attempt 1 succeeded

Host
d3d1748bf284:42705
Started
2026-11-07T14:13:01Z
Ended
2026-11-07T14:16:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/759/load_day/2023-01-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:13:01Z [load_day 2023-01-25] attempt 1 started
2026-11-07T14:13:02Z [load_day 2023-01-25] 2023-01-25: 2 hours in flight, about 1200 MB
2026-11-07T14:13:20Z [load_day 2023-01-25] 2023-01-25 hour 0: 176340 events in 4 files, snapshot 3724931031474975904 (task 15217 ms: download 9256 ms overlapping gunzip 1062 ms, parse 4461 ms, sort 101 ms, write 8248 ms, index 492 ms: 9 candidates, 75124 repo-hours, 905 releases; waiting 507 ms; commit 1404 ms)
2026-11-07T14:13:21Z [load_day 2023-01-25] 2023-01-25 hour 1: 150573 events in 4 files, snapshot 3024445933188544362 (task 11513 ms: download 5021 ms overlapping gunzip 681 ms, parse 3083 ms, sort 94 ms, write 6308 ms, index 497 ms: 4 candidates, 71289 repo-hours, 839 releases; waiting 569 ms; commit 1332 ms)
2026-11-07T14:13:30Z [load_day 2023-01-25] 2023-01-25 hour 2: 124294 events in 3 files, snapshot 8750948036094202976 (task 9489 ms: download 4402 ms overlapping gunzip 592 ms, parse 2459 ms, sort 59 ms, write 4777 ms, index 352 ms: 8 candidates, 54835 repo-hours, 598 releases; waiting 891 ms; commit 1207 ms)
2026-11-07T14:13:33Z [load_day 2023-01-25] 2023-01-25 hour 3: 129938 events in 3 files, snapshot 4208770016076647714 (task 10655 ms: download 5485 ms overlapping gunzip 640 ms, parse 2744 ms, sort 65 ms, write 5138 ms, index 314 ms: 2 candidates, 47484 repo-hours, 793 releases; waiting 1356 ms; commit 1416 ms)
2026-11-07T14:13:43Z [load_day 2023-01-25] 2023-01-25 hour 4: 144731 events in 3 files, snapshot 1981773686154782282 (task 11709 ms: download 5410 ms overlapping gunzip 803 ms, parse 3418 ms, sort 94 ms, write 6227 ms, index 345 ms: 4 candidates, 52497 repo-hours, 567 releases; waiting 506 ms; commit 1514 ms)
2026-11-07T14:13:44Z [load_day 2023-01-25] 2023-01-25 hour 5: 132971 events in 3 files, snapshot 2732411490784835548 (task 9721 ms: download 4136 ms overlapping gunzip 575 ms, parse 2479 ms, sort 79 ms, write 5196 ms, index 321 ms: 2 candidates, 50376 repo-hours, 689 releases; waiting 525 ms; commit 1312 ms)
2026-11-07T14:13:55Z [load_day 2023-01-25] 2023-01-25 hour 6: 143421 events in 3 files, snapshot 2840289096698644693 (task 12038 ms: download 6161 ms overlapping gunzip 649 ms, parse 2788 ms, sort 86 ms, write 5431 ms, index 369 ms: 2 candidates, 56660 repo-hours, 724 releases; waiting 2205 ms; commit 1467 ms)
2026-11-07T14:13:57Z [load_day 2023-01-25] 2023-01-25 hour 7: 144986 events in 3 files, snapshot 3468226141550317450 (task 10735 ms: download 4701 ms overlapping gunzip 670 ms, parse 2882 ms, sort 82 ms, write 5881 ms, index 365 ms: 2 candidates, 55557 repo-hours, 580 releases; waiting 518 ms; commit 1447 ms)
2026-11-07T14:14:10Z [load_day 2023-01-25] 2023-01-25 hour 8: 176129 events in 4 files, snapshot 7268873257140496585 (task 13928 ms: download 8507 ms overlapping gunzip 895 ms, parse 3848 ms, sort 117 ms, write 7920 ms, index 430 ms: 4 candidates, 66812 repo-hours, 734 releases; waiting 434 ms; commit 1315 ms)
2026-11-07T14:14:12Z [load_day 2023-01-25] 2023-01-25 hour 9: 188356 events in 4 files, snapshot 8846907268653117015 (task 14737 ms: download 8316 ms overlapping gunzip 957 ms, parse 4165 ms, sort 105 ms, write 8488 ms, index 549 ms: 1 candidates, 72702 repo-hours, 963 releases; waiting 200 ms; commit 1222 ms)
2026-11-07T14:14:26Z [load_day 2023-01-25] 2023-01-25 hour 10: 184111 events in 4 files, snapshot 6289203205022610773 (task 15817 ms: download 9546 ms overlapping gunzip 969 ms, parse 4104 ms, sort 97 ms, write 8875 ms, index 495 ms: 10 candidates, 74981 repo-hours, 979 releases; waiting 966 ms; commit 1424 ms)
2026-11-07T14:14:28Z [load_day 2023-01-25] 2023-01-25 hour 11: 186549 events in 4 files, snapshot 5684751163889147854 (task 14777 ms: download 8649 ms overlapping gunzip 921 ms, parse 3953 ms, sort 106 ms, write 8419 ms, index 463 ms: 10 candidates, 73111 repo-hours, 997 releases; waiting 588 ms; commit 1197 ms)
2026-11-07T14:14:42Z [load_day 2023-01-25] 2023-01-25 hour 12: 217105 events in 5 files, snapshot 2490716555198930495 (task 15164 ms: download 7698 ms overlapping gunzip 926 ms, parse 4143 ms, sort 127 ms, write 8852 ms, index 682 ms: 6 candidates, 101074 repo-hours, 1073 releases; waiting 187 ms; commit 1189 ms)
2026-11-07T14:14:45Z [load_day 2023-01-25] 2023-01-25 hour 13: 215330 events in 5 files, snapshot 1272950158036886540 (task 16797 ms: download 11114 ms overlapping gunzip 998 ms, parse 4358 ms, sort 117 ms, write 9994 ms, index 618 ms: 7 candidates, 98898 repo-hours, 1118 releases; waiting 397 ms; commit 1258 ms)
2026-11-07T14:15:00Z [load_day 2023-01-25] 2023-01-25 hour 14: 210363 events in 5 files, snapshot 5179413577231625730 (task 17201 ms: download 9525 ms overlapping gunzip 1102 ms, parse 4819 ms, sort 121 ms, write 10064 ms, index 594 ms: 5 candidates, 89706 repo-hours, 1025 releases; waiting 184 ms; commit 1268 ms)
2026-11-07T14:15:03Z [load_day 2023-01-25] 2023-01-25 hour 15: 210023 events in 5 files, snapshot 4029774276775454191 (task 17069 ms: download 9250 ms overlapping gunzip 1064 ms, parse 4588 ms, sort 118 ms, write 9851 ms, index 610 ms: 3 candidates, 90743 repo-hours, 1295 releases; waiting 516 ms; commit 1327 ms)
2026-11-07T14:15:20Z [load_day 2023-01-25] 2023-01-25 hour 16: 201145 events in 5 files, snapshot 3462840252836499337 (task 19404 ms: download 11861 ms overlapping gunzip 1082 ms, parse 4764 ms, sort 121 ms, write 9934 ms, index 613 ms: 5 candidates, 88133 repo-hours, 1028 releases; waiting 2531 ms; commit 1418 ms)
2026-11-07T14:15:22Z [load_day 2023-01-25] 2023-01-25 hour 17: 193003 events in 4 files, snapshot 7502191725837156621 (task 18053 ms: download 11112 ms overlapping gunzip 1036 ms, parse 4440 ms, sort 124 ms, write 9298 ms, index 567 ms: 5 candidates, 83721 repo-hours, 1069 releases; waiting 2232 ms; commit 1374 ms)
2026-11-07T14:15:37Z [load_day 2023-01-25] 2023-01-25 hour 18: 188877 events in 4 files, snapshot 7300886050859203350 (task 15650 ms: download 8998 ms overlapping gunzip 912 ms, parse 3954 ms, sort 83 ms, write 9194 ms, index 594 ms: 3 candidates, 84603 repo-hours, 1013 releases; waiting 638 ms; commit 1386 ms)
2026-11-07T14:15:38Z [load_day 2023-01-25] 2023-01-25 hour 19: 177851 events in 4 files, snapshot 6635690005998763072 (task 15322 ms: download 9122 ms overlapping gunzip 915 ms, parse 3929 ms, sort 88 ms, write 8517 ms, index 494 ms: 4 candidates, 76154 repo-hours, 931 releases; waiting 1060 ms; commit 1401 ms)
2026-11-07T14:15:52Z [load_day 2023-01-25] 2023-01-25 hour 20: 177571 events in 4 files, snapshot 8053610699702096928 (task 14953 ms: download 8763 ms overlapping gunzip 919 ms, parse 3970 ms, sort 112 ms, write 8233 ms, index 534 ms: 5 candidates, 77342 repo-hours, 978 releases; waiting 846 ms; commit 1224 ms)
2026-11-07T14:15:57Z [load_day 2023-01-25] 2023-01-25 hour 21: 171311 events in 4 files, snapshot 4068895959286793300 (task 17747 ms: download 11940 ms overlapping gunzip 942 ms, parse 4035 ms, sort 81 ms, write 7918 ms, index 496 ms: 2 candidates, 69871 repo-hours, 1085 releases; waiting 3856 ms; commit 1323 ms)
2026-11-07T14:16:06Z [load_day 2023-01-25] 2023-01-25 hour 22: 152077 events in 4 files, snapshot 2548037460196977301 (task 12910 ms: download 5663 ms overlapping gunzip 789 ms, parse 3396 ms, sort 101 ms, write 7168 ms, index 422 ms: 4 candidates, 62840 repo-hours, 925 releases; waiting 696 ms; commit 1461 ms)
2026-11-07T14:16:10Z [load_day 2023-01-25] 2023-01-25 hour 23: 140253 events in 3 files, snapshot 7318803358234498397 (task 12098 ms: download 5771 ms overlapping gunzip 738 ms, parse 3159 ms, sort 85 ms, write 6382 ms, index 423 ms: 4 candidates, 58571 repo-hours, 823 releases; waiting 1003 ms; commit 1780 ms)
2026-11-07T14:16:17Z [load_day 2023-01-25] 2023-01-25: repo_hour merged from 24 files to 1 (1733084 rows, 7034 ms)
2026-11-07T14:16:19Z [load_day 2023-01-25] 2023-01-25: index committed in 8893 ms (24 + 1 + 24 files)
2026-11-07T14:16:19Z [load_day 2023-01-25] 2023-01-25: 4137308 events in 24 hours
2026-11-07T14:16:19Z [load_day 2023-01-25] attempt 1 succeeded