orcaLog in

Runs · run 1429

load_day 2023-08-25, attempt 1 succeeded

Host
3c2b29713ce8:262476
Started
2026-11-08T00:13:02Z
Ended
2026-11-08T00:16:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1429/load_day/2023-08-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:13:02Z [load_day 2023-08-25] attempt 1 started
2026-11-08T00:13:04Z [load_day 2023-08-25] 2023-08-25: 2 hours in flight, about 1200 MB
2026-11-08T00:13:25Z [load_day 2023-08-25] 2023-08-25 hour 0: 172886 events in 4 files, snapshot 1518767654580344282 (task 16555 ms: download 7103 ms overlapping gunzip 979 ms, parse 4788 ms, sort 113 ms, write 9247 ms, index 662 ms: 8 candidates, 92758 repo-hours, 918 releases; waiting 479 ms; commit 2525 ms)
2026-11-08T00:13:29Z [load_day 2023-08-25] 2023-08-25 hour 1: 166846 events in 4 files, snapshot 120825009374096880 (task 15908 ms: download 6104 ms overlapping gunzip 820 ms, parse 3857 ms, sort 108 ms, write 9468 ms, index 836 ms: 5 candidates, 92021 repo-hours, 792 releases; waiting 509 ms; commit 4629 ms)
2026-11-08T00:13:40Z [load_day 2023-08-25] 2023-08-25 hour 2: 145492 events in 3 files, snapshot 7589320057570796289 (task 14398 ms: download 6684 ms overlapping gunzip 910 ms, parse 3904 ms, sort 120 ms, write 8201 ms, index 486 ms: 5 candidates, 61367 repo-hours, 854 releases; waiting 516 ms; commit 2948 ms)
2026-11-08T00:13:43Z [load_day 2023-08-25] 2023-08-25 hour 3: 139292 events in 3 files, snapshot 267078742499319772 (task 13236 ms: download 6054 ms overlapping gunzip 801 ms, parse 3711 ms, sort 125 ms, write 7403 ms, index 411 ms: 5 candidates, 58160 repo-hours, 864 releases; waiting 502 ms; commit 2500 ms)
2026-11-08T00:13:54Z [load_day 2023-08-25] 2023-08-25 hour 4: 130466 events in 3 files, snapshot 440483284369474407 (task 13204 ms: download 5274 ms overlapping gunzip 808 ms, parse 3611 ms, sort 182 ms, write 7416 ms, index 402 ms: 4 candidates, 52812 repo-hours, 615 releases; waiting 480 ms; commit 2378 ms)
2026-11-08T00:13:58Z [load_day 2023-08-25] 2023-08-25 hour 5: 141363 events in 3 files, snapshot 5252683048184833540 (task 14149 ms: download 6166 ms overlapping gunzip 884 ms, parse 3712 ms, sort 121 ms, write 8175 ms, index 505 ms: 5 candidates, 59003 repo-hours, 787 releases; waiting 497 ms; commit 2661 ms)
2026-11-08T00:14:13Z [load_day 2023-08-25] 2023-08-25 hour 6: 167441 events in 4 files, snapshot 7313589808111227588 (task 17321 ms: download 9909 ms overlapping gunzip 1112 ms, parse 4866 ms, sort 113 ms, write 9811 ms, index 583 ms: 5 candidates, 75805 repo-hours, 946 releases; waiting 514 ms; commit 2663 ms)
2026-11-08T00:14:18Z [load_day 2023-08-25] 2023-08-25 hour 7: 170277 events in 4 files, snapshot 4112961157689311058 (task 18315 ms: download 11094 ms overlapping gunzip 1058 ms, parse 4833 ms, sort 155 ms, write 10900 ms, index 528 ms: 5 candidates, 74714 repo-hours, 1125 releases; waiting 488 ms; commit 2967 ms)
2026-11-08T00:14:30Z [load_day 2023-08-25] 2023-08-25 hour 8: 183338 events in 4 files, snapshot 2407045935446491752 (task 17009 ms: download 9738 ms overlapping gunzip 977 ms, parse 4331 ms, sort 127 ms, write 10155 ms, index 570 ms: 6 candidates, 80161 repo-hours, 1099 releases; waiting 515 ms; commit 1914 ms)
2026-11-08T00:14:34Z [load_day 2023-08-25] 2023-08-25 hour 9: 185233 events in 4 files, snapshot 8511448587100642760 (task 16070 ms: download 9182 ms overlapping gunzip 913 ms, parse 4168 ms, sort 139 ms, write 9482 ms, index 561 ms: 2 candidates, 80519 repo-hours, 1270 releases; waiting 521 ms; commit 1919 ms)
2026-11-08T00:14:52Z [load_day 2023-08-25] 2023-08-25 hour 10: 179117 events in 4 files, snapshot 8826037137616379385 (task 18258 ms: download 10411 ms overlapping gunzip 942 ms, parse 4214 ms, sort 168 ms, write 11597 ms, index 570 ms: 3 candidates, 75543 repo-hours, 1107 releases; waiting 514 ms; commit 4125 ms)
2026-11-08T00:14:56Z [load_day 2023-08-25] 2023-08-25 hour 11: 178160 events in 4 files, snapshot 6404583456513828084 (task 19284 ms: download 11639 ms overlapping gunzip 1110 ms, parse 5052 ms, sort 170 ms, write 11311 ms, index 849 ms: 5 candidates, 74915 repo-hours, 920 releases; waiting 518 ms; commit 3035 ms)
2026-11-08T00:15:13Z [load_day 2023-08-25] 2023-08-25 hour 12: 226565 events in 5 files, snapshot 5928968510522646914 (task 21406 ms: download 11232 ms overlapping gunzip 1227 ms, parse 5534 ms, sort 148 ms, write 13020 ms, index 722 ms: 4 candidates, 104070 repo-hours, 1073 releases; waiting 499 ms; commit 3055 ms)
2026-11-08T00:15:18Z [load_day 2023-08-25] 2023-08-25 hour 13: 207878 events in 5 files, snapshot 5477874637352842499 (task 22045 ms: download 11458 ms overlapping gunzip 1165 ms, parse 5391 ms, sort 184 ms, write 13594 ms, index 858 ms: 5 candidates, 102272 repo-hours, 1184 releases; waiting 507 ms; commit 2375 ms)
2026-11-08T00:15:34Z [load_day 2023-08-25] 2023-08-25 hour 14: 194826 events in 4 files, snapshot 5377016629743204053 (task 20847 ms: download 11691 ms overlapping gunzip 1194 ms, parse 5313 ms, sort 175 ms, write 12717 ms, index 629 ms: 6 candidates, 85592 repo-hours, 1203 releases; waiting 509 ms; commit 2343 ms)
2026-11-08T00:15:39Z [load_day 2023-08-25] 2023-08-25 hour 15: 178498 events in 4 files, snapshot 4806142309188550473 (task 19614 ms: download 11692 ms overlapping gunzip 1142 ms, parse 5390 ms, sort 163 ms, write 11220 ms, index 891 ms: 5 candidates, 80192 repo-hours, 1269 releases; waiting 516 ms; commit 2331 ms)
2026-11-08T00:16:00Z [load_day 2023-08-25] 2023-08-25 hour 16: 175995 events in 4 files, snapshot 7977816120413039103 (task 19063 ms: download 11026 ms overlapping gunzip 1153 ms, parse 5172 ms, sort 166 ms, write 10805 ms, index 629 ms: 5 candidates, 76989 repo-hours, 1227 releases; waiting 880 ms; commit 7978 ms)
2026-11-08T00:16:02Z [load_day 2023-08-25] 2023-08-25 hour 17: 173220 events in 4 files, snapshot 1712825073316414364 (task 18060 ms: download 10561 ms overlapping gunzip 924 ms, parse 4108 ms, sort 152 ms, write 11184 ms, index 860 ms: 6 candidates, 73196 repo-hours, 1056 releases; waiting 476 ms; commit 2248 ms)
2026-11-08T00:16:13Z [load_day 2023-08-25] 2023-08-25 hour 18: 176259 events in 4 files, snapshot 4066659950438726268 (task 16876 ms: download 8809 ms overlapping gunzip 1011 ms, parse 4532 ms, sort 181 ms, write 10052 ms, index 541 ms: 3 candidates, 77212 repo-hours, 936 releases; waiting 191 ms; commit 3384 ms)
2026-11-08T00:16:22Z [load_day 2023-08-25] 2023-08-25 hour 19: 157955 events in 4 files, snapshot 5827658253621915258 (task 16116 ms: download 6389 ms overlapping gunzip 976 ms, parse 4575 ms, sort 120 ms, write 9079 ms, index 608 ms: 3 candidates, 64183 repo-hours, 952 releases; waiting 487 ms; commit 5060 ms)
2026-11-08T00:16:30Z [load_day 2023-08-25] 2023-08-25 hour 20: 153960 events in 4 files, snapshot 2237702578280914864 (task 16732 ms: download 6439 ms overlapping gunzip 1071 ms, parse 4537 ms, sort 118 ms, write 9495 ms, index 699 ms: 8 candidates, 63596 repo-hours, 838 releases; waiting 509 ms; commit 2410 ms)
2026-11-08T00:16:37Z [load_day 2023-08-25] 2023-08-25 hour 21: 139243 events in 3 files, snapshot 9046029949535705082 (task 15927 ms: download 7475 ms overlapping gunzip 980 ms, parse 4124 ms, sort 89 ms, write 9459 ms, index 476 ms: 5 candidates, 56066 repo-hours, 854 releases; waiting 482 ms; commit 2930 ms)
2026-11-08T00:16:45Z [load_day 2023-08-25] 2023-08-25 hour 22: 125473 events in 3 files, snapshot 1015385185278843976 (task 12898 ms: download 5426 ms overlapping gunzip 739 ms, parse 3156 ms, sort 97 ms, write 7871 ms, index 381 ms: 3 candidates, 50606 repo-hours, 716 releases; waiting 343 ms; commit 3301 ms)
2026-11-08T00:16:49Z [load_day 2023-08-25] 2023-08-25 hour 23: 116044 events in 3 files, snapshot 2333578327278594000 (task 11377 ms: download 5531 ms overlapping gunzip 745 ms, parse 3018 ms, sort 71 ms, write 6368 ms, index 324 ms: 1 candidates, 47637 repo-hours, 633 releases; waiting 540 ms; commit 2056 ms)
2026-11-08T00:16:56Z [load_day 2023-08-25] 2023-08-25: repo_hour merged from 24 files to 1 (1759389 rows, 7302 ms)
2026-11-08T00:16:59Z [load_day 2023-08-25] 2023-08-25: index committed in 9376 ms (24 + 1 + 24 files)
2026-11-08T00:16:59Z [load_day 2023-08-25] 2023-08-25: 3985827 events in 24 hours
2026-11-08T00:16:59Z [load_day 2023-08-25] attempt 1 succeeded