orcaLog in

Runs · run 840

load_day 2023-02-21, attempt 1 succeeded

Host
caf251265124:78808
Started
2026-11-07T15:54:32Z
Ended
2026-11-07T15:57:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/840/load_day/2023-02-21/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:54:32Z [load_day 2023-02-21] attempt 1 started
2026-11-07T15:54:34Z [load_day 2023-02-21] 2023-02-21: 2 hours in flight, about 1200 MB
2026-11-07T15:54:49Z [load_day 2023-02-21] 2023-02-21 hour 0: 150077 events in 4 files, snapshot 8564545172601131630 (task 12329 ms: download 5894 ms overlapping gunzip 788 ms, parse 3315 ms, sort 90 ms, write 6691 ms, index 459 ms: 6 candidates, 70380 repo-hours, 1006 releases; waiting 603 ms; commit 1491 ms)
2026-11-07T15:54:50Z [load_day 2023-02-21] 2023-02-21 hour 1: 158047 events in 4 files, snapshot 5530510465338408061 (task 12486 ms: download 5614 ms overlapping gunzip 745 ms, parse 3233 ms, sort 83 ms, write 6656 ms, index 484 ms: 8 candidates, 80245 repo-hours, 852 releases; waiting 905 ms; commit 1230 ms)
2026-11-07T15:55:01Z [load_day 2023-02-21] 2023-02-21 hour 2: 146168 events in 3 files, snapshot 8647819288769158634 (task 11138 ms: download 4946 ms overlapping gunzip 679 ms, parse 2835 ms, sort 101 ms, write 5950 ms, index 454 ms: 3 candidates, 70295 repo-hours, 742 releases; waiting 783 ms; commit 1515 ms)
2026-11-07T15:55:02Z [load_day 2023-02-21] 2023-02-21 hour 3: 139135 events in 3 files, snapshot 7272360865089328771 (task 10600 ms: download 4648 ms overlapping gunzip 628 ms, parse 2657 ms, sort 81 ms, write 5716 ms, index 400 ms: 1 candidates, 59630 repo-hours, 952 releases; waiting 756 ms; commit 1259 ms)
2026-11-07T15:55:11Z [load_day 2023-02-21] 2023-02-21 hour 4: 128680 events in 3 files, snapshot 3055674070011926821 (task 9686 ms: download 4297 ms overlapping gunzip 588 ms, parse 2490 ms, sort 90 ms, write 5271 ms, index 341 ms: 3 candidates, 53966 repo-hours, 662 releases; waiting 574 ms; commit 1266 ms)
2026-11-07T15:55:13Z [load_day 2023-02-21] 2023-02-21 hour 5: 138896 events in 3 files, snapshot 5009603743718829540 (task 10546 ms: download 4709 ms overlapping gunzip 677 ms, parse 2863 ms, sort 74 ms, write 5672 ms, index 389 ms: 1 candidates, 59996 repo-hours, 710 releases; waiting 502 ms; commit 1285 ms)
2026-11-07T15:55:24Z [load_day 2023-02-21] 2023-02-21 hour 6: 157180 events in 4 files, snapshot 5529014079845710867 (task 12147 ms: download 5542 ms overlapping gunzip 798 ms, parse 3414 ms, sort 94 ms, write 6604 ms, index 452 ms: 2 candidates, 71679 repo-hours, 922 releases; waiting 534 ms; commit 1188 ms)
2026-11-07T15:55:28Z [load_day 2023-02-21] 2023-02-21 hour 7: 167326 events in 4 files, snapshot 1005784493430269690 (task 13618 ms: download 5950 ms overlapping gunzip 807 ms, parse 3439 ms, sort 93 ms, write 7264 ms, index 525 ms: 5 candidates, 72977 repo-hours, 874 releases; waiting 1010 ms; commit 1300 ms)
2026-11-07T15:55:40Z [load_day 2023-02-21] 2023-02-21 hour 8: 184088 events in 4 files, snapshot 6148402091895377542 (task 15564 ms: download 9031 ms overlapping gunzip 975 ms, parse 4188 ms, sort 105 ms, write 8848 ms, index 544 ms: 3 candidates, 82215 repo-hours, 898 releases; waiting 543 ms; commit 1205 ms)
2026-11-07T15:55:45Z [load_day 2023-02-21] 2023-02-21 hour 9: 196573 events in 4 files, snapshot 2723398512590174581 (task 16199 ms: download 9115 ms overlapping gunzip 1013 ms, parse 4377 ms, sort 125 ms, write 9250 ms, index 615 ms: 5 candidates, 90413 repo-hours, 1136 releases; waiting 546 ms; commit 1303 ms)
2026-11-07T15:55:57Z [load_day 2023-02-21] 2023-02-21 hour 10: 198648 events in 4 files, snapshot 3230861578474341221 (task 16351 ms: download 9187 ms overlapping gunzip 1018 ms, parse 4363 ms, sort 145 ms, write 9681 ms, index 543 ms: 4 candidates, 89612 repo-hours, 1094 releases; waiting 298 ms; commit 1369 ms)
2026-11-07T15:56:02Z [load_day 2023-02-21] 2023-02-21 hour 11: 196648 events in 4 files, snapshot 6406093720918068718 (task 16316 ms: download 9348 ms overlapping gunzip 1019 ms, parse 4281 ms, sort 128 ms, write 9102 ms, index 586 ms: 5 candidates, 89592 repo-hours, 984 releases; waiting 805 ms; commit 1629 ms)
2026-11-07T15:56:16Z [load_day 2023-02-21] 2023-02-21 hour 12: 225699 events in 5 files, snapshot 1535729080006274236 (task 17767 ms: download 11689 ms overlapping gunzip 1079 ms, parse 4636 ms, sort 119 ms, write 10227 ms, index 708 ms: 7 candidates, 108845 repo-hours, 1094 releases; waiting 711 ms; commit 1626 ms)
2026-11-07T15:56:23Z [load_day 2023-02-21] 2023-02-21 hour 13: 221443 events in 5 files, snapshot 1001116969576711663 (task 17384 ms: download 11213 ms overlapping gunzip 1082 ms, parse 4722 ms, sort 138 ms, write 10170 ms, index 683 ms: 6 candidates, 107607 repo-hours, 938 releases; waiting 267 ms; commit 4365 ms)
2026-11-07T15:56:35Z [load_day 2023-02-21] 2023-02-21 hour 14: 227661 events in 5 files, snapshot 2764856183933741189 (task 18493 ms: download 11908 ms overlapping gunzip 1103 ms, parse 4741 ms, sort 123 ms, write 11163 ms, index 647 ms: 1 candidates, 110193 repo-hours, 1205 releases; waiting 405 ms; commit 1379 ms)
2026-11-07T15:56:39Z [load_day 2023-02-21] 2023-02-21 hour 15: 214177 events in 5 files, snapshot 4281926977602541828 (task 18497 ms: download 12639 ms overlapping gunzip 1141 ms, parse 4890 ms, sort 122 ms, write 10811 ms, index 688 ms: 1 candidates, 97048 repo-hours, 1301 releases; waiting 549 ms; commit 1535 ms)
2026-11-07T15:56:53Z [load_day 2023-02-21] 2023-02-21 hour 16: 211545 events in 5 files, snapshot 8993954949407537725 (task 17751 ms: download 9935 ms overlapping gunzip 1049 ms, parse 4663 ms, sort 124 ms, write 10333 ms, index 615 ms: 3 candidates, 95567 repo-hours, 1172 releases; waiting 613 ms; commit 1392 ms)
2026-11-07T15:56:56Z [load_day 2023-02-21] 2023-02-21 hour 17: 203839 events in 5 files, snapshot 5210621412271740897 (task 16487 ms: download 8957 ms overlapping gunzip 1027 ms, parse 4437 ms, sort 131 ms, write 9739 ms, index 579 ms: 2 candidates, 87388 repo-hours, 1155 releases; waiting 232 ms; commit 1384 ms)
2026-11-07T15:57:13Z [load_day 2023-02-21] 2023-02-21 hour 18: 198744 events in 4 files, snapshot 8736367803269208946 (task 17147 ms: download 9839 ms overlapping gunzip 1032 ms, parse 4362 ms, sort 118 ms, write 9290 ms, index 558 ms: 7 candidates, 88579 repo-hours, 1136 releases; waiting 1360 ms; commit 2970 ms)
2026-11-07T15:57:14Z [load_day 2023-02-21] 2023-02-21 hour 19: 188618 events in 4 files, snapshot 1243969464084557129 (task 17147 ms: download 8778 ms overlapping gunzip 957 ms, parse 4112 ms, sort 125 ms, write 8809 ms, index 2242 ms: 5 candidates, 79891 repo-hours, 1202 releases; waiting 573 ms; commit 1382 ms)
2026-11-07T15:57:28Z [load_day 2023-02-21] 2023-02-21 hour 20: 190157 events in 4 files, snapshot 8841385830387263194 (task 16152 ms: download 9682 ms overlapping gunzip 1000 ms, parse 4305 ms, sort 125 ms, write 8985 ms, index 517 ms: 5 candidates, 85166 repo-hours, 986 releases; waiting 932 ms; commit 1423 ms)
2026-11-07T15:57:29Z [load_day 2023-02-21] 2023-02-21 hour 21: 188220 events in 4 files, snapshot 3060311186974108286 (task 14431 ms: download 8350 ms overlapping gunzip 857 ms, parse 3772 ms, sort 104 ms, write 8310 ms, index 533 ms: 14 candidates, 88658 repo-hours, 961 releases; waiting 523 ms; commit 1157 ms)
2026-11-07T15:57:42Z [load_day 2023-02-21] 2023-02-21 hour 22: 164023 events in 4 files, snapshot 3278036430556521751 (task 13838 ms: download 8449 ms overlapping gunzip 869 ms, parse 3660 ms, sort 108 ms, write 7870 ms, index 473 ms: 7 candidates, 66778 repo-hours, 946 releases; waiting 534 ms; commit 1317 ms)
2026-11-07T15:57:44Z [load_day 2023-02-21] 2023-02-21 hour 23: 149353 events in 3 files, snapshot 89988244959305234 (task 11723 ms: download 5116 ms overlapping gunzip 748 ms, parse 3206 ms, sort 99 ms, write 6727 ms, index 411 ms: 9 candidates, 62624 repo-hours, 754 releases; waiting 247 ms; commit 1269 ms)
2026-11-07T15:57:52Z [load_day 2023-02-21] 2023-02-21: repo_hour merged from 24 files to 1 (1969344 rows, 8151 ms)
2026-11-07T15:57:54Z [load_day 2023-02-21] 2023-02-21: index committed in 10142 ms (24 + 1 + 24 files)
2026-11-07T15:57:54Z [load_day 2023-02-21] 2023-02-21: 4344945 events in 24 hours
2026-11-07T15:57:54Z [load_day 2023-02-21] attempt 1 succeeded