orcaLog in

Runs · run 963

load_day 2023-04-03, attempt 1 succeeded

Host
caf251265124:228172
Started
2026-11-07T18:04:35Z
Ended
2026-11-07T18:08:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/963/load_day/2023-04-03/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:04:35Z [load_day 2023-04-03] attempt 1 started
2026-11-07T18:04:36Z [load_day 2023-04-03] 2023-04-03: 2 hours in flight, about 1200 MB
2026-11-07T18:04:49Z [load_day 2023-04-03] 2023-04-03 hour 0: 140230 events in 3 files, snapshot 3176978604232295325 (task 10127 ms: download 3512 ms overlapping gunzip 539 ms, parse 2479 ms, sort 93 ms, write 4977 ms, index 488 ms: 3 candidates, 71499 repo-hours, 869 releases; waiting 1274 ms; commit 1575 ms)
2026-11-07T18:04:51Z [load_day 2023-04-03] 2023-04-03 hour 1: 169851 events in 4 files, snapshot 7769884847774563555 (task 12783 ms: download 7187 ms overlapping gunzip 802 ms, parse 3415 ms, sort 110 ms, write 7055 ms, index 566 ms: 2 candidates, 85634 repo-hours, 786 releases; waiting 512 ms; commit 1519 ms)
2026-11-07T18:05:01Z [load_day 2023-04-03] 2023-04-03 hour 2: 144019 events in 3 files, snapshot 4058850191520836817 (task 11463 ms: download 5044 ms overlapping gunzip 727 ms, parse 3090 ms, sort 120 ms, write 6224 ms, index 397 ms: 3 candidates, 63786 repo-hours, 784 releases; waiting 340 ms; commit 1539 ms)
2026-11-07T18:05:03Z [load_day 2023-04-03] 2023-04-03 hour 3: 137977 events in 3 files, snapshot 1454517237061100707 (task 10151 ms: download 4326 ms overlapping gunzip 628 ms, parse 2682 ms, sort 81 ms, write 5771 ms, index 426 ms: 2 candidates, 59588 repo-hours, 915 releases; waiting 216 ms; commit 1581 ms)
2026-11-07T18:05:12Z [load_day 2023-04-03] 2023-04-03 hour 4: 131651 events in 3 files, snapshot 7963816353490599432 (task 10262 ms: download 4706 ms overlapping gunzip 666 ms, parse 2770 ms, sort 97 ms, write 5770 ms, index 350 ms: 1 candidates, 54587 repo-hours, 597 releases; waiting 289 ms; commit 1555 ms)
2026-11-07T18:05:16Z [load_day 2023-04-03] 2023-04-03 hour 5: 149589 events in 3 files, snapshot 3052907922969390727 (task 12664 ms: download 6002 ms overlapping gunzip 789 ms, parse 3234 ms, sort 107 ms, write 6711 ms, index 420 ms: 3 candidates, 62227 repo-hours, 733 releases; waiting 1062 ms; commit 1560 ms)
2026-11-07T18:05:27Z [load_day 2023-04-03] 2023-04-03 hour 6: 172764 events in 4 files, snapshot 3619595376866780463 (task 14192 ms: download 8235 ms overlapping gunzip 883 ms, parse 3791 ms, sort 105 ms, write 7979 ms, index 546 ms: 6 candidates, 77663 repo-hours, 928 releases; waiting 590 ms; commit 1696 ms)
2026-11-07T18:05:31Z [load_day 2023-04-03] 2023-04-03 hour 7: 163945 events in 4 files, snapshot 2840709906149533205 (task 14393 ms: download 8613 ms overlapping gunzip 876 ms, parse 3712 ms, sort 108 ms, write 8280 ms, index 510 ms: 32 candidates, 75044 repo-hours, 896 releases; waiting 591 ms; commit 1608 ms)
2026-11-07T18:05:43Z [load_day 2023-04-03] 2023-04-03 hour 8: 174993 events in 4 files, snapshot 5404096701357520992 (task 15128 ms: download 8669 ms overlapping gunzip 912 ms, parse 3978 ms, sort 126 ms, write 8956 ms, index 671 ms: 4 candidates, 81679 repo-hours, 1222 releases; waiting 230 ms; commit 1417 ms)
2026-11-07T18:05:49Z [load_day 2023-04-03] 2023-04-03 hour 9: 186614 events in 4 files, snapshot 399558469766295124 (task 16873 ms: download 9577 ms overlapping gunzip 1050 ms, parse 4463 ms, sort 137 ms, write 10106 ms, index 603 ms: 7 candidates, 84214 repo-hours, 1097 releases; waiting 234 ms; commit 1691 ms)
2026-11-07T18:06:01Z [load_day 2023-04-03] 2023-04-03 hour 10: 186145 events in 4 files, snapshot 4295664532241898655 (task 16856 ms: download 9926 ms overlapping gunzip 995 ms, parse 4183 ms, sort 128 ms, write 9829 ms, index 578 ms: 3 candidates, 82947 repo-hours, 982 releases; waiting 830 ms; commit 1587 ms)
2026-11-07T18:06:05Z [load_day 2023-04-03] 2023-04-03 hour 11: 179378 events in 4 files, snapshot 1246363596598667372 (task 15783 ms: download 9149 ms overlapping gunzip 944 ms, parse 3985 ms, sort 111 ms, write 9330 ms, index 579 ms: 3 candidates, 79262 repo-hours, 980 releases; waiting 533 ms; commit 1556 ms)
2026-11-07T18:06:19Z [load_day 2023-04-03] 2023-04-03 hour 12: 205210 events in 5 files, snapshot 6246185004958786975 (task 17144 ms: download 9728 ms overlapping gunzip 1010 ms, parse 4370 ms, sort 135 ms, write 9766 ms, index 673 ms: 7 candidates, 105726 repo-hours, 891 releases; waiting 879 ms; commit 1668 ms)
2026-11-07T18:06:22Z [load_day 2023-04-03] 2023-04-03 hour 13: 194076 events in 4 files, snapshot 7634375846968145084 (task 16524 ms: download 9055 ms overlapping gunzip 984 ms, parse 4242 ms, sort 132 ms, write 9705 ms, index 648 ms: 14 candidates, 100581 repo-hours, 972 releases; waiting 517 ms; commit 1443 ms)
2026-11-07T18:06:39Z [load_day 2023-04-03] 2023-04-03 hour 14: 202868 events in 5 files, snapshot 3697984980672884459 (task 19093 ms: download 10859 ms overlapping gunzip 1161 ms, parse 4866 ms, sort 145 ms, write 11443 ms, index 655 ms: 4 candidates, 94325 repo-hours, 1072 releases; waiting 523 ms; commit 1866 ms)
2026-11-07T18:06:42Z [load_day 2023-04-03] 2023-04-03 hour 15: 184023 events in 4 files, snapshot 7522389371282935940 (task 18462 ms: download 11239 ms overlapping gunzip 1045 ms, parse 4392 ms, sort 117 ms, write 10158 ms, index 592 ms: 2 candidates, 89254 repo-hours, 960 releases; waiting 1927 ms; commit 1540 ms)
2026-11-07T18:06:57Z [load_day 2023-04-03] 2023-04-03 hour 16: 183704 events in 4 files, snapshot 6440337708263143499 (task 17539 ms: download 9708 ms overlapping gunzip 1011 ms, parse 4304 ms, sort 125 ms, write 9731 ms, index 1551 ms: 5 candidates, 86376 repo-hours, 919 releases; waiting 535 ms; commit 1532 ms)
2026-11-07T18:06:59Z [load_day 2023-04-03] 2023-04-03 hour 17: 189698 events in 4 files, snapshot 2706660306697120210 (task 16090 ms: download 9138 ms overlapping gunzip 960 ms, parse 4083 ms, sort 129 ms, write 9461 ms, index 650 ms: 4 candidates, 85114 repo-hours, 879 releases; waiting 535 ms; commit 1555 ms)
2026-11-07T18:07:14Z [load_day 2023-04-03] 2023-04-03 hour 18: 186204 events in 4 files, snapshot 4221624346532584929 (task 16576 ms: download 9831 ms overlapping gunzip 1001 ms, parse 4323 ms, sort 132 ms, write 9552 ms, index 594 ms: 8 candidates, 84881 repo-hours, 933 releases; waiting 701 ms; commit 1562 ms)
2026-11-07T18:07:19Z [load_day 2023-04-03] 2023-04-03 hour 19: 180558 events in 4 files, snapshot 4632952654893823260 (task 16602 ms: download 10073 ms overlapping gunzip 977 ms, parse 4137 ms, sort 114 ms, write 9177 ms, index 594 ms: 8 candidates, 78467 repo-hours, 1091 releases; waiting 1284 ms; commit 4490 ms)
2026-11-07T18:07:31Z [load_day 2023-04-03] 2023-04-03 hour 20: 180768 events in 4 files, snapshot 947416062005726603 (task 15624 ms: download 9164 ms overlapping gunzip 959 ms, parse 4200 ms, sort 120 ms, write 9227 ms, index 524 ms: 5 candidates, 78086 repo-hours, 892 releases; waiting 263 ms; commit 1814 ms)
2026-11-07T18:07:33Z [load_day 2023-04-03] 2023-04-03 hour 21: 170442 events in 4 files, snapshot 5465115634946637349 (task 16137 ms: download 10272 ms overlapping gunzip 977 ms, parse 4043 ms, sort 129 ms, write 8801 ms, index 513 ms: 4 candidates, 70025 repo-hours, 958 releases; waiting 1364 ms; commit 1586 ms)
2026-11-07T18:07:46Z [load_day 2023-04-03] 2023-04-03 hour 22: 159205 events in 4 files, snapshot 5481164850299299954 (task 14420 ms: download 6379 ms overlapping gunzip 927 ms, parse 3867 ms, sort 134 ms, write 8235 ms, index 458 ms: 7 candidates, 64090 repo-hours, 761 releases; waiting 476 ms; commit 1614 ms)
2026-11-07T18:07:57Z [load_day 2023-04-03] 2023-04-03 hour 23: 181930 events in 4 files, snapshot 9173182530771786727 (task 22866 ms: download 14030 ms overlapping gunzip 1421 ms, parse 5658 ms, sort 122 ms, write 14334 ms, index 540 ms: 10 candidates, 82426 repo-hours, 638 releases; waiting 526 ms; commit 1450 ms)
2026-11-07T18:08:05Z [load_day 2023-04-03] 2023-04-03: repo_hour merged from 24 files to 1 (1897481 rows, 7963 ms)
2026-11-07T18:08:07Z [load_day 2023-04-03] 2023-04-03: index committed in 10040 ms (24 + 1 + 24 files)
2026-11-07T18:08:07Z [load_day 2023-04-03] 2023-04-03: 4155842 events in 24 hours
2026-11-07T18:08:07Z [load_day 2023-04-03] attempt 1 succeeded