orcaLog in

Runs · run 1328

load_day 2023-07-24, attempt 1 succeeded

Host
3c2b29713ce8:156350
Started
2026-11-07T23:14:45Z
Ended
2026-11-07T23:18:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1328/load_day/2023-07-24/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:14:45Z [load_day 2023-07-24] attempt 1 started
2026-11-07T23:14:47Z [load_day 2023-07-24] 2023-07-24: 2 hours in flight, about 1200 MB
2026-11-07T23:15:06Z [load_day 2023-07-24] 2023-07-24 hour 0: 127349 events in 3 files, snapshot 2542617110327716189 (task 13204 ms: download 6200 ms overlapping gunzip 785 ms, parse 3550 ms, sort 124 ms, write 7500 ms, index 451 ms: 4 candidates, 63389 repo-hours, 747 releases; waiting 502 ms; commit 4182 ms)
2026-11-07T23:15:08Z [load_day 2023-07-24] 2023-07-24 hour 1: 149091 events in 3 files, snapshot 4404303193844622436 (task 15421 ms: download 7373 ms overlapping gunzip 1058 ms, parse 4824 ms, sort 166 ms, write 7914 ms, index 682 ms: 8 candidates, 82104 repo-hours, 762 releases; waiting 480 ms; commit 2038 ms)
2026-11-07T23:15:18Z [load_day 2023-07-24] 2023-07-24 hour 2: 130147 events in 3 files, snapshot 4582882860283680882 (task 13190 ms: download 5382 ms overlapping gunzip 919 ms, parse 3960 ms, sort 128 ms, write 6908 ms, index 406 ms: 7 candidates, 58804 repo-hours, 667 releases; waiting 529 ms; commit 2452 ms)
2026-11-07T23:15:23Z [load_day 2023-07-24] 2023-07-24 hour 3: 130224 events in 3 files, snapshot 3351834885140090896 (task 12860 ms: download 5998 ms overlapping gunzip 830 ms, parse 3453 ms, sort 94 ms, write 7385 ms, index 370 ms: 6 candidates, 54566 repo-hours, 817 releases; waiting 507 ms; commit 2900 ms)
2026-11-07T23:15:31Z [load_day 2023-07-24] 2023-07-24 hour 4: 130131 events in 3 files, snapshot 9167413027623573858 (task 12304 ms: download 5410 ms overlapping gunzip 853 ms, parse 3559 ms, sort 71 ms, write 6576 ms, index 455 ms: 2 candidates, 52854 repo-hours, 558 releases; waiting 452 ms; commit 2408 ms)
2026-11-07T23:15:38Z [load_day 2023-07-24] 2023-07-24 hour 5: 148477 events in 3 files, snapshot 782447020484974033 (task 14413 ms: download 6133 ms overlapping gunzip 917 ms, parse 3800 ms, sort 93 ms, write 8376 ms, index 467 ms: 8 candidates, 63132 repo-hours, 716 releases; waiting 506 ms; commit 2645 ms)
2026-11-07T23:15:57Z [load_day 2023-07-24] 2023-07-24 hour 6: 169201 events in 4 files, snapshot 8856315186670533466 (task 17427 ms: download 10183 ms overlapping gunzip 964 ms, parse 4110 ms, sort 139 ms, write 10808 ms, index 518 ms: 8 candidates, 76228 repo-hours, 921 releases; waiting 534 ms; commit 9522 ms)
2026-11-07T23:15:59Z [load_day 2023-07-24] 2023-07-24 hour 7: 179648 events in 4 files, snapshot 2507931749046288810 (task 20261 ms: download 11268 ms overlapping gunzip 1115 ms, parse 4876 ms, sort 153 ms, write 11906 ms, index 1386 ms: 5 candidates, 76033 repo-hours, 809 releases; waiting 520 ms; commit 1991 ms)
2026-11-07T23:16:07Z [load_day 2023-07-24] 2023-07-24 hour 8: 180077 events in 4 files, snapshot 1008326170315424699 (task 17170 ms: download 10133 ms overlapping gunzip 1159 ms, parse 4985 ms, sort 111 ms, write 9854 ms, index 548 ms: 12 candidates, 81078 repo-hours, 929 releases; waiting 198 ms; commit 1793 ms)
2026-11-07T23:16:17Z [load_day 2023-07-24] 2023-07-24 hour 9: 189543 events in 4 files, snapshot 5003244468383183367 (task 17160 ms: download 9562 ms overlapping gunzip 1049 ms, parse 4532 ms, sort 117 ms, write 10029 ms, index 601 ms: 7 candidates, 81553 repo-hours, 1087 releases; waiting 514 ms; commit 1965 ms)
2026-11-07T23:16:28Z [load_day 2023-07-24] 2023-07-24 hour 10: 187345 events in 4 files, snapshot 8998499772021858879 (task 19149 ms: download 9095 ms overlapping gunzip 1220 ms, parse 4964 ms, sort 119 ms, write 11402 ms, index 750 ms: 3 candidates, 79828 repo-hours, 962 releases; waiting 356 ms; commit 2703 ms)
2026-11-07T23:16:40Z [load_day 2023-07-24] 2023-07-24 hour 11: 186607 events in 4 files, snapshot 7603818750062378448 (task 20367 ms: download 12013 ms overlapping gunzip 1041 ms, parse 4650 ms, sort 140 ms, write 12783 ms, index 540 ms: 2 candidates, 77272 repo-hours, 903 releases; waiting 778 ms; commit 3927 ms)
2026-11-07T23:16:53Z [load_day 2023-07-24] 2023-07-24 hour 12: 232948 events in 5 files, snapshot 4432942286660292671 (task 22549 ms: download 14804 ms overlapping gunzip 1191 ms, parse 5346 ms, sort 174 ms, write 14090 ms, index 897 ms: 9 candidates, 111112 repo-hours, 1111 releases; waiting 495 ms; commit 3643 ms)
2026-11-07T23:17:04Z [load_day 2023-07-24] 2023-07-24 hour 13: 213766 events in 5 files, snapshot 8368946099964930308 (task 24301 ms: download 16444 ms overlapping gunzip 1469 ms, parse 6602 ms, sort 145 ms, write 14378 ms, index 974 ms: 6 candidates, 103482 repo-hours, 1088 releases; waiting 442 ms; commit 2637 ms)
2026-11-07T23:17:17Z [load_day 2023-07-24] 2023-07-24 hour 14: 195262 events in 4 files, snapshot 3833244942137235678 (task 24378 ms: download 13272 ms overlapping gunzip 1397 ms, parse 5721 ms, sort 205 ms, write 15723 ms, index 618 ms: 3 candidates, 88345 repo-hours, 1051 releases; waiting 502 ms; commit 2337 ms)
2026-11-07T23:17:27Z [load_day 2023-07-24] 2023-07-24 hour 15: 179172 events in 4 files, snapshot 1735977688373184183 (task 22318 ms: download 12949 ms overlapping gunzip 1472 ms, parse 6282 ms, sort 147 ms, write 12819 ms, index 733 ms: 7 candidates, 83433 repo-hours, 1111 releases; waiting 518 ms; commit 2034 ms)
2026-11-07T23:17:39Z [load_day 2023-07-24] 2023-07-24 hour 16: 185276 events in 4 files, snapshot 3112637066789685338 (task 21370 ms: download 12053 ms overlapping gunzip 1307 ms, parse 5429 ms, sort 212 ms, write 12862 ms, index 732 ms: 9 candidates, 81881 repo-hours, 918 releases; waiting 503 ms; commit 2696 ms)
2026-11-07T23:17:49Z [load_day 2023-07-24] 2023-07-24 hour 17: 178841 events in 4 files, snapshot 3447830806247455222 (task 20544 ms: download 11719 ms overlapping gunzip 1185 ms, parse 5205 ms, sort 155 ms, write 12454 ms, index 673 ms: 10 candidates, 76659 repo-hours, 881 releases; waiting 452 ms; commit 2291 ms)
2026-11-07T23:18:01Z [load_day 2023-07-24] 2023-07-24 hour 18: 178625 events in 4 files, snapshot 4450367353911880861 (task 20470 ms: download 11946 ms overlapping gunzip 1415 ms, parse 5890 ms, sort 143 ms, write 11548 ms, index 650 ms: 4 candidates, 81232 repo-hours, 1011 releases; waiting 522 ms; commit 2348 ms)
2026-11-07T23:18:09Z [load_day 2023-07-24] 2023-07-24 hour 19: 174388 events in 4 files, snapshot 6064736884414621483 (task 19603 ms: download 11635 ms overlapping gunzip 1152 ms, parse 5167 ms, sort 136 ms, write 11799 ms, index 564 ms: 12 candidates, 72558 repo-hours, 930 releases; waiting 482 ms; commit 2005 ms)
2026-11-07T23:18:21Z [load_day 2023-07-24] 2023-07-24 hour 20: 176684 events in 4 files, snapshot 4906849354435020211 (task 19287 ms: download 11070 ms overlapping gunzip 1173 ms, parse 5057 ms, sort 127 ms, write 11504 ms, index 610 ms: 10 candidates, 72957 repo-hours, 913 releases; waiting 361 ms; commit 2361 ms)
2026-11-07T23:18:27Z [load_day 2023-07-24] 2023-07-24 hour 21: 162724 events in 4 files, snapshot 2145684796310606388 (task 17296 ms: download 10586 ms overlapping gunzip 1014 ms, parse 4299 ms, sort 145 ms, write 10538 ms, index 421 ms: 10 candidates, 64228 repo-hours, 1006 releases; waiting 516 ms; commit 2025 ms)
2026-11-07T23:18:39Z [load_day 2023-07-24] 2023-07-24 hour 22: 147037 events in 3 files, snapshot 2485975347784009483 (task 16751 ms: download 7336 ms overlapping gunzip 994 ms, parse 4424 ms, sort 182 ms, write 9776 ms, index 451 ms: 4 candidates, 57259 repo-hours, 835 releases; waiting 583 ms; commit 2253 ms)
2026-11-07T23:18:42Z [load_day 2023-07-24] 2023-07-24 hour 23: 137550 events in 3 files, snapshot 8216173901434153202 (task 13614 ms: download 6349 ms overlapping gunzip 888 ms, parse 3741 ms, sort 136 ms, write 7634 ms, index 399 ms: 1 candidates, 54198 repo-hours, 712 releases; waiting 507 ms; commit 1971 ms)
2026-11-07T23:18:50Z [load_day 2023-07-24] 2023-07-24: repo_hour merged from 24 files to 1 (1794185 rows, 7831 ms)
2026-11-07T23:18:52Z [load_day 2023-07-24] 2023-07-24: index committed in 10054 ms (24 + 1 + 24 files)
2026-11-07T23:18:52Z [load_day 2023-07-24] 2023-07-24: 4070113 events in 24 hours
2026-11-07T23:18:52Z [load_day 2023-07-24] attempt 1 succeeded