orcaLog in

Runs · run 1501

load_day 2023-09-14, attempt 1 succeeded

Host
3c2b29713ce8:329199
Started
2026-11-08T00:49:11Z
Ended
2026-11-08T00:53:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1501/load_day/2023-09-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:49:11Z [load_day 2023-09-14] attempt 1 started
2026-11-08T00:49:12Z [load_day 2023-09-14] 2023-09-14: 2 hours in flight, about 1200 MB
2026-11-08T00:49:32Z [load_day 2023-09-14] 2023-09-14 hour 0: 174235 events in 4 files, snapshot 5128787407137604020 (task 15580 ms: download 6400 ms overlapping gunzip 910 ms, parse 4300 ms, sort 221 ms, write 8734 ms, index 650 ms: 11 candidates, 92536 repo-hours, 941 releases; waiting 485 ms; commit 2772 ms)
2026-11-08T00:49:35Z [load_day 2023-09-14] 2023-09-14 hour 1: 158178 events in 4 files, snapshot 3668939685417108769 (task 14727 ms: download 5808 ms overlapping gunzip 832 ms, parse 3858 ms, sort 129 ms, write 8475 ms, index 577 ms: 15 candidates, 88556 repo-hours, 777 releases; waiting 556 ms; commit 2530 ms)
2026-11-08T00:49:46Z [load_day 2023-09-14] 2023-09-14 hour 2: 140177 events in 3 files, snapshot 8250362238657953031 (task 12853 ms: download 5257 ms overlapping gunzip 707 ms, parse 3233 ms, sort 154 ms, write 7654 ms, index 397 ms: 8 candidates, 60339 repo-hours, 769 releases; waiting 514 ms; commit 2335 ms)
2026-11-08T00:49:51Z [load_day 2023-09-14] 2023-09-14 hour 3: 139512 events in 3 files, snapshot 8886255694678739270 (task 13264 ms: download 5811 ms overlapping gunzip 722 ms, parse 3159 ms, sort 111 ms, write 7949 ms, index 618 ms: 6 candidates, 58327 repo-hours, 832 releases; waiting 493 ms; commit 4911 ms)
2026-11-08T00:50:00Z [load_day 2023-09-14] 2023-09-14 hour 4: 135348 events in 3 files, snapshot 8918230675901032239 (task 13238 ms: download 5238 ms overlapping gunzip 824 ms, parse 3677 ms, sort 118 ms, write 7317 ms, index 438 ms: 6 candidates, 55815 repo-hours, 571 releases; waiting 630 ms; commit 2694 ms)
2026-11-08T00:50:05Z [load_day 2023-09-14] 2023-09-14 hour 5: 146450 events in 3 files, snapshot 5988901230881303800 (task 15269 ms: download 6474 ms overlapping gunzip 903 ms, parse 4126 ms, sort 213 ms, write 8705 ms, index 532 ms: 5 candidates, 61370 repo-hours, 816 releases; waiting 518 ms; commit 2661 ms)
2026-11-08T00:50:18Z [load_day 2023-09-14] 2023-09-14 hour 6: 176040 events in 4 files, snapshot 8811668463223875596 (task 16631 ms: download 9055 ms overlapping gunzip 945 ms, parse 4326 ms, sort 121 ms, write 9725 ms, index 890 ms: 12 candidates, 80229 repo-hours, 935 releases; waiting 268 ms; commit 3077 ms)
2026-11-08T00:50:27Z [load_day 2023-09-14] 2023-09-14 hour 7: 179737 events in 4 files, snapshot 1447265234049863167 (task 19446 ms: download 10612 ms overlapping gunzip 1121 ms, parse 5052 ms, sort 183 ms, write 11343 ms, index 770 ms: 10 candidates, 78379 repo-hours, 995 releases; waiting 639 ms; commit 3200 ms)
2026-11-08T00:50:40Z [load_day 2023-09-14] 2023-09-14 hour 8: 185922 events in 4 files, snapshot 9067173437759989894 (task 20529 ms: download 12631 ms overlapping gunzip 1130 ms, parse 5056 ms, sort 134 ms, write 12635 ms, index 725 ms: 16 candidates, 85359 repo-hours, 1064 releases; waiting 529 ms; commit 2867 ms)
2026-11-08T00:50:48Z [load_day 2023-09-14] 2023-09-14 hour 9: 189405 events in 4 files, snapshot 4222722448547653926 (task 20528 ms: download 11251 ms overlapping gunzip 1190 ms, parse 5432 ms, sort 187 ms, write 12154 ms, index 692 ms: 13 candidates, 85535 repo-hours, 1354 releases; waiting 526 ms; commit 2543 ms)
2026-11-08T00:50:59Z [load_day 2023-09-14] 2023-09-14 hour 10: 181352 events in 4 files, snapshot 3335196028516753077 (task 18705 ms: download 10382 ms overlapping gunzip 1109 ms, parse 4928 ms, sort 128 ms, write 11040 ms, index 713 ms: 10 candidates, 81267 repo-hours, 1025 releases; waiting 547 ms; commit 2738 ms)
2026-11-08T00:51:09Z [load_day 2023-09-14] 2023-09-14 hour 11: 189176 events in 4 files, snapshot 2267588390569657212 (task 18875 ms: download 10469 ms overlapping gunzip 1127 ms, parse 4993 ms, sort 128 ms, write 11048 ms, index 643 ms: 8 candidates, 80743 repo-hours, 1119 releases; waiting 573 ms; commit 3846 ms)
2026-11-08T00:51:20Z [load_day 2023-09-14] 2023-09-14 hour 12: 242389 events in 5 files, snapshot 5493492722733279207 (task 19570 ms: download 12619 ms overlapping gunzip 1071 ms, parse 4842 ms, sort 157 ms, write 11926 ms, index 792 ms: 9 candidates, 114815 repo-hours, 1252 releases; waiting 508 ms; commit 2247 ms)
2026-11-08T00:51:26Z [load_day 2023-09-14] 2023-09-14 hour 13: 221392 events in 5 files, snapshot 350880366296130627 (task 18232 ms: download 11756 ms overlapping gunzip 1040 ms, parse 4705 ms, sort 145 ms, write 10723 ms, index 757 ms: 12 candidates, 109509 repo-hours, 1332 releases; waiting 510 ms; commit 2088 ms)
2026-11-08T00:51:42Z [load_day 2023-09-14] 2023-09-14 hour 14: 208205 events in 5 files, snapshot 1022221053710133108 (task 21157 ms: download 11152 ms overlapping gunzip 1356 ms, parse 5761 ms, sort 184 ms, write 12038 ms, index 667 ms: 11 candidates, 94479 repo-hours, 1368 releases; waiting 820 ms; commit 2250 ms)
2026-11-08T00:51:49Z [load_day 2023-09-14] 2023-09-14 hour 15: 193535 events in 4 files, snapshot 4792442440094396012 (task 20580 ms: download 12338 ms overlapping gunzip 1140 ms, parse 5345 ms, sort 175 ms, write 12440 ms, index 659 ms: 9 candidates, 89109 repo-hours, 1303 releases; waiting 523 ms; commit 2718 ms)
2026-11-08T00:52:05Z [load_day 2023-09-14] 2023-09-14 hour 16: 195116 events in 4 files, snapshot 4293437906739691120 (task 21666 ms: download 12228 ms overlapping gunzip 1139 ms, parse 4998 ms, sort 135 ms, write 13831 ms, index 667 ms: 10 candidates, 87206 repo-hours, 1259 releases; waiting 564 ms; commit 2883 ms)
2026-11-08T00:52:10Z [load_day 2023-09-14] 2023-09-14 hour 17: 193962 events in 4 files, snapshot 8431102604991303483 (task 20587 ms: download 11302 ms overlapping gunzip 1245 ms, parse 5430 ms, sort 164 ms, write 12131 ms, index 711 ms: 7 candidates, 83168 repo-hours, 1175 releases; waiting 457 ms; commit 2111 ms)
2026-11-08T00:52:26Z [load_day 2023-09-14] 2023-09-14 hour 18: 192406 events in 4 files, snapshot 1951190527492802449 (task 20268 ms: download 11055 ms overlapping gunzip 1104 ms, parse 4993 ms, sort 141 ms, write 12503 ms, index 749 ms: 14 candidates, 86024 repo-hours, 1113 releases; waiting 488 ms; commit 2629 ms)
2026-11-08T00:52:32Z [load_day 2023-09-14] 2023-09-14 hour 19: 176395 events in 4 files, snapshot 5640879439444994135 (task 20028 ms: download 11490 ms overlapping gunzip 1103 ms, parse 5147 ms, sort 150 ms, write 11856 ms, index 1023 ms: 8 candidates, 73323 repo-hours, 1089 releases; waiting 496 ms; commit 3736 ms)
2026-11-08T00:52:46Z [load_day 2023-09-14] 2023-09-14 hour 20: 174293 events in 4 files, snapshot 5713808718855336996 (task 19618 ms: download 11626 ms overlapping gunzip 1091 ms, parse 5310 ms, sort 153 ms, write 11687 ms, index 575 ms: 13 candidates, 72764 repo-hours, 999 releases; waiting 487 ms; commit 2277 ms)
2026-11-08T00:52:49Z [load_day 2023-09-14] 2023-09-14 hour 21: 156021 events in 4 files, snapshot 7384344414316204083 (task 16118 ms: download 6497 ms overlapping gunzip 932 ms, parse 3948 ms, sort 162 ms, write 9739 ms, index 503 ms: 9 candidates, 62664 repo-hours, 1021 releases; waiting 508 ms; commit 2641 ms)
2026-11-08T00:53:01Z [load_day 2023-09-14] 2023-09-14 hour 22: 138360 events in 3 files, snapshot 6705576308783354387 (task 14099 ms: download 6486 ms overlapping gunzip 764 ms, parse 3499 ms, sort 186 ms, write 8275 ms, index 574 ms: 14 candidates, 56298 repo-hours, 762 releases; waiting 492 ms; commit 2293 ms)
2026-11-08T00:53:04Z [load_day 2023-09-14] 2023-09-14 hour 23: 126662 events in 3 files, snapshot 8747766019634852027 (task 12948 ms: download 5951 ms overlapping gunzip 780 ms, parse 3487 ms, sort 83 ms, write 7669 ms, index 478 ms: 7 candidates, 52855 repo-hours, 699 releases; waiting 181 ms; commit 2415 ms)
2026-11-08T00:53:12Z [load_day 2023-09-14] 2023-09-14: repo_hour merged from 24 files to 1 (1890669 rows, 8352 ms)
2026-11-08T00:53:14Z [load_day 2023-09-14] 2023-09-14: index committed in 10159 ms (24 + 1 + 24 files)
2026-11-08T00:53:14Z [load_day 2023-09-14] 2023-09-14: 4214268 events in 24 hours
2026-11-08T00:53:14Z [load_day 2023-09-14] attempt 1 succeeded