orcaLog in

Runs · run 1351

load_day 2023-08-01, attempt 1 succeeded

Host
3c2b29713ce8:182730
Started
2026-11-07T23:29:22Z
Ended
2026-11-07T23:33:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1351/load_day/2023-08-01/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:29:22Z [load_day 2023-08-01] attempt 1 started
2026-11-07T23:29:24Z [load_day 2023-08-01] 2023-08-01: 2 hours in flight, about 1200 MB
2026-11-07T23:29:44Z [load_day 2023-08-01] 2023-08-01 hour 0: 155129 events in 4 files, snapshot 3930283662552700473 (task 17143 ms: download 7367 ms overlapping gunzip 1163 ms, parse 4531 ms, sort 100 ms, write 9931 ms, index 620 ms: 10 candidates, 76210 repo-hours, 957 releases; waiting 523 ms; commit 2295 ms)
2026-11-07T23:29:47Z [load_day 2023-08-01] 2023-08-01 hour 1: 168644 events in 4 files, snapshot 2059024058179347002 (task 17517 ms: download 11026 ms overlapping gunzip 1266 ms, parse 4818 ms, sort 153 ms, write 9467 ms, index 693 ms: 3 candidates, 90623 repo-hours, 1050 releases; waiting 766 ms; commit 2486 ms)
2026-11-07T23:30:02Z [load_day 2023-08-01] 2023-08-01 hour 2: 153424 events in 4 files, snapshot 2993700734812864411 (task 16502 ms: download 7159 ms overlapping gunzip 1101 ms, parse 4227 ms, sort 134 ms, write 9723 ms, index 505 ms: 5 candidates, 69458 repo-hours, 899 releases; waiting 509 ms; commit 2475 ms)
2026-11-07T23:30:05Z [load_day 2023-08-01] 2023-08-01 hour 3: 138601 events in 3 files, snapshot 3785691609680430312 (task 15433 ms: download 10869 ms overlapping gunzip 1183 ms, parse 3986 ms, sort 96 ms, write 8818 ms, index 423 ms: 4 candidates, 57997 repo-hours, 970 releases; waiting 572 ms; commit 3175 ms)
2026-11-07T23:30:16Z [load_day 2023-08-01] 2023-08-01 hour 4: 133240 events in 3 files, snapshot 7775368403516879531 (task 13966 ms: download 6531 ms overlapping gunzip 996 ms, parse 3756 ms, sort 128 ms, write 7915 ms, index 410 ms: 11 candidates, 54559 repo-hours, 676 releases; waiting 475 ms; commit 2005 ms)
2026-11-07T23:30:21Z [load_day 2023-08-01] 2023-08-01 hour 5: 141104 events in 3 files, snapshot 7105344807331800636 (task 14622 ms: download 10565 ms overlapping gunzip 1108 ms, parse 3783 ms, sort 112 ms, write 8246 ms, index 546 ms: 6 candidates, 60440 repo-hours, 854 releases; waiting 511 ms; commit 2473 ms)
2026-11-07T23:30:37Z [load_day 2023-08-01] 2023-08-01 hour 6: 173131 events in 4 files, snapshot 4591347657074371483 (task 19550 ms: download 11591 ms overlapping gunzip 1312 ms, parse 5042 ms, sort 174 ms, write 11547 ms, index 686 ms: 3 candidates, 76565 repo-hours, 967 releases; waiting 492 ms; commit 2454 ms)
2026-11-07T23:30:46Z [load_day 2023-08-01] 2023-08-01 hour 7: 169368 events in 4 files, snapshot 1614965281463165338 (task 20623 ms: download 13471 ms overlapping gunzip 1393 ms, parse 5323 ms, sort 175 ms, write 12096 ms, index 810 ms: 5 candidates, 73319 repo-hours, 840 releases; waiting 497 ms; commit 5610 ms)
2026-11-07T23:31:03Z [load_day 2023-08-01] 2023-08-01 hour 8: 177082 events in 4 files, snapshot 2384160508694165739 (task 22908 ms: download 13959 ms overlapping gunzip 1471 ms, parse 5658 ms, sort 199 ms, write 13900 ms, index 595 ms: 4 candidates, 78396 repo-hours, 1007 releases; waiting 626 ms; commit 3985 ms)
2026-11-07T23:31:06Z [load_day 2023-08-01] 2023-08-01 hour 9: 188195 events in 4 files, snapshot 5718581619775643211 (task 22822 ms: download 15100 ms overlapping gunzip 1468 ms, parse 5896 ms, sort 180 ms, write 13884 ms, index 600 ms: 13 candidates, 81038 repo-hours, 1253 releases; waiting 513 ms; commit 2000 ms)
2026-11-07T23:31:28Z [load_day 2023-08-01] 2023-08-01 hour 10: 184351 events in 4 files, snapshot 7530888673451714506 (task 18810 ms: download 10829 ms overlapping gunzip 1167 ms, parse 4570 ms, sort 141 ms, write 11066 ms, index 775 ms: 5 candidates, 79818 repo-hours, 1079 releases; waiting 762 ms; commit 8827 ms)
2026-11-07T23:31:31Z [load_day 2023-08-01] 2023-08-01 hour 11: 187676 events in 4 files, snapshot 4400076233034584779 (task 21404 ms: download 10498 ms overlapping gunzip 1166 ms, parse 4631 ms, sort 132 ms, write 13422 ms, index 916 ms: 4 candidates, 78313 repo-hours, 1096 releases; waiting 804 ms; commit 3092 ms)
2026-11-07T23:31:47Z [load_day 2023-08-01] 2023-08-01 hour 12: 234666 events in 5 files, snapshot 1417476319676488950 (task 24757 ms: download 16195 ms overlapping gunzip 1597 ms, parse 6453 ms, sort 229 ms, write 14585 ms, index 934 ms: 7 candidates, 110170 repo-hours, 1199 releases; waiting 648 ms; commit 2343 ms)
2026-11-07T23:31:54Z [load_day 2023-08-01] 2023-08-01 hour 13: 199994 events in 4 files, snapshot 7235653882013164218 (task 22821 ms: download 16336 ms overlapping gunzip 1379 ms, parse 5568 ms, sort 191 ms, write 14122 ms, index 737 ms: 6 candidates, 98012 repo-hours, 1098 releases; waiting 496 ms; commit 2391 ms)
2026-11-07T23:32:12Z [load_day 2023-08-01] 2023-08-01 hour 14: 192147 events in 4 files, snapshot 4269160773599765035 (task 23159 ms: download 13348 ms overlapping gunzip 1215 ms, parse 5011 ms, sort 223 ms, write 15194 ms, index 699 ms: 9 candidates, 87640 repo-hours, 1101 releases; waiting 526 ms; commit 2832 ms)
2026-11-07T23:32:17Z [load_day 2023-08-01] 2023-08-01 hour 15: 172011 events in 4 files, snapshot 3106379984669372852 (task 20196 ms: download 12887 ms overlapping gunzip 1382 ms, parse 5523 ms, sort 127 ms, write 11841 ms, index 691 ms: 6 candidates, 80548 repo-hours, 1053 releases; waiting 327 ms; commit 3287 ms)
2026-11-07T23:32:33Z [load_day 2023-08-01] 2023-08-01 hour 16: 172159 events in 4 files, snapshot 4212274105409291075 (task 20812 ms: download 12952 ms overlapping gunzip 1288 ms, parse 5060 ms, sort 115 ms, write 12828 ms, index 665 ms: 7 candidates, 76851 repo-hours, 921 releases; waiting 550 ms; commit 2295 ms)
2026-11-07T23:32:39Z [load_day 2023-08-01] 2023-08-01 hour 17: 174569 events in 4 files, snapshot 903006675497776731 (task 21684 ms: download 13027 ms overlapping gunzip 1463 ms, parse 5541 ms, sort 173 ms, write 13002 ms, index 680 ms: 4 candidates, 75083 repo-hours, 871 releases; waiting 490 ms; commit 2309 ms)
2026-11-07T23:32:55Z [load_day 2023-08-01] 2023-08-01 hour 18: 173621 events in 4 files, snapshot 2763972421443507755 (task 20661 ms: download 12829 ms overlapping gunzip 1482 ms, parse 5297 ms, sort 162 ms, write 12172 ms, index 720 ms: 7 candidates, 78258 repo-hours, 959 releases; waiting 548 ms; commit 2501 ms)
2026-11-07T23:33:00Z [load_day 2023-08-01] 2023-08-01 hour 19: 169819 events in 4 files, snapshot 4186084045128277620 (task 19727 ms: download 11448 ms overlapping gunzip 1160 ms, parse 4725 ms, sort 142 ms, write 12137 ms, index 818 ms: 6 candidates, 69100 repo-hours, 957 releases; waiting 465 ms; commit 2549 ms)
2026-11-07T23:33:18Z [load_day 2023-08-01] 2023-08-01 hour 20: 171288 events in 4 files, snapshot 282818513206511750 (task 20108 ms: download 12628 ms overlapping gunzip 1510 ms, parse 5864 ms, sort 99 ms, write 11284 ms, index 496 ms: 5 candidates, 70287 repo-hours, 861 releases; waiting 558 ms; commit 3985 ms)
2026-11-07T23:33:20Z [load_day 2023-08-01] 2023-08-01 hour 21: 156590 events in 4 files, snapshot 3747662459907486313 (task 17016 ms: download 10894 ms overlapping gunzip 1091 ms, parse 4277 ms, sort 159 ms, write 10044 ms, index 671 ms: 2 candidates, 61106 repo-hours, 995 releases; waiting 484 ms; commit 2531 ms)
2026-11-07T23:33:33Z [load_day 2023-08-01] 2023-08-01 hour 22: 145671 events in 3 files, snapshot 9118656596589332744 (task 15985 ms: download 10954 ms overlapping gunzip 1185 ms, parse 4492 ms, sort 112 ms, write 8948 ms, index 393 ms: 3 candidates, 55591 repo-hours, 896 releases; waiting 528 ms; commit 2420 ms)
2026-11-07T23:33:36Z [load_day 2023-08-01] 2023-08-01 hour 23: 137815 events in 3 files, snapshot 6315763256386932216 (task 14950 ms: download 7012 ms overlapping gunzip 947 ms, parse 3890 ms, sort 108 ms, write 8842 ms, index 380 ms: 4 candidates, 53055 repo-hours, 727 releases; waiting 509 ms; commit 2106 ms)
2026-11-07T23:33:45Z [load_day 2023-08-01] 2023-08-01: repo_hour merged from 24 files to 1 (1792437 rows, 8645 ms)
2026-11-07T23:33:47Z [load_day 2023-08-01] 2023-08-01: index committed in 10872 ms (24 + 1 + 24 files)
2026-11-07T23:33:47Z [load_day 2023-08-01] 2023-08-01: 4070295 events in 24 hours
2026-11-07T23:33:47Z [load_day 2023-08-01] attempt 1 succeeded