orcaLog in

Runs · run 1315

load_day 2023-07-20, attempt 1 succeeded

Host
3c2b29713ce8:144113
Started
2026-11-07T23:08:00Z
Ended
2026-11-07T23:12:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1315/load_day/2023-07-20/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:08:00Z [load_day 2023-07-20] attempt 1 started
2026-11-07T23:08:01Z [load_day 2023-07-20] 2023-07-20: 2 hours in flight, about 1200 MB
2026-11-07T23:08:20Z [load_day 2023-07-20] 2023-07-20 hour 0: 147847 events in 3 files, snapshot 1335754716651036261 (task 15462 ms: download 7350 ms overlapping gunzip 999 ms, parse 4468 ms, sort 132 ms, write 8477 ms, index 518 ms: 4 candidates, 73021 repo-hours, 838 releases; waiting 503 ms; commit 1984 ms)
2026-11-07T23:08:23Z [load_day 2023-07-20] 2023-07-20 hour 1: 154582 events in 4 files, snapshot 7745381051823090595 (task 15023 ms: download 6280 ms overlapping gunzip 879 ms, parse 4173 ms, sort 139 ms, write 8442 ms, index 553 ms: 2 candidates, 88125 repo-hours, 844 releases; waiting 510 ms; commit 2480 ms)
2026-11-07T23:08:35Z [load_day 2023-07-20] 2023-07-20 hour 2: 137573 events in 3 files, snapshot 893820494938474795 (task 12912 ms: download 4813 ms overlapping gunzip 800 ms, parse 3410 ms, sort 101 ms, write 7454 ms, index 458 ms: 3 candidates, 62437 repo-hours, 691 releases; waiting 380 ms; commit 2833 ms)
2026-11-07T23:08:37Z [load_day 2023-07-20] 2023-07-20 hour 3: 135225 events in 3 files, snapshot 4709274837482344955 (task 13394 ms: download 5976 ms overlapping gunzip 706 ms, parse 3084 ms, sort 84 ms, write 7672 ms, index 600 ms: 6 candidates, 58017 repo-hours, 853 releases; waiting 890 ms; commit 2377 ms)
2026-11-07T23:08:48Z [load_day 2023-07-20] 2023-07-20 hour 4: 135243 events in 3 files, snapshot 5793249030518900174 (task 12260 ms: download 5275 ms overlapping gunzip 717 ms, parse 3154 ms, sort 136 ms, write 6982 ms, index 451 ms: 2 candidates, 58640 repo-hours, 602 releases; waiting 498 ms; commit 2262 ms)
2026-11-07T23:08:52Z [load_day 2023-07-20] 2023-07-20 hour 5: 143296 events in 3 files, snapshot 4008168464753645088 (task 13897 ms: download 5452 ms overlapping gunzip 767 ms, parse 3392 ms, sort 94 ms, write 8307 ms, index 502 ms: 4 candidates, 60925 repo-hours, 791 releases; waiting 533 ms; commit 2546 ms)
2026-11-07T23:09:21Z [load_day 2023-07-20] 2023-07-20 hour 6: 169150 events in 4 files, snapshot 2643164067382255823 (task 16519 ms: download 10196 ms overlapping gunzip 1113 ms, parse 4670 ms, sort 103 ms, write 9230 ms, index 542 ms: 7 candidates, 77863 repo-hours, 932 releases; waiting 511 ms; commit 17893 ms)
2026-11-07T23:09:23Z [load_day 2023-07-20] 2023-07-20 hour 7: 173259 events in 4 files, snapshot 1327822654868251482 (task 19586 ms: download 10641 ms overlapping gunzip 1069 ms, parse 4806 ms, sort 184 ms, write 11878 ms, index 840 ms: 7 candidates, 77037 repo-hours, 906 releases; waiting 494 ms; commit 1975 ms)
2026-11-07T23:09:27Z [load_day 2023-07-20] 2023-07-20 hour 8: 184134 events in 4 files, snapshot 266752083408929666 (task 20443 ms: download 13116 ms overlapping gunzip 1156 ms, parse 5271 ms, sort 132 ms, write 12461 ms, index 573 ms: 13 candidates, 82459 repo-hours, 1095 releases; waiting 497 ms; commit 3211 ms)
2026-11-07T23:09:44Z [load_day 2023-07-20] 2023-07-20 hour 9: 192611 events in 4 files, snapshot 7775376648417169086 (task 19858 ms: download 12104 ms overlapping gunzip 1255 ms, parse 5490 ms, sort 122 ms, write 11543 ms, index 630 ms: 6 candidates, 83909 repo-hours, 1278 releases; waiting 540 ms; commit 2647 ms)
2026-11-07T23:09:46Z [load_day 2023-07-20] 2023-07-20 hour 10: 191681 events in 4 files, snapshot 9090144772102743523 (task 18469 ms: download 11375 ms overlapping gunzip 1128 ms, parse 4719 ms, sort 241 ms, write 10934 ms, index 597 ms: 5 candidates, 82197 repo-hours, 1138 releases; waiting 516 ms; commit 1997 ms)
2026-11-07T23:10:03Z [load_day 2023-07-20] 2023-07-20 hour 11: 196872 events in 4 files, snapshot 3592252855470615014 (task 17902 ms: download 9568 ms overlapping gunzip 1066 ms, parse 4505 ms, sort 131 ms, write 10084 ms, index 1071 ms: 6 candidates, 85810 repo-hours, 977 releases; waiting 719 ms; commit 2619 ms)
2026-11-07T23:10:10Z [load_day 2023-07-20] 2023-07-20 hour 12: 235888 events in 5 files, snapshot 3397217538254174458 (task 21769 ms: download 12768 ms overlapping gunzip 1335 ms, parse 5705 ms, sort 171 ms, write 12912 ms, index 845 ms: 5 candidates, 114027 repo-hours, 1139 releases; waiting 512 ms; commit 2585 ms)
2026-11-07T23:10:28Z [load_day 2023-07-20] 2023-07-20 hour 13: 208293 events in 5 files, snapshot 8958734924979687244 (task 23302 ms: download 12509 ms overlapping gunzip 1433 ms, parse 6250 ms, sort 134 ms, write 13907 ms, index 804 ms: 7 candidates, 105645 repo-hours, 1077 releases; waiting 492 ms; commit 3339 ms)
2026-11-07T23:10:32Z [load_day 2023-07-20] 2023-07-20 hour 14: 175244 events in 4 files, snapshot 6920781112820588691 (task 18720 ms: download 11490 ms overlapping gunzip 1226 ms, parse 5157 ms, sort 103 ms, write 10848 ms, index 598 ms: 4 candidates, 83947 repo-hours, 1055 releases; waiting 502 ms; commit 3830 ms)
2026-11-07T23:10:51Z [load_day 2023-07-20] 2023-07-20 hour 15: 183724 events in 4 files, snapshot 9185487842301707705 (task 21898 ms: download 12608 ms overlapping gunzip 1231 ms, parse 5468 ms, sort 175 ms, write 13604 ms, index 615 ms: 5 candidates, 85702 repo-hours, 1072 releases; waiting 519 ms; commit 3148 ms)
2026-11-07T23:10:55Z [load_day 2023-07-20] 2023-07-20 hour 16: 203060 events in 5 files, snapshot 1812673361677430039 (task 22859 ms: download 12675 ms overlapping gunzip 1373 ms, parse 6160 ms, sort 132 ms, write 13700 ms, index 735 ms: 2 candidates, 86682 repo-hours, 1152 releases; waiting 468 ms; commit 2686 ms)
2026-11-07T23:11:13Z [load_day 2023-07-20] 2023-07-20 hour 17: 196461 events in 4 files, snapshot 1037555453966674848 (task 22403 ms: download 12376 ms overlapping gunzip 1437 ms, parse 6091 ms, sort 147 ms, write 13634 ms, index 573 ms: 1 candidates, 84024 repo-hours, 1009 releases; waiting 192 ms; commit 2077 ms)
2026-11-07T23:11:16Z [load_day 2023-07-20] 2023-07-20 hour 18: 186690 events in 4 files, snapshot 8699926994120137847 (task 19925 ms: download 11558 ms overlapping gunzip 1189 ms, parse 5166 ms, sort 124 ms, write 12028 ms, index 688 ms: 3 candidates, 81131 repo-hours, 1070 releases; waiting 353 ms; commit 2722 ms)
2026-11-07T23:11:32Z [load_day 2023-07-20] 2023-07-20 hour 19: 169767 events in 4 files, snapshot 1936438235943250682 (task 17519 ms: download 10249 ms overlapping gunzip 1072 ms, parse 4809 ms, sort 154 ms, write 10170 ms, index 594 ms: 4 candidates, 68643 repo-hours, 1016 releases; waiting 458 ms; commit 2250 ms)
2026-11-07T23:11:36Z [load_day 2023-07-20] 2023-07-20 hour 20: 168237 events in 4 files, snapshot 835795754974268265 (task 18726 ms: download 10935 ms overlapping gunzip 902 ms, parse 4059 ms, sort 122 ms, write 12220 ms, index 789 ms: 1 candidates, 68119 repo-hours, 997 releases; waiting 230 ms; commit 2138 ms)
2026-11-07T23:11:50Z [load_day 2023-07-20] 2023-07-20 hour 21: 150742 events in 4 files, snapshot 6902483376091725645 (task 16892 ms: download 7049 ms overlapping gunzip 1024 ms, parse 4998 ms, sort 177 ms, write 9357 ms, index 560 ms: 2 candidates, 59391 repo-hours, 916 releases; waiting 510 ms; commit 2230 ms)
2026-11-07T23:11:52Z [load_day 2023-07-20] 2023-07-20 hour 22: 131646 events in 3 files, snapshot 6447790971995395603 (task 14675 ms: download 6050 ms overlapping gunzip 727 ms, parse 3103 ms, sort 125 ms, write 9400 ms, index 470 ms: 2 candidates, 51805 repo-hours, 784 releases; waiting 526 ms; commit 2218 ms)
2026-11-07T23:12:02Z [load_day 2023-07-20] 2023-07-20 hour 23: 123829 events in 3 files, snapshot 7470514831679875331 (task 10710 ms: download 5013 ms overlapping gunzip 592 ms, parse 2646 ms, sort 83 ms, write 6231 ms, index 341 ms: 0 candidates, 48980 repo-hours, 634 releases; waiting 498 ms; commit 2527 ms)
2026-11-07T23:12:10Z [load_day 2023-07-20] 2023-07-20: repo_hour merged from 24 files to 1 (1828536 rows, 8271 ms)
2026-11-07T23:12:12Z [load_day 2023-07-20] 2023-07-20: index committed in 10245 ms (23 + 1 + 24 files)
2026-11-07T23:12:12Z [load_day 2023-07-20] 2023-07-20: 4095054 events in 24 hours
2026-11-07T23:12:12Z [load_day 2023-07-20] attempt 1 succeeded