orcaLog in

Runs · run 1308

load_day 2023-07-18, attempt 1 succeeded

Host
3c2b29713ce8:136451
Started
2026-11-07T23:04:03Z
Ended
2026-11-07T23:07:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1308/load_day/2023-07-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:04:03Z [load_day 2023-07-18] attempt 1 started
2026-11-07T23:04:05Z [load_day 2023-07-18] 2023-07-18: 2 hours in flight, about 1200 MB
2026-11-07T23:04:24Z [load_day 2023-07-18] 2023-07-18 hour 0: 127932 events in 3 files, snapshot 3504395934857752554 (task 14241 ms: download 6751 ms overlapping gunzip 876 ms, parse 4118 ms, sort 130 ms, write 7875 ms, index 462 ms: 3 candidates, 57198 repo-hours, 631 releases; waiting 474 ms; commit 2016 ms)
2026-11-07T23:04:28Z [load_day 2023-07-18] 2023-07-18 hour 1: 157651 events in 4 files, snapshot 5784612157339839043 (task 15550 ms: download 6584 ms overlapping gunzip 934 ms, parse 4138 ms, sort 167 ms, write 8987 ms, index 564 ms: 4 candidates, 87369 repo-hours, 987 releases; waiting 490 ms; commit 3866 ms)
2026-11-07T23:04:41Z [load_day 2023-07-18] 2023-07-18 hour 2: 146497 events in 3 files, snapshot 7019996885901994234 (task 15164 ms: download 6619 ms overlapping gunzip 832 ms, parse 3569 ms, sort 102 ms, write 9218 ms, index 578 ms: 5 candidates, 71612 repo-hours, 730 releases; waiting 513 ms; commit 2415 ms)
2026-11-07T23:04:46Z [load_day 2023-07-18] 2023-07-18 hour 3: 131826 events in 3 files, snapshot 4493548409103691859 (task 14085 ms: download 6261 ms overlapping gunzip 954 ms, parse 4186 ms, sort 112 ms, write 7456 ms, index 567 ms: 7 candidates, 58482 repo-hours, 840 releases; waiting 479 ms; commit 4797 ms)
2026-11-07T23:04:54Z [load_day 2023-07-18] 2023-07-18 hour 4: 126921 events in 3 files, snapshot 3358727228992220235 (task 11831 ms: download 4519 ms overlapping gunzip 769 ms, parse 3160 ms, sort 82 ms, write 6712 ms, index 485 ms: 5 candidates, 53699 repo-hours, 624 releases; waiting 322 ms; commit 2480 ms)
2026-11-07T23:04:58Z [load_day 2023-07-18] 2023-07-18 hour 5: 137010 events in 3 files, snapshot 609997962751753588 (task 14055 ms: download 5573 ms overlapping gunzip 821 ms, parse 3573 ms, sort 105 ms, write 8256 ms, index 475 ms: 6 candidates, 59846 repo-hours, 794 releases; waiting 485 ms; commit 2157 ms)
2026-11-07T23:05:11Z [load_day 2023-07-18] 2023-07-18 hour 6: 160391 events in 4 files, snapshot 4149528731377364732 (task 15965 ms: download 6383 ms overlapping gunzip 855 ms, parse 3852 ms, sort 98 ms, write 9591 ms, index 680 ms: 7 candidates, 74640 repo-hours, 869 releases; waiting 506 ms; commit 2513 ms)
2026-11-07T23:05:17Z [load_day 2023-07-18] 2023-07-18 hour 7: 154902 events in 4 files, snapshot 2381373172482011629 (task 17138 ms: download 6587 ms overlapping gunzip 948 ms, parse 4184 ms, sort 113 ms, write 10670 ms, index 567 ms: 1 candidates, 71639 repo-hours, 869 releases; waiting 380 ms; commit 2329 ms)
2026-11-07T23:05:30Z [load_day 2023-07-18] 2023-07-18 hour 8: 167405 events in 4 files, snapshot 800459411204641895 (task 17950 ms: download 10825 ms overlapping gunzip 1095 ms, parse 5183 ms, sort 113 ms, write 10002 ms, index 763 ms: 6 candidates, 77868 repo-hours, 961 releases; waiting 500 ms; commit 2578 ms)
2026-11-07T23:05:36Z [load_day 2023-07-18] 2023-07-18 hour 9: 178719 events in 4 files, snapshot 2257706811326203840 (task 18474 ms: download 10353 ms overlapping gunzip 1144 ms, parse 4853 ms, sort 145 ms, write 10890 ms, index 648 ms: 5 candidates, 83765 repo-hours, 1193 releases; waiting 505 ms; commit 2550 ms)
2026-11-07T23:05:49Z [load_day 2023-07-18] 2023-07-18 hour 10: 173364 events in 4 files, snapshot 2460527636111224088 (task 17612 ms: download 11532 ms overlapping gunzip 1043 ms, parse 4755 ms, sort 234 ms, write 10082 ms, index 509 ms: 7 candidates, 78061 repo-hours, 1003 releases; waiting 700 ms; commit 1881 ms)
2026-11-07T23:05:52Z [load_day 2023-07-18] 2023-07-18 hour 11: 166170 events in 4 files, snapshot 2154305856918666935 (task 15538 ms: download 9647 ms overlapping gunzip 963 ms, parse 4136 ms, sort 107 ms, write 9009 ms, index 503 ms: 8 candidates, 73285 repo-hours, 935 releases; waiting 488 ms; commit 2008 ms)
2026-11-07T23:06:07Z [load_day 2023-07-18] 2023-07-18 hour 12: 195748 events in 4 files, snapshot 1248264316307640285 (task 17534 ms: download 8277 ms overlapping gunzip 943 ms, parse 4264 ms, sort 134 ms, write 10608 ms, index 812 ms: 6 candidates, 102073 repo-hours, 1158 releases; waiting 511 ms; commit 2036 ms)
2026-11-07T23:06:12Z [load_day 2023-07-18] 2023-07-18 hour 13: 185930 events in 4 files, snapshot 3127372889653306649 (task 19135 ms: download 10199 ms overlapping gunzip 1119 ms, parse 4813 ms, sort 124 ms, write 11407 ms, index 848 ms: 7 candidates, 95647 repo-hours, 924 releases; waiting 484 ms; commit 1977 ms)
2026-11-07T23:06:29Z [load_day 2023-07-18] 2023-07-18 hour 14: 177722 events in 4 files, snapshot 8928848885539920822 (task 19886 ms: download 11053 ms overlapping gunzip 1072 ms, parse 4652 ms, sort 134 ms, write 12511 ms, index 583 ms: 0 candidates, 84689 repo-hours, 935 releases; waiting 568 ms; commit 2380 ms)
2026-11-07T23:06:32Z [load_day 2023-07-18] 2023-07-18 hour 15: 165050 events in 4 files, snapshot 6854596505329332352 (task 18410 ms: download 11614 ms overlapping gunzip 1009 ms, parse 4511 ms, sort 120 ms, write 11340 ms, index 599 ms: 5 candidates, 80097 repo-hours, 1036 releases; waiting 491 ms; commit 2667 ms)
2026-11-07T23:06:49Z [load_day 2023-07-18] 2023-07-18 hour 16: 167038 events in 4 files, snapshot 6325062055655427651 (task 18948 ms: download 11337 ms overlapping gunzip 1092 ms, parse 4909 ms, sort 105 ms, write 11051 ms, index 1005 ms: 8 candidates, 77990 repo-hours, 927 releases; waiting 508 ms; commit 2205 ms)
2026-11-07T23:06:53Z [load_day 2023-07-18] 2023-07-18 hour 17: 171924 events in 4 files, snapshot 4204722112075460634 (task 19411 ms: download 11225 ms overlapping gunzip 960 ms, parse 4281 ms, sort 103 ms, write 12463 ms, index 831 ms: 4 candidates, 74588 repo-hours, 850 releases; waiting 478 ms; commit 2265 ms)
2026-11-07T23:07:08Z [load_day 2023-07-18] 2023-07-18 hour 18: 171841 events in 4 files, snapshot 7166792472962401879 (task 18430 ms: download 10703 ms overlapping gunzip 1024 ms, parse 4558 ms, sort 134 ms, write 11448 ms, index 765 ms: 10 candidates, 77741 repo-hours, 915 releases; waiting 224 ms; commit 2627 ms)
2026-11-07T23:07:12Z [load_day 2023-07-18] 2023-07-18 hour 19: 162614 events in 4 files, snapshot 8853793869079408107 (task 17903 ms: download 10231 ms overlapping gunzip 878 ms, parse 3981 ms, sort 149 ms, write 11014 ms, index 1060 ms: 5 candidates, 69524 repo-hours, 881 releases; waiting 201 ms; commit 2761 ms)
2026-11-07T23:07:31Z [load_day 2023-07-18] 2023-07-18 hour 20: 171438 events in 4 files, snapshot 5353252868132161484 (task 20128 ms: download 12482 ms overlapping gunzip 1189 ms, parse 5102 ms, sort 162 ms, write 12157 ms, index 711 ms: 2 candidates, 75248 repo-hours, 889 releases; waiting 497 ms; commit 4111 ms)
2026-11-07T23:07:33Z [load_day 2023-07-18] 2023-07-18 hour 21: 161917 events in 4 files, snapshot 4319403146134033276 (task 18828 ms: download 12047 ms overlapping gunzip 1058 ms, parse 4390 ms, sort 100 ms, write 11934 ms, index 591 ms: 7 candidates, 67554 repo-hours, 817 releases; waiting 485 ms; commit 2043 ms)
2026-11-07T23:07:48Z [load_day 2023-07-18] 2023-07-18 hour 22: 147764 events in 3 files, snapshot 4409636690577356106 (task 17371 ms: download 7748 ms overlapping gunzip 1214 ms, parse 4966 ms, sort 163 ms, write 9590 ms, index 604 ms: 3 candidates, 59869 repo-hours, 901 releases; waiting 535 ms; commit 2412 ms)
2026-11-07T23:07:49Z [load_day 2023-07-18] 2023-07-18 hour 23: 136112 events in 3 files, snapshot 1048373966478078625 (task 15178 ms: download 6920 ms overlapping gunzip 796 ms, parse 3457 ms, sort 80 ms, write 9697 ms, index 373 ms: 6 candidates, 55676 repo-hours, 747 releases; waiting 503 ms; commit 1817 ms)
2026-11-07T23:07:57Z [load_day 2023-07-18] 2023-07-18: repo_hour merged from 24 files to 1 (1768160 rows, 7943 ms)
2026-11-07T23:07:59Z [load_day 2023-07-18] 2023-07-18: index committed in 9977 ms (23 + 1 + 24 files)
2026-11-07T23:07:59Z [load_day 2023-07-18] 2023-07-18: 3843886 events in 24 hours
2026-11-07T23:07:59Z [load_day 2023-07-18] attempt 1 succeeded