orcaLog in

Runs · run 1318

load_day 2023-07-21, attempt 1 succeeded

Host
3c2b29713ce8:147707
Started
2026-11-07T23:09:54Z
Ended
2026-11-07T23:13:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1318/load_day/2023-07-21/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:09:54Z [load_day 2023-07-21] attempt 1 started
2026-11-07T23:09:55Z [load_day 2023-07-21] 2023-07-21: 2 hours in flight, about 1200 MB
2026-11-07T23:10:14Z [load_day 2023-07-21] 2023-07-21 hour 0: 146200 events in 3 files, snapshot 441533371945343872 (task 14727 ms: download 6658 ms overlapping gunzip 915 ms, parse 4168 ms, sort 207 ms, write 7975 ms, index 644 ms: 4 candidates, 70843 repo-hours, 814 releases; waiting 530 ms; commit 2125 ms)
2026-11-07T23:10:16Z [load_day 2023-07-21] 2023-07-21 hour 1: 153519 events in 4 files, snapshot 122601282400996870 (task 14517 ms: download 5386 ms overlapping gunzip 804 ms, parse 3507 ms, sort 173 ms, write 8591 ms, index 608 ms: 6 candidates, 84400 repo-hours, 750 releases; waiting 460 ms; commit 2554 ms)
2026-11-07T23:10:27Z [load_day 2023-07-21] 2023-07-21 hour 2: 132167 events in 3 files, snapshot 2008144938186220400 (task 11817 ms: download 5255 ms overlapping gunzip 645 ms, parse 2830 ms, sort 68 ms, write 7063 ms, index 413 ms: 4 candidates, 61205 repo-hours, 708 releases; waiting 488 ms; commit 2358 ms)
2026-11-07T23:10:31Z [load_day 2023-07-21] 2023-07-21 hour 3: 128911 events in 3 files, snapshot 2881928900710251646 (task 10728 ms: download 4399 ms overlapping gunzip 687 ms, parse 3032 ms, sort 73 ms, write 5763 ms, index 419 ms: 4 candidates, 54303 repo-hours, 731 releases; waiting 473 ms; commit 3795 ms)
2026-11-07T23:10:40Z [load_day 2023-07-21] 2023-07-21 hour 4: 123011 events in 3 files, snapshot 3652034836411877180 (task 11801 ms: download 4644 ms overlapping gunzip 701 ms, parse 2897 ms, sort 78 ms, write 7034 ms, index 329 ms: 3 candidates, 50484 repo-hours, 621 releases; waiting 480 ms; commit 2270 ms)
2026-11-07T23:10:44Z [load_day 2023-07-21] 2023-07-21 hour 5: 135441 events in 3 files, snapshot 9055235340157968529 (task 13345 ms: download 5789 ms overlapping gunzip 722 ms, parse 3083 ms, sort 101 ms, write 8100 ms, index 598 ms: 6 candidates, 58351 repo-hours, 740 releases; waiting 478 ms; commit 2363 ms)
2026-11-07T23:10:57Z [load_day 2023-07-21] 2023-07-21 hour 6: 168217 events in 4 files, snapshot 7013995612603491293 (task 16086 ms: download 6555 ms overlapping gunzip 943 ms, parse 4247 ms, sort 223 ms, write 9244 ms, index 639 ms: 4 candidates, 79811 repo-hours, 945 releases; waiting 504 ms; commit 2797 ms)
2026-11-07T23:11:03Z [load_day 2023-07-21] 2023-07-21 hour 7: 170490 events in 4 files, snapshot 8656331327865147142 (task 17108 ms: download 9949 ms overlapping gunzip 998 ms, parse 4379 ms, sort 108 ms, write 10328 ms, index 517 ms: 3 candidates, 74201 repo-hours, 934 releases; waiting 477 ms; commit 2651 ms)
2026-11-07T23:11:18Z [load_day 2023-07-21] 2023-07-21 hour 8: 173377 events in 4 files, snapshot 3482764066210462133 (task 18434 ms: download 10924 ms overlapping gunzip 1245 ms, parse 5292 ms, sort 125 ms, write 9902 ms, index 926 ms: 5 candidates, 76937 repo-hours, 949 releases; waiting 511 ms; commit 3821 ms)
2026-11-07T23:11:23Z [load_day 2023-07-21] 2023-07-21 hour 9: 184342 events in 4 files, snapshot 6333309465068370021 (task 19115 ms: download 10474 ms overlapping gunzip 1182 ms, parse 5375 ms, sort 142 ms, write 10935 ms, index 640 ms: 3 candidates, 78952 repo-hours, 1221 releases; waiting 516 ms; commit 2365 ms)
2026-11-07T23:11:38Z [load_day 2023-07-21] 2023-07-21 hour 10: 177693 events in 4 files, snapshot 4238934607268082431 (task 18988 ms: download 10908 ms overlapping gunzip 1082 ms, parse 4776 ms, sort 145 ms, write 11508 ms, index 625 ms: 2 candidates, 77399 repo-hours, 1016 releases; waiting 522 ms; commit 3439 ms)
2026-11-07T23:11:42Z [load_day 2023-07-21] 2023-07-21 hour 11: 171801 events in 4 files, snapshot 9172071956783864360 (task 18378 ms: download 10420 ms overlapping gunzip 1138 ms, parse 5156 ms, sort 185 ms, write 10544 ms, index 546 ms: 6 candidates, 70046 repo-hours, 947 releases; waiting 491 ms; commit 2405 ms)
2026-11-07T23:11:58Z [load_day 2023-07-21] 2023-07-21 hour 12: 228173 events in 5 files, snapshot 1819023463841838264 (task 20308 ms: download 11253 ms overlapping gunzip 1261 ms, parse 5907 ms, sort 201 ms, write 11450 ms, index 666 ms: 4 candidates, 103451 repo-hours, 1122 releases; waiting 509 ms; commit 1939 ms)
2026-11-07T23:12:00Z [load_day 2023-07-21] 2023-07-21 hour 13: 191437 events in 4 files, snapshot 9091401018464805666 (task 18141 ms: download 10577 ms overlapping gunzip 1071 ms, parse 4805 ms, sort 223 ms, write 10532 ms, index 632 ms: 3 candidates, 90685 repo-hours, 1002 releases; waiting 461 ms; commit 1898 ms)
2026-11-07T23:12:16Z [load_day 2023-07-21] 2023-07-21 hour 14: 192737 events in 4 files, snapshot 6915595691421347886 (task 16517 ms: download 8947 ms overlapping gunzip 953 ms, parse 4258 ms, sort 124 ms, write 9766 ms, index 599 ms: 3 candidates, 83163 repo-hours, 1152 releases; waiting 224 ms; commit 2163 ms)
2026-11-07T23:12:18Z [load_day 2023-07-21] 2023-07-21 hour 15: 184933 events in 4 files, snapshot 8904985611868469327 (task 15406 ms: download 8700 ms overlapping gunzip 890 ms, parse 3967 ms, sort 120 ms, write 9085 ms, index 550 ms: 4 candidates, 80626 repo-hours, 1208 releases; waiting 489 ms; commit 2618 ms)
2026-11-07T23:12:35Z [load_day 2023-07-21] 2023-07-21 hour 16: 175524 events in 4 files, snapshot 3731535345297505317 (task 18440 ms: download 11340 ms overlapping gunzip 971 ms, parse 4404 ms, sort 119 ms, write 11427 ms, index 721 ms: 6 candidates, 75922 repo-hours, 979 releases; waiting 508 ms; commit 2226 ms)
2026-11-07T23:12:38Z [load_day 2023-07-21] 2023-07-21 hour 17: 166193 events in 4 files, snapshot 3711824072235011958 (task 17399 ms: download 8268 ms overlapping gunzip 1160 ms, parse 5006 ms, sort 125 ms, write 9708 ms, index 603 ms: 2 candidates, 68819 repo-hours, 845 releases; waiting 466 ms; commit 2568 ms)
2026-11-07T23:12:53Z [load_day 2023-07-21] 2023-07-21 hour 18: 168786 events in 4 files, snapshot 2886177217608083164 (task 16755 ms: download 9875 ms overlapping gunzip 957 ms, parse 4376 ms, sort 237 ms, write 9607 ms, index 764 ms: 8 candidates, 74207 repo-hours, 998 releases; waiting 511 ms; commit 2240 ms)
2026-11-07T23:12:57Z [load_day 2023-07-21] 2023-07-21 hour 19: 150766 events in 4 files, snapshot 2620489660707786085 (task 15802 ms: download 6690 ms overlapping gunzip 965 ms, parse 4254 ms, sort 111 ms, write 9165 ms, index 457 ms: 6 candidates, 61215 repo-hours, 928 releases; waiting 479 ms; commit 3763 ms)
2026-11-07T23:13:09Z [load_day 2023-07-21] 2023-07-21 hour 20: 149930 events in 3 files, snapshot 2606438457008031106 (task 14727 ms: download 6726 ms overlapping gunzip 949 ms, parse 4279 ms, sort 104 ms, write 7899 ms, index 690 ms: 3 candidates, 60646 repo-hours, 839 releases; waiting 473 ms; commit 2187 ms)
2026-11-07T23:13:11Z [load_day 2023-07-21] 2023-07-21 hour 21: 137110 events in 3 files, snapshot 1503423502790670488 (task 13578 ms: download 5763 ms overlapping gunzip 798 ms, parse 3531 ms, sort 92 ms, write 7947 ms, index 350 ms: 4 candidates, 54109 repo-hours, 937 releases; waiting 508 ms; commit 2530 ms)
2026-11-07T23:13:22Z [load_day 2023-07-21] 2023-07-21 hour 22: 127278 events in 3 files, snapshot 8599611787864699215 (task 12289 ms: download 5492 ms overlapping gunzip 764 ms, parse 3447 ms, sort 79 ms, write 6800 ms, index 344 ms: 6 candidates, 49235 repo-hours, 799 releases; waiting 510 ms; commit 1878 ms)
2026-11-07T23:13:25Z [load_day 2023-07-21] 2023-07-21 hour 23: 110118 events in 3 files, snapshot 7425545730262296496 (task 10579 ms: download 2660 ms overlapping gunzip 615 ms, parse 2638 ms, sort 65 ms, write 6088 ms, index 352 ms: 2 candidates, 43283 repo-hours, 626 releases; waiting 469 ms; commit 3436 ms)
2026-11-07T23:13:33Z [load_day 2023-07-21] 2023-07-21: repo_hour merged from 24 files to 1 (1682293 rows, 7919 ms)
2026-11-07T23:13:35Z [load_day 2023-07-21] 2023-07-21: index committed in 9981 ms (24 + 1 + 24 files)
2026-11-07T23:13:35Z [load_day 2023-07-21] 2023-07-21: 3848154 events in 24 hours
2026-11-07T23:13:35Z [load_day 2023-07-21] attempt 1 succeeded