orcaLog in

Runs · run 1110

load_day 2023-05-22, attempt 1 succeeded

Host
caf251265124:390112
Started
2026-11-07T20:27:36Z
Ended
2026-11-07T20:30:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1110/load_day/2023-05-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:27:36Z [load_day 2023-05-22] attempt 1 started
2026-11-07T20:27:37Z [load_day 2023-05-22] 2023-05-22: 2 hours in flight, about 1200 MB
2026-11-07T20:27:49Z [load_day 2023-05-22] 2023-05-22 hour 0: 126477 events in 3 files, snapshot 2658159668274733380 (task 8547 ms: download 2205 ms overlapping gunzip 498 ms, parse 2321 ms, sort 73 ms, write 4730 ms, index 433 ms: 8 candidates, 68030 repo-hours, 849 releases; waiting 194 ms; commit 1641 ms)
2026-11-07T20:27:52Z [load_day 2023-05-22] 2023-05-22 hour 1: 149740 events in 3 files, snapshot 4892979052983583854 (task 11960 ms: download 4901 ms overlapping gunzip 708 ms, parse 3093 ms, sort 83 ms, write 6426 ms, index 596 ms: 13 candidates, 82232 repo-hours, 750 releases; waiting 684 ms; commit 2013 ms)
2026-11-07T20:28:01Z [load_day 2023-05-22] 2023-05-22 hour 2: 136947 events in 3 files, snapshot 8845890321920395426 (task 10936 ms: download 4920 ms overlapping gunzip 659 ms, parse 2765 ms, sort 90 ms, write 5950 ms, index 464 ms: 11 candidates, 64834 repo-hours, 716 releases; waiting 684 ms; commit 1790 ms)
2026-11-07T20:28:03Z [load_day 2023-05-22] 2023-05-22 hour 3: 132648 events in 3 files, snapshot 2854393780321112243 (task 10208 ms: download 4406 ms overlapping gunzip 655 ms, parse 2720 ms, sort 76 ms, write 5505 ms, index 427 ms: 5 candidates, 57361 repo-hours, 792 releases; waiting 518 ms; commit 1827 ms)
2026-11-07T20:28:12Z [load_day 2023-05-22] 2023-05-22 hour 4: 126337 events in 3 files, snapshot 7619489600863344765 (task 10089 ms: download 4801 ms overlapping gunzip 625 ms, parse 2709 ms, sort 78 ms, write 5367 ms, index 336 ms: 5 candidates, 52850 repo-hours, 607 releases; waiting 649 ms; commit 1818 ms)
2026-11-07T20:28:16Z [load_day 2023-05-22] 2023-05-22 hour 5: 142315 events in 3 files, snapshot 1382773923804993947 (task 11790 ms: download 5286 ms overlapping gunzip 775 ms, parse 3213 ms, sort 86 ms, write 6552 ms, index 394 ms: 5 candidates, 60254 repo-hours, 785 releases; waiting 472 ms; commit 1848 ms)
2026-11-07T20:28:26Z [load_day 2023-05-22] 2023-05-22 hour 6: 167204 events in 4 files, snapshot 9103342500814589689 (task 13516 ms: download 7859 ms overlapping gunzip 840 ms, parse 3617 ms, sort 94 ms, write 7991 ms, index 522 ms: 11 candidates, 77389 repo-hours, 920 releases; waiting 213 ms; commit 1962 ms)
2026-11-07T20:28:31Z [load_day 2023-05-22] 2023-05-22 hour 7: 152560 events in 4 files, snapshot 3071916181192848224 (task 13943 ms: download 6028 ms overlapping gunzip 857 ms, parse 3628 ms, sort 107 ms, write 7845 ms, index 482 ms: 7 candidates, 71888 repo-hours, 1061 releases; waiting 530 ms; commit 1906 ms)
2026-11-07T20:28:42Z [load_day 2023-05-22] 2023-05-22 hour 8: 164523 events in 4 files, snapshot 1190473717686171788 (task 15030 ms: download 9297 ms overlapping gunzip 933 ms, parse 3947 ms, sort 102 ms, write 8542 ms, index 504 ms: 7 candidates, 79893 repo-hours, 854 releases; waiting 650 ms; commit 1934 ms)
2026-11-07T20:28:47Z [load_day 2023-05-22] 2023-05-22 hour 9: 177214 events in 4 files, snapshot 635829021928856679 (task 15533 ms: download 9199 ms overlapping gunzip 997 ms, parse 4266 ms, sort 98 ms, write 8854 ms, index 531 ms: 6 candidates, 83418 repo-hours, 1185 releases; waiting 510 ms; commit 1623 ms)
2026-11-07T20:28:58Z [load_day 2023-05-22] 2023-05-22 hour 10: 170635 events in 4 files, snapshot 380365543102306790 (task 15455 ms: download 9305 ms overlapping gunzip 911 ms, parse 3923 ms, sort 115 ms, write 8992 ms, index 571 ms: 10 candidates, 78616 repo-hours, 996 releases; waiting 609 ms; commit 1702 ms)
2026-11-07T20:29:04Z [load_day 2023-05-22] 2023-05-22 hour 11: 186188 events in 4 files, snapshot 5611266565342069999 (task 16201 ms: download 9439 ms overlapping gunzip 988 ms, parse 4262 ms, sort 120 ms, write 9184 ms, index 572 ms: 5 candidates, 83194 repo-hours, 959 releases; waiting 727 ms; commit 1748 ms)
2026-11-07T20:29:16Z [load_day 2023-05-22] 2023-05-22 hour 12: 217694 events in 5 files, snapshot 5357481794111392174 (task 16732 ms: download 8874 ms overlapping gunzip 987 ms, parse 4339 ms, sort 136 ms, write 9680 ms, index 754 ms: 10 candidates, 110424 repo-hours, 1037 releases; waiting 530 ms; commit 1912 ms)
2026-11-07T20:29:23Z [load_day 2023-05-22] 2023-05-22 hour 13: 200647 events in 5 files, snapshot 7768991894048361260 (task 17503 ms: download 9371 ms overlapping gunzip 1042 ms, parse 4569 ms, sort 122 ms, write 10136 ms, index 650 ms: 6 candidates, 103547 repo-hours, 982 releases; waiting 511 ms; commit 1635 ms)
2026-11-07T20:29:33Z [load_day 2023-05-22] 2023-05-22 hour 14: 196183 events in 4 files, snapshot 3124788329322085359 (task 16827 ms: download 9505 ms overlapping gunzip 1038 ms, parse 4502 ms, sort 115 ms, write 9678 ms, index 633 ms: 9 candidates, 95066 repo-hours, 1364 releases; waiting 517 ms; commit 1740 ms)
2026-11-07T20:29:39Z [load_day 2023-05-22] 2023-05-22 hour 15: 176574 events in 4 files, snapshot 2896602957103701146 (task 15647 ms: download 9028 ms overlapping gunzip 923 ms, parse 4000 ms, sort 95 ms, write 9132 ms, index 585 ms: 12 candidates, 86036 repo-hours, 1031 releases; waiting 535 ms; commit 1717 ms)
2026-11-07T20:29:50Z [load_day 2023-05-22] 2023-05-22 hour 16: 180381 events in 4 files, snapshot 9011824060712742316 (task 16137 ms: download 9750 ms overlapping gunzip 1002 ms, parse 4301 ms, sort 115 ms, write 9320 ms, index 559 ms: 9 candidates, 83601 repo-hours, 951 releases; waiting 512 ms; commit 1754 ms)
2026-11-07T20:29:56Z [load_day 2023-05-22] 2023-05-22 hour 17: 181518 events in 4 files, snapshot 2830806024847782703 (task 15287 ms: download 8839 ms overlapping gunzip 931 ms, parse 4025 ms, sort 105 ms, write 8896 ms, index 568 ms: 13 candidates, 79306 repo-hours, 1075 releases; waiting 517 ms; commit 2090 ms)
2026-11-07T20:30:07Z [load_day 2023-05-22] 2023-05-22 hour 18: 190156 events in 4 files, snapshot 8062008510034328281 (task 16478 ms: download 9223 ms overlapping gunzip 998 ms, parse 4228 ms, sort 137 ms, write 9719 ms, index 573 ms: 7 candidates, 86256 repo-hours, 948 releases; waiting 525 ms; commit 1874 ms)
2026-11-07T20:30:13Z [load_day 2023-05-22] 2023-05-22 hour 19: 177324 events in 4 files, snapshot 1270903355499711887 (task 16355 ms: download 9300 ms overlapping gunzip 964 ms, parse 4154 ms, sort 120 ms, write 9150 ms, index 561 ms: 8 candidates, 76674 repo-hours, 926 releases; waiting 683 ms; commit 1723 ms)
2026-11-07T20:30:24Z [load_day 2023-05-22] 2023-05-22 hour 20: 178748 events in 4 files, snapshot 5899490545326754917 (task 15752 ms: download 9125 ms overlapping gunzip 981 ms, parse 4112 ms, sort 120 ms, write 9202 ms, index 513 ms: 5 candidates, 79970 repo-hours, 921 releases; waiting 510 ms; commit 2090 ms)
2026-11-07T20:30:29Z [load_day 2023-05-22] 2023-05-22 hour 21: 164810 events in 4 files, snapshot 7879051274838354889 (task 15352 ms: download 9427 ms overlapping gunzip 988 ms, parse 4221 ms, sort 107 ms, write 8615 ms, index 485 ms: 9 candidates, 69706 repo-hours, 949 releases; waiting 538 ms; commit 1858 ms)
2026-11-07T20:30:40Z [load_day 2023-05-22] 2023-05-22 hour 22: 158185 events in 4 files, snapshot 891172246448960275 (task 14951 ms: download 9452 ms overlapping gunzip 979 ms, parse 4124 ms, sort 97 ms, write 8457 ms, index 451 ms: 5 candidates, 66965 repo-hours, 800 releases; waiting 446 ms; commit 1644 ms)
2026-11-07T20:30:42Z [load_day 2023-05-22] 2023-05-22 hour 23: 137776 events in 3 files, snapshot 1843207118219770279 (task 12673 ms: download 6122 ms overlapping gunzip 849 ms, parse 3560 ms, sort 82 ms, write 7022 ms, index 385 ms: 1 candidates, 58586 repo-hours, 641 releases; waiting 516 ms; commit 1569 ms)
2026-11-07T20:30:50Z [load_day 2023-05-22] 2023-05-22: repo_hour merged from 24 files to 1 (1856096 rows, 7584 ms)
2026-11-07T20:30:52Z [load_day 2023-05-22] 2023-05-22: index committed in 9857 ms (24 + 1 + 24 files)
2026-11-07T20:30:52Z [load_day 2023-05-22] 2023-05-22: 3992784 events in 24 hours
2026-11-07T20:30:52Z [load_day 2023-05-22] attempt 1 succeeded