orcaLog in

Runs · run 861

load_day 2023-02-28, attempt 1 succeeded

Host
caf251265124:104584
Started
2026-11-07T16:16:25Z
Ended
2026-11-07T16:20:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/861/load_day/2023-02-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:16:25Z [load_day 2023-02-28] attempt 1 started
2026-11-07T16:16:27Z [load_day 2023-02-28] 2023-02-28: 2 hours in flight, about 1200 MB
2026-11-07T16:16:46Z [load_day 2023-02-28] 2023-02-28 hour 0: 171155 events in 4 files, snapshot 3175043640755418495 (task 16634 ms: download 11137 ms overlapping gunzip 1015 ms, parse 4204 ms, sort 104 ms, write 9448 ms, index 533 ms: 7 candidates, 78209 repo-hours, 950 releases; waiting 1002 ms; commit 1466 ms)
2026-11-07T16:16:47Z [load_day 2023-02-28] 2023-02-28 hour 1: 166830 events in 4 files, snapshot 3048748097419074249 (task 14037 ms: download 6340 ms overlapping gunzip 848 ms, parse 3706 ms, sort 96 ms, write 7670 ms, index 549 ms: 3 candidates, 83783 repo-hours, 869 releases; waiting 835 ms; commit 1303 ms)
2026-11-07T16:16:59Z [load_day 2023-02-28] 2023-02-28 hour 2: 152195 events in 4 files, snapshot 7015904109066625030 (task 12336 ms: download 5442 ms overlapping gunzip 777 ms, parse 3204 ms, sort 100 ms, write 6877 ms, index 498 ms: 4 candidates, 73112 repo-hours, 726 releases; waiting 504 ms; commit 1268 ms)
2026-11-07T16:17:00Z [load_day 2023-02-28] 2023-02-28 hour 3: 144524 events in 3 files, snapshot 5550001245395741831 (task 11380 ms: download 5194 ms overlapping gunzip 706 ms, parse 2998 ms, sort 91 ms, write 6180 ms, index 382 ms: 4 candidates, 62027 repo-hours, 811 releases; waiting 739 ms; commit 1286 ms)
2026-11-07T16:17:12Z [load_day 2023-02-28] 2023-02-28 hour 4: 137106 events in 3 files, snapshot 1700302228102540322 (task 12125 ms: download 6039 ms overlapping gunzip 728 ms, parse 2967 ms, sort 88 ms, write 6074 ms, index 404 ms: 4 candidates, 57270 repo-hours, 699 releases; waiting 1507 ms; commit 1626 ms)
2026-11-07T16:17:14Z [load_day 2023-02-28] 2023-02-28 hour 5: 142147 events in 3 files, snapshot 7082150095064089623 (task 12260 ms: download 5942 ms overlapping gunzip 774 ms, parse 3164 ms, sort 91 ms, write 6394 ms, index 405 ms: 8 candidates, 61158 repo-hours, 804 releases; waiting 1111 ms; commit 1483 ms)
2026-11-07T16:17:26Z [load_day 2023-02-28] 2023-02-28 hour 6: 162091 events in 4 files, snapshot 8948981590642836423 (task 12774 ms: download 5599 ms overlapping gunzip 802 ms, parse 3283 ms, sort 96 ms, write 7085 ms, index 530 ms: 12 candidates, 73988 repo-hours, 822 releases; waiting 655 ms; commit 1592 ms)
2026-11-07T16:17:28Z [load_day 2023-02-28] 2023-02-28 hour 7: 171279 events in 4 files, snapshot 2105238273823139543 (task 13899 ms: download 8148 ms overlapping gunzip 879 ms, parse 3739 ms, sort 86 ms, write 7837 ms, index 507 ms: 8 candidates, 74971 repo-hours, 796 releases; waiting 529 ms; commit 1448 ms)
2026-11-07T16:17:43Z [load_day 2023-02-28] 2023-02-28 hour 8: 184171 events in 4 files, snapshot 1465374465489396670 (task 16409 ms: download 9789 ms overlapping gunzip 976 ms, parse 4153 ms, sort 109 ms, write 9146 ms, index 516 ms: 8 candidates, 82991 repo-hours, 921 releases; waiting 1100 ms; commit 1590 ms)
2026-11-07T16:17:47Z [load_day 2023-02-28] 2023-02-28 hour 9: 200704 events in 5 files, snapshot 823951465410726065 (task 17494 ms: download 9837 ms overlapping gunzip 1081 ms, parse 4620 ms, sort 132 ms, write 10012 ms, index 706 ms: 4 candidates, 92172 repo-hours, 1149 releases; waiting 582 ms; commit 1525 ms)
2026-11-07T16:18:01Z [load_day 2023-02-28] 2023-02-28 hour 10: 199477 events in 4 files, snapshot 8021839285294099485 (task 17876 ms: download 10217 ms overlapping gunzip 1127 ms, parse 4826 ms, sort 136 ms, write 10292 ms, index 600 ms: 13 candidates, 84840 repo-hours, 1139 releases; waiting 576 ms; commit 1637 ms)
2026-11-07T16:18:05Z [load_day 2023-02-28] 2023-02-28 hour 11: 197239 events in 4 files, snapshot 2060803883988628769 (task 18134 ms: download 10670 ms overlapping gunzip 1101 ms, parse 4661 ms, sort 134 ms, write 9996 ms, index 591 ms: 5 candidates, 82725 repo-hours, 1095 releases; waiting 1308 ms; commit 1322 ms)
2026-11-07T16:18:19Z [load_day 2023-02-28] 2023-02-28 hour 12: 229492 events in 5 files, snapshot 225944217331066589 (task 17465 ms: download 11394 ms overlapping gunzip 1084 ms, parse 4599 ms, sort 143 ms, write 10074 ms, index 668 ms: 6 candidates, 111820 repo-hours, 1060 releases; waiting 575 ms; commit 1557 ms)
2026-11-07T16:18:25Z [load_day 2023-02-28] 2023-02-28 hour 13: 226004 events in 5 files, snapshot 2225697167247691763 (task 18773 ms: download 12214 ms overlapping gunzip 1131 ms, parse 4846 ms, sort 137 ms, write 10569 ms, index 882 ms: 7 candidates, 109081 repo-hours, 1215 releases; waiting 911 ms; commit 1808 ms)
2026-11-07T16:18:39Z [load_day 2023-02-28] 2023-02-28 hour 14: 221973 events in 5 files, snapshot 6539786346825772146 (task 18741 ms: download 12531 ms overlapping gunzip 1167 ms, parse 5002 ms, sort 143 ms, write 10852 ms, index 670 ms: 3 candidates, 103333 repo-hours, 1377 releases; waiting 556 ms; commit 1462 ms)
2026-11-07T16:18:46Z [load_day 2023-02-28] 2023-02-28 hour 15: 225558 events in 5 files, snapshot 2083238159341992089 (task 19520 ms: download 13119 ms overlapping gunzip 1196 ms, parse 5263 ms, sort 149 ms, write 11301 ms, index 758 ms: 6 candidates, 108890 repo-hours, 1147 releases; waiting 545 ms; commit 1598 ms)
2026-11-07T16:18:58Z [load_day 2023-02-28] 2023-02-28 hour 16: 224213 events in 5 files, snapshot 3797485989976482748 (task 18701 ms: download 12276 ms overlapping gunzip 1170 ms, parse 5075 ms, sort 144 ms, write 10799 ms, index 699 ms: 7 candidates, 112684 repo-hours, 1066 releases; waiting 519 ms; commit 1597 ms)
2026-11-07T16:19:05Z [load_day 2023-02-28] 2023-02-28 hour 17: 212034 events in 5 files, snapshot 755663729345415052 (task 17938 ms: download 12099 ms overlapping gunzip 1092 ms, parse 4639 ms, sort 136 ms, write 10558 ms, index 685 ms: 15 candidates, 104635 repo-hours, 1030 releases; waiting 531 ms; commit 1557 ms)
2026-11-07T16:19:15Z [load_day 2023-02-28] 2023-02-28 hour 18: 198142 events in 4 files, snapshot 4672893460613277519 (task 16210 ms: download 9042 ms overlapping gunzip 1008 ms, parse 4273 ms, sort 132 ms, write 9469 ms, index 640 ms: 8 candidates, 92226 repo-hours, 1040 releases; waiting 351 ms; commit 1508 ms)
2026-11-07T16:19:23Z [load_day 2023-02-28] 2023-02-28 hour 19: 199557 events in 4 files, snapshot 6905348438001363775 (task 17241 ms: download 9731 ms overlapping gunzip 1062 ms, parse 4400 ms, sort 134 ms, write 10172 ms, index 568 ms: 8 candidates, 89629 repo-hours, 933 releases; waiting 588 ms; commit 1645 ms)
2026-11-07T16:19:32Z [load_day 2023-02-28] 2023-02-28 hour 20: 199551 events in 4 files, snapshot 9185937345277887678 (task 15999 ms: download 9233 ms overlapping gunzip 1013 ms, parse 4186 ms, sort 128 ms, write 9223 ms, index 623 ms: 4 candidates, 99759 repo-hours, 972 releases; waiting 544 ms; commit 1532 ms)
2026-11-07T16:19:40Z [load_day 2023-02-28] 2023-02-28 hour 21: 176518 events in 4 files, snapshot 1906203875706579863 (task 16436 ms: download 9837 ms overlapping gunzip 1077 ms, parse 4475 ms, sort 126 ms, write 9130 ms, index 502 ms: 7 candidates, 73994 repo-hours, 1068 releases; waiting 834 ms; commit 1677 ms)
2026-11-07T16:19:47Z [load_day 2023-02-28] 2023-02-28 hour 22: 161221 events in 4 files, snapshot 8364803816058552669 (task 14111 ms: download 8541 ms overlapping gunzip 896 ms, parse 3730 ms, sort 97 ms, write 8064 ms, index 493 ms: 7 candidates, 67793 repo-hours, 901 releases; waiting 526 ms; commit 1417 ms)
2026-11-07T16:19:56Z [load_day 2023-02-28] 2023-02-28 hour 23: 148486 events in 3 files, snapshot 8122895063547428382 (task 15631 ms: download 8672 ms overlapping gunzip 909 ms, parse 3664 ms, sort 114 ms, write 7235 ms, index 427 ms: 4 candidates, 63364 repo-hours, 817 releases; waiting 2966 ms; commit 1434 ms)
2026-11-07T16:20:05Z [load_day 2023-02-28] 2023-02-28: repo_hour merged from 24 files to 1 (2044454 rows, 8593 ms)
2026-11-07T16:20:07Z [load_day 2023-02-28] 2023-02-28: index committed in 10493 ms (24 + 1 + 24 files)
2026-11-07T16:20:07Z [load_day 2023-02-28] 2023-02-28: 4451667 events in 24 hours
2026-11-07T16:20:07Z [load_day 2023-02-28] attempt 1 succeeded