orcaLog in

Runs · run 1035

load_day 2023-04-27, attempt 1 succeeded

Host
caf251265124:311582
Started
2026-11-07T19:17:25Z
Ended
2026-11-07T19:20:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1035/load_day/2023-04-27/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:17:25Z [load_day 2023-04-27] attempt 1 started
2026-11-07T19:17:26Z [load_day 2023-04-27] 2023-04-27: 2 hours in flight, about 1200 MB
2026-11-07T19:17:41Z [load_day 2023-04-27] 2023-04-27 hour 0: 146523 events in 3 files, snapshot 5682640182959214894 (task 11277 ms: download 4818 ms overlapping gunzip 638 ms, parse 2899 ms, sort 98 ms, write 6230 ms, index 512 ms: 8 candidates, 75799 repo-hours, 923 releases; waiting 582 ms; commit 1709 ms)
2026-11-07T19:17:42Z [load_day 2023-04-27] 2023-04-27 hour 1: 159325 events in 4 files, snapshot 7987212685847247881 (task 11322 ms: download 4264 ms overlapping gunzip 643 ms, parse 2887 ms, sort 101 ms, write 6568 ms, index 613 ms: 4 candidates, 89319 repo-hours, 858 releases; waiting 221 ms; commit 1672 ms)
2026-11-07T19:17:53Z [load_day 2023-04-27] 2023-04-27 hour 2: 140761 events in 3 files, snapshot 1713742728844658459 (task 10959 ms: download 4886 ms overlapping gunzip 609 ms, parse 2576 ms, sort 98 ms, write 6000 ms, index 436 ms: 2 candidates, 66265 repo-hours, 702 releases; waiting 864 ms; commit 1914 ms)
2026-11-07T19:17:54Z [load_day 2023-04-27] 2023-04-27 hour 3: 131710 events in 3 files, snapshot 3928310514846771056 (task 10275 ms: download 4278 ms overlapping gunzip 567 ms, parse 2452 ms, sort 78 ms, write 5823 ms, index 419 ms: 4 candidates, 59770 repo-hours, 801 releases; waiting 623 ms; commit 1740 ms)
2026-11-07T19:18:02Z [load_day 2023-04-27] 2023-04-27 hour 4: 125459 events in 3 files, snapshot 7882882813989820523 (task 9423 ms: download 4088 ms overlapping gunzip 539 ms, parse 2351 ms, sort 67 ms, write 5175 ms, index 389 ms: 3 candidates, 55277 repo-hours, 577 releases; waiting 633 ms; commit 1630 ms)
2026-11-07T19:18:05Z [load_day 2023-04-27] 2023-04-27 hour 5: 138072 events in 3 files, snapshot 1328317810497193306 (task 10283 ms: download 4192 ms overlapping gunzip 612 ms, parse 2711 ms, sort 88 ms, write 5755 ms, index 419 ms: 6 candidates, 61641 repo-hours, 794 releases; waiting 486 ms; commit 1669 ms)
2026-11-07T19:18:16Z [load_day 2023-04-27] 2023-04-27 hour 6: 164522 events in 4 files, snapshot 9131864032134185409 (task 12914 ms: download 5350 ms overlapping gunzip 722 ms, parse 3155 ms, sort 104 ms, write 7363 ms, index 490 ms: 9 candidates, 77413 repo-hours, 984 releases; waiting 765 ms; commit 1470 ms)
2026-11-07T19:18:21Z [load_day 2023-04-27] 2023-04-27 hour 7: 164937 events in 4 files, snapshot 956227107070399286 (task 14683 ms: download 6854 ms overlapping gunzip 823 ms, parse 3644 ms, sort 93 ms, write 7584 ms, index 499 ms: 16 candidates, 76347 repo-hours, 954 releases; waiting 1761 ms; commit 1756 ms)
2026-11-07T19:18:32Z [load_day 2023-04-27] 2023-04-27 hour 8: 171167 events in 4 files, snapshot 8957641611944406597 (task 14579 ms: download 8310 ms overlapping gunzip 865 ms, parse 3820 ms, sort 118 ms, write 8383 ms, index 525 ms: 7 candidates, 80932 repo-hours, 985 releases; waiting 548 ms; commit 1595 ms)
2026-11-07T19:18:37Z [load_day 2023-04-27] 2023-04-27 hour 9: 181414 events in 4 files, snapshot 7126846006868955540 (task 14993 ms: download 8407 ms overlapping gunzip 904 ms, parse 4019 ms, sort 108 ms, write 8628 ms, index 604 ms: 8 candidates, 84435 repo-hours, 1151 releases; waiting 401 ms; commit 1571 ms)
2026-11-07T19:18:47Z [load_day 2023-04-27] 2023-04-27 hour 10: 175918 events in 4 files, snapshot 3825940121470488509 (task 14072 ms: download 7966 ms overlapping gunzip 816 ms, parse 3676 ms, sort 100 ms, write 8034 ms, index 616 ms: 6 candidates, 80989 repo-hours, 968 releases; waiting 523 ms; commit 1741 ms)
2026-11-07T19:18:52Z [load_day 2023-04-27] 2023-04-27 hour 11: 178465 events in 4 files, snapshot 3054253106715783234 (task 14233 ms: download 7929 ms overlapping gunzip 830 ms, parse 3640 ms, sort 112 ms, write 8195 ms, index 608 ms: 3 candidates, 78993 repo-hours, 1069 releases; waiting 532 ms; commit 1571 ms)
2026-11-07T19:19:04Z [load_day 2023-04-27] 2023-04-27 hour 12: 214243 events in 5 files, snapshot 7992559507959038820 (task 17084 ms: download 9654 ms overlapping gunzip 919 ms, parse 4124 ms, sort 109 ms, write 8794 ms, index 655 ms: 4 candidates, 108378 repo-hours, 1046 releases; waiting 2138 ms; commit 1498 ms)
2026-11-07T19:19:08Z [load_day 2023-04-27] 2023-04-27 hour 13: 198149 events in 4 files, snapshot 2392079383863067534 (task 15705 ms: download 8164 ms overlapping gunzip 917 ms, parse 4124 ms, sort 115 ms, write 9063 ms, index 696 ms: 5 candidates, 103885 repo-hours, 1245 releases; waiting 477 ms; commit 1712 ms)
2026-11-07T19:19:23Z [load_day 2023-04-27] 2023-04-27 hour 14: 198498 events in 4 files, snapshot 2445560870874932080 (task 17817 ms: download 10212 ms overlapping gunzip 1033 ms, parse 4548 ms, sort 141 ms, write 9836 ms, index 731 ms: 5 candidates, 93867 repo-hours, 1227 releases; waiting 1154 ms; commit 1646 ms)
2026-11-07T19:19:25Z [load_day 2023-04-27] 2023-04-27 hour 15: 179211 events in 4 files, snapshot 8111550187699231883 (task 15206 ms: download 8465 ms overlapping gunzip 873 ms, parse 3839 ms, sort 107 ms, write 8954 ms, index 602 ms: 3 candidates, 88376 repo-hours, 1344 releases; waiting 487 ms; commit 1688 ms)
2026-11-07T19:19:40Z [load_day 2023-04-27] 2023-04-27 hour 16: 178501 events in 4 files, snapshot 3841033615881531669 (task 15672 ms: download 9061 ms overlapping gunzip 871 ms, parse 3826 ms, sort 103 ms, write 9275 ms, index 579 ms: 4 candidates, 83410 repo-hours, 1115 releases; waiting 568 ms; commit 1785 ms)
2026-11-07T19:19:41Z [load_day 2023-04-27] 2023-04-27 hour 17: 177443 events in 4 files, snapshot 8958772160355901497 (task 14932 ms: download 8651 ms overlapping gunzip 868 ms, parse 3860 ms, sort 119 ms, write 8714 ms, index 548 ms: 5 candidates, 79399 repo-hours, 1107 releases; waiting 517 ms; commit 1769 ms)
2026-11-07T19:19:56Z [load_day 2023-04-27] 2023-04-27 hour 18: 182953 events in 4 files, snapshot 7368666389416222293 (task 15093 ms: download 8511 ms overlapping gunzip 864 ms, parse 3956 ms, sort 116 ms, write 8648 ms, index 576 ms: 5 candidates, 85782 repo-hours, 1171 releases; waiting 621 ms; commit 1718 ms)
2026-11-07T19:19:57Z [load_day 2023-04-27] 2023-04-27 hour 19: 169663 events in 4 files, snapshot 5821166033859092351 (task 14695 ms: download 8999 ms overlapping gunzip 851 ms, parse 3820 ms, sort 112 ms, write 8072 ms, index 506 ms: 3 candidates, 74239 repo-hours, 1156 releases; waiting 1048 ms; commit 1687 ms)
2026-11-07T19:20:11Z [load_day 2023-04-27] 2023-04-27 hour 20: 170855 events in 4 files, snapshot 1313858277486235514 (task 14063 ms: download 8133 ms overlapping gunzip 856 ms, parse 3819 ms, sort 114 ms, write 7889 ms, index 517 ms: 5 candidates, 75481 repo-hours, 1150 releases; waiting 524 ms; commit 1889 ms)
2026-11-07T19:20:12Z [load_day 2023-04-27] 2023-04-27 hour 21: 153346 events in 4 files, snapshot 2825382074249032281 (task 11965 ms: download 5023 ms overlapping gunzip 743 ms, parse 3198 ms, sort 93 ms, write 7018 ms, index 449 ms: 4 candidates, 65508 repo-hours, 1191 releases; waiting 184 ms; commit 1720 ms)
2026-11-07T19:20:22Z [load_day 2023-04-27] 2023-04-27 hour 22: 138790 events in 3 files, snapshot 7333255192747285143 (task 11241 ms: download 5013 ms overlapping gunzip 696 ms, parse 3117 ms, sort 94 ms, write 6265 ms, index 391 ms: 7 candidates, 58398 repo-hours, 960 releases; waiting 392 ms; commit 1486 ms)
2026-11-07T19:20:24Z [load_day 2023-04-27] 2023-04-27 hour 23: 126851 events in 3 files, snapshot 2579984201744221848 (task 9802 ms: download 4230 ms overlapping gunzip 560 ms, parse 2574 ms, sort 87 ms, write 5405 ms, index 351 ms: 6 candidates, 54813 repo-hours, 871 releases; waiting 534 ms; commit 1654 ms)
2026-11-07T19:20:32Z [load_day 2023-04-27] 2023-04-27: repo_hour merged from 24 files to 1 (1858716 rows, 7654 ms)
2026-11-07T19:20:33Z [load_day 2023-04-27] 2023-04-27: index committed in 9377 ms (24 + 1 + 24 files)
2026-11-07T19:20:33Z [load_day 2023-04-27] 2023-04-27: 3966776 events in 24 hours
2026-11-07T19:20:33Z [load_day 2023-04-27] attempt 1 succeeded