orcaLog in

Runs · run 1095

load_day 2023-05-17, attempt 1 succeeded

Host
caf251265124:376120
Started
2026-11-07T20:14:38Z
Ended
2026-11-07T20:17:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1095/load_day/2023-05-17/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:14:38Z [load_day 2023-05-17] attempt 1 started
2026-11-07T20:14:40Z [load_day 2023-05-17] 2023-05-17: 2 hours in flight, about 1200 MB
2026-11-07T20:14:54Z [load_day 2023-05-17] 2023-05-17 hour 0: 148446 events in 3 files, snapshot 3389493785439207276 (task 11263 ms: download 4761 ms overlapping gunzip 627 ms, parse 2943 ms, sort 87 ms, write 6037 ms, index 630 ms: 10 candidates, 77560 repo-hours, 893 releases; waiting 584 ms; commit 1568 ms)
2026-11-07T20:14:55Z [load_day 2023-05-17] 2023-05-17 hour 1: 151663 events in 4 files, snapshot 8320184164309159357 (task 11205 ms: download 4594 ms overlapping gunzip 634 ms, parse 2944 ms, sort 85 ms, write 6148 ms, index 562 ms: 9 candidates, 84698 repo-hours, 710 releases; waiting 495 ms; commit 1789 ms)
2026-11-07T20:15:05Z [load_day 2023-05-17] 2023-05-17 hour 2: 135401 events in 3 files, snapshot 8410894497324166644 (task 10096 ms: download 4218 ms overlapping gunzip 603 ms, parse 2617 ms, sort 85 ms, write 5679 ms, index 403 ms: 3 candidates, 64099 repo-hours, 753 releases; waiting 386 ms; commit 1982 ms)
2026-11-07T20:15:07Z [load_day 2023-05-17] 2023-05-17 hour 3: 132197 events in 3 files, snapshot 6895788417772404969 (task 10062 ms: download 4126 ms overlapping gunzip 611 ms, parse 2700 ms, sort 91 ms, write 5563 ms, index 400 ms: 6 candidates, 59219 repo-hours, 793 releases; waiting 349 ms; commit 1819 ms)
2026-11-07T20:15:17Z [load_day 2023-05-17] 2023-05-17 hour 4: 135446 events in 3 files, snapshot 6006667279827156547 (task 11738 ms: download 5885 ms overlapping gunzip 711 ms, parse 3029 ms, sort 81 ms, write 5919 ms, index 391 ms: 6 candidates, 56820 repo-hours, 540 releases; waiting 1325 ms; commit 1691 ms)
2026-11-07T20:15:19Z [load_day 2023-05-17] 2023-05-17 hour 5: 140097 events in 3 files, snapshot 9168296311570269819 (task 10657 ms: download 4469 ms overlapping gunzip 621 ms, parse 2784 ms, sort 89 ms, write 5789 ms, index 442 ms: 6 candidates, 62601 repo-hours, 728 releases; waiting 565 ms; commit 1699 ms)
2026-11-07T20:15:32Z [load_day 2023-05-17] 2023-05-17 hour 6: 166509 events in 4 files, snapshot 7657562786399401069 (task 13550 ms: download 8099 ms overlapping gunzip 792 ms, parse 3462 ms, sort 90 ms, write 7445 ms, index 484 ms: 11 candidates, 77307 repo-hours, 881 releases; waiting 1005 ms; commit 1883 ms)
2026-11-07T20:15:34Z [load_day 2023-05-17] 2023-05-17 hour 7: 160742 events in 4 files, snapshot 8233804043067054086 (task 13073 ms: download 5554 ms overlapping gunzip 795 ms, parse 3567 ms, sort 104 ms, write 7282 ms, index 538 ms: 10 candidates, 76269 repo-hours, 885 releases; waiting 487 ms; commit 1655 ms)
2026-11-07T20:15:47Z [load_day 2023-05-17] 2023-05-17 hour 8: 171808 events in 4 files, snapshot 6189869567487425930 (task 14337 ms: download 8410 ms overlapping gunzip 910 ms, parse 3963 ms, sort 109 ms, write 8358 ms, index 547 ms: 11 candidates, 81127 repo-hours, 1088 releases; waiting 214 ms; commit 1782 ms)
2026-11-07T20:15:50Z [load_day 2023-05-17] 2023-05-17 hour 9: 175167 events in 4 files, snapshot 1554043693228736135 (task 15461 ms: download 9037 ms overlapping gunzip 875 ms, parse 3884 ms, sort 120 ms, write 8533 ms, index 553 ms: 4 candidates, 81201 repo-hours, 1152 releases; waiting 1054 ms; commit 1662 ms)
2026-11-07T20:16:01Z [load_day 2023-05-17] 2023-05-17 hour 10: 167038 events in 4 files, snapshot 804725173214919555 (task 13905 ms: download 8213 ms overlapping gunzip 791 ms, parse 3570 ms, sort 97 ms, write 8088 ms, index 529 ms: 10 candidates, 77402 repo-hours, 968 releases; waiting 519 ms; commit 1632 ms)
2026-11-07T20:16:04Z [load_day 2023-05-17] 2023-05-17 hour 11: 163572 events in 4 files, snapshot 3187770746289788236 (task 13515 ms: download 5693 ms overlapping gunzip 771 ms, parse 3458 ms, sort 86 ms, write 7610 ms, index 526 ms: 8 candidates, 76643 repo-hours, 918 releases; waiting 742 ms; commit 1782 ms)
2026-11-07T20:16:17Z [load_day 2023-05-17] 2023-05-17 hour 12: 199606 events in 4 files, snapshot 7362017839230997199 (task 15090 ms: download 8184 ms overlapping gunzip 833 ms, parse 3834 ms, sort 111 ms, write 8555 ms, index 661 ms: 9 candidates, 104458 repo-hours, 889 releases; waiting 752 ms; commit 1745 ms)
2026-11-07T20:16:20Z [load_day 2023-05-17] 2023-05-17 hour 13: 185020 events in 4 files, snapshot 4544042160083138530 (task 15172 ms: download 8273 ms overlapping gunzip 872 ms, parse 3977 ms, sort 106 ms, write 8703 ms, index 746 ms: 6 candidates, 97799 repo-hours, 1002 releases; waiting 483 ms; commit 1788 ms)
2026-11-07T20:16:35Z [load_day 2023-05-17] 2023-05-17 hour 14: 182638 events in 4 files, snapshot 1064655689605300798 (task 16466 ms: download 9885 ms overlapping gunzip 919 ms, parse 4122 ms, sort 112 ms, write 9213 ms, index 584 ms: 10 candidates, 89273 repo-hours, 1041 releases; waiting 1233 ms; commit 1774 ms)
2026-11-07T20:16:36Z [load_day 2023-05-17] 2023-05-17 hour 15: 166135 events in 4 files, snapshot 8482975039397090091 (task 14825 ms: download 9116 ms overlapping gunzip 856 ms, parse 3741 ms, sort 99 ms, write 8331 ms, index 531 ms: 5 candidates, 82899 repo-hours, 986 releases; waiting 938 ms; commit 1758 ms)
2026-11-07T20:16:51Z [load_day 2023-05-17] 2023-05-17 hour 16: 163743 events in 4 files, snapshot 8748666692104741762 (task 15465 ms: download 7426 ms overlapping gunzip 856 ms, parse 3793 ms, sort 102 ms, write 8040 ms, index 615 ms: 10 candidates, 79449 repo-hours, 885 releases; waiting 1769 ms; commit 1752 ms)
2026-11-07T20:16:53Z [load_day 2023-05-17] 2023-05-17 hour 17: 170101 events in 4 files, snapshot 2033130719225795043 (task 14127 ms: download 8345 ms overlapping gunzip 821 ms, parse 3647 ms, sort 102 ms, write 8013 ms, index 513 ms: 4 candidates, 77541 repo-hours, 788 releases; waiting 655 ms; commit 1801 ms)
2026-11-07T20:17:05Z [load_day 2023-05-17] 2023-05-17 hour 18: 172647 events in 4 files, snapshot 414486597473921376 (task 13593 ms: download 7681 ms overlapping gunzip 783 ms, parse 3496 ms, sort 95 ms, write 8037 ms, index 531 ms: 6 candidates, 82557 repo-hours, 961 releases; waiting 402 ms; commit 1585 ms)
2026-11-07T20:17:09Z [load_day 2023-05-17] 2023-05-17 hour 19: 158542 events in 4 files, snapshot 6955125419006124919 (task 14865 ms: download 7242 ms overlapping gunzip 788 ms, parse 3596 ms, sort 101 ms, write 7483 ms, index 491 ms: 7 candidates, 69780 repo-hours, 964 releases; waiting 2124 ms; commit 1897 ms)
2026-11-07T20:17:19Z [load_day 2023-05-17] 2023-05-17 hour 20: 159034 events in 4 files, snapshot 120170478105003251 (task 13257 ms: download 5548 ms overlapping gunzip 776 ms, parse 3406 ms, sort 104 ms, write 7604 ms, index 488 ms: 8 candidates, 70469 repo-hours, 931 releases; waiting 528 ms; commit 1555 ms)
2026-11-07T20:17:22Z [load_day 2023-05-17] 2023-05-17 hour 21: 152986 events in 4 files, snapshot 7891678802329920973 (task 12246 ms: download 5382 ms overlapping gunzip 735 ms, parse 3267 ms, sort 95 ms, write 6887 ms, index 448 ms: 6 candidates, 69525 repo-hours, 939 releases; waiting 509 ms; commit 1530 ms)
2026-11-07T20:17:31Z [load_day 2023-05-17] 2023-05-17 hour 22: 133114 events in 3 files, snapshot 3318218848127128859 (task 10614 ms: download 4578 ms overlapping gunzip 615 ms, parse 2774 ms, sort 83 ms, write 5998 ms, index 356 ms: 5 candidates, 56633 repo-hours, 770 releases; waiting 517 ms; commit 1662 ms)
2026-11-07T20:17:32Z [load_day 2023-05-17] 2023-05-17 hour 23: 122007 events in 3 files, snapshot 6042467403754043106 (task 9644 ms: download 4203 ms overlapping gunzip 556 ms, parse 2510 ms, sort 62 ms, write 5222 ms, index 390 ms: 4 candidates, 53659 repo-hours, 590 releases; waiting 505 ms; commit 1632 ms)
2026-11-07T20:17:40Z [load_day 2023-05-17] 2023-05-17: repo_hour merged from 24 files to 1 (1808988 rows, 7634 ms)
2026-11-07T20:17:42Z [load_day 2023-05-17] 2023-05-17: index committed in 9799 ms (24 + 1 + 24 files)
2026-11-07T20:17:42Z [load_day 2023-05-17] 2023-05-17: 3813659 events in 24 hours
2026-11-07T20:17:42Z [load_day 2023-05-17] attempt 1 succeeded