orcaLog in

Runs · run 927

load_day 2023-03-22, attempt 1 succeeded

Host
caf251265124:188352
Started
2026-11-07T17:29:06Z
Ended
2026-11-07T17:32:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/927/load_day/2023-03-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:29:06Z [load_day 2023-03-22] attempt 1 started
2026-11-07T17:29:08Z [load_day 2023-03-22] 2023-03-22: 2 hours in flight, about 1200 MB
2026-11-07T17:29:22Z [load_day 2023-03-22] 2023-03-22 hour 0: 157516 events in 4 files, snapshot 7649797885310481598 (task 11919 ms: download 5282 ms overlapping gunzip 738 ms, parse 3350 ms, sort 122 ms, write 6355 ms, index 495 ms: 9 candidates, 76467 repo-hours, 773 releases; waiting 518 ms; commit 1443 ms)
2026-11-07T17:29:24Z [load_day 2023-03-22] 2023-03-22 hour 1: 160316 events in 4 files, snapshot 94987606609248502 (task 11948 ms: download 4953 ms overlapping gunzip 696 ms, parse 3065 ms, sort 99 ms, write 6576 ms, index 550 ms: 7 candidates, 84836 repo-hours, 750 releases; waiting 577 ms; commit 1465 ms)
2026-11-07T17:29:34Z [load_day 2023-03-22] 2023-03-22 hour 2: 146323 events in 3 files, snapshot 119496711726587151 (task 10922 ms: download 4703 ms overlapping gunzip 658 ms, parse 2908 ms, sort 105 ms, write 5944 ms, index 468 ms: 2 candidates, 66851 repo-hours, 757 releases; waiting 519 ms; commit 1527 ms)
2026-11-07T17:29:35Z [load_day 2023-03-22] 2023-03-22 hour 3: 135943 events in 3 files, snapshot 4200164481447972222 (task 10514 ms: download 4493 ms overlapping gunzip 585 ms, parse 2637 ms, sort 76 ms, write 5563 ms, index 411 ms: 2 candidates, 59412 repo-hours, 919 releases; waiting 833 ms; commit 1421 ms)
2026-11-07T17:29:44Z [load_day 2023-03-22] 2023-03-22 hour 4: 139287 events in 3 files, snapshot 86848590133913190 (task 9828 ms: download 4017 ms overlapping gunzip 593 ms, parse 2660 ms, sort 119 ms, write 5252 ms, index 372 ms: 4 candidates, 62264 repo-hours, 668 releases; waiting 528 ms; commit 1422 ms)
2026-11-07T17:29:46Z [load_day 2023-03-22] 2023-03-22 hour 5: 133776 events in 3 files, snapshot 2248979203030382613 (task 9233 ms: download 3742 ms overlapping gunzip 571 ms, parse 2503 ms, sort 81 ms, write 5190 ms, index 364 ms: 1 candidates, 57674 repo-hours, 767 releases; waiting 220 ms; commit 1389 ms)
2026-11-07T17:29:56Z [load_day 2023-03-22] 2023-03-22 hour 6: 159004 events in 4 files, snapshot 7345513229031731833 (task 11276 ms: download 4600 ms overlapping gunzip 665 ms, parse 2967 ms, sort 94 ms, write 6210 ms, index 492 ms: 4 candidates, 72356 repo-hours, 831 releases; waiting 520 ms; commit 1373 ms)
2026-11-07T17:29:59Z [load_day 2023-03-22] 2023-03-22 hour 7: 163606 events in 4 files, snapshot 1140448664329968296 (task 12765 ms: download 5297 ms overlapping gunzip 754 ms, parse 3220 ms, sort 95 ms, write 7122 ms, index 501 ms: 5 candidates, 72657 repo-hours, 846 releases; waiting 748 ms; commit 1507 ms)
2026-11-07T17:30:11Z [load_day 2023-03-22] 2023-03-22 hour 8: 168448 events in 4 files, snapshot 596869910645802102 (task 13625 ms: download 7836 ms overlapping gunzip 806 ms, parse 3510 ms, sort 106 ms, write 7901 ms, index 574 ms: 6 candidates, 79074 repo-hours, 877 releases; waiting 410 ms; commit 1612 ms)
2026-11-07T17:30:15Z [load_day 2023-03-22] 2023-03-22 hour 9: 170860 events in 4 files, snapshot 1758170677781117273 (task 14788 ms: download 8573 ms overlapping gunzip 836 ms, parse 3687 ms, sort 116 ms, write 8451 ms, index 535 ms: 4 candidates, 80632 repo-hours, 1114 releases; waiting 772 ms; commit 1658 ms)
2026-11-07T17:30:30Z [load_day 2023-03-22] 2023-03-22 hour 10: 193772 events in 4 files, snapshot 5495114293654151900 (task 14890 ms: download 8213 ms overlapping gunzip 848 ms, parse 3654 ms, sort 132 ms, write 8823 ms, index 614 ms: 6 candidates, 104262 repo-hours, 1006 releases; waiting 501 ms; commit 4836 ms)
2026-11-07T17:30:31Z [load_day 2023-03-22] 2023-03-22 hour 11: 165448 events in 4 files, snapshot 175150496703240115 (task 13588 ms: download 7929 ms overlapping gunzip 783 ms, parse 3419 ms, sort 111 ms, write 7638 ms, index 551 ms: 3 candidates, 77374 repo-hours, 933 releases; waiting 807 ms; commit 1525 ms)
2026-11-07T17:30:42Z [load_day 2023-03-22] 2023-03-22 hour 12: 191907 events in 4 files, snapshot 6943590345883878792 (task 14881 ms: download 8263 ms overlapping gunzip 829 ms, parse 3771 ms, sort 115 ms, write 8683 ms, index 642 ms: 7 candidates, 101046 repo-hours, 1043 releases; waiting 502 ms; commit 1728 ms)
2026-11-07T17:30:47Z [load_day 2023-03-22] 2023-03-22 hour 13: 197029 events in 4 files, snapshot 768371365816016381 (task 15218 ms: download 8132 ms overlapping gunzip 876 ms, parse 3925 ms, sort 132 ms, write 9048 ms, index 714 ms: 5 candidates, 110708 repo-hours, 919 releases; waiting 199 ms; commit 1426 ms)
2026-11-07T17:31:03Z [load_day 2023-03-22] 2023-03-22 hour 14: 198255 events in 4 files, snapshot 5229662012355373750 (task 20411 ms: download 12916 ms overlapping gunzip 1012 ms, parse 4417 ms, sort 129 ms, write 9667 ms, index 681 ms: 1 candidates, 100715 repo-hours, 1015 releases; waiting 4174 ms; commit 1602 ms)
2026-11-07T17:31:05Z [load_day 2023-03-22] 2023-03-22 hour 15: 201405 events in 5 files, snapshot 2226287906868340465 (task 16364 ms: download 8873 ms overlapping gunzip 975 ms, parse 4095 ms, sort 143 ms, write 9747 ms, index 748 ms: 7 candidates, 115148 repo-hours, 1080 releases; waiting 245 ms; commit 1408 ms)
2026-11-07T17:31:20Z [load_day 2023-03-22] 2023-03-22 hour 16: 188028 events in 4 files, snapshot 1661705869774326001 (task 15621 ms: download 8923 ms overlapping gunzip 917 ms, parse 4028 ms, sort 117 ms, write 9005 ms, index 594 ms: 9 candidates, 94881 repo-hours, 991 releases; waiting 581 ms; commit 1734 ms)
2026-11-07T17:31:22Z [load_day 2023-03-22] 2023-03-22 hour 17: 190023 events in 4 files, snapshot 6678447971695343127 (task 16376 ms: download 9372 ms overlapping gunzip 946 ms, parse 4105 ms, sort 112 ms, write 9330 ms, index 628 ms: 10 candidates, 90717 repo-hours, 995 releases; waiting 910 ms; commit 1806 ms)
2026-11-07T17:31:35Z [load_day 2023-03-22] 2023-03-22 hour 18: 189773 events in 4 files, snapshot 9130230315204793508 (task 15007 ms: download 8527 ms overlapping gunzip 871 ms, parse 3841 ms, sort 120 ms, write 8695 ms, index 663 ms: 5 candidates, 93809 repo-hours, 960 releases; waiting 522 ms; commit 1565 ms)
2026-11-07T17:31:37Z [load_day 2023-03-22] 2023-03-22 hour 19: 190103 events in 4 files, snapshot 4177589949290737202 (task 14499 ms: download 7692 ms overlapping gunzip 849 ms, parse 3663 ms, sort 114 ms, write 8408 ms, index 591 ms: 8 candidates, 99305 repo-hours, 953 releases; waiting 510 ms; commit 1509 ms)
2026-11-07T17:31:50Z [load_day 2023-03-22] 2023-03-22 hour 20: 177434 events in 4 files, snapshot 6889554006524547868 (task 13934 ms: download 7960 ms overlapping gunzip 836 ms, parse 3587 ms, sort 112 ms, write 7997 ms, index 532 ms: 5 candidates, 83128 repo-hours, 930 releases; waiting 549 ms; commit 1498 ms)
2026-11-07T17:31:52Z [load_day 2023-03-22] 2023-03-22 hour 21: 166201 events in 4 files, snapshot 2426427538878144604 (task 13922 ms: download 8315 ms overlapping gunzip 855 ms, parse 3645 ms, sort 96 ms, write 7980 ms, index 481 ms: 6 candidates, 72751 repo-hours, 958 releases; waiting 546 ms; commit 1516 ms)
2026-11-07T17:32:03Z [load_day 2023-03-22] 2023-03-22 hour 22: 152803 events in 4 files, snapshot 5995928179866972593 (task 11991 ms: download 5192 ms overlapping gunzip 735 ms, parse 3239 ms, sort 90 ms, write 6686 ms, index 442 ms: 4 candidates, 63658 repo-hours, 789 releases; waiting 514 ms; commit 1608 ms)
2026-11-07T17:32:05Z [load_day 2023-03-22] 2023-03-22 hour 23: 142759 events in 3 files, snapshot 3261320715355776412 (task 11063 ms: download 4594 ms overlapping gunzip 663 ms, parse 2864 ms, sort 79 ms, write 6178 ms, index 383 ms: 0 candidates, 61339 repo-hours, 672 releases; waiting 540 ms; commit 1738 ms)
2026-11-07T17:32:13Z [load_day 2023-03-22] 2023-03-22: repo_hour merged from 24 files to 1 (1981064 rows, 7979 ms)
2026-11-07T17:32:14Z [load_day 2023-03-22] 2023-03-22: index committed in 9652 ms (23 + 1 + 24 files)
2026-11-07T17:32:14Z [load_day 2023-03-22] 2023-03-22: 4080019 events in 24 hours
2026-11-07T17:32:14Z [load_day 2023-03-22] attempt 1 succeeded