orcaLog in

Runs · run 909

load_day 2023-03-16, attempt 1 succeeded

Host
caf251265124:168588
Started
2026-11-07T17:11:30Z
Ended
2026-11-07T17:14:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/909/load_day/2023-03-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:11:30Z [load_day 2023-03-16] attempt 1 started
2026-11-07T17:11:32Z [load_day 2023-03-16] 2023-03-16: 2 hours in flight, about 1200 MB
2026-11-07T17:11:48Z [load_day 2023-03-16] 2023-03-16 hour 0: 166042 events in 4 files, snapshot 1948867481371048999 (task 12948 ms: download 5807 ms overlapping gunzip 773 ms, parse 3482 ms, sort 115 ms, write 7108 ms, index 551 ms: 5 candidates, 77541 repo-hours, 980 releases; waiting 634 ms; commit 1653 ms)
2026-11-07T17:11:49Z [load_day 2023-03-16] 2023-03-16 hour 1: 174080 events in 4 files, snapshot 5326945569332456077 (task 13229 ms: download 5619 ms overlapping gunzip 794 ms, parse 3549 ms, sort 108 ms, write 7218 ms, index 673 ms: 5 candidates, 87275 repo-hours, 940 releases; waiting 594 ms; commit 1420 ms)
2026-11-07T17:12:00Z [load_day 2023-03-16] 2023-03-16 hour 2: 158133 events in 4 files, snapshot 2494775040003035421 (task 11971 ms: download 4853 ms overlapping gunzip 710 ms, parse 3026 ms, sort 113 ms, write 6800 ms, index 482 ms: 6 candidates, 73981 repo-hours, 744 releases; waiting 551 ms; commit 1625 ms)
2026-11-07T17:12:02Z [load_day 2023-03-16] 2023-03-16 hour 3: 147623 events in 3 files, snapshot 8023705726596980345 (task 12275 ms: download 5666 ms overlapping gunzip 728 ms, parse 3101 ms, sort 101 ms, write 6503 ms, index 404 ms: 6 candidates, 61077 repo-hours, 804 releases; waiting 1029 ms; commit 1424 ms)
2026-11-07T17:12:12Z [load_day 2023-03-16] 2023-03-16 hour 4: 137310 events in 3 files, snapshot 5273022905372375283 (task 10935 ms: download 4890 ms overlapping gunzip 676 ms, parse 2825 ms, sort 89 ms, write 6040 ms, index 357 ms: 3 candidates, 55670 repo-hours, 665 releases; waiting 572 ms; commit 1643 ms)
2026-11-07T17:12:14Z [load_day 2023-03-16] 2023-03-16 hour 5: 146665 events in 3 files, snapshot 220079402737017732 (task 11469 ms: download 4793 ms overlapping gunzip 739 ms, parse 3073 ms, sort 93 ms, write 6341 ms, index 410 ms: 3 candidates, 60743 repo-hours, 754 releases; waiting 502 ms; commit 1569 ms)
2026-11-07T17:12:25Z [load_day 2023-03-16] 2023-03-16 hour 6: 166096 events in 4 files, snapshot 6812951479296034329 (task 13083 ms: download 7598 ms overlapping gunzip 834 ms, parse 3399 ms, sort 120 ms, write 7559 ms, index 470 ms: 5 candidates, 72869 repo-hours, 780 releases; waiting 405 ms; commit 1465 ms)
2026-11-07T17:12:29Z [load_day 2023-03-16] 2023-03-16 hour 7: 173104 events in 4 files, snapshot 2653081211594615715 (task 14296 ms: download 8458 ms overlapping gunzip 883 ms, parse 3730 ms, sort 122 ms, write 8173 ms, index 520 ms: 9 candidates, 74207 repo-hours, 823 releases; waiting 534 ms; commit 1446 ms)
2026-11-07T17:12:42Z [load_day 2023-03-16] 2023-03-16 hour 8: 189071 events in 4 files, snapshot 5226436812997549145 (task 15918 ms: download 9006 ms overlapping gunzip 959 ms, parse 4102 ms, sort 107 ms, write 9156 ms, index 579 ms: 2 candidates, 83795 repo-hours, 907 releases; waiting 660 ms; commit 1655 ms)
2026-11-07T17:12:48Z [load_day 2023-03-16] 2023-03-16 hour 9: 202096 events in 5 files, snapshot 7708156253595883532 (task 17349 ms: download 9603 ms overlapping gunzip 1096 ms, parse 4595 ms, sort 143 ms, write 10117 ms, index 558 ms: 3 candidates, 86571 repo-hours, 1255 releases; waiting 544 ms; commit 1495 ms)
2026-11-07T17:13:00Z [load_day 2023-03-16] 2023-03-16 hour 10: 199486 events in 4 files, snapshot 8936074276540689658 (task 16891 ms: download 9514 ms overlapping gunzip 1067 ms, parse 4556 ms, sort 125 ms, write 9716 ms, index 613 ms: 6 candidates, 86352 repo-hours, 1119 releases; waiting 518 ms; commit 1559 ms)
2026-11-07T17:13:05Z [load_day 2023-03-16] 2023-03-16 hour 11: 201005 events in 5 files, snapshot 4202306747463962391 (task 16156 ms: download 9050 ms overlapping gunzip 951 ms, parse 4128 ms, sort 149 ms, write 9401 ms, index 624 ms: 9 candidates, 101709 repo-hours, 848 releases; waiting 562 ms; commit 1448 ms)
2026-11-07T17:13:21Z [load_day 2023-03-16] 2023-03-16 hour 12: 222687 events in 5 files, snapshot 8123972151483950334 (task 20058 ms: download 13883 ms overlapping gunzip 1049 ms, parse 4613 ms, sort 123 ms, write 10104 ms, index 712 ms: 6 candidates, 111112 repo-hours, 1169 releases; waiting 3094 ms; commit 1620 ms)
2026-11-07T17:13:22Z [load_day 2023-03-16] 2023-03-16 hour 13: 197659 events in 4 files, snapshot 8512118763310294260 (task 16223 ms: download 8809 ms overlapping gunzip 935 ms, parse 4074 ms, sort 104 ms, write 9344 ms, index 678 ms: 7 candidates, 102559 repo-hours, 985 releases; waiting 789 ms; commit 1562 ms)
2026-11-07T17:13:39Z [load_day 2023-03-16] 2023-03-16 hour 14: 199268 events in 4 files, snapshot 5749928536990435045 (task 18153 ms: download 10587 ms overlapping gunzip 1066 ms, parse 4563 ms, sort 124 ms, write 10597 ms, index 618 ms: 6 candidates, 94829 repo-hours, 1081 releases; waiting 858 ms; commit 1426 ms)
2026-11-07T17:13:41Z [load_day 2023-03-16] 2023-03-16 hour 15: 181832 events in 4 files, snapshot 5290955490349220290 (task 15265 ms: download 8744 ms overlapping gunzip 862 ms, parse 3774 ms, sort 117 ms, write 8992 ms, index 630 ms: 3 candidates, 99499 repo-hours, 983 releases; waiting 563 ms; commit 1454 ms)
2026-11-07T17:13:57Z [load_day 2023-03-16] 2023-03-16 hour 16: 180206 events in 4 files, snapshot 6193201902837237573 (task 16878 ms: download 10194 ms overlapping gunzip 1001 ms, parse 4281 ms, sort 172 ms, write 9679 ms, index 588 ms: 6 candidates, 90038 repo-hours, 980 releases; waiting 830 ms; commit 1335 ms)
2026-11-07T17:14:00Z [load_day 2023-03-16] 2023-03-16 hour 17: 199229 events in 4 files, snapshot 728285362366026437 (task 18098 ms: download 10328 ms overlapping gunzip 1069 ms, parse 4597 ms, sort 135 ms, write 10438 ms, index 636 ms: 11 candidates, 87900 repo-hours, 1003 releases; waiting 852 ms; commit 1321 ms)
2026-11-07T17:14:14Z [load_day 2023-03-16] 2023-03-16 hour 18: 197066 events in 4 files, snapshot 270933018731424300 (task 16341 ms: download 9141 ms overlapping gunzip 975 ms, parse 4256 ms, sort 128 ms, write 9459 ms, index 587 ms: 7 candidates, 87486 repo-hours, 1015 releases; waiting 581 ms; commit 1553 ms)
2026-11-07T17:14:18Z [load_day 2023-03-16] 2023-03-16 hour 19: 198594 events in 4 files, snapshot 4320062909523640664 (task 17100 ms: download 9610 ms overlapping gunzip 977 ms, parse 4152 ms, sort 137 ms, write 9707 ms, index 616 ms: 9 candidates, 93485 repo-hours, 1046 releases; waiting 1159 ms; commit 1495 ms)
2026-11-07T17:14:31Z [load_day 2023-03-16] 2023-03-16 hour 20: 194080 events in 4 files, snapshot 6392117008770638336 (task 16746 ms: download 10010 ms overlapping gunzip 972 ms, parse 4125 ms, sort 128 ms, write 9078 ms, index 593 ms: 2 candidates, 88023 repo-hours, 952 releases; waiting 1563 ms; commit 1415 ms)
2026-11-07T17:14:34Z [load_day 2023-03-16] 2023-03-16 hour 21: 192439 events in 4 files, snapshot 6207593742934189396 (task 15552 ms: download 8788 ms overlapping gunzip 909 ms, parse 3852 ms, sort 128 ms, write 9231 ms, index 581 ms: 11 candidates, 89503 repo-hours, 959 releases; waiting 545 ms; commit 1536 ms)
2026-11-07T17:14:45Z [load_day 2023-03-16] 2023-03-16 hour 22: 194022 events in 4 files, snapshot 5681749980511351632 (task 13216 ms: download 7264 ms overlapping gunzip 785 ms, parse 3261 ms, sort 110 ms, write 7642 ms, index 596 ms: 0 candidates, 96841 repo-hours, 905 releases; waiting 508 ms; commit 1310 ms)
2026-11-07T17:14:47Z [load_day 2023-03-16] 2023-03-16 hour 23: 152389 events in 4 files, snapshot 2888278372485913675 (task 12409 ms: download 5167 ms overlapping gunzip 741 ms, parse 3136 ms, sort 98 ms, write 6965 ms, index 416 ms: 5 candidates, 63743 repo-hours, 730 releases; waiting 562 ms; commit 1423 ms)
2026-11-07T17:14:55Z [load_day 2023-03-16] 2023-03-16: repo_hour merged from 24 files to 1 (2026808 rows, 8249 ms)
2026-11-07T17:14:57Z [load_day 2023-03-16] 2023-03-16: index committed in 10017 ms (23 + 1 + 24 files)
2026-11-07T17:14:57Z [load_day 2023-03-16] 2023-03-16: 4370182 events in 24 hours
2026-11-07T17:14:57Z [load_day 2023-03-16] attempt 1 succeeded