orcaLog in

Runs · run 972

load_day 2023-04-06, attempt 1 succeeded

Host
caf251265124:240242
Started
2026-11-07T18:14:52Z
Ended
2026-11-07T18:18:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/972/load_day/2023-04-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:14:52Z [load_day 2023-04-06] attempt 1 started
2026-11-07T18:14:53Z [load_day 2023-04-06] 2023-04-06: 2 hours in flight, about 1200 MB
2026-11-07T18:15:07Z [load_day 2023-04-06] 2023-04-06 hour 0: 158626 events in 4 files, snapshot 7656722294245940203 (task 11347 ms: download 4719 ms overlapping gunzip 629 ms, parse 2964 ms, sort 129 ms, write 6330 ms, index 513 ms: 5 candidates, 80525 repo-hours, 872 releases; waiting 518 ms; commit 1442 ms)
2026-11-07T18:15:09Z [load_day 2023-04-06] 2023-04-06 hour 1: 162007 events in 4 files, snapshot 2177001658343635463 (task 11404 ms: download 4508 ms overlapping gunzip 630 ms, parse 2863 ms, sort 90 ms, write 6447 ms, index 581 ms: 7 candidates, 89236 repo-hours, 735 releases; waiting 494 ms; commit 1608 ms)
2026-11-07T18:15:20Z [load_day 2023-04-06] 2023-04-06 hour 2: 143436 events in 3 files, snapshot 1181472274661788588 (task 11976 ms: download 5606 ms overlapping gunzip 627 ms, parse 2709 ms, sort 107 ms, write 6027 ms, index 465 ms: 1 candidates, 66081 repo-hours, 697 releases; waiting 1715 ms; commit 1546 ms)
2026-11-07T18:15:22Z [load_day 2023-04-06] 2023-04-06 hour 3: 138854 events in 3 files, snapshot 8068361346292427196 (task 10729 ms: download 4650 ms overlapping gunzip 604 ms, parse 2610 ms, sort 115 ms, write 5998 ms, index 402 ms: 5 candidates, 60934 repo-hours, 822 releases; waiting 691 ms; commit 1630 ms)
2026-11-07T18:15:30Z [load_day 2023-04-06] 2023-04-06 hour 4: 127138 events in 3 files, snapshot 5955550941937334156 (task 9046 ms: download 3695 ms overlapping gunzip 544 ms, parse 2352 ms, sort 75 ms, write 5071 ms, index 347 ms: 3 candidates, 55131 repo-hours, 631 releases; waiting 316 ms; commit 1460 ms)
2026-11-07T18:15:33Z [load_day 2023-04-06] 2023-04-06 hour 5: 141253 events in 3 files, snapshot 7038382929919854599 (task 9968 ms: download 3930 ms overlapping gunzip 627 ms, parse 2632 ms, sort 80 ms, write 5729 ms, index 408 ms: 4 candidates, 62132 repo-hours, 792 releases; waiting 207 ms; commit 1727 ms)
2026-11-07T18:15:44Z [load_day 2023-04-06] 2023-04-06 hour 6: 165125 events in 4 files, snapshot 7567554147361405796 (task 12806 ms: download 5126 ms overlapping gunzip 732 ms, parse 3154 ms, sort 106 ms, write 7278 ms, index 515 ms: 4 candidates, 77842 repo-hours, 849 releases; waiting 659 ms; commit 1532 ms)
2026-11-07T18:15:48Z [load_day 2023-04-06] 2023-04-06 hour 7: 172118 events in 4 files, snapshot 1757242937554238232 (task 14298 ms: download 8238 ms overlapping gunzip 859 ms, parse 3712 ms, sort 109 ms, write 8272 ms, index 548 ms: 0 candidates, 78218 repo-hours, 940 releases; waiting 503 ms; commit 1525 ms)
2026-11-07T18:16:00Z [load_day 2023-04-06] 2023-04-06 hour 8: 176127 events in 4 files, snapshot 4206206278341321324 (task 15050 ms: download 8842 ms overlapping gunzip 864 ms, parse 3688 ms, sort 109 ms, write 8988 ms, index 574 ms: 4 candidates, 81115 repo-hours, 938 releases; waiting 525 ms; commit 1459 ms)
2026-11-07T18:16:04Z [load_day 2023-04-06] 2023-04-06 hour 9: 186280 events in 4 files, snapshot 4997104558084465759 (task 15222 ms: download 8478 ms overlapping gunzip 894 ms, parse 3867 ms, sort 119 ms, write 8865 ms, index 581 ms: 6 candidates, 83074 repo-hours, 1110 releases; waiting 582 ms; commit 1523 ms)
2026-11-07T18:16:15Z [load_day 2023-04-06] 2023-04-06 hour 10: 177603 events in 4 files, snapshot 1967379574069698662 (task 14584 ms: download 8351 ms overlapping gunzip 886 ms, parse 3841 ms, sort 117 ms, write 8310 ms, index 568 ms: 2 candidates, 80824 repo-hours, 974 releases; waiting 516 ms; commit 1776 ms)
2026-11-07T18:16:20Z [load_day 2023-04-06] 2023-04-06 hour 11: 181256 events in 4 files, snapshot 873865761008759525 (task 15266 ms: download 8916 ms overlapping gunzip 904 ms, parse 3813 ms, sort 121 ms, write 8628 ms, index 534 ms: 6 candidates, 77997 repo-hours, 1008 releases; waiting 946 ms; commit 1657 ms)
2026-11-07T18:16:33Z [load_day 2023-04-06] 2023-04-06 hour 12: 227003 events in 5 files, snapshot 4400040926863432439 (task 16661 ms: download 8572 ms overlapping gunzip 948 ms, parse 4135 ms, sort 142 ms, write 9887 ms, index 705 ms: 11 candidates, 108521 repo-hours, 978 releases; waiting 527 ms; commit 1748 ms)
2026-11-07T18:16:37Z [load_day 2023-04-06] 2023-04-06 hour 13: 197845 events in 4 files, snapshot 3260181602475503969 (task 15931 ms: download 8501 ms overlapping gunzip 910 ms, parse 3975 ms, sort 124 ms, write 9185 ms, index 678 ms: 10 candidates, 100071 repo-hours, 1013 releases; waiting 720 ms; commit 1623 ms)
2026-11-07T18:16:49Z [load_day 2023-04-06] 2023-04-06 hour 14: 186001 events in 4 files, snapshot 7451650942448356727 (task 15944 ms: download 8949 ms overlapping gunzip 946 ms, parse 4024 ms, sort 110 ms, write 9203 ms, index 605 ms: 3 candidates, 87953 repo-hours, 1045 releases; waiting 679 ms; commit 1741 ms)
2026-11-07T18:16:54Z [load_day 2023-04-06] 2023-04-06 hour 15: 191480 events in 4 files, snapshot 5254834532269244431 (task 16578 ms: download 9111 ms overlapping gunzip 984 ms, parse 4190 ms, sort 131 ms, write 9647 ms, index 687 ms: 6 candidates, 88486 repo-hours, 1111 releases; waiting 603 ms; commit 1870 ms)
2026-11-07T18:17:05Z [load_day 2023-04-06] 2023-04-06 hour 16: 176778 events in 4 files, snapshot 3711688167606749928 (task 15267 ms: download 9002 ms overlapping gunzip 934 ms, parse 4069 ms, sort 124 ms, write 8735 ms, index 587 ms: 6 candidates, 81301 repo-hours, 950 releases; waiting 553 ms; commit 1449 ms)
2026-11-07T18:17:12Z [load_day 2023-04-06] 2023-04-06 hour 17: 177281 events in 4 files, snapshot 6070649998189623744 (task 17455 ms: download 11403 ms overlapping gunzip 919 ms, parse 4077 ms, sort 111 ms, write 8286 ms, index 512 ms: 26 candidates, 78945 repo-hours, 875 releases; waiting 3263 ms; commit 1620 ms)
2026-11-07T18:17:20Z [load_day 2023-04-06] 2023-04-06 hour 18: 179009 events in 4 files, snapshot 9148421262398641693 (task 14096 ms: download 7880 ms overlapping gunzip 859 ms, parse 3848 ms, sort 111 ms, write 7940 ms, index 567 ms: 5 candidates, 81393 repo-hours, 966 releases; waiting 528 ms; commit 1622 ms)
2026-11-07T18:17:26Z [load_day 2023-04-06] 2023-04-06 hour 19: 164297 events in 4 files, snapshot 8436467633743788811 (task 13209 ms: download 7691 ms overlapping gunzip 766 ms, parse 3416 ms, sort 96 ms, write 7618 ms, index 515 ms: 5 candidates, 72616 repo-hours, 904 releases; waiting 526 ms; commit 1770 ms)
2026-11-07T18:17:36Z [load_day 2023-04-06] 2023-04-06 hour 20: 165657 events in 4 files, snapshot 1117270222302766014 (task 15095 ms: download 9717 ms overlapping gunzip 821 ms, parse 3600 ms, sort 107 ms, write 7557 ms, index 474 ms: 16 candidates, 71131 repo-hours, 860 releases; waiting 2251 ms; commit 1562 ms)
2026-11-07T18:17:39Z [load_day 2023-04-06] 2023-04-06 hour 21: 155805 events in 4 files, snapshot 2184215833317809174 (task 12444 ms: download 5267 ms overlapping gunzip 769 ms, parse 3310 ms, sort 96 ms, write 7010 ms, index 477 ms: 7 candidates, 64233 repo-hours, 1001 releases; waiting 561 ms; commit 1478 ms)
2026-11-07T18:17:48Z [load_day 2023-04-06] 2023-04-06 hour 22: 138983 events in 3 files, snapshot 4402531297697601473 (task 10981 ms: download 4775 ms overlapping gunzip 662 ms, parse 2863 ms, sort 86 ms, write 6196 ms, index 377 ms: 7 candidates, 57327 repo-hours, 828 releases; waiting 518 ms; commit 1465 ms)
2026-11-07T18:17:50Z [load_day 2023-04-06] 2023-04-06 hour 23: 129345 events in 3 files, snapshot 4416323132547484858 (task 9652 ms: download 4153 ms overlapping gunzip 614 ms, parse 2652 ms, sort 78 ms, write 5466 ms, index 343 ms: 6 candidates, 53750 repo-hours, 745 releases; waiting 209 ms; commit 1631 ms)
2026-11-07T18:17:58Z [load_day 2023-04-06] 2023-04-06: repo_hour merged from 24 files to 1 (1838836 rows, 7724 ms)
2026-11-07T18:18:00Z [load_day 2023-04-06] 2023-04-06: index committed in 9760 ms (23 + 1 + 24 files)
2026-11-07T18:18:00Z [load_day 2023-04-06] 2023-04-06: 4019307 events in 24 hours
2026-11-07T18:18:00Z [load_day 2023-04-06] attempt 1 succeeded