orcaLog in

Runs · run 1266

load_day 2023-07-05, attempt 1 succeeded

Host
3c2b29713ce8:91016
Started
2026-11-07T22:40:05Z
Ended
2026-11-07T22:44:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1266/load_day/2023-07-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:40:05Z [load_day 2023-07-05] attempt 1 started
2026-11-07T22:40:07Z [load_day 2023-07-05] 2023-07-05: 2 hours in flight, about 1200 MB
2026-11-07T22:40:23Z [load_day 2023-07-05] 2023-07-05 hour 0: 127779 events in 3 files, snapshot 8984869981631061546 (task 12318 ms: download 2957 ms overlapping gunzip 827 ms, parse 3641 ms, sort 103 ms, write 6377 ms, index 524 ms: 7 candidates, 62977 repo-hours, 768 releases; waiting 521 ms; commit 2645 ms)
2026-11-07T22:40:25Z [load_day 2023-07-05] 2023-07-05 hour 1: 153014 events in 4 files, snapshot 6267979665818678069 (task 12592 ms: download 4890 ms overlapping gunzip 609 ms, parse 2908 ms, sort 124 ms, write 7276 ms, index 837 ms: 5 candidates, 89511 repo-hours, 789 releases; waiting 222 ms; commit 2245 ms)
2026-11-07T22:40:36Z [load_day 2023-07-05] 2023-07-05 hour 2: 128047 events in 3 files, snapshot 1203797037223109785 (task 11898 ms: download 4442 ms overlapping gunzip 748 ms, parse 3205 ms, sort 137 ms, write 6527 ms, index 516 ms: 5 candidates, 63955 repo-hours, 662 releases; waiting 497 ms; commit 2209 ms)
2026-11-07T22:40:39Z [load_day 2023-07-05] 2023-07-05 hour 3: 122875 events in 3 files, snapshot 4078543975786502657 (task 11606 ms: download 2178 ms overlapping gunzip 593 ms, parse 2621 ms, sort 88 ms, write 6791 ms, index 713 ms: 6 candidates, 57084 repo-hours, 839 releases; waiting 506 ms; commit 2600 ms)
2026-11-07T22:40:48Z [load_day 2023-07-05] 2023-07-05 hour 4: 114452 events in 3 files, snapshot 1951132726866960984 (task 10844 ms: download 2400 ms overlapping gunzip 606 ms, parse 2626 ms, sort 67 ms, write 6275 ms, index 444 ms: 6 candidates, 51896 repo-hours, 606 releases; waiting 529 ms; commit 2536 ms)
2026-11-07T22:40:51Z [load_day 2023-07-05] 2023-07-05 hour 5: 115631 events in 3 files, snapshot 108383056845219200 (task 11970 ms: download 2327 ms overlapping gunzip 687 ms, parse 3003 ms, sort 72 ms, write 6805 ms, index 581 ms: 8 candidates, 56879 repo-hours, 642 releases; waiting 516 ms; commit 2350 ms)
2026-11-07T22:41:05Z [load_day 2023-07-05] 2023-07-05 hour 6: 149972 events in 3 files, snapshot 3723841099486329627 (task 14591 ms: download 5844 ms overlapping gunzip 898 ms, parse 3949 ms, sort 100 ms, write 8280 ms, index 574 ms: 7 candidates, 74887 repo-hours, 815 releases; waiting 494 ms; commit 4332 ms)
2026-11-07T22:41:10Z [load_day 2023-07-05] 2023-07-05 hour 7: 172312 events in 4 files, snapshot 8350387186954161037 (task 17570 ms: download 9862 ms overlapping gunzip 956 ms, parse 4303 ms, sort 171 ms, write 10978 ms, index 617 ms: 5 candidates, 78901 repo-hours, 1057 releases; waiting 195 ms; commit 2402 ms)
2026-11-07T22:41:27Z [load_day 2023-07-05] 2023-07-05 hour 8: 185897 events in 4 files, snapshot 1434284246795721468 (task 21706 ms: download 12505 ms overlapping gunzip 1361 ms, parse 5960 ms, sort 277 ms, write 12432 ms, index 575 ms: 10 candidates, 84936 repo-hours, 1150 releases; waiting 727 ms; commit 3312 ms)
2026-11-07T22:41:32Z [load_day 2023-07-05] 2023-07-05 hour 9: 188302 events in 4 files, snapshot 7418493869153212010 (task 21039 ms: download 11907 ms overlapping gunzip 1396 ms, parse 5934 ms, sort 147 ms, write 12197 ms, index 613 ms: 2 candidates, 84703 repo-hours, 1273 releases; waiting 454 ms; commit 2346 ms)
2026-11-07T22:41:46Z [load_day 2023-07-05] 2023-07-05 hour 10: 183609 events in 4 files, snapshot 4823460412676030158 (task 19187 ms: download 11016 ms overlapping gunzip 1175 ms, parse 5296 ms, sort 150 ms, write 10734 ms, index 1011 ms: 5 candidates, 82763 repo-hours, 1109 releases; waiting 543 ms; commit 2153 ms)
2026-11-07T22:41:52Z [load_day 2023-07-05] 2023-07-05 hour 11: 182214 events in 4 files, snapshot 4257845399397362065 (task 18873 ms: download 10454 ms overlapping gunzip 1123 ms, parse 5049 ms, sort 130 ms, write 11223 ms, index 550 ms: 5 candidates, 79337 repo-hours, 926 releases; waiting 502 ms; commit 2563 ms)
2026-11-07T22:42:10Z [load_day 2023-07-05] 2023-07-05 hour 12: 220672 events in 5 files, snapshot 6270440984710224928 (task 21913 ms: download 14666 ms overlapping gunzip 1072 ms, parse 5022 ms, sort 178 ms, write 14010 ms, index 827 ms: 6 candidates, 112105 repo-hours, 1188 releases; waiting 494 ms; commit 2784 ms)
2026-11-07T22:42:17Z [load_day 2023-07-05] 2023-07-05 hour 13: 212904 events in 5 files, snapshot 308884425810724742 (task 23397 ms: download 15504 ms overlapping gunzip 1537 ms, parse 6879 ms, sort 155 ms, write 13185 ms, index 841 ms: 6 candidates, 109197 repo-hours, 1182 releases; waiting 518 ms; commit 2541 ms)
2026-11-07T22:42:31Z [load_day 2023-07-05] 2023-07-05 hour 14: 199515 events in 4 files, snapshot 3538460209420755334 (task 20703 ms: download 12265 ms overlapping gunzip 1159 ms, parse 5160 ms, sort 143 ms, write 12810 ms, index 596 ms: 6 candidates, 92336 repo-hours, 1236 releases; waiting 529 ms; commit 2265 ms)
2026-11-07T22:42:34Z [load_day 2023-07-05] 2023-07-05 hour 15: 184359 events in 4 files, snapshot 1700630129533392467 (task 16946 ms: download 9697 ms overlapping gunzip 1079 ms, parse 4670 ms, sort 112 ms, write 9625 ms, index 638 ms: 7 candidates, 87696 repo-hours, 1219 releases; waiting 517 ms; commit 2065 ms)
2026-11-07T22:42:52Z [load_day 2023-07-05] 2023-07-05 hour 16: 186798 events in 4 files, snapshot 8973820486160942674 (task 20597 ms: download 12136 ms overlapping gunzip 1220 ms, parse 5312 ms, sort 163 ms, write 11993 ms, index 582 ms: 3 candidates, 83928 repo-hours, 990 releases; waiting 969 ms; commit 2358 ms)
2026-11-07T22:43:02Z [load_day 2023-07-05] 2023-07-05 hour 17: 187434 events in 4 files, snapshot 2544472558672979779 (task 19747 ms: download 12257 ms overlapping gunzip 998 ms, parse 4369 ms, sort 163 ms, write 12884 ms, index 536 ms: 4 candidates, 79500 repo-hours, 837 releases; waiting 526 ms; commit 9002 ms)
2026-11-07T22:43:12Z [load_day 2023-07-05] 2023-07-05 hour 18: 193323 events in 4 files, snapshot 293725775703889074 (task 16831 ms: download 9229 ms overlapping gunzip 882 ms, parse 4001 ms, sort 119 ms, write 10423 ms, index 590 ms: 5 candidates, 83523 repo-hours, 1048 releases; waiting 502 ms; commit 4018 ms)
2026-11-07T22:43:14Z [load_day 2023-07-05] 2023-07-05 hour 19: 180129 events in 4 files, snapshot 8905290618214426745 (task 16789 ms: download 9243 ms overlapping gunzip 991 ms, parse 4184 ms, sort 118 ms, write 9882 ms, index 796 ms: 7 candidates, 76073 repo-hours, 1057 releases; waiting 496 ms; commit 2034 ms)
2026-11-07T22:43:32Z [load_day 2023-07-05] 2023-07-05 hour 20: 184059 events in 4 files, snapshot 5821284007681917945 (task 20708 ms: download 11345 ms overlapping gunzip 1271 ms, parse 5379 ms, sort 161 ms, write 12372 ms, index 704 ms: 9 candidates, 79529 repo-hours, 1001 releases; waiting 498 ms; commit 2534 ms)
2026-11-07T22:43:37Z [load_day 2023-07-05] 2023-07-05 hour 21: 175663 events in 4 files, snapshot 5129192625302389224 (task 20611 ms: download 12862 ms overlapping gunzip 1451 ms, parse 5965 ms, sort 158 ms, write 11449 ms, index 655 ms: 7 candidates, 69112 repo-hours, 987 releases; waiting 598 ms; commit 4295 ms)
2026-11-07T22:43:49Z [load_day 2023-07-05] 2023-07-05 hour 22: 152954 events in 4 files, snapshot 2781724509220975465 (task 17407 ms: download 7740 ms overlapping gunzip 1236 ms, parse 5128 ms, sort 97 ms, write 9523 ms, index 542 ms: 9 candidates, 60631 repo-hours, 834 releases; waiting 530 ms; commit 1879 ms)
2026-11-07T22:43:52Z [load_day 2023-07-05] 2023-07-05 hour 23: 142218 events in 3 files, snapshot 1453168110202407862 (task 15306 ms: download 6813 ms overlapping gunzip 934 ms, parse 3849 ms, sort 90 ms, write 9266 ms, index 418 ms: 5 candidates, 59303 repo-hours, 644 releases; waiting 488 ms; commit 1881 ms)
2026-11-07T22:43:59Z [load_day 2023-07-05] 2023-07-05: repo_hour merged from 24 files to 1 (1860762 rows, 7618 ms)
2026-11-07T22:44:01Z [load_day 2023-07-05] 2023-07-05: index committed in 9605 ms (24 + 1 + 24 files)
2026-11-07T22:44:01Z [load_day 2023-07-05] 2023-07-05: 4044132 events in 24 hours
2026-11-07T22:44:01Z [load_day 2023-07-05] attempt 1 succeeded