orcaLog in

Runs · run 1041

load_day 2023-04-29, attempt 1 succeeded

Host
caf251265124:318523
Started
2026-11-07T19:23:35Z
Ended
2026-11-07T19:25:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1041/load_day/2023-04-29/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:23:35Z [load_day 2023-04-29] attempt 1 started
2026-11-07T19:23:36Z [load_day 2023-04-29] 2023-04-29: 2 hours in flight, about 1200 MB
2026-11-07T19:23:49Z [load_day 2023-04-29] 2023-04-29 hour 0: 129799 events in 3 files, snapshot 2642578370058061063 (task 9446 ms: download 2353 ms overlapping gunzip 572 ms, parse 2645 ms, sort 75 ms, write 4780 ms, index 439 ms: 3 candidates, 66780 repo-hours, 833 releases; waiting 610 ms; commit 1613 ms)
2026-11-07T19:23:50Z [load_day 2023-04-29] 2023-04-29 hour 1: 138784 events in 3 files, snapshot 7236510078976099273 (task 9340 ms: download 3807 ms overlapping gunzip 522 ms, parse 2424 ms, sort 93 ms, write 4969 ms, index 441 ms: 3 candidates, 69540 repo-hours, 680 releases; waiting 516 ms; commit 1611 ms)
2026-11-07T19:23:57Z [load_day 2023-04-29] 2023-04-29 hour 2: 103716 events in 3 files, snapshot 4149299015492999289 (task 7237 ms: download 1947 ms overlapping gunzip 451 ms, parse 1932 ms, sort 54 ms, write 3695 ms, index 295 ms: 3 candidates, 43569 repo-hours, 549 releases; waiting 532 ms; commit 1641 ms)
2026-11-07T19:23:58Z [load_day 2023-04-29] 2023-04-29 hour 3: 100008 events in 3 files, snapshot 5490329543580926529 (task 7066 ms: download 2089 ms overlapping gunzip 386 ms, parse 1730 ms, sort 63 ms, write 3519 ms, index 294 ms: 1 candidates, 40712 repo-hours, 747 releases; waiting 718 ms; commit 1687 ms)
2026-11-07T19:24:04Z [load_day 2023-04-29] 2023-04-29 hour 4: 98221 events in 2 files, snapshot 3787641373413123434 (task 6974 ms: download 1880 ms overlapping gunzip 389 ms, parse 1708 ms, sort 68 ms, write 3636 ms, index 286 ms: 2 candidates, 40604 repo-hours, 453 releases; waiting 619 ms; commit 1680 ms)
2026-11-07T19:24:06Z [load_day 2023-04-29] 2023-04-29 hour 5: 104109 events in 3 files, snapshot 3984359973208669132 (task 6942 ms: download 2078 ms overlapping gunzip 377 ms, parse 1702 ms, sort 51 ms, write 3670 ms, index 282 ms: 2 candidates, 45092 repo-hours, 549 releases; waiting 521 ms; commit 1660 ms)
2026-11-07T19:24:13Z [load_day 2023-04-29] 2023-04-29 hour 6: 114448 events in 3 files, snapshot 1146413845836216202 (task 7519 ms: download 1954 ms overlapping gunzip 428 ms, parse 1910 ms, sort 66 ms, write 3885 ms, index 323 ms: 1 candidates, 51472 repo-hours, 665 releases; waiting 519 ms; commit 1632 ms)
2026-11-07T19:24:15Z [load_day 2023-04-29] 2023-04-29 hour 7: 112798 events in 3 files, snapshot 659652579911933346 (task 7627 ms: download 2266 ms overlapping gunzip 436 ms, parse 1969 ms, sort 60 ms, write 3864 ms, index 339 ms: 2 candidates, 47379 repo-hours, 485 releases; waiting 650 ms; commit 1635 ms)
2026-11-07T19:24:22Z [load_day 2023-04-29] 2023-04-29 hour 8: 120063 events in 3 files, snapshot 7119439250573243187 (task 8220 ms: download 2604 ms overlapping gunzip 449 ms, parse 1963 ms, sort 73 ms, write 4254 ms, index 353 ms: 1 candidates, 52050 repo-hours, 523 releases; waiting 733 ms; commit 1647 ms)
2026-11-07T19:24:24Z [load_day 2023-04-29] 2023-04-29 hour 9: 121723 events in 3 files, snapshot 2740705345486125745 (task 8219 ms: download 1810 ms overlapping gunzip 479 ms, parse 2117 ms, sort 91 ms, write 4501 ms, index 343 ms: 3 candidates, 51703 repo-hours, 685 releases; waiting 271 ms; commit 1619 ms)
2026-11-07T19:24:31Z [load_day 2023-04-29] 2023-04-29 hour 10: 123981 events in 3 files, snapshot 5427668965966887876 (task 8397 ms: download 2272 ms overlapping gunzip 485 ms, parse 2125 ms, sort 69 ms, write 4323 ms, index 351 ms: 2 candidates, 53327 repo-hours, 636 releases; waiting 650 ms; commit 1558 ms)
2026-11-07T19:24:33Z [load_day 2023-04-29] 2023-04-29 hour 11: 121322 events in 3 files, snapshot 1068638226713908366 (task 8053 ms: download 2295 ms overlapping gunzip 450 ms, parse 2038 ms, sort 74 ms, write 4319 ms, index 350 ms: 1 candidates, 50018 repo-hours, 643 releases; waiting 526 ms; commit 1644 ms)
2026-11-07T19:24:42Z [load_day 2023-04-29] 2023-04-29 hour 12: 191677 events in 4 files, snapshot 6871606985077969736 (task 10090 ms: download 3399 ms overlapping gunzip 534 ms, parse 2536 ms, sort 103 ms, write 5583 ms, index 586 ms: 15 candidates, 82435 repo-hours, 779 releases; waiting 528 ms; commit 1692 ms)
2026-11-07T19:24:44Z [load_day 2023-04-29] 2023-04-29 hour 13: 147547 events in 3 files, snapshot 8788465604473809819 (task 9111 ms: download 3057 ms overlapping gunzip 481 ms, parse 2214 ms, sort 86 ms, write 5175 ms, index 473 ms: 6 candidates, 74523 repo-hours, 692 releases; waiting 387 ms; commit 1826 ms)
2026-11-07T19:24:52Z [load_day 2023-04-29] 2023-04-29 hour 14: 140708 events in 3 files, snapshot 7471188609968092304 (task 9246 ms: download 3424 ms overlapping gunzip 567 ms, parse 2427 ms, sort 98 ms, write 5139 ms, index 435 ms: 7 candidates, 61822 repo-hours, 709 releases; waiting 209 ms; commit 1628 ms)
2026-11-07T19:24:54Z [load_day 2023-04-29] 2023-04-29 hour 15: 143746 events in 3 files, snapshot 7775775255404674073 (task 9150 ms: download 3345 ms overlapping gunzip 530 ms, parse 2402 ms, sort 93 ms, write 5073 ms, index 418 ms: 7 candidates, 64277 repo-hours, 863 releases; waiting 356 ms; commit 1642 ms)
2026-11-07T19:25:02Z [load_day 2023-04-29] 2023-04-29 hour 16: 139457 events in 3 files, snapshot 2651489438507551580 (task 9093 ms: download 3705 ms overlapping gunzip 511 ms, parse 2232 ms, sort 79 ms, write 4958 ms, index 417 ms: 6 candidates, 62749 repo-hours, 685 releases; waiting 663 ms; commit 1609 ms)
2026-11-07T19:25:04Z [load_day 2023-04-29] 2023-04-29 hour 17: 136662 events in 3 files, snapshot 4496344136701215963 (task 8613 ms: download 2055 ms overlapping gunzip 492 ms, parse 2221 ms, sort 101 ms, write 4601 ms, index 395 ms: 6 candidates, 57458 repo-hours, 675 releases; waiting 502 ms; commit 2305 ms)
2026-11-07T19:25:11Z [load_day 2023-04-29] 2023-04-29 hour 18: 135932 events in 3 files, snapshot 848681474310195173 (task 8441 ms: download 3026 ms overlapping gunzip 479 ms, parse 2157 ms, sort 72 ms, write 4756 ms, index 389 ms: 5 candidates, 61442 repo-hours, 784 releases; waiting 283 ms; commit 1689 ms)
2026-11-07T19:25:15Z [load_day 2023-04-29] 2023-04-29 hour 19: 121019 events in 3 files, snapshot 8545865882939110895 (task 9936 ms: download 3510 ms overlapping gunzip 502 ms, parse 2143 ms, sort 74 ms, write 4232 ms, index 397 ms: 3 candidates, 50885 repo-hours, 740 releases; waiting 2304 ms; commit 1583 ms)
2026-11-07T19:25:20Z [load_day 2023-04-29] 2023-04-29 hour 20: 122771 events in 3 files, snapshot 4638026568096982314 (task 7834 ms: download 2315 ms overlapping gunzip 432 ms, parse 1948 ms, sort 73 ms, write 4141 ms, index 387 ms: 3 candidates, 52800 repo-hours, 649 releases; waiting 508 ms; commit 1660 ms)
2026-11-07T19:25:24Z [load_day 2023-04-29] 2023-04-29 hour 21: 112689 events in 3 files, snapshot 8661349730820470592 (task 7604 ms: download 2582 ms overlapping gunzip 406 ms, parse 1843 ms, sort 75 ms, write 3864 ms, index 307 ms: 4 candidates, 46299 repo-hours, 690 releases; waiting 799 ms; commit 1743 ms)
2026-11-07T19:25:28Z [load_day 2023-04-29] 2023-04-29 hour 22: 100977 events in 3 files, snapshot 9112368426644330277 (task 7011 ms: download 2383 ms overlapping gunzip 367 ms, parse 1619 ms, sort 69 ms, write 3526 ms, index 286 ms: 19 candidates, 41216 repo-hours, 624 releases; waiting 764 ms; commit 1750 ms)
2026-11-07T19:25:31Z [load_day 2023-04-29] 2023-04-29 hour 23: 95635 events in 2 files, snapshot 1389281129164802760 (task 6791 ms: download 2229 ms overlapping gunzip 381 ms, parse 1685 ms, sort 64 ms, write 3514 ms, index 272 ms: 6 candidates, 40465 repo-hours, 581 releases; waiting 515 ms; commit 1742 ms)
2026-11-07T19:25:37Z [load_day 2023-04-29] 2023-04-29: repo_hour merged from 24 files to 1 (1308617 rows, 5743 ms)
2026-11-07T19:25:39Z [load_day 2023-04-29] 2023-04-29: index committed in 7776 ms (24 + 1 + 24 files)
2026-11-07T19:25:39Z [load_day 2023-04-29] 2023-04-29: 2977792 events in 24 hours
2026-11-07T19:25:39Z [load_day 2023-04-29] attempt 1 succeeded