orcaLog in

Runs · run 1155

load_day 2023-06-06, attempt 1 succeeded

Host
caf251265124:438574
Started
2026-11-07T21:10:11Z
Ended
2026-11-07T21:13:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1155/load_day/2023-06-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:10:11Z [load_day 2023-06-06] attempt 1 started
2026-11-07T21:10:13Z [load_day 2023-06-06] 2023-06-06: 2 hours in flight, about 1200 MB
2026-11-07T21:10:28Z [load_day 2023-06-06] 2023-06-06 hour 0: 141145 events in 3 files, snapshot 3213445036330874427 (task 11489 ms: download 5446 ms overlapping gunzip 745 ms, parse 3344 ms, sort 87 ms, write 6034 ms, index 490 ms: 8 candidates, 71089 repo-hours, 916 releases; waiting 502 ms; commit 2643 ms)
2026-11-07T21:10:30Z [load_day 2023-06-06] 2023-06-06 hour 1: 153176 events in 4 files, snapshot 1323388343807027544 (task 11160 ms: download 4498 ms overlapping gunzip 627 ms, parse 2951 ms, sort 88 ms, write 6059 ms, index 527 ms: 5 candidates, 85069 repo-hours, 955 releases; waiting 517 ms; commit 2078 ms)
2026-11-07T21:10:45Z [load_day 2023-06-06] 2023-06-06 hour 2: 165843 events in 4 files, snapshot 2155882462772378878 (task 15842 ms: download 10156 ms overlapping gunzip 1096 ms, parse 4466 ms, sort 101 ms, write 8825 ms, index 503 ms: 5 candidates, 82921 repo-hours, 759 releases; waiting 521 ms; commit 1785 ms)
2026-11-07T21:10:47Z [load_day 2023-06-06] 2023-06-06 hour 3: 138426 events in 3 files, snapshot 2008736295645041078 (task 11235 ms: download 4989 ms overlapping gunzip 697 ms, parse 3047 ms, sort 86 ms, write 6203 ms, index 387 ms: 6 candidates, 61337 repo-hours, 1047 releases; waiting 515 ms; commit 2496 ms)
2026-11-07T21:10:56Z [load_day 2023-06-06] 2023-06-06 hour 4: 127540 events in 3 files, snapshot 2534105989028335114 (task 10232 ms: download 4784 ms overlapping gunzip 650 ms, parse 2756 ms, sort 120 ms, write 5311 ms, index 359 ms: 3 candidates, 56262 repo-hours, 841 releases; waiting 743 ms; commit 1788 ms)
2026-11-07T21:10:59Z [load_day 2023-06-06] 2023-06-06 hour 5: 141252 events in 3 files, snapshot 2220539837571618481 (task 11128 ms: download 4524 ms overlapping gunzip 645 ms, parse 2931 ms, sort 87 ms, write 5945 ms, index 411 ms: 8 candidates, 66643 repo-hours, 906 releases; waiting 612 ms; commit 1737 ms)
2026-11-07T21:11:09Z [load_day 2023-06-06] 2023-06-06 hour 6: 160355 events in 4 files, snapshot 2113636881013102966 (task 12661 ms: download 5351 ms overlapping gunzip 744 ms, parse 3337 ms, sort 95 ms, write 6833 ms, index 495 ms: 8 candidates, 74465 repo-hours, 1001 releases; waiting 832 ms; commit 1897 ms)
2026-11-07T21:11:12Z [load_day 2023-06-06] 2023-06-06 hour 7: 146677 events in 3 files, snapshot 8125072776649002656 (task 12525 ms: download 5387 ms overlapping gunzip 736 ms, parse 3231 ms, sort 91 ms, write 6947 ms, index 465 ms: 8 candidates, 69957 repo-hours, 890 releases; waiting 713 ms; commit 1718 ms)
2026-11-07T21:11:25Z [load_day 2023-06-06] 2023-06-06 hour 8: 158389 events in 4 files, snapshot 1279835115948779276 (task 13707 ms: download 5848 ms overlapping gunzip 788 ms, parse 3516 ms, sort 102 ms, write 7524 ms, index 703 ms: 5 candidates, 75626 repo-hours, 1073 releases; waiting 801 ms; commit 3297 ms)
2026-11-07T21:11:28Z [load_day 2023-06-06] 2023-06-06 hour 9: 170096 events in 4 files, snapshot 1252482262609618055 (task 14359 ms: download 8487 ms overlapping gunzip 840 ms, parse 3744 ms, sort 100 ms, write 8246 ms, index 564 ms: 10 candidates, 79148 repo-hours, 1166 releases; waiting 548 ms; commit 1762 ms)
2026-11-07T21:11:39Z [load_day 2023-06-06] 2023-06-06 hour 10: 167971 events in 4 files, snapshot 5089888362121922275 (task 13353 ms: download 5624 ms overlapping gunzip 797 ms, parse 3565 ms, sort 107 ms, write 7405 ms, index 540 ms: 10 candidates, 79007 repo-hours, 1167 releases; waiting 603 ms; commit 1838 ms)
2026-11-07T21:11:42Z [load_day 2023-06-06] 2023-06-06 hour 11: 163493 events in 4 files, snapshot 7101370398533085116 (task 13735 ms: download 5632 ms overlapping gunzip 774 ms, parse 3536 ms, sort 109 ms, write 7957 ms, index 553 ms: 11 candidates, 73465 repo-hours, 1141 releases; waiting 531 ms; commit 1907 ms)
2026-11-07T21:11:54Z [load_day 2023-06-06] 2023-06-06 hour 12: 192335 events in 4 files, snapshot 5529834260726402808 (task 14762 ms: download 7906 ms overlapping gunzip 825 ms, parse 3792 ms, sort 122 ms, write 8565 ms, index 661 ms: 5 candidates, 101426 repo-hours, 1002 releases; waiting 430 ms; commit 1749 ms)
2026-11-07T21:11:58Z [load_day 2023-06-06] 2023-06-06 hour 13: 179800 events in 4 files, snapshot 937987638149885343 (task 15494 ms: download 8588 ms overlapping gunzip 870 ms, parse 3846 ms, sort 112 ms, write 8840 ms, index 628 ms: 10 candidates, 95681 repo-hours, 1060 releases; waiting 769 ms; commit 1797 ms)
2026-11-07T21:12:10Z [load_day 2023-06-06] 2023-06-06 hour 14: 180805 events in 4 files, snapshot 1367680265258758797 (task 15180 ms: download 8697 ms overlapping gunzip 902 ms, parse 4016 ms, sort 115 ms, write 8751 ms, index 593 ms: 7 candidates, 91723 repo-hours, 1062 releases; waiting 536 ms; commit 1934 ms)
2026-11-07T21:12:16Z [load_day 2023-06-06] 2023-06-06 hour 15: 169497 events in 4 files, snapshot 7732217578117532868 (task 15447 ms: download 9291 ms overlapping gunzip 863 ms, parse 3827 ms, sort 112 ms, write 8803 ms, index 569 ms: 10 candidates, 84103 repo-hours, 1278 releases; waiting 887 ms; commit 2561 ms)
2026-11-07T21:12:25Z [load_day 2023-06-06] 2023-06-06 hour 16: 161709 events in 4 files, snapshot 6340250421083053533 (task 14130 ms: download 6124 ms overlapping gunzip 840 ms, parse 3773 ms, sort 123 ms, write 7906 ms, index 532 ms: 16 candidates, 78755 repo-hours, 925 releases; waiting 597 ms; commit 1785 ms)
2026-11-07T21:12:29Z [load_day 2023-06-06] 2023-06-06 hour 17: 163388 events in 4 files, snapshot 3251482295797267557 (task 13579 ms: download 8018 ms overlapping gunzip 781 ms, parse 3494 ms, sort 105 ms, write 7872 ms, index 507 ms: 25 candidates, 76187 repo-hours, 839 releases; waiting 517 ms; commit 1807 ms)
2026-11-07T21:12:40Z [load_day 2023-06-06] 2023-06-06 hour 18: 171630 events in 4 files, snapshot 92039062162784559 (task 14179 ms: download 8323 ms overlapping gunzip 868 ms, parse 3842 ms, sort 110 ms, write 8137 ms, index 534 ms: 11 candidates, 81368 repo-hours, 955 releases; waiting 392 ms; commit 1700 ms)
2026-11-07T21:12:44Z [load_day 2023-06-06] 2023-06-06 hour 19: 163684 events in 4 files, snapshot 4654893332924534566 (task 13368 ms: download 5476 ms overlapping gunzip 804 ms, parse 3494 ms, sort 92 ms, write 7618 ms, index 509 ms: 17 candidates, 73079 repo-hours, 928 releases; waiting 521 ms; commit 1866 ms)
2026-11-07T21:12:55Z [load_day 2023-06-06] 2023-06-06 hour 20: 163663 events in 4 files, snapshot 3768323327923707988 (task 13927 ms: download 8385 ms overlapping gunzip 835 ms, parse 3748 ms, sort 122 ms, write 7866 ms, index 528 ms: 16 candidates, 74290 repo-hours, 928 releases; waiting 518 ms; commit 1844 ms)
2026-11-07T21:12:57Z [load_day 2023-06-06] 2023-06-06 hour 21: 154113 events in 4 files, snapshot 2767050693233676376 (task 12493 ms: download 5634 ms overlapping gunzip 731 ms, parse 3281 ms, sort 100 ms, write 7060 ms, index 459 ms: 14 candidates, 66009 repo-hours, 980 releases; waiting 514 ms; commit 1834 ms)
2026-11-07T21:13:07Z [load_day 2023-06-06] 2023-06-06 hour 22: 139009 events in 3 files, snapshot 1805909344656909529 (task 11460 ms: download 5192 ms overlapping gunzip 682 ms, parse 2977 ms, sort 104 ms, write 6318 ms, index 389 ms: 15 candidates, 58826 repo-hours, 756 releases; waiting 728 ms; commit 1817 ms)
2026-11-07T21:13:09Z [load_day 2023-06-06] 2023-06-06 hour 23: 127599 events in 3 files, snapshot 3078223330575036908 (task 10204 ms: download 4496 ms overlapping gunzip 612 ms, parse 2665 ms, sort 96 ms, write 5611 ms, index 357 ms: 10 candidates, 54935 repo-hours, 704 releases; waiting 520 ms; commit 1787 ms)
2026-11-07T21:13:17Z [load_day 2023-06-06] 2023-06-06: repo_hour merged from 24 files to 1 (1811371 rows, 7529 ms)
2026-11-07T21:13:19Z [load_day 2023-06-06] 2023-06-06: index committed in 9667 ms (24 + 1 + 24 files)
2026-11-07T21:13:19Z [load_day 2023-06-06] 2023-06-06: 3801595 events in 24 hours
2026-11-07T21:13:19Z [load_day 2023-06-06] attempt 1 succeeded