orcaLog in

Runs · run 951

load_day 2023-03-30, attempt 1 succeeded

Host
caf251265124:216280
Started
2026-11-07T17:53:33Z
Ended
2026-11-07T17:56:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/951/load_day/2023-03-30/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:53:33Z [load_day 2023-03-30] attempt 1 started
2026-11-07T17:53:34Z [load_day 2023-03-30] 2023-03-30: 2 hours in flight, about 1200 MB
2026-11-07T17:53:48Z [load_day 2023-03-30] 2023-03-30 hour 0: 152645 events in 4 files, snapshot 8054439575314587442 (task 11524 ms: download 4799 ms overlapping gunzip 657 ms, parse 3003 ms, sort 98 ms, write 6367 ms, index 541 ms: 8 candidates, 77798 repo-hours, 853 releases; waiting 521 ms; commit 1514 ms)
2026-11-07T17:53:50Z [load_day 2023-03-30] 2023-03-30 hour 1: 162159 events in 4 files, snapshot 8169235914387582662 (task 12964 ms: download 5857 ms overlapping gunzip 718 ms, parse 3173 ms, sort 103 ms, write 6708 ms, index 574 ms: 5 candidates, 87155 repo-hours, 829 releases; waiting 1327 ms; commit 1391 ms)
2026-11-07T17:54:01Z [load_day 2023-03-30] 2023-03-30 hour 2: 149811 events in 3 files, snapshot 7487631662799195248 (task 11410 ms: download 4835 ms overlapping gunzip 659 ms, parse 2827 ms, sort 90 ms, write 6442 ms, index 486 ms: 2 candidates, 70813 repo-hours, 697 releases; waiting 531 ms; commit 1784 ms)
2026-11-07T17:54:03Z [load_day 2023-03-30] 2023-03-30 hour 3: 140975 events in 3 files, snapshot 7869139910254492 (task 10849 ms: download 4389 ms overlapping gunzip 602 ms, parse 2620 ms, sort 84 ms, write 5816 ms, index 439 ms: 3 candidates, 62524 repo-hours, 847 releases; waiting 530 ms; commit 1786 ms)
2026-11-07T17:54:13Z [load_day 2023-03-30] 2023-03-30 hour 4: 130682 events in 3 files, snapshot 5595212477879560284 (task 11038 ms: download 5158 ms overlapping gunzip 580 ms, parse 2510 ms, sort 89 ms, write 6305 ms, index 386 ms: 2 candidates, 56815 repo-hours, 632 releases; waiting 774 ms; commit 1501 ms)
2026-11-07T17:54:14Z [load_day 2023-03-30] 2023-03-30 hour 5: 140913 events in 3 files, snapshot 7330878925039593833 (task 10898 ms: download 4414 ms overlapping gunzip 647 ms, parse 2739 ms, sort 86 ms, write 6061 ms, index 421 ms: 0 candidates, 64197 repo-hours, 760 releases; waiting 609 ms; commit 1469 ms)
2026-11-07T17:54:26Z [load_day 2023-03-30] 2023-03-30 hour 6: 153611 events in 4 files, snapshot 4225067493077903393 (task 12193 ms: download 4981 ms overlapping gunzip 730 ms, parse 3170 ms, sort 104 ms, write 7004 ms, index 501 ms: 6 candidates, 74744 repo-hours, 778 releases; waiting 407 ms; commit 1622 ms)
2026-11-07T17:54:27Z [load_day 2023-03-30] 2023-03-30 hour 7: 148317 events in 3 files, snapshot 8807374685142091357 (task 11947 ms: download 4777 ms overlapping gunzip 718 ms, parse 3182 ms, sort 101 ms, write 6915 ms, index 525 ms: 7 candidates, 72309 repo-hours, 763 releases; waiting 181 ms; commit 1460 ms)
2026-11-07T17:54:40Z [load_day 2023-03-30] 2023-03-30 hour 8: 157976 events in 4 files, snapshot 8865260994510159140 (task 13823 ms: download 5756 ms overlapping gunzip 795 ms, parse 3484 ms, sort 99 ms, write 8018 ms, index 520 ms: 7 candidates, 77768 repo-hours, 803 releases; waiting 580 ms; commit 1648 ms)
2026-11-07T17:54:44Z [load_day 2023-03-30] 2023-03-30 hour 9: 172683 events in 4 files, snapshot 7062114188254588876 (task 16208 ms: download 9800 ms overlapping gunzip 880 ms, parse 3910 ms, sort 104 ms, write 8517 ms, index 668 ms: 6 candidates, 81408 repo-hours, 1074 releases; waiting 1814 ms; commit 1554 ms)
2026-11-07T17:54:55Z [load_day 2023-03-30] 2023-03-30 hour 10: 171378 events in 4 files, snapshot 538910688529602359 (task 14512 ms: download 8421 ms overlapping gunzip 851 ms, parse 3717 ms, sort 122 ms, write 8437 ms, index 552 ms: 4 candidates, 79585 repo-hours, 946 releases; waiting 465 ms; commit 1587 ms)
2026-11-07T17:54:59Z [load_day 2023-03-30] 2023-03-30 hour 11: 171346 events in 4 files, snapshot 7118763144552995014 (task 14288 ms: download 8359 ms overlapping gunzip 843 ms, parse 3694 ms, sort 114 ms, write 8404 ms, index 572 ms: 4 candidates, 78156 repo-hours, 863 releases; waiting 361 ms; commit 1547 ms)
2026-11-07T17:55:11Z [load_day 2023-03-30] 2023-03-30 hour 12: 188857 events in 4 files, snapshot 4992740283781869490 (task 15110 ms: download 8333 ms overlapping gunzip 892 ms, parse 4100 ms, sort 137 ms, write 8790 ms, index 690 ms: 10 candidates, 100964 repo-hours, 1015 releases; waiting 181 ms; commit 1576 ms)
2026-11-07T17:55:16Z [load_day 2023-03-30] 2023-03-30 hour 13: 186777 events in 4 files, snapshot 6875095039020487104 (task 15701 ms: download 8660 ms overlapping gunzip 884 ms, parse 3887 ms, sort 120 ms, write 9249 ms, index 672 ms: 6 candidates, 99860 repo-hours, 1007 releases; waiting 585 ms; commit 1640 ms)
2026-11-07T17:55:29Z [load_day 2023-03-30] 2023-03-30 hour 14: 185559 events in 4 files, snapshot 6787384264177989119 (task 16309 ms: download 9547 ms overlapping gunzip 968 ms, parse 4174 ms, sort 125 ms, write 9500 ms, index 647 ms: 6 candidates, 91370 repo-hours, 977 releases; waiting 578 ms; commit 1717 ms)
2026-11-07T17:55:31Z [load_day 2023-03-30] 2023-03-30 hour 15: 168576 events in 4 files, snapshot 6160001804199271776 (task 14588 ms: download 8404 ms overlapping gunzip 855 ms, parse 3759 ms, sort 110 ms, write 8478 ms, index 583 ms: 6 candidates, 84891 repo-hours, 1061 releases; waiting 517 ms; commit 1590 ms)
2026-11-07T17:55:47Z [load_day 2023-03-30] 2023-03-30 hour 16: 176203 events in 4 files, snapshot 7640745166146368569 (task 14466 ms: download 8426 ms overlapping gunzip 847 ms, parse 3659 ms, sort 105 ms, write 8457 ms, index 576 ms: 10 candidates, 88650 repo-hours, 845 releases; waiting 511 ms; commit 4759 ms)
2026-11-07T17:55:48Z [load_day 2023-03-30] 2023-03-30 hour 17: 176026 events in 4 files, snapshot 1995864633516718035 (task 14844 ms: download 8377 ms overlapping gunzip 891 ms, parse 3855 ms, sort 115 ms, write 8545 ms, index 609 ms: 7 candidates, 82635 repo-hours, 916 releases; waiting 500 ms; commit 1647 ms)
2026-11-07T17:55:59Z [load_day 2023-03-30] 2023-03-30 hour 18: 178677 events in 4 files, snapshot 9075526324804814397 (task 15213 ms: download 8703 ms overlapping gunzip 860 ms, parse 3781 ms, sort 113 ms, write 8692 ms, index 579 ms: 11 candidates, 85053 repo-hours, 1068 releases; waiting 822 ms; commit 1531 ms)
2026-11-07T17:56:04Z [load_day 2023-03-30] 2023-03-30 hour 19: 167200 events in 4 files, snapshot 1841501622615600826 (task 14430 ms: download 8668 ms overlapping gunzip 823 ms, parse 3725 ms, sort 117 ms, write 8170 ms, index 513 ms: 8 candidates, 75141 repo-hours, 868 releases; waiting 753 ms; commit 1602 ms)
2026-11-07T17:56:15Z [load_day 2023-03-30] 2023-03-30 hour 20: 172343 events in 4 files, snapshot 716056808546075319 (task 14279 ms: download 8332 ms overlapping gunzip 844 ms, parse 3629 ms, sort 115 ms, write 8195 ms, index 533 ms: 5 candidates, 78674 repo-hours, 912 releases; waiting 669 ms; commit 1573 ms)
2026-11-07T17:56:18Z [load_day 2023-03-30] 2023-03-30 hour 21: 165424 events in 4 files, snapshot 625124808394880311 (task 13947 ms: download 8303 ms overlapping gunzip 842 ms, parse 3630 ms, sort 102 ms, write 8027 ms, index 557 ms: 5 candidates, 70610 repo-hours, 943 releases; waiting 502 ms; commit 1473 ms)
2026-11-07T17:56:28Z [load_day 2023-03-30] 2023-03-30 hour 22: 153941 events in 4 files, snapshot 8703974268146832755 (task 12401 ms: download 5115 ms overlapping gunzip 762 ms, parse 3302 ms, sort 108 ms, write 7192 ms, index 429 ms: 8 candidates, 64654 repo-hours, 820 releases; waiting 242 ms; commit 1652 ms)
2026-11-07T17:56:31Z [load_day 2023-03-30] 2023-03-30 hour 23: 139657 events in 3 files, snapshot 7815861885495241442 (task 11405 ms: download 5197 ms overlapping gunzip 656 ms, parse 2852 ms, sort 94 ms, write 6302 ms, index 398 ms: 3 candidates, 58638 repo-hours, 627 releases; waiting 805 ms; commit 1852 ms)
2026-11-07T17:56:39Z [load_day 2023-03-30] 2023-03-30: repo_hour merged from 24 files to 1 (1864412 rows, 7826 ms)
2026-11-07T17:56:40Z [load_day 2023-03-30] 2023-03-30: index committed in 9616 ms (23 + 1 + 24 files)
2026-11-07T17:56:40Z [load_day 2023-03-30] 2023-03-30: 3911736 events in 24 hours
2026-11-07T17:56:40Z [load_day 2023-03-30] attempt 1 succeeded