orcaLog in

Runs · run 948

load_day 2023-03-29, attempt 1 succeeded

Host
caf251265124:212422
Started
2026-11-07T17:50:11Z
Ended
2026-11-07T17:53:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/948/load_day/2023-03-29/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:50:11Z [load_day 2023-03-29] attempt 1 started
2026-11-07T17:50:13Z [load_day 2023-03-29] 2023-03-29: 2 hours in flight, about 1200 MB
2026-11-07T17:50:28Z [load_day 2023-03-29] 2023-03-29 hour 0: 149999 events in 3 files, snapshot 1220246034231539330 (task 12389 ms: download 5566 ms overlapping gunzip 697 ms, parse 3074 ms, sort 107 ms, write 6954 ms, index 541 ms: 11 candidates, 74102 repo-hours, 826 releases; waiting 645 ms; commit 1596 ms)
2026-11-07T17:50:30Z [load_day 2023-03-29] 2023-03-29 hour 1: 169745 events in 4 files, snapshot 5091483968066081103 (task 13476 ms: download 8082 ms overlapping gunzip 854 ms, parse 3525 ms, sort 126 ms, write 7504 ms, index 592 ms: 8 candidates, 84317 repo-hours, 843 releases; waiting 530 ms; commit 1757 ms)
2026-11-07T17:50:41Z [load_day 2023-03-29] 2023-03-29 hour 2: 152971 events in 4 files, snapshot 665728821256025243 (task 11973 ms: download 5735 ms overlapping gunzip 721 ms, parse 3045 ms, sort 109 ms, write 6669 ms, index 492 ms: 5 candidates, 75289 repo-hours, 662 releases; waiting 631 ms; commit 1580 ms)
2026-11-07T17:50:42Z [load_day 2023-03-29] 2023-03-29 hour 3: 143703 events in 3 files, snapshot 8777590763780076015 (task 10464 ms: download 4317 ms overlapping gunzip 657 ms, parse 2737 ms, sort 90 ms, write 5976 ms, index 453 ms: 5 candidates, 66052 repo-hours, 860 releases; waiting 201 ms; commit 1606 ms)
2026-11-07T17:50:52Z [load_day 2023-03-29] 2023-03-29 hour 4: 136464 events in 3 files, snapshot 444413467293038257 (task 10908 ms: download 4673 ms overlapping gunzip 643 ms, parse 2774 ms, sort 91 ms, write 6066 ms, index 391 ms: 3 candidates, 59393 repo-hours, 649 releases; waiting 526 ms; commit 1636 ms)
2026-11-07T17:50:56Z [load_day 2023-03-29] 2023-03-29 hour 5: 150566 events in 4 files, snapshot 420845155505784146 (task 12410 ms: download 5004 ms overlapping gunzip 724 ms, parse 3160 ms, sort 106 ms, write 7044 ms, index 496 ms: 2 candidates, 66017 repo-hours, 835 releases; waiting 494 ms; commit 1699 ms)
2026-11-07T17:51:07Z [load_day 2023-03-29] 2023-03-29 hour 6: 175412 events in 4 files, snapshot 4564066136229351345 (task 14039 ms: download 7811 ms overlapping gunzip 803 ms, parse 3511 ms, sort 108 ms, write 8089 ms, index 583 ms: 8 candidates, 81366 repo-hours, 1020 releases; waiting 523 ms; commit 1682 ms)
2026-11-07T17:51:11Z [load_day 2023-03-29] 2023-03-29 hour 7: 164852 events in 4 files, snapshot 4764447967767931274 (task 14393 ms: download 8313 ms overlapping gunzip 872 ms, parse 3770 ms, sort 127 ms, write 8161 ms, index 587 ms: 4 candidates, 77821 repo-hours, 940 releases; waiting 515 ms; commit 1622 ms)
2026-11-07T17:51:23Z [load_day 2023-03-29] 2023-03-29 hour 8: 169678 events in 4 files, snapshot 2201835481719050433 (task 14851 ms: download 8756 ms overlapping gunzip 849 ms, parse 3703 ms, sort 117 ms, write 8603 ms, index 612 ms: 13 candidates, 82487 repo-hours, 924 releases; waiting 676 ms; commit 1574 ms)
2026-11-07T17:51:27Z [load_day 2023-03-29] 2023-03-29 hour 9: 173564 events in 4 files, snapshot 7872794307257669685 (task 14611 ms: download 8455 ms overlapping gunzip 884 ms, parse 3862 ms, sort 110 ms, write 8616 ms, index 569 ms: 10 candidates, 84301 repo-hours, 1058 releases; waiting 265 ms; commit 1730 ms)
2026-11-07T17:51:38Z [load_day 2023-03-29] 2023-03-29 hour 10: 170624 events in 4 files, snapshot 9062768980485889491 (task 14451 ms: download 8427 ms overlapping gunzip 846 ms, parse 3684 ms, sort 103 ms, write 8196 ms, index 627 ms: 11 candidates, 80272 repo-hours, 1200 releases; waiting 609 ms; commit 1602 ms)
2026-11-07T17:51:42Z [load_day 2023-03-29] 2023-03-29 hour 11: 173035 events in 4 files, snapshot 3285507655307644832 (task 14684 ms: download 8428 ms overlapping gunzip 897 ms, parse 3943 ms, sort 119 ms, write 8361 ms, index 574 ms: 7 candidates, 79609 repo-hours, 1420 releases; waiting 505 ms; commit 1669 ms)
2026-11-07T17:51:54Z [load_day 2023-03-29] 2023-03-29 hour 12: 190267 events in 4 files, snapshot 6700562665610088883 (task 15258 ms: download 8289 ms overlapping gunzip 866 ms, parse 3862 ms, sort 120 ms, write 8865 ms, index 669 ms: 9 candidates, 103341 repo-hours, 978 releases; waiting 527 ms; commit 1500 ms)
2026-11-07T17:52:00Z [load_day 2023-03-29] 2023-03-29 hour 13: 204645 events in 5 files, snapshot 8343628415771194558 (task 17312 ms: download 9152 ms overlapping gunzip 984 ms, parse 4362 ms, sort 131 ms, write 10190 ms, index 728 ms: 11 candidates, 104323 repo-hours, 1066 releases; waiting 562 ms; commit 1458 ms)
2026-11-07T17:52:17Z [load_day 2023-03-29] 2023-03-29 hour 14: 220658 events in 5 files, snapshot 83934298877664790 (task 21807 ms: download 15442 ms overlapping gunzip 1247 ms, parse 5410 ms, sort 141 ms, write 11446 ms, index 754 ms: 10 candidates, 104749 repo-hours, 1062 releases; waiting 2480 ms; commit 1518 ms)
2026-11-07T17:52:19Z [load_day 2023-03-29] 2023-03-29 hour 15: 211177 events in 5 files, snapshot 6949902660311095941 (task 18328 ms: download 12485 ms overlapping gunzip 1081 ms, parse 4752 ms, sort 135 ms, write 10648 ms, index 785 ms: 5 candidates, 99604 repo-hours, 1161 releases; waiting 601 ms; commit 1497 ms)
2026-11-07T17:52:33Z [load_day 2023-03-29] 2023-03-29 hour 16: 175743 events in 4 files, snapshot 896343716014696244 (task 15340 ms: download 9007 ms overlapping gunzip 901 ms, parse 4002 ms, sort 116 ms, write 8897 ms, index 578 ms: 8 candidates, 83424 repo-hours, 794 releases; waiting 556 ms; commit 1671 ms)
2026-11-07T17:52:36Z [load_day 2023-03-29] 2023-03-29 hour 17: 177353 events in 4 files, snapshot 1891528603260346549 (task 15090 ms: download 8484 ms overlapping gunzip 891 ms, parse 3898 ms, sort 127 ms, write 8749 ms, index 645 ms: 7 candidates, 85734 repo-hours, 1051 releases; waiting 472 ms; commit 1785 ms)
2026-11-07T17:52:49Z [load_day 2023-03-29] 2023-03-29 hour 18: 175759 events in 4 files, snapshot 5905338368585839081 (task 15286 ms: download 8752 ms overlapping gunzip 883 ms, parse 3929 ms, sort 132 ms, write 8862 ms, index 617 ms: 10 candidates, 86587 repo-hours, 859 releases; waiting 508 ms; commit 1573 ms)
2026-11-07T17:52:51Z [load_day 2023-03-29] 2023-03-29 hour 19: 169450 events in 4 files, snapshot 4797694740390888485 (task 13885 ms: download 7906 ms overlapping gunzip 825 ms, parse 3673 ms, sort 119 ms, write 8250 ms, index 531 ms: 10 candidates, 77742 repo-hours, 910 releases; waiting 191 ms; commit 1648 ms)
2026-11-07T17:53:04Z [load_day 2023-03-29] 2023-03-29 hour 20: 159274 events in 4 files, snapshot 3816009097169628053 (task 13969 ms: download 5922 ms overlapping gunzip 811 ms, parse 3545 ms, sort 105 ms, write 8057 ms, index 531 ms: 5 candidates, 72697 repo-hours, 941 releases; waiting 548 ms; commit 1726 ms)
2026-11-07T17:53:06Z [load_day 2023-03-29] 2023-03-29 hour 21: 154450 events in 4 files, snapshot 9198990484532004354 (task 13194 ms: download 5601 ms overlapping gunzip 782 ms, parse 3361 ms, sort 114 ms, write 7626 ms, index 501 ms: 6 candidates, 66979 repo-hours, 1000 releases; waiting 499 ms; commit 1550 ms)
2026-11-07T17:53:21Z [load_day 2023-03-29] 2023-03-29 hour 22: 148226 events in 3 files, snapshot 4533417098006801034 (task 15799 ms: download 8524 ms overlapping gunzip 854 ms, parse 3712 ms, sort 101 ms, write 7350 ms, index 436 ms: 10 candidates, 61509 repo-hours, 791 releases; waiting 3045 ms; commit 1618 ms)
2026-11-07T17:53:22Z [load_day 2023-03-29] 2023-03-29 hour 23: 135251 events in 3 files, snapshot 3128047661623994260 (task 11610 ms: download 5264 ms overlapping gunzip 702 ms, parse 2996 ms, sort 132 ms, write 6571 ms, index 388 ms: 5 candidates, 58507 repo-hours, 660 releases; waiting 529 ms; commit 1525 ms)
2026-11-07T17:53:30Z [load_day 2023-03-29] 2023-03-29: repo_hour merged from 24 files to 1 (1916222 rows, 7908 ms)
2026-11-07T17:53:32Z [load_day 2023-03-29] 2023-03-29: index committed in 9675 ms (24 + 1 + 24 files)
2026-11-07T17:53:32Z [load_day 2023-03-29] 2023-03-29: 4052866 events in 24 hours
2026-11-07T17:53:32Z [load_day 2023-03-29] attempt 1 succeeded