orcaLog in

Runs · run 1206

load_day 2023-06-23, attempt 1 succeeded

Host
3c2b29713ce8:25983
Started
2026-11-07T21:53:46Z
Ended
2026-11-07T21:58:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1206/load_day/2023-06-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:53:46Z [load_day 2023-06-23] attempt 1 started
2026-11-07T21:53:48Z [load_day 2023-06-23] 2023-06-23: 1 hours in flight, about 750 MB
2026-11-07T21:54:00Z [load_day 2023-06-23] 2023-06-23 hour 0: 135912 events in 3 files, snapshot 6215695692017900522 (task 9085 ms: download 3917 ms overlapping gunzip 598 ms, parse 2762 ms, sort 83 ms, write 4458 ms, index 393 ms: 5 candidates, 65243 repo-hours, 817 releases; waiting 505 ms; commit 1697 ms)
2026-11-07T21:54:10Z [load_day 2023-06-23] 2023-06-23 hour 1: 147972 events in 3 files, snapshot 2269170307647767454 (task 8742 ms: download 3623 ms overlapping gunzip 566 ms, parse 2533 ms, sort 92 ms, write 4286 ms, index 471 ms: 3 candidates, 78475 repo-hours, 868 releases; waiting 505 ms; commit 1710 ms)
2026-11-07T21:54:18Z [load_day 2023-06-23] 2023-06-23 hour 2: 123049 events in 3 files, snapshot 7555766180925515422 (task 7771 ms: download 2301 ms overlapping gunzip 502 ms, parse 2204 ms, sort 68 ms, write 3825 ms, index 354 ms: 3 candidates, 58924 repo-hours, 680 releases; waiting 508 ms; commit 1733 ms)
2026-11-07T21:54:26Z [load_day 2023-06-23] 2023-06-23 hour 3: 116202 events in 3 files, snapshot 3149243656014746722 (task 7305 ms: download 1876 ms overlapping gunzip 463 ms, parse 2051 ms, sort 62 ms, write 3573 ms, index 339 ms: 2 candidates, 49932 repo-hours, 796 releases; waiting 499 ms; commit 1662 ms)
2026-11-07T21:54:35Z [load_day 2023-06-23] 2023-06-23 hour 4: 118298 events in 3 files, snapshot 4915483618140564652 (task 7421 ms: download 2072 ms overlapping gunzip 497 ms, parse 2211 ms, sort 72 ms, write 3658 ms, index 357 ms: 2 candidates, 49520 repo-hours, 617 releases; waiting 286 ms; commit 1823 ms)
2026-11-07T21:54:44Z [load_day 2023-06-23] 2023-06-23 hour 5: 131761 events in 3 files, snapshot 7588848198405291901 (task 8726 ms: download 3790 ms overlapping gunzip 621 ms, parse 2629 ms, sort 92 ms, write 4227 ms, index 349 ms: 3 candidates, 55074 repo-hours, 748 releases; waiting 529 ms; commit 1617 ms)
2026-11-07T21:54:54Z [load_day 2023-06-23] 2023-06-23 hour 6: 152530 events in 4 files, snapshot 739059872035059910 (task 9323 ms: download 3820 ms overlapping gunzip 620 ms, parse 2763 ms, sort 81 ms, write 4683 ms, index 421 ms: 5 candidates, 68573 repo-hours, 793 releases; waiting 455 ms; commit 1693 ms)
2026-11-07T21:55:06Z [load_day 2023-06-23] 2023-06-23 hour 7: 158875 events in 4 files, snapshot 985261140699029635 (task 11602 ms: download 4832 ms overlapping gunzip 790 ms, parse 3387 ms, sort 107 ms, write 6010 ms, index 513 ms: 8 candidates, 69871 repo-hours, 853 releases; waiting 506 ms; commit 1615 ms)
2026-11-07T21:55:19Z [load_day 2023-06-23] 2023-06-23 hour 8: 173649 events in 4 files, snapshot 4571028145303135099 (task 12098 ms: download 6916 ms overlapping gunzip 826 ms, parse 3602 ms, sort 96 ms, write 6211 ms, index 519 ms: 6 candidates, 75602 repo-hours, 1033 releases; waiting 530 ms; commit 1883 ms)
2026-11-07T21:55:32Z [load_day 2023-06-23] 2023-06-23 hour 9: 175709 events in 4 files, snapshot 1194609179745763557 (task 11902 ms: download 6669 ms overlapping gunzip 804 ms, parse 3682 ms, sort 112 ms, write 6369 ms, index 506 ms: 4 candidates, 76311 repo-hours, 1072 releases; waiting 183 ms; commit 1734 ms)
2026-11-07T21:55:45Z [load_day 2023-06-23] 2023-06-23 hour 10: 169661 events in 4 files, snapshot 6189618731115350022 (task 11938 ms: download 7055 ms overlapping gunzip 829 ms, parse 3666 ms, sort 99 ms, write 6030 ms, index 468 ms: 5 candidates, 74192 repo-hours, 845 releases; waiting 516 ms; commit 1738 ms)
2026-11-07T21:55:57Z [load_day 2023-06-23] 2023-06-23 hour 11: 168945 events in 4 files, snapshot 6577404641630287267 (task 11397 ms: download 6587 ms overlapping gunzip 766 ms, parse 3388 ms, sort 105 ms, write 5845 ms, index 482 ms: 10 candidates, 73308 repo-hours, 1032 releases; waiting 524 ms; commit 1726 ms)
2026-11-07T21:56:12Z [load_day 2023-06-23] 2023-06-23 hour 12: 211142 events in 5 files, snapshot 4375896658231635055 (task 14151 ms: download 7727 ms overlapping gunzip 885 ms, parse 3980 ms, sort 129 ms, write 7113 ms, index 645 ms: 6 candidates, 106264 repo-hours, 1018 releases; waiting 1042 ms; commit 1593 ms)
2026-11-07T21:56:27Z [load_day 2023-06-23] 2023-06-23 hour 13: 202261 events in 5 files, snapshot 3642815156707560976 (task 14269 ms: download 7709 ms overlapping gunzip 931 ms, parse 4106 ms, sort 134 ms, write 7484 ms, index 648 ms: 4 candidates, 102520 repo-hours, 1074 releases; waiting 605 ms; commit 1911 ms)
2026-11-07T21:56:42Z [load_day 2023-06-23] 2023-06-23 hour 14: 193967 events in 4 files, snapshot 3802773835270617138 (task 13772 ms: download 7756 ms overlapping gunzip 950 ms, parse 4191 ms, sort 132 ms, write 7261 ms, index 578 ms: 4 candidates, 87611 repo-hours, 1292 releases; waiting 386 ms; commit 1874 ms)
2026-11-07T21:56:56Z [load_day 2023-06-23] 2023-06-23 hour 15: 181787 events in 4 files, snapshot 7889207803340784598 (task 13498 ms: download 7765 ms overlapping gunzip 918 ms, parse 4038 ms, sort 117 ms, write 7087 ms, index 534 ms: 7 candidates, 82633 repo-hours, 1145 releases; waiting 498 ms; commit 1813 ms)
2026-11-07T21:57:09Z [load_day 2023-06-23] 2023-06-23 hour 16: 168433 events in 4 files, snapshot 7508524384443688259 (task 12198 ms: download 7136 ms overlapping gunzip 803 ms, parse 3521 ms, sort 97 ms, write 6437 ms, index 515 ms: 8 candidates, 76911 repo-hours, 1112 releases; waiting 532 ms; commit 1708 ms)
2026-11-07T21:57:21Z [load_day 2023-06-23] 2023-06-23 hour 17: 162345 events in 4 files, snapshot 3254057972803305863 (task 11599 ms: download 5079 ms overlapping gunzip 773 ms, parse 3384 ms, sort 99 ms, write 6003 ms, index 500 ms: 12 candidates, 69935 repo-hours, 975 releases; waiting 534 ms; commit 1743 ms)
2026-11-07T21:57:35Z [load_day 2023-06-23] 2023-06-23 hour 18: 170220 events in 4 files, snapshot 3030484330502826088 (task 12281 ms: download 7310 ms overlapping gunzip 832 ms, parse 3644 ms, sort 116 ms, write 6307 ms, index 530 ms: 9 candidates, 75919 repo-hours, 1048 releases; waiting 566 ms; commit 1855 ms)
2026-11-07T21:57:47Z [load_day 2023-06-23] 2023-06-23 hour 19: 159280 events in 4 files, snapshot 2262806276346727110 (task 11233 ms: download 4828 ms overlapping gunzip 749 ms, parse 3310 ms, sort 98 ms, write 5791 ms, index 481 ms: 9 candidates, 65894 repo-hours, 972 releases; waiting 509 ms; commit 1822 ms)
2026-11-07T21:57:58Z [load_day 2023-06-23] 2023-06-23 hour 20: 151674 events in 4 files, snapshot 4180175988856406976 (task 10711 ms: download 4738 ms overlapping gunzip 706 ms, parse 3094 ms, sort 102 ms, write 5592 ms, index 417 ms: 5 candidates, 65266 repo-hours, 893 releases; waiting 518 ms; commit 1732 ms)
2026-11-07T21:58:10Z [load_day 2023-06-23] 2023-06-23 hour 21: 142759 events in 3 files, snapshot 4540350065990036858 (task 10205 ms: download 4520 ms overlapping gunzip 686 ms, parse 2941 ms, sort 87 ms, write 5234 ms, index 378 ms: 6 candidates, 56924 repo-hours, 915 releases; waiting 528 ms; commit 1931 ms)
2026-11-07T21:58:19Z [load_day 2023-06-23] 2023-06-23 hour 22: 121813 events in 3 files, snapshot 3662185294306480525 (task 9001 ms: download 4108 ms overlapping gunzip 601 ms, parse 2518 ms, sort 76 ms, write 4498 ms, index 314 ms: 1 candidates, 50123 repo-hours, 801 releases; waiting 591 ms; commit 1742 ms)
2026-11-07T21:58:28Z [load_day 2023-06-23] 2023-06-23 hour 23: 108468 events in 3 files, snapshot 3841041380833548190 (task 8384 ms: download 3009 ms overlapping gunzip 518 ms, parse 2212 ms, sort 65 ms, write 3660 ms, index 296 ms: 3 candidates, 45096 repo-hours, 649 releases; waiting 1305 ms; commit 1708 ms)
2026-11-07T21:58:35Z [load_day 2023-06-23] 2023-06-23: repo_hour merged from 24 files to 1 (1680121 rows, 7062 ms)
2026-11-07T21:58:37Z [load_day 2023-06-23] 2023-06-23: index committed in 8968 ms (24 + 1 + 24 files)
2026-11-07T21:58:37Z [load_day 2023-06-23] 2023-06-23: 3746712 events in 24 hours
2026-11-07T21:58:37Z [load_day 2023-06-23] attempt 1 succeeded