orcaLog in

Runs · run 947

load_day 2023-03-28, attempt 1 succeeded

Host
caf251265124:208662
Started
2026-11-07T17:46:56Z
Ended
2026-11-07T17:50:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/947/load_day/2023-03-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:46:56Z [load_day 2023-03-28] attempt 1 started
2026-11-07T17:46:57Z [load_day 2023-03-28] 2023-03-28: 2 hours in flight, about 1200 MB
2026-11-07T17:47:12Z [load_day 2023-03-28] 2023-03-28 hour 0: 158093 events in 4 files, snapshot 2317711654789500755 (task 12426 ms: download 5487 ms overlapping gunzip 746 ms, parse 3314 ms, sort 107 ms, write 6825 ms, index 586 ms: 9 candidates, 76973 repo-hours, 862 releases; waiting 525 ms; commit 1591 ms)
2026-11-07T17:47:14Z [load_day 2023-03-28] 2023-03-28 hour 1: 168189 events in 4 files, snapshot 7302429557431662669 (task 12276 ms: download 4914 ms overlapping gunzip 696 ms, parse 3096 ms, sort 109 ms, write 6966 ms, index 591 ms: 7 candidates, 88769 repo-hours, 830 releases; waiting 518 ms; commit 1540 ms)
2026-11-07T17:47:25Z [load_day 2023-03-28] 2023-03-28 hour 2: 150095 events in 4 files, snapshot 3952365213448776729 (task 11755 ms: download 5204 ms overlapping gunzip 683 ms, parse 2884 ms, sort 95 ms, write 6345 ms, index 508 ms: 4 candidates, 70765 repo-hours, 815 releases; waiting 929 ms; commit 1708 ms)
2026-11-07T17:47:27Z [load_day 2023-03-28] 2023-03-28 hour 3: 143053 events in 3 files, snapshot 8322113165974898894 (task 10413 ms: download 4210 ms overlapping gunzip 619 ms, parse 2794 ms, sort 90 ms, write 5773 ms, index 418 ms: 1 candidates, 62476 repo-hours, 820 releases; waiting 370 ms; commit 1710 ms)
2026-11-07T17:47:36Z [load_day 2023-03-28] 2023-03-28 hour 4: 137207 events in 3 files, snapshot 6420163330050699313 (task 10078 ms: download 4174 ms overlapping gunzip 591 ms, parse 2597 ms, sort 77 ms, write 5604 ms, index 381 ms: 10 candidates, 57852 repo-hours, 642 releases; waiting 534 ms; commit 1868 ms)
2026-11-07T17:47:39Z [load_day 2023-03-28] 2023-03-28 hour 5: 150818 events in 4 files, snapshot 9051683567958973399 (task 11661 ms: download 4970 ms overlapping gunzip 690 ms, parse 3012 ms, sort 93 ms, write 6417 ms, index 451 ms: 3 candidates, 66005 repo-hours, 847 releases; waiting 691 ms; commit 1515 ms)
2026-11-07T17:47:49Z [load_day 2023-03-28] 2023-03-28 hour 6: 172926 events in 4 files, snapshot 3937928465066085768 (task 13016 ms: download 7210 ms overlapping gunzip 780 ms, parse 3427 ms, sort 112 ms, write 7632 ms, index 553 ms: 11 candidates, 79771 repo-hours, 900 releases; waiting 225 ms; commit 1661 ms)
2026-11-07T17:47:55Z [load_day 2023-03-28] 2023-03-28 hour 7: 157220 events in 4 files, snapshot 2131350092020757052 (task 15624 ms: download 7817 ms overlapping gunzip 836 ms, parse 3576 ms, sort 105 ms, write 7826 ms, index 511 ms: 11 candidates, 75310 repo-hours, 798 releases; waiting 2468 ms; commit 1657 ms)
2026-11-07T17:48:05Z [load_day 2023-03-28] 2023-03-28 hour 8: 165920 events in 4 files, snapshot 6559923709425756199 (task 14512 ms: download 8594 ms overlapping gunzip 847 ms, parse 3694 ms, sort 105 ms, write 8197 ms, index 543 ms: 6 candidates, 79825 repo-hours, 894 releases; waiting 652 ms; commit 1525 ms)
2026-11-07T17:48:11Z [load_day 2023-03-28] 2023-03-28 hour 9: 175438 events in 4 files, snapshot 484684548541559089 (task 15234 ms: download 8745 ms overlapping gunzip 914 ms, parse 3987 ms, sort 113 ms, write 8747 ms, index 632 ms: 8 candidates, 83016 repo-hours, 1123 releases; waiting 545 ms; commit 1290 ms)
2026-11-07T17:48:20Z [load_day 2023-03-28] 2023-03-28 hour 10: 173272 events in 4 files, snapshot 1222428410529505871 (task 15102 ms: download 8831 ms overlapping gunzip 912 ms, parse 3995 ms, sort 116 ms, write 8557 ms, index 584 ms: 5 candidates, 80901 repo-hours, 1149 releases; waiting 615 ms; commit 1372 ms)
2026-11-07T17:48:26Z [load_day 2023-03-28] 2023-03-28 hour 11: 172770 events in 4 files, snapshot 1954970263131146706 (task 14751 ms: download 8680 ms overlapping gunzip 875 ms, parse 3900 ms, sort 114 ms, write 8176 ms, index 550 ms: 7 candidates, 80025 repo-hours, 1034 releases; waiting 817 ms; commit 1411 ms)
2026-11-07T17:48:37Z [load_day 2023-03-28] 2023-03-28 hour 12: 194940 events in 4 files, snapshot 4735112620030142530 (task 15561 ms: download 8279 ms overlapping gunzip 873 ms, parse 3940 ms, sort 126 ms, write 9067 ms, index 690 ms: 10 candidates, 103730 repo-hours, 921 releases; waiting 534 ms; commit 1613 ms)
2026-11-07T17:48:44Z [load_day 2023-03-28] 2023-03-28 hour 13: 193479 events in 4 files, snapshot 5949430179761307678 (task 16613 ms: download 9127 ms overlapping gunzip 961 ms, parse 4324 ms, sort 121 ms, write 9705 ms, index 722 ms: 10 candidates, 101295 repo-hours, 924 releases; waiting 517 ms; commit 1514 ms)
2026-11-07T17:48:54Z [load_day 2023-03-28] 2023-03-28 hour 14: 194555 events in 4 files, snapshot 6155535326672056535 (task 17154 ms: download 9401 ms overlapping gunzip 1036 ms, parse 4394 ms, sort 127 ms, write 10068 ms, index 684 ms: 5 candidates, 95729 repo-hours, 978 releases; waiting 526 ms; commit 1441 ms)
2026-11-07T17:49:02Z [load_day 2023-03-28] 2023-03-28 hour 15: 190816 events in 4 files, snapshot 1117931394492224572 (task 17496 ms: download 9889 ms overlapping gunzip 1041 ms, parse 4540 ms, sort 126 ms, write 10357 ms, index 635 ms: 11 candidates, 93326 repo-hours, 1071 releases; waiting 508 ms; commit 1622 ms)
2026-11-07T17:49:12Z [load_day 2023-03-28] 2023-03-28 hour 16: 189992 events in 4 files, snapshot 3451589988139855082 (task 16372 ms: download 9206 ms overlapping gunzip 962 ms, parse 4219 ms, sort 127 ms, write 9628 ms, index 633 ms: 11 candidates, 93374 repo-hours, 948 releases; waiting 532 ms; commit 1601 ms)
2026-11-07T17:49:18Z [load_day 2023-03-28] 2023-03-28 hour 17: 171300 events in 4 files, snapshot 5817675720230344607 (task 14703 ms: download 8528 ms overlapping gunzip 883 ms, parse 3739 ms, sort 108 ms, write 8470 ms, index 632 ms: 10 candidates, 79434 repo-hours, 915 releases; waiting 508 ms; commit 1640 ms)
2026-11-07T17:49:28Z [load_day 2023-03-28] 2023-03-28 hour 18: 182039 events in 4 files, snapshot 3257528886050273498 (task 15452 ms: download 8868 ms overlapping gunzip 884 ms, parse 3937 ms, sort 121 ms, write 8993 ms, index 560 ms: 10 candidates, 85864 repo-hours, 993 releases; waiting 632 ms; commit 1507 ms)
2026-11-07T17:49:33Z [load_day 2023-03-28] 2023-03-28 hour 19: 169350 events in 4 files, snapshot 84106696908845442 (task 14352 ms: download 8396 ms overlapping gunzip 810 ms, parse 3670 ms, sort 110 ms, write 8309 ms, index 535 ms: 6 candidates, 75405 repo-hours, 1013 releases; waiting 612 ms; commit 1604 ms)
2026-11-07T17:49:43Z [load_day 2023-03-28] 2023-03-28 hour 20: 172316 events in 4 files, snapshot 1935868439944156052 (task 14578 ms: download 8436 ms overlapping gunzip 832 ms, parse 3714 ms, sort 110 ms, write 8576 ms, index 536 ms: 9 candidates, 76556 repo-hours, 988 releases; waiting 506 ms; commit 1498 ms)
2026-11-07T17:49:47Z [load_day 2023-03-28] 2023-03-28 hour 21: 159646 events in 4 files, snapshot 6585544664067491814 (task 13854 ms: download 5792 ms overlapping gunzip 799 ms, parse 3475 ms, sort 99 ms, write 7835 ms, index 536 ms: 9 candidates, 68440 repo-hours, 928 releases; waiting 746 ms; commit 1450 ms)
2026-11-07T17:49:57Z [load_day 2023-03-28] 2023-03-28 hour 22: 149896 events in 3 files, snapshot 4984859723335436590 (task 12817 ms: download 5634 ms overlapping gunzip 732 ms, parse 3194 ms, sort 94 ms, write 7024 ms, index 443 ms: 9 candidates, 65771 repo-hours, 758 releases; waiting 911 ms; commit 1785 ms)
2026-11-07T17:50:00Z [load_day 2023-03-28] 2023-03-28 hour 23: 138675 events in 3 files, snapshot 6348032722242238823 (task 11751 ms: download 5332 ms overlapping gunzip 691 ms, parse 2971 ms, sort 79 ms, write 6666 ms, index 386 ms: 4 candidates, 60161 repo-hours, 738 releases; waiting 678 ms; commit 1514 ms)
2026-11-07T17:50:08Z [load_day 2023-03-28] 2023-03-28: repo_hour merged from 24 files to 1 (1900773 rows, 8214 ms)
2026-11-07T17:50:10Z [load_day 2023-03-28] 2023-03-28: index committed in 10481 ms (24 + 1 + 24 files)
2026-11-07T17:50:10Z [load_day 2023-03-28] 2023-03-28: 4032005 events in 24 hours
2026-11-07T17:50:10Z [load_day 2023-03-28] attempt 1 succeeded