orcaLog in

Runs · run 1101

load_day 2023-05-19, attempt 1 succeeded

Host
caf251265124:383044
Started
2026-11-07T20:20:41Z
Ended
2026-11-07T20:23:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1101/load_day/2023-05-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:20:41Z [load_day 2023-05-19] attempt 1 started
2026-11-07T20:20:42Z [load_day 2023-05-19] 2023-05-19: 2 hours in flight, about 1200 MB
2026-11-07T20:20:56Z [load_day 2023-05-19] 2023-05-19 hour 0: 144464 events in 3 files, snapshot 5014458009460416780 (task 10973 ms: download 4654 ms overlapping gunzip 616 ms, parse 2960 ms, sort 92 ms, write 5937 ms, index 490 ms: 7 candidates, 77568 repo-hours, 926 releases; waiting 539 ms; commit 1559 ms)
2026-11-07T20:20:58Z [load_day 2023-05-19] 2023-05-19 hour 1: 156965 events in 4 files, snapshot 2823478939195903047 (task 11168 ms: download 4625 ms overlapping gunzip 629 ms, parse 3003 ms, sort 91 ms, write 6095 ms, index 544 ms: 8 candidates, 89699 repo-hours, 894 releases; waiting 501 ms; commit 1671 ms)
2026-11-07T20:21:07Z [load_day 2023-05-19] 2023-05-19 hour 2: 134622 events in 3 files, snapshot 2718820675778877210 (task 9995 ms: download 4304 ms overlapping gunzip 568 ms, parse 2561 ms, sort 85 ms, write 5525 ms, index 414 ms: 4 candidates, 63482 repo-hours, 796 releases; waiting 569 ms; commit 1737 ms)
2026-11-07T20:21:09Z [load_day 2023-05-19] 2023-05-19 hour 3: 127629 events in 3 files, snapshot 701006465952041391 (task 9839 ms: download 4351 ms overlapping gunzip 560 ms, parse 2475 ms, sort 74 ms, write 5108 ms, index 374 ms: 2 candidates, 57007 repo-hours, 819 releases; waiting 906 ms; commit 1875 ms)
2026-11-07T20:21:20Z [load_day 2023-05-19] 2023-05-19 hour 4: 120298 events in 3 files, snapshot 111722106562812070 (task 8940 ms: download 2275 ms overlapping gunzip 496 ms, parse 2206 ms, sort 77 ms, write 4859 ms, index 484 ms: 4 candidates, 51257 repo-hours, 673 releases; waiting 508 ms; commit 5390 ms)
2026-11-07T20:21:22Z [load_day 2023-05-19] 2023-05-19 hour 5: 129398 events in 3 files, snapshot 6437424430972010723 (task 10534 ms: download 4316 ms overlapping gunzip 582 ms, parse 2600 ms, sort 77 ms, write 5752 ms, index 512 ms: 8 candidates, 57170 repo-hours, 729 releases; waiting 588 ms; commit 1808 ms)
2026-11-07T20:21:30Z [load_day 2023-05-19] 2023-05-19 hour 6: 155377 events in 4 files, snapshot 7684956222567546307 (task 12209 ms: download 5161 ms overlapping gunzip 691 ms, parse 3131 ms, sort 101 ms, write 6593 ms, index 491 ms: 6 candidates, 73225 repo-hours, 829 releases; waiting 863 ms; commit 1722 ms)
2026-11-07T20:21:36Z [load_day 2023-05-19] 2023-05-19 hour 7: 155494 events in 4 files, snapshot 7836325548518182279 (task 12589 ms: download 5250 ms overlapping gunzip 740 ms, parse 3341 ms, sort 97 ms, write 7098 ms, index 482 ms: 5 candidates, 72443 repo-hours, 842 releases; waiting 543 ms; commit 1737 ms)
2026-11-07T20:21:44Z [load_day 2023-05-19] 2023-05-19 hour 8: 161044 events in 4 files, snapshot 6569550716245546881 (task 13046 ms: download 5129 ms overlapping gunzip 762 ms, parse 3370 ms, sort 100 ms, write 7784 ms, index 528 ms: 8 candidates, 76719 repo-hours, 897 releases; waiting 227 ms; commit 1801 ms)
2026-11-07T20:21:50Z [load_day 2023-05-19] 2023-05-19 hour 9: 162849 events in 4 files, snapshot 4026831087936197870 (task 13213 ms: download 5538 ms overlapping gunzip 807 ms, parse 3500 ms, sort 89 ms, write 7526 ms, index 521 ms: 9 candidates, 77199 repo-hours, 1060 releases; waiting 519 ms; commit 1811 ms)
2026-11-07T20:21:57Z [load_day 2023-05-19] 2023-05-19 hour 10: 154665 events in 4 files, snapshot 5730653533076322579 (task 12649 ms: download 5158 ms overlapping gunzip 726 ms, parse 3251 ms, sort 99 ms, write 7199 ms, index 539 ms: 3 candidates, 73356 repo-hours, 902 releases; waiting 553 ms; commit 1737 ms)
2026-11-07T20:22:03Z [load_day 2023-05-19] 2023-05-19 hour 11: 155168 events in 4 files, snapshot 5650586962738381591 (task 12601 ms: download 5161 ms overlapping gunzip 726 ms, parse 3249 ms, sort 103 ms, write 7197 ms, index 504 ms: 3 candidates, 71138 repo-hours, 953 releases; waiting 530 ms; commit 1799 ms)
2026-11-07T20:22:12Z [load_day 2023-05-19] 2023-05-19 hour 12: 192269 events in 4 files, snapshot 4914260619258924806 (task 13616 ms: download 7289 ms overlapping gunzip 769 ms, parse 3503 ms, sort 116 ms, write 7761 ms, index 598 ms: 6 candidates, 98159 repo-hours, 889 releases; waiting 527 ms; commit 1683 ms)
2026-11-07T20:22:18Z [load_day 2023-05-19] 2023-05-19 hour 13: 174317 events in 4 files, snapshot 419581998436901643 (task 13915 ms: download 7810 ms overlapping gunzip 770 ms, parse 3474 ms, sort 110 ms, write 7843 ms, index 605 ms: 6 candidates, 92490 repo-hours, 864 releases; waiting 748 ms; commit 1740 ms)
2026-11-07T20:22:27Z [load_day 2023-05-19] 2023-05-19 hour 14: 163406 events in 4 files, snapshot 5894699657180681426 (task 14144 ms: download 8441 ms overlapping gunzip 804 ms, parse 3538 ms, sort 105 ms, write 8027 ms, index 538 ms: 6 candidates, 80856 repo-hours, 929 releases; waiting 798 ms; commit 1773 ms)
2026-11-07T20:22:32Z [load_day 2023-05-19] 2023-05-19 hour 15: 158104 events in 4 files, snapshot 6711511237069788843 (task 13392 ms: download 5445 ms overlapping gunzip 780 ms, parse 3382 ms, sort 115 ms, write 7790 ms, index 510 ms: 5 candidates, 76854 repo-hours, 1071 releases; waiting 515 ms; commit 1753 ms)
2026-11-07T20:22:40Z [load_day 2023-05-19] 2023-05-19 hour 16: 156806 events in 4 files, snapshot 3440839395671962059 (task 13313 ms: download 5736 ms overlapping gunzip 760 ms, parse 3432 ms, sort 103 ms, write 7397 ms, index 501 ms: 8 candidates, 76635 repo-hours, 887 releases; waiting 798 ms; commit 1629 ms)
2026-11-07T20:22:48Z [load_day 2023-05-19] 2023-05-19 hour 17: 157804 events in 4 files, snapshot 5696565811017698205 (task 15353 ms: download 5655 ms overlapping gunzip 805 ms, parse 3473 ms, sort 99 ms, write 9250 ms, index 513 ms: 8 candidates, 74019 repo-hours, 829 releases; waiting 894 ms; commit 1623 ms)
2026-11-07T20:22:57Z [load_day 2023-05-19] 2023-05-19 hour 18: 159270 events in 4 files, snapshot 4133631690022901845 (task 15863 ms: download 7403 ms overlapping gunzip 746 ms, parse 3304 ms, sort 96 ms, write 10157 ms, index 490 ms: 8 candidates, 76075 repo-hours, 978 releases; waiting 748 ms; commit 1528 ms)
2026-11-07T20:23:01Z [load_day 2023-05-19] 2023-05-19 hour 19: 155991 events in 4 files, snapshot 4302841681122536002 (task 12218 ms: download 4972 ms overlapping gunzip 701 ms, parse 3159 ms, sort 85 ms, write 6993 ms, index 486 ms: 11 candidates, 67530 repo-hours, 869 releases; waiting 475 ms; commit 1573 ms)
2026-11-07T20:23:10Z [load_day 2023-05-19] 2023-05-19 hour 20: 151504 events in 4 files, snapshot 1412258448662684451 (task 12079 ms: download 4740 ms overlapping gunzip 721 ms, parse 3173 ms, sort 96 ms, write 7067 ms, index 486 ms: 8 candidates, 67782 repo-hours, 979 releases; waiting 209 ms; commit 1676 ms)
2026-11-07T20:23:14Z [load_day 2023-05-19] 2023-05-19 hour 21: 138523 events in 3 files, snapshot 7718418579737023397 (task 11593 ms: download 5095 ms overlapping gunzip 693 ms, parse 2973 ms, sort 87 ms, write 6550 ms, index 415 ms: 8 candidates, 59582 repo-hours, 924 releases; waiting 545 ms; commit 1606 ms)
2026-11-07T20:23:21Z [load_day 2023-05-19] 2023-05-19 hour 22: 124979 events in 3 files, snapshot 8358386830989032793 (task 10346 ms: download 4746 ms overlapping gunzip 645 ms, parse 2643 ms, sort 79 ms, write 5663 ms, index 421 ms: 3 candidates, 54603 repo-hours, 799 releases; waiting 547 ms; commit 2108 ms)
2026-11-07T20:23:23Z [load_day 2023-05-19] 2023-05-19 hour 23: 110466 events in 3 files, snapshot 8593627607713101496 (task 9285 ms: download 3144 ms overlapping gunzip 540 ms, parse 2312 ms, sort 68 ms, write 4876 ms, index 376 ms: 2 candidates, 48837 repo-hours, 701 releases; waiting 815 ms; commit 1648 ms)
2026-11-07T20:23:31Z [load_day 2023-05-19] 2023-05-19: repo_hour merged from 24 files to 1 (1713685 rows, 7304 ms)
2026-11-07T20:23:33Z [load_day 2023-05-19] 2023-05-19: index committed in 9252 ms (24 + 1 + 24 files)
2026-11-07T20:23:33Z [load_day 2023-05-19] 2023-05-19: 3601412 events in 24 hours
2026-11-07T20:23:33Z [load_day 2023-05-19] attempt 1 succeeded