orcaLog in

Runs · run 882

load_day 2023-03-07, attempt 1 succeeded

Host
caf251265124:132808
Started
2026-11-07T16:40:26Z
Ended
2026-11-07T16:45:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/882/load_day/2023-03-07/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:40:26Z [load_day 2023-03-07] attempt 1 started
2026-11-07T16:40:27Z [load_day 2023-03-07] 2023-03-07: 2 hours in flight, about 1200 MB
2026-11-07T16:40:49Z [load_day 2023-03-07] 2023-03-07 hour 0: 179872 events in 4 files, snapshot 4927621628332353679 (task 19039 ms: download 12867 ms overlapping gunzip 1121 ms, parse 4710 ms, sort 101 ms, write 9124 ms, index 515 ms: 8 candidates, 78835 repo-hours, 921 releases; waiting 3119 ms; commit 1577 ms)
2026-11-07T16:40:51Z [load_day 2023-03-07] 2023-03-07 hour 1: 183286 events in 4 files, snapshot 1333664833535618265 (task 15585 ms: download 9401 ms overlapping gunzip 1055 ms, parse 4513 ms, sort 106 ms, write 8519 ms, index 569 ms: 3 candidates, 89275 repo-hours, 861 releases; waiting 417 ms; commit 1503 ms)
2026-11-07T16:41:05Z [load_day 2023-03-07] 2023-03-07 hour 2: 177080 events in 4 files, snapshot 3241288723499827984 (task 15723 ms: download 9769 ms overlapping gunzip 894 ms, parse 3613 ms, sort 109 ms, write 7710 ms, index 647 ms: 6 candidates, 98366 repo-hours, 668 releases; waiting 2450 ms; commit 1388 ms)
2026-11-07T16:41:07Z [load_day 2023-03-07] 2023-03-07 hour 3: 191302 events in 4 files, snapshot 8560148559102661196 (task 14444 ms: download 8132 ms overlapping gunzip 923 ms, parse 3896 ms, sort 116 ms, write 8057 ms, index 616 ms: 4 candidates, 100636 repo-hours, 876 releases; waiting 528 ms; commit 1610 ms)
2026-11-07T16:41:20Z [load_day 2023-03-07] 2023-03-07 hour 4: 174075 events in 4 files, snapshot 7264847713480816325 (task 13650 ms: download 6777 ms overlapping gunzip 756 ms, parse 3071 ms, sort 99 ms, write 6546 ms, index 568 ms: 3 candidates, 92074 repo-hours, 687 releases; waiting 2261 ms; commit 1413 ms)
2026-11-07T16:41:21Z [load_day 2023-03-07] 2023-03-07 hour 5: 179559 events in 4 files, snapshot 8120638595808703486 (task 13173 ms: download 7726 ms overlapping gunzip 810 ms, parse 3272 ms, sort 106 ms, write 6869 ms, index 571 ms: 0 candidates, 94459 repo-hours, 970 releases; waiting 1245 ms; commit 1470 ms)
2026-11-07T16:41:34Z [load_day 2023-03-07] 2023-03-07 hour 6: 193670 events in 4 files, snapshot 8158712723929231076 (task 13026 ms: download 6981 ms overlapping gunzip 792 ms, parse 3281 ms, sort 116 ms, write 7394 ms, index 638 ms: 2 candidates, 103717 repo-hours, 876 releases; waiting 534 ms; commit 1585 ms)
2026-11-07T16:42:37Z [load_day 2023-03-07] 2023-03-07 hour 7: 199703 events in 4 files, snapshot 4693152704656405606 (task 75237 ms: download 71991 ms overlapping gunzip 1669 ms, parse 7234 ms, sort 136 ms, write 8308 ms, index 686 ms: 4 candidates, 102458 repo-hours, 859 releases; waiting 56832 ms; commit 1398 ms)
2026-11-07T16:42:39Z [load_day 2023-03-07] 2023-03-07 hour 8: 219583 events in 5 files, snapshot 3116036255830944656 (task 15879 ms: download 10123 ms overlapping gunzip 949 ms, parse 3892 ms, sort 138 ms, write 9084 ms, index 728 ms: 4 candidates, 129724 repo-hours, 844 releases; waiting 791 ms; commit 1643 ms)
2026-11-07T16:42:55Z [load_day 2023-03-07] 2023-03-07 hour 9: 218111 events in 5 files, snapshot 3754744693495708408 (task 17396 ms: download 11766 ms overlapping gunzip 1063 ms, parse 4590 ms, sort 133 ms, write 10081 ms, index 658 ms: 5 candidates, 109898 repo-hours, 1135 releases; waiting 547 ms; commit 1458 ms)
2026-11-07T16:42:58Z [load_day 2023-03-07] 2023-03-07 hour 10: 216828 events in 5 files, snapshot 2704795365902121687 (task 18017 ms: download 12162 ms overlapping gunzip 1079 ms, parse 4715 ms, sort 141 ms, write 10111 ms, index 682 ms: 5 candidates, 107260 repo-hours, 1060 releases; waiting 928 ms; commit 1378 ms)
2026-11-07T16:43:13Z [load_day 2023-03-07] 2023-03-07 hour 11: 205791 events in 5 files, snapshot 4418394680500394461 (task 16503 ms: download 8951 ms overlapping gunzip 1011 ms, parse 4292 ms, sort 120 ms, write 9617 ms, index 638 ms: 5 candidates, 95410 repo-hours, 1033 releases; waiting 519 ms; commit 1535 ms)
2026-11-07T16:43:27Z [load_day 2023-03-07] 2023-03-07 hour 12: 234778 events in 5 files, snapshot 8546300514409178204 (task 28507 ms: download 22372 ms overlapping gunzip 1182 ms, parse 5108 ms, sort 132 ms, write 9938 ms, index 742 ms: 8 candidates, 116003 repo-hours, 1266 releases; waiting 11102 ms; commit 1483 ms)
2026-11-07T16:43:31Z [load_day 2023-03-07] 2023-03-07 hour 13: 234633 events in 5 files, snapshot 5579896344197005320 (task 17907 ms: download 11091 ms overlapping gunzip 1072 ms, parse 4679 ms, sort 147 ms, write 10365 ms, index 827 ms: 5 candidates, 120831 repo-hours, 1074 releases; waiting 518 ms; commit 1443 ms)
2026-11-07T16:43:47Z [load_day 2023-03-07] 2023-03-07 hour 14: 229451 events in 5 files, snapshot 4746810402656727320 (task 18955 ms: download 12685 ms overlapping gunzip 1150 ms, parse 4975 ms, sort 144 ms, write 10842 ms, index 719 ms: 6 candidates, 109211 repo-hours, 1103 releases; waiting 801 ms; commit 1498 ms)
2026-11-07T16:43:52Z [load_day 2023-03-07] 2023-03-07 hour 15: 231229 events in 5 files, snapshot 447571530583972638 (task 19712 ms: download 13005 ms overlapping gunzip 1156 ms, parse 4989 ms, sort 138 ms, write 10831 ms, index 706 ms: 6 candidates, 112550 repo-hours, 1310 releases; waiting 1551 ms; commit 1407 ms)
2026-11-07T16:44:06Z [load_day 2023-03-07] 2023-03-07 hour 16: 228468 events in 5 files, snapshot 8436510781802082093 (task 17808 ms: download 11388 ms overlapping gunzip 1025 ms, parse 4415 ms, sort 154 ms, write 10572 ms, index 744 ms: 6 candidates, 127167 repo-hours, 1047 releases; waiting 614 ms; commit 1405 ms)
2026-11-07T16:44:10Z [load_day 2023-03-07] 2023-03-07 hour 17: 208929 events in 5 files, snapshot 5434772083136531736 (task 17126 ms: download 9392 ms overlapping gunzip 1045 ms, parse 4580 ms, sort 148 ms, write 9992 ms, index 602 ms: 9 candidates, 92363 repo-hours, 1064 releases; waiting 527 ms; commit 1621 ms)
2026-11-07T16:44:23Z [load_day 2023-03-07] 2023-03-07 hour 18: 200493 events in 5 files, snapshot 6545866032622143494 (task 16700 ms: download 9238 ms overlapping gunzip 971 ms, parse 4245 ms, sort 137 ms, write 9556 ms, index 584 ms: 8 candidates, 91118 repo-hours, 1007 releases; waiting 842 ms; commit 1507 ms)
2026-11-07T16:44:26Z [load_day 2023-03-07] 2023-03-07 hour 19: 191423 events in 4 files, snapshot 5996559093287225899 (task 16075 ms: download 9360 ms overlapping gunzip 924 ms, parse 4060 ms, sort 111 ms, write 8961 ms, index 595 ms: 8 candidates, 80478 repo-hours, 960 releases; waiting 1031 ms; commit 1470 ms)
2026-11-07T16:44:40Z [load_day 2023-03-07] 2023-03-07 hour 20: 195254 events in 4 files, snapshot 8521671883756783727 (task 15845 ms: download 8953 ms overlapping gunzip 982 ms, parse 4184 ms, sort 131 ms, write 9116 ms, index 565 ms: 8 candidates, 80519 repo-hours, 929 releases; waiting 540 ms; commit 1649 ms)
2026-11-07T16:44:42Z [load_day 2023-03-07] 2023-03-07 hour 21: 179901 events in 4 files, snapshot 3546874176521100066 (task 14729 ms: download 8370 ms overlapping gunzip 864 ms, parse 3771 ms, sort 107 ms, write 8347 ms, index 654 ms: 6 candidates, 74079 repo-hours, 1081 releases; waiting 622 ms; commit 1329 ms)
2026-11-07T16:44:55Z [load_day 2023-03-07] 2023-03-07 hour 22: 177121 events in 4 files, snapshot 7164602195727200213 (task 14233 ms: download 8340 ms overlapping gunzip 910 ms, parse 3829 ms, sort 115 ms, write 8082 ms, index 451 ms: 6 candidates, 69531 repo-hours, 921 releases; waiting 513 ms; commit 1617 ms)
2026-11-07T16:44:57Z [load_day 2023-03-07] 2023-03-07 hour 23: 166778 events in 4 files, snapshot 8718308886452600623 (task 14177 ms: download 8726 ms overlapping gunzip 885 ms, parse 3704 ms, sort 98 ms, write 7807 ms, index 431 ms: 2 candidates, 65471 repo-hours, 778 releases; waiting 907 ms; commit 1338 ms)
2026-11-07T16:45:06Z [load_day 2023-03-07] 2023-03-07: repo_hour merged from 24 files to 1 (2341433 rows, 9578 ms)
2026-11-07T16:45:09Z [load_day 2023-03-07] 2023-03-07: index committed in 12199 ms (23 + 1 + 24 files)
2026-11-07T16:45:09Z [load_day 2023-03-07] 2023-03-07: 4817318 events in 24 hours
2026-11-07T16:45:09Z [load_day 2023-03-07] attempt 1 succeeded