orcaLog in

Runs · run 1304

load_day 2023-07-17, attempt 1 succeeded

Host
3c2b29713ce8:132274
Started
2026-11-07T23:01:47Z
Ended
2026-11-07T23:05:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1304/load_day/2023-07-17/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:01:47Z [load_day 2023-07-17] attempt 1 started
2026-11-07T23:01:49Z [load_day 2023-07-17] 2023-07-17: 2 hours in flight, about 1200 MB
2026-11-07T23:02:06Z [load_day 2023-07-17] 2023-07-17 hour 0: 116654 events in 3 files, snapshot 3603277368345862493 (task 12444 ms: download 6347 ms overlapping gunzip 812 ms, parse 3506 ms, sort 82 ms, write 6791 ms, index 431 ms: 6 candidates, 56249 repo-hours, 738 releases; waiting 502 ms; commit 3763 ms)
2026-11-07T23:02:08Z [load_day 2023-07-17] 2023-07-17 hour 1: 146349 events in 3 files, snapshot 8752812088584423186 (task 16219 ms: download 7731 ms overlapping gunzip 1045 ms, parse 4516 ms, sort 103 ms, write 8811 ms, index 856 ms: 3 candidates, 76893 repo-hours, 917 releases; waiting 515 ms; commit 2043 ms)
2026-11-07T23:02:21Z [load_day 2023-07-17] 2023-07-17 hour 2: 135120 events in 3 files, snapshot 2523494320124472849 (task 13220 ms: download 5710 ms overlapping gunzip 770 ms, parse 3527 ms, sort 149 ms, write 7454 ms, index 473 ms: 9 candidates, 66130 repo-hours, 895 releases; waiting 531 ms; commit 4309 ms)
2026-11-07T23:02:25Z [load_day 2023-07-17] 2023-07-17 hour 3: 130637 events in 3 files, snapshot 702021237720026300 (task 12170 ms: download 5294 ms overlapping gunzip 753 ms, parse 2935 ms, sort 100 ms, write 6895 ms, index 751 ms: 8 candidates, 55443 repo-hours, 854 releases; waiting 462 ms; commit 3447 ms)
2026-11-07T23:02:36Z [load_day 2023-07-17] 2023-07-17 hour 4: 127549 events in 3 files, snapshot 7505771319939802572 (task 13138 ms: download 5617 ms overlapping gunzip 941 ms, parse 3828 ms, sort 110 ms, write 7049 ms, index 429 ms: 2 candidates, 50880 repo-hours, 555 releases; waiting 524 ms; commit 4866 ms)
2026-11-07T23:02:42Z [load_day 2023-07-17] 2023-07-17 hour 5: 139257 events in 3 files, snapshot 6891458885378843032 (task 14910 ms: download 6121 ms overlapping gunzip 953 ms, parse 4068 ms, sort 87 ms, write 8326 ms, index 572 ms: 2 candidates, 57491 repo-hours, 732 releases; waiting 517 ms; commit 4835 ms)
2026-11-07T23:02:52Z [load_day 2023-07-17] 2023-07-17 hour 6: 165546 events in 4 files, snapshot 4101089834910816270 (task 18164 ms: download 11075 ms overlapping gunzip 1052 ms, parse 4467 ms, sort 168 ms, write 11010 ms, index 683 ms: 5 candidates, 74236 repo-hours, 843 releases; waiting 486 ms; commit 2169 ms)
2026-11-07T23:03:01Z [load_day 2023-07-17] 2023-07-17 hour 7: 180545 events in 4 files, snapshot 985243805470900210 (task 20164 ms: download 11447 ms overlapping gunzip 1381 ms, parse 5896 ms, sort 154 ms, write 11061 ms, index 894 ms: 5 candidates, 76692 repo-hours, 988 releases; waiting 156 ms; commit 2465 ms)
2026-11-07T23:03:16Z [load_day 2023-07-17] 2023-07-17 hour 8: 185329 events in 4 files, snapshot 494861651483668138 (task 22538 ms: download 13329 ms overlapping gunzip 1442 ms, parse 6112 ms, sort 117 ms, write 13447 ms, index 637 ms: 6 candidates, 81259 repo-hours, 1044 releases; waiting 474 ms; commit 1951 ms)
2026-11-07T23:03:25Z [load_day 2023-07-17] 2023-07-17 hour 9: 188308 events in 4 files, snapshot 972509409083614079 (task 21093 ms: download 12407 ms overlapping gunzip 1546 ms, parse 6602 ms, sort 136 ms, write 11432 ms, index 525 ms: 5 candidates, 82754 repo-hours, 1175 releases; waiting 525 ms; commit 4364 ms)
2026-11-07T23:03:37Z [load_day 2023-07-17] 2023-07-17 hour 10: 177055 events in 4 files, snapshot 3522699186463039221 (task 20093 ms: download 12221 ms overlapping gunzip 1104 ms, parse 4735 ms, sort 133 ms, write 12567 ms, index 721 ms: 5 candidates, 78718 repo-hours, 987 releases; waiting 504 ms; commit 2620 ms)
2026-11-07T23:03:45Z [load_day 2023-07-17] 2023-07-17 hour 11: 184075 events in 4 files, snapshot 1348556792721423548 (task 20979 ms: download 11897 ms overlapping gunzip 1335 ms, parse 5608 ms, sort 159 ms, write 12298 ms, index 704 ms: 10 candidates, 76938 repo-hours, 972 releases; waiting 519 ms; commit 2433 ms)
2026-11-07T23:03:59Z [load_day 2023-07-17] 2023-07-17 hour 12: 215650 events in 5 files, snapshot 7608899126849151786 (task 20539 ms: download 14529 ms overlapping gunzip 1345 ms, parse 5878 ms, sort 158 ms, write 11682 ms, index 682 ms: 12 candidates, 106885 repo-hours, 1101 releases; waiting 498 ms; commit 2188 ms)
2026-11-07T23:04:04Z [load_day 2023-07-17] 2023-07-17 hour 13: 198476 events in 4 files, snapshot 6687094541428324793 (task 18768 ms: download 10591 ms overlapping gunzip 1188 ms, parse 5181 ms, sort 175 ms, write 10798 ms, index 632 ms: 6 candidates, 100762 repo-hours, 979 releases; waiting 516 ms; commit 1994 ms)
2026-11-07T23:04:21Z [load_day 2023-07-17] 2023-07-17 hour 14: 186482 events in 4 files, snapshot 3970793647034446883 (task 21299 ms: download 10988 ms overlapping gunzip 1173 ms, parse 4934 ms, sort 139 ms, write 13808 ms, index 616 ms: 5 candidates, 87344 repo-hours, 1011 releases; waiting 374 ms; commit 2135 ms)
2026-11-07T23:04:27Z [load_day 2023-07-17] 2023-07-17 hour 15: 181212 events in 4 files, snapshot 2527749853021757332 (task 20482 ms: download 11948 ms overlapping gunzip 1234 ms, parse 5235 ms, sort 179 ms, write 12392 ms, index 632 ms: 8 candidates, 86823 repo-hours, 1102 releases; waiting 503 ms; commit 3007 ms)
2026-11-07T23:04:43Z [load_day 2023-07-17] 2023-07-17 hour 16: 177182 events in 4 files, snapshot 869702236511164243 (task 20702 ms: download 12311 ms overlapping gunzip 1424 ms, parse 5857 ms, sort 114 ms, write 11911 ms, index 564 ms: 6 candidates, 80299 repo-hours, 929 releases; waiting 503 ms; commit 3016 ms)
2026-11-07T23:04:49Z [load_day 2023-07-17] 2023-07-17 hour 17: 183275 events in 4 files, snapshot 3181607937049354815 (task 22459 ms: download 13103 ms overlapping gunzip 1377 ms, parse 6157 ms, sort 135 ms, write 13723 ms, index 653 ms: 4 candidates, 77259 repo-hours, 1109 releases; waiting 199 ms; commit 2023 ms)
2026-11-07T23:05:05Z [load_day 2023-07-17] 2023-07-17 hour 18: 181443 events in 4 files, snapshot 3610509337421716602 (task 21750 ms: download 11978 ms overlapping gunzip 1213 ms, parse 5159 ms, sort 163 ms, write 13409 ms, index 689 ms: 5 candidates, 82115 repo-hours, 953 releases; waiting 800 ms; commit 2464 ms)
2026-11-07T23:05:09Z [load_day 2023-07-17] 2023-07-17 hour 19: 167375 events in 4 files, snapshot 9118754328060388297 (task 18449 ms: download 11119 ms overlapping gunzip 1143 ms, parse 5156 ms, sort 106 ms, write 10427 ms, index 757 ms: 6 candidates, 70617 repo-hours, 879 releases; waiting 563 ms; commit 2371 ms)
2026-11-07T23:05:25Z [load_day 2023-07-17] 2023-07-17 hour 20: 169967 events in 4 files, snapshot 8050458500407247607 (task 18495 ms: download 11006 ms overlapping gunzip 1059 ms, parse 4880 ms, sort 111 ms, write 10981 ms, index 603 ms: 9 candidates, 70453 repo-hours, 927 releases; waiting 530 ms; commit 2315 ms)
2026-11-07T23:05:27Z [load_day 2023-07-17] 2023-07-17 hour 21: 158545 events in 4 files, snapshot 2803844988124035183 (task 17330 ms: download 10984 ms overlapping gunzip 989 ms, parse 4151 ms, sort 110 ms, write 10747 ms, index 478 ms: 6 candidates, 62078 repo-hours, 978 releases; waiting 497 ms; commit 2077 ms)
2026-11-07T23:05:42Z [load_day 2023-07-17] 2023-07-17 hour 22: 146099 events in 3 files, snapshot 2245864093321196563 (task 16512 ms: download 6954 ms overlapping gunzip 930 ms, parse 3921 ms, sort 93 ms, write 10305 ms, index 439 ms: 4 candidates, 55846 repo-hours, 1088 releases; waiting 530 ms; commit 1993 ms)
2026-11-07T23:05:44Z [load_day 2023-07-17] 2023-07-17 hour 23: 130672 events in 3 files, snapshot 8201954457698991078 (task 14305 ms: download 5646 ms overlapping gunzip 1002 ms, parse 4309 ms, sort 97 ms, write 7576 ms, index 509 ms: 4 candidates, 52162 repo-hours, 829 releases; waiting 503 ms; commit 2002 ms)
2026-11-07T23:05:51Z [load_day 2023-07-17] 2023-07-17: repo_hour merged from 24 files to 1 (1766326 rows, 7652 ms)
2026-11-07T23:05:54Z [load_day 2023-07-17] 2023-07-17: index committed in 10007 ms (24 + 1 + 24 files)
2026-11-07T23:05:54Z [load_day 2023-07-17] 2023-07-17: 3972802 events in 24 hours
2026-11-07T23:05:54Z [load_day 2023-07-17] attempt 1 succeeded