orcaLog in

Runs · run 1369

load_day 2023-08-07, attempt 1 succeeded

Host
3c2b29713ce8:202578
Started
2026-11-07T23:40:19Z
Ended
2026-11-07T23:44:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1369/load_day/2023-08-07/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:40:19Z [load_day 2023-08-07] attempt 1 started
2026-11-07T23:40:20Z [load_day 2023-08-07] 2023-08-07: 2 hours in flight, about 1200 MB
2026-11-07T23:40:38Z [load_day 2023-08-07] 2023-08-07 hour 0: 130913 events in 3 files, snapshot 7101741086875463355 (task 13010 ms: download 5924 ms overlapping gunzip 782 ms, parse 3615 ms, sort 145 ms, write 7023 ms, index 656 ms: 4 candidates, 66918 repo-hours, 866 releases; waiting 466 ms; commit 3594 ms)
2026-11-07T23:40:40Z [load_day 2023-08-07] 2023-08-07 hour 1: 154685 events in 4 files, snapshot 7692118299658023005 (task 16319 ms: download 6855 ms overlapping gunzip 1012 ms, parse 4480 ms, sort 126 ms, write 8881 ms, index 1041 ms: 6 candidates, 84036 repo-hours, 835 releases; waiting 487 ms; commit 2109 ms)
2026-11-07T23:40:51Z [load_day 2023-08-07] 2023-08-07 hour 2: 133264 events in 3 files, snapshot 2436419849667151464 (task 13101 ms: download 5654 ms overlapping gunzip 1025 ms, parse 4081 ms, sort 95 ms, write 6498 ms, index 580 ms: 9 candidates, 58675 repo-hours, 719 releases; waiting 536 ms; commit 2310 ms)
2026-11-07T23:40:55Z [load_day 2023-08-07] 2023-08-07 hour 3: 133537 events in 3 files, snapshot 3745889271883931846 (task 12975 ms: download 5811 ms overlapping gunzip 849 ms, parse 3348 ms, sort 119 ms, write 7149 ms, index 486 ms: 6 candidates, 55357 repo-hours, 789 releases; waiting 554 ms; commit 2549 ms)
2026-11-07T23:41:06Z [load_day 2023-08-07] 2023-08-07 hour 4: 129456 events in 3 files, snapshot 7361715773389765879 (task 13090 ms: download 5655 ms overlapping gunzip 862 ms, parse 3435 ms, sort 89 ms, write 7598 ms, index 338 ms: 1 candidates, 51732 repo-hours, 527 releases; waiting 512 ms; commit 3327 ms)
2026-11-07T23:41:12Z [load_day 2023-08-07] 2023-08-07 hour 5: 138595 events in 3 files, snapshot 3626191909816285240 (task 13853 ms: download 5566 ms overlapping gunzip 832 ms, parse 3326 ms, sort 118 ms, write 8359 ms, index 401 ms: 6 candidates, 58152 repo-hours, 828 releases; waiting 515 ms; commit 4628 ms)
2026-11-07T23:41:21Z [load_day 2023-08-07] 2023-08-07 hour 6: 167885 events in 4 files, snapshot 4120940078943255039 (task 15515 ms: download 9637 ms overlapping gunzip 979 ms, parse 4389 ms, sort 115 ms, write 8680 ms, index 526 ms: 4 candidates, 75756 repo-hours, 898 releases; waiting 530 ms; commit 2175 ms)
2026-11-07T23:41:27Z [load_day 2023-08-07] 2023-08-07 hour 7: 177358 events in 4 files, snapshot 4038221389285485551 (task 16346 ms: download 9836 ms overlapping gunzip 1085 ms, parse 4492 ms, sort 161 ms, write 9250 ms, index 523 ms: 7 candidates, 76115 repo-hours, 915 releases; waiting 504 ms; commit 2240 ms)
2026-11-07T23:41:43Z [load_day 2023-08-07] 2023-08-07 hour 8: 189405 events in 4 files, snapshot 3768415735333515822 (task 20365 ms: download 10187 ms overlapping gunzip 1112 ms, parse 4600 ms, sort 117 ms, write 12658 ms, index 715 ms: 6 candidates, 82468 repo-hours, 1069 releases; waiting 857 ms; commit 2476 ms)
2026-11-07T23:41:54Z [load_day 2023-08-07] 2023-08-07 hour 9: 191492 events in 4 files, snapshot 8093946019190291235 (task 20649 ms: download 11954 ms overlapping gunzip 1305 ms, parse 5631 ms, sort 120 ms, write 12207 ms, index 583 ms: 16 candidates, 82258 repo-hours, 1320 releases; waiting 509 ms; commit 7328 ms)
2026-11-07T23:42:06Z [load_day 2023-08-07] 2023-08-07 hour 10: 185628 events in 4 files, snapshot 6732503590296658763 (task 20413 ms: download 11999 ms overlapping gunzip 1205 ms, parse 5310 ms, sort 113 ms, write 12674 ms, index 624 ms: 0 candidates, 78816 repo-hours, 1075 releases; waiting 192 ms; commit 4164 ms)
2026-11-07T23:42:11Z [load_day 2023-08-07] 2023-08-07 hour 11: 192410 events in 4 files, snapshot 3270956791224324635 (task 21709 ms: download 12523 ms overlapping gunzip 1338 ms, parse 5827 ms, sort 136 ms, write 13013 ms, index 564 ms: 7 candidates, 77964 repo-hours, 1067 releases; waiting 490 ms; commit 2600 ms)
2026-11-07T23:42:29Z [load_day 2023-08-07] 2023-08-07 hour 12: 235222 events in 5 files, snapshot 4188092680562100756 (task 24230 ms: download 15990 ms overlapping gunzip 1401 ms, parse 6300 ms, sort 201 ms, write 14540 ms, index 744 ms: 8 candidates, 108194 repo-hours, 984 releases; waiting 759 ms; commit 2328 ms)
2026-11-07T23:42:36Z [load_day 2023-08-07] 2023-08-07 hour 13: 205687 events in 5 files, snapshot 9198340468504129960 (task 21756 ms: download 11066 ms overlapping gunzip 1178 ms, parse 5098 ms, sort 203 ms, write 13790 ms, index 678 ms: 12 candidates, 100446 repo-hours, 1083 releases; waiting 511 ms; commit 4861 ms)
2026-11-07T23:42:52Z [load_day 2023-08-07] 2023-08-07 hour 14: 178259 events in 4 files, snapshot 1069264658840452900 (task 22041 ms: download 12227 ms overlapping gunzip 1324 ms, parse 5870 ms, sort 211 ms, write 13251 ms, index 579 ms: 1 candidates, 81542 repo-hours, 1103 releases; waiting 471 ms; commit 2697 ms)
2026-11-07T23:42:55Z [load_day 2023-08-07] 2023-08-07 hour 15: 167091 events in 4 files, snapshot 7634940554017523337 (task 20047 ms: download 12419 ms overlapping gunzip 1043 ms, parse 4505 ms, sort 121 ms, write 12615 ms, index 905 ms: 8 candidates, 78162 repo-hours, 1100 releases; waiting 529 ms; commit 2603 ms)
2026-11-07T23:43:14Z [load_day 2023-08-07] 2023-08-07 hour 16: 172254 events in 4 files, snapshot 8549874134615189149 (task 20497 ms: download 12899 ms overlapping gunzip 1357 ms, parse 5775 ms, sort 116 ms, write 11769 ms, index 621 ms: 7 candidates, 77223 repo-hours, 838 releases; waiting 531 ms; commit 2278 ms)
2026-11-07T23:43:16Z [load_day 2023-08-07] 2023-08-07 hour 17: 176646 events in 4 files, snapshot 879063407504058144 (task 19083 ms: download 11910 ms overlapping gunzip 1112 ms, parse 4846 ms, sort 119 ms, write 11725 ms, index 569 ms: 3 candidates, 74591 repo-hours, 1010 releases; waiting 379 ms; commit 2605 ms)
2026-11-07T23:43:35Z [load_day 2023-08-07] 2023-08-07 hour 18: 192930 events in 4 files, snapshot 5572001394601460242 (task 20337 ms: download 11868 ms overlapping gunzip 1313 ms, parse 5640 ms, sort 137 ms, write 11824 ms, index 631 ms: 9 candidates, 83481 repo-hours, 989 releases; waiting 526 ms; commit 2253 ms)
2026-11-07T23:43:39Z [load_day 2023-08-07] 2023-08-07 hour 19: 179348 events in 4 files, snapshot 7138957653997167993 (task 21145 ms: download 13019 ms overlapping gunzip 1198 ms, parse 5340 ms, sort 125 ms, write 12399 ms, index 919 ms: 6 candidates, 72138 repo-hours, 987 releases; waiting 886 ms; commit 2733 ms)
2026-11-07T23:43:56Z [load_day 2023-08-07] 2023-08-07 hour 20: 179291 events in 4 files, snapshot 1290029924785514331 (task 19834 ms: download 11869 ms overlapping gunzip 1252 ms, parse 5511 ms, sort 134 ms, write 11611 ms, index 553 ms: 6 candidates, 71691 repo-hours, 916 releases; waiting 464 ms; commit 2083 ms)
2026-11-07T23:43:58Z [load_day 2023-08-07] 2023-08-07 hour 21: 167257 events in 4 files, snapshot 3044956059593937799 (task 18168 ms: download 11641 ms overlapping gunzip 974 ms, parse 4057 ms, sort 167 ms, write 11642 ms, index 444 ms: 6 candidates, 62858 repo-hours, 992 releases; waiting 504 ms; commit 2534 ms)
2026-11-07T23:44:12Z [load_day 2023-08-07] 2023-08-07 hour 22: 152969 events in 4 files, snapshot 6532811168968723167 (task 15509 ms: download 6263 ms overlapping gunzip 968 ms, parse 3910 ms, sort 117 ms, write 9164 ms, index 536 ms: 4 candidates, 56722 repo-hours, 870 releases; waiting 514 ms; commit 2086 ms)
2026-11-07T23:44:14Z [load_day 2023-08-07] 2023-08-07 hour 23: 141423 events in 3 files, snapshot 7122934381852286331 (task 14778 ms: download 6788 ms overlapping gunzip 842 ms, parse 3554 ms, sort 112 ms, write 8928 ms, index 342 ms: 0 candidates, 54646 repo-hours, 676 releases; waiting 650 ms; commit 2064 ms)
2026-11-07T23:44:22Z [load_day 2023-08-07] 2023-08-07: repo_hour merged from 24 files to 1 (1769941 rows, 7387 ms)
2026-11-07T23:44:24Z [load_day 2023-08-07] 2023-08-07: index committed in 9425 ms (22 + 1 + 24 files)
2026-11-07T23:44:24Z [load_day 2023-08-07] 2023-08-07: 4073005 events in 24 hours
2026-11-07T23:44:24Z [load_day 2023-08-07] attempt 1 succeeded