orcaLog in

Runs · run 1312

load_day 2023-07-19, attempt 1 succeeded

Host
3c2b29713ce8:140006
Started
2026-11-07T23:05:54Z
Ended
2026-11-07T23:09:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1312/load_day/2023-07-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:05:54Z [load_day 2023-07-19] attempt 1 started
2026-11-07T23:05:56Z [load_day 2023-07-19] 2023-07-19: 2 hours in flight, about 1200 MB
2026-11-07T23:06:14Z [load_day 2023-07-19] 2023-07-19 hour 0: 129321 events in 3 files, snapshot 7185240343114132244 (task 13920 ms: download 7042 ms overlapping gunzip 878 ms, parse 3895 ms, sort 98 ms, write 7843 ms, index 374 ms: 3 candidates, 56543 repo-hours, 680 releases; waiting 515 ms; commit 3054 ms)
2026-11-07T23:06:17Z [load_day 2023-07-19] 2023-07-19 hour 1: 142271 events in 3 files, snapshot 5451916574353619462 (task 14425 ms: download 6628 ms overlapping gunzip 877 ms, parse 3926 ms, sort 130 ms, write 8167 ms, index 537 ms: 2 candidates, 69772 repo-hours, 634 releases; waiting 520 ms; commit 2488 ms)
2026-11-07T23:06:30Z [load_day 2023-07-19] 2023-07-19 hour 2: 162554 events in 4 files, snapshot 5001729136019231263 (task 15085 ms: download 6430 ms overlapping gunzip 953 ms, parse 4367 ms, sort 137 ms, write 8156 ms, index 578 ms: 2 candidates, 85981 repo-hours, 742 releases; waiting 533 ms; commit 3085 ms)
2026-11-07T23:06:35Z [load_day 2023-07-19] 2023-07-19 hour 3: 141396 events in 3 files, snapshot 6425217136342973942 (task 13345 ms: download 5861 ms overlapping gunzip 693 ms, parse 3074 ms, sort 104 ms, write 7679 ms, index 736 ms: 3 candidates, 66611 repo-hours, 877 releases; waiting 716 ms; commit 4386 ms)
2026-11-07T23:06:44Z [load_day 2023-07-19] 2023-07-19 hour 4: 130690 events in 3 files, snapshot 3899291632235343439 (task 13372 ms: download 5339 ms overlapping gunzip 858 ms, parse 3759 ms, sort 73 ms, write 7415 ms, index 455 ms: 6 candidates, 55246 repo-hours, 718 releases; waiting 533 ms; commit 2066 ms)
2026-11-07T23:06:50Z [load_day 2023-07-19] 2023-07-19 hour 5: 146386 events in 3 files, snapshot 1485090919595614337 (task 15323 ms: download 6733 ms overlapping gunzip 813 ms, parse 3840 ms, sort 99 ms, write 8695 ms, index 452 ms: 7 candidates, 63583 repo-hours, 799 releases; waiting 1044 ms; commit 3265 ms)
2026-11-07T23:07:03Z [load_day 2023-07-19] 2023-07-19 hour 6: 171097 events in 4 files, snapshot 262984985545873871 (task 17545 ms: download 9844 ms overlapping gunzip 1035 ms, parse 4443 ms, sort 169 ms, write 10294 ms, index 715 ms: 5 candidates, 78976 repo-hours, 924 releases; waiting 547 ms; commit 2317 ms)
2026-11-07T23:07:10Z [load_day 2023-07-19] 2023-07-19 hour 7: 175256 events in 4 files, snapshot 3631367260215492381 (task 18777 ms: download 11075 ms overlapping gunzip 1273 ms, parse 5748 ms, sort 109 ms, write 10194 ms, index 573 ms: 8 candidates, 78023 repo-hours, 974 releases; waiting 495 ms; commit 3696 ms)
2026-11-07T23:07:25Z [load_day 2023-07-19] 2023-07-19 hour 8: 181632 events in 4 files, snapshot 204031875711619844 (task 20802 ms: download 12026 ms overlapping gunzip 1300 ms, parse 5838 ms, sort 141 ms, write 12092 ms, index 636 ms: 11 candidates, 81940 repo-hours, 1047 releases; waiting 509 ms; commit 2034 ms)
2026-11-07T23:07:29Z [load_day 2023-07-19] 2023-07-19 hour 9: 168940 events in 4 files, snapshot 979916978256520292 (task 19091 ms: download 11496 ms overlapping gunzip 1169 ms, parse 5048 ms, sort 128 ms, write 11238 ms, index 670 ms: 7 candidates, 78379 repo-hours, 1093 releases; waiting 532 ms; commit 2089 ms)
2026-11-07T23:07:45Z [load_day 2023-07-19] 2023-07-19 hour 10: 177477 events in 4 files, snapshot 1763479757546452137 (task 19127 ms: download 10812 ms overlapping gunzip 1234 ms, parse 5621 ms, sort 103 ms, write 10679 ms, index 694 ms: 2 candidates, 79427 repo-hours, 1025 releases; waiting 491 ms; commit 2304 ms)
2026-11-07T23:07:51Z [load_day 2023-07-19] 2023-07-19 hour 11: 184210 events in 4 files, snapshot 6830864310179999216 (task 19881 ms: download 11476 ms overlapping gunzip 1130 ms, parse 5006 ms, sort 163 ms, write 12207 ms, index 561 ms: 3 candidates, 78393 repo-hours, 986 releases; waiting 505 ms; commit 3790 ms)
2026-11-07T23:08:03Z [load_day 2023-07-19] 2023-07-19 hour 12: 227192 events in 5 files, snapshot 2948786075175535417 (task 17564 ms: download 9228 ms overlapping gunzip 1047 ms, parse 4760 ms, sort 110 ms, write 10112 ms, index 716 ms: 6 candidates, 110152 repo-hours, 1112 releases; waiting 507 ms; commit 2254 ms)
2026-11-07T23:08:08Z [load_day 2023-07-19] 2023-07-19 hour 13: 195252 events in 4 files, snapshot 5943723936972103314 (task 16819 ms: download 8574 ms overlapping gunzip 941 ms, parse 4192 ms, sort 129 ms, write 9598 ms, index 1180 ms: 6 candidates, 99792 repo-hours, 973 releases; waiting 479 ms; commit 3111 ms)
2026-11-07T23:08:25Z [load_day 2023-07-19] 2023-07-19 hour 14: 177847 events in 4 files, snapshot 3450133431715570869 (task 20356 ms: download 12266 ms overlapping gunzip 1106 ms, parse 4909 ms, sort 164 ms, write 12730 ms, index 665 ms: 5 candidates, 85202 repo-hours, 883 releases; waiting 467 ms; commit 2345 ms)
2026-11-07T23:08:29Z [load_day 2023-07-19] 2023-07-19 hour 15: 170262 events in 4 files, snapshot 8251053815475993274 (task 19275 ms: download 11473 ms overlapping gunzip 1004 ms, parse 4407 ms, sort 102 ms, write 12187 ms, index 792 ms: 8 candidates, 81418 repo-hours, 895 releases; waiting 453 ms; commit 2687 ms)
2026-11-07T23:08:45Z [load_day 2023-07-19] 2023-07-19 hour 16: 167899 events in 4 files, snapshot 1323830502455620158 (task 18867 ms: download 11050 ms overlapping gunzip 1118 ms, parse 5039 ms, sort 110 ms, write 11245 ms, index 524 ms: 6 candidates, 78322 repo-hours, 869 releases; waiting 518 ms; commit 2314 ms)
2026-11-07T23:08:49Z [load_day 2023-07-19] 2023-07-19 hour 17: 181768 events in 4 files, snapshot 1854364134018029013 (task 18368 ms: download 10830 ms overlapping gunzip 1087 ms, parse 4659 ms, sort 102 ms, write 11081 ms, index 560 ms: 6 candidates, 82143 repo-hours, 848 releases; waiting 504 ms; commit 3818 ms)
2026-11-07T23:09:04Z [load_day 2023-07-19] 2023-07-19 hour 18: 183446 events in 4 files, snapshot 6947924720822130883 (task 18620 ms: download 10896 ms overlapping gunzip 1029 ms, parse 4792 ms, sort 155 ms, write 11110 ms, index 583 ms: 2 candidates, 82622 repo-hours, 925 releases; waiting 605 ms; commit 2219 ms)
2026-11-07T23:09:14Z [load_day 2023-07-19] 2023-07-19 hour 19: 177690 events in 4 files, snapshot 8918474061077216705 (task 18731 ms: download 10874 ms overlapping gunzip 1121 ms, parse 5124 ms, sort 146 ms, write 10642 ms, index 1052 ms: 6 candidates, 75336 repo-hours, 884 releases; waiting 365 ms; commit 9127 ms)
2026-11-07T23:09:25Z [load_day 2023-07-19] 2023-07-19 hour 20: 166163 events in 4 files, snapshot 4460538996063713610 (task 19560 ms: download 12794 ms overlapping gunzip 1170 ms, parse 5189 ms, sort 119 ms, write 11685 ms, index 520 ms: 8 candidates, 70223 repo-hours, 865 releases; waiting 499 ms; commit 2077 ms)
2026-11-07T23:09:30Z [load_day 2023-07-19] 2023-07-19 hour 21: 153564 events in 4 files, snapshot 4724225193270697778 (task 16237 ms: download 8077 ms overlapping gunzip 1070 ms, parse 4737 ms, sort 103 ms, write 9019 ms, index 417 ms: 6 candidates, 62480 repo-hours, 962 releases; waiting 535 ms; commit 5270 ms)
2026-11-07T23:09:41Z [load_day 2023-07-19] 2023-07-19 hour 22: 138985 events in 3 files, snapshot 427465167501456058 (task 15063 ms: download 7351 ms overlapping gunzip 879 ms, parse 3620 ms, sort 155 ms, write 9107 ms, index 466 ms: 10 candidates, 54610 repo-hours, 767 releases; waiting 486 ms; commit 2053 ms)
2026-11-07T23:09:43Z [load_day 2023-07-19] 2023-07-19 hour 23: 126430 events in 3 files, snapshot 9191094283066785316 (task 13252 ms: download 6564 ms overlapping gunzip 848 ms, parse 3851 ms, sort 102 ms, write 7265 ms, index 360 ms: 3 candidates, 51143 repo-hours, 642 releases; waiting 476 ms; commit 2026 ms)
2026-11-07T23:09:51Z [load_day 2023-07-19] 2023-07-19: repo_hour merged from 24 files to 1 (1806317 rows, 8000 ms)
2026-11-07T23:09:53Z [load_day 2023-07-19] 2023-07-19: index committed in 9975 ms (24 + 1 + 24 files)
2026-11-07T23:09:53Z [load_day 2023-07-19] 2023-07-19: 3977728 events in 24 hours
2026-11-07T23:09:53Z [load_day 2023-07-19] attempt 1 succeeded