orcaLog in

Runs · run 779

load_day 2023-01-31, attempt 1 succeeded

Host
caf251265124:57
Started
2026-11-07T14:48:20Z
Ended
2026-11-07T14:51:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/779/load_day/2023-01-31/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:48:20Z [load_day 2023-01-31] attempt 1 started
2026-11-07T14:48:21Z [load_day 2023-01-31] 2023-01-31: 2 hours in flight, about 1200 MB
2026-11-07T14:48:39Z [load_day 2023-01-31] 2023-01-31 hour 0: 180273 events in 4 files, snapshot 5221173844067707949 (task 15857 ms: download 10001 ms overlapping gunzip 1111 ms, parse 4623 ms, sort 100 ms, write 8501 ms, index 528 ms: 6 candidates, 85384 repo-hours, 877 releases; waiting 632 ms; commit 1176 ms)
2026-11-07T14:48:40Z [load_day 2023-01-31] 2023-01-31 hour 1: 161390 events in 4 files, snapshot 2326393781914630398 (task 12832 ms: download 5798 ms overlapping gunzip 782 ms, parse 3388 ms, sort 80 ms, write 7155 ms, index 553 ms: 4 candidates, 82791 repo-hours, 799 releases; waiting 554 ms; commit 1173 ms)
2026-11-07T14:48:54Z [load_day 2023-01-31] 2023-01-31 hour 2: 156034 events in 4 files, snapshot 209990722806882660 (task 13587 ms: download 6228 ms overlapping gunzip 905 ms, parse 3786 ms, sort 89 ms, write 7315 ms, index 477 ms: 4 candidates, 75507 repo-hours, 674 releases; waiting 734 ms; commit 1472 ms)
2026-11-07T14:48:55Z [load_day 2023-01-31] 2023-01-31 hour 3: 154442 events in 4 files, snapshot 2821845437911139930 (task 12719 ms: download 5367 ms overlapping gunzip 810 ms, parse 3451 ms, sort 93 ms, write 6994 ms, index 522 ms: 5 candidates, 64901 repo-hours, 842 releases; waiting 277 ms; commit 1587 ms)
2026-11-07T14:49:06Z [load_day 2023-01-31] 2023-01-31 hour 4: 144201 events in 3 files, snapshot 3304622590601437455 (task 11935 ms: download 5501 ms overlapping gunzip 754 ms, parse 3143 ms, sort 80 ms, write 6595 ms, index 398 ms: 4 candidates, 58466 repo-hours, 674 releases; waiting 547 ms; commit 1347 ms)
2026-11-07T14:49:08Z [load_day 2023-01-31] 2023-01-31 hour 5: 142264 events in 3 files, snapshot 5172602440724590121 (task 10901 ms: download 4816 ms overlapping gunzip 667 ms, parse 2840 ms, sort 94 ms, write 6125 ms, index 369 ms: 4 candidates, 60046 repo-hours, 764 releases; waiting 520 ms; commit 1369 ms)
2026-11-07T14:49:20Z [load_day 2023-01-31] 2023-01-31 hour 6: 160721 events in 4 files, snapshot 1083230045944068022 (task 13267 ms: download 5619 ms overlapping gunzip 794 ms, parse 3307 ms, sort 98 ms, write 7822 ms, index 461 ms: 6 candidates, 70710 repo-hours, 829 releases; waiting 524 ms; commit 1320 ms)
2026-11-07T14:49:22Z [load_day 2023-01-31] 2023-01-31 hour 7: 168034 events in 4 files, snapshot 3880058614393750875 (task 13531 ms: download 8084 ms overlapping gunzip 861 ms, parse 3534 ms, sort 107 ms, write 7565 ms, index 487 ms: 5 candidates, 71678 repo-hours, 869 releases; waiting 556 ms; commit 1225 ms)
2026-11-07T14:49:37Z [load_day 2023-01-31] 2023-01-31 hour 8: 189437 events in 4 files, snapshot 3245864055546161069 (task 15335 ms: download 8844 ms overlapping gunzip 1002 ms, parse 4153 ms, sort 115 ms, write 8642 ms, index 525 ms: 6 candidates, 84628 repo-hours, 990 releases; waiting 538 ms; commit 1522 ms)
2026-11-07T14:49:41Z [load_day 2023-01-31] 2023-01-31 hour 9: 196836 events in 4 files, snapshot 2295388699007898494 (task 18664 ms: download 11464 ms overlapping gunzip 1112 ms, parse 4631 ms, sort 120 ms, write 9693 ms, index 592 ms: 9 candidates, 84768 repo-hours, 1222 releases; waiting 2228 ms; commit 1217 ms)
2026-11-07T14:49:55Z [load_day 2023-01-31] 2023-01-31 hour 10: 199582 events in 4 files, snapshot 2745617522883272870 (task 17025 ms: download 9894 ms overlapping gunzip 1093 ms, parse 4548 ms, sort 128 ms, write 9831 ms, index 555 ms: 3 candidates, 88798 repo-hours, 1055 releases; waiting 540 ms; commit 1346 ms)
2026-11-07T14:49:59Z [load_day 2023-01-31] 2023-01-31 hour 11: 193263 events in 4 files, snapshot 7213663938899632540 (task 16546 ms: download 9786 ms overlapping gunzip 1047 ms, parse 4366 ms, sort 123 ms, write 9634 ms, index 525 ms: 3 candidates, 80693 repo-hours, 1032 releases; waiting 570 ms; commit 1462 ms)
2026-11-07T14:50:12Z [load_day 2023-01-31] 2023-01-31 hour 12: 221547 events in 5 files, snapshot 6036671076364098227 (task 17115 ms: download 9206 ms overlapping gunzip 1058 ms, parse 4413 ms, sort 131 ms, write 9658 ms, index 685 ms: 4 candidates, 105826 repo-hours, 1128 releases; waiting 816 ms; commit 1578 ms)
2026-11-07T14:50:18Z [load_day 2023-01-31] 2023-01-31 hour 13: 216273 events in 5 files, snapshot 3289717461501908246 (task 18257 ms: download 12186 ms overlapping gunzip 1106 ms, parse 4705 ms, sort 152 ms, write 10384 ms, index 685 ms: 5 candidates, 103727 repo-hours, 1167 releases; waiting 778 ms; commit 1389 ms)
2026-11-07T14:50:31Z [load_day 2023-01-31] 2023-01-31 hour 14: 217295 events in 5 files, snapshot 1169693159189643236 (task 17823 ms: download 12093 ms overlapping gunzip 1098 ms, parse 4742 ms, sort 116 ms, write 10368 ms, index 620 ms: 3 candidates, 94688 repo-hours, 1164 releases; waiting 529 ms; commit 1364 ms)
2026-11-07T14:50:38Z [load_day 2023-01-31] 2023-01-31 hour 15: 215824 events in 5 files, snapshot 5162950275651389028 (task 19270 ms: download 13124 ms overlapping gunzip 1167 ms, parse 5115 ms, sort 134 ms, write 11044 ms, index 703 ms: 3 candidates, 96576 repo-hours, 1217 releases; waiting 796 ms; commit 1557 ms)
2026-11-07T14:50:49Z [load_day 2023-01-31] 2023-01-31 hour 16: 207095 events in 5 files, snapshot 5491015911747397130 (task 17896 ms: download 10056 ms overlapping gunzip 1087 ms, parse 4703 ms, sort 134 ms, write 10475 ms, index 656 ms: 3 candidates, 92325 repo-hours, 1023 releases; waiting 515 ms; commit 1536 ms)
2026-11-07T14:50:56Z [load_day 2023-01-31] 2023-01-31 hour 17: 203081 events in 5 files, snapshot 8018885845698190179 (task 17462 ms: download 9785 ms overlapping gunzip 1085 ms, parse 4603 ms, sort 138 ms, write 10185 ms, index 563 ms: 11 candidates, 88200 repo-hours, 952 releases; waiting 547 ms; commit 1552 ms)
2026-11-07T14:51:06Z [load_day 2023-01-31] 2023-01-31 hour 18: 202116 events in 5 files, snapshot 1871006311520574881 (task 16371 ms: download 9184 ms overlapping gunzip 1026 ms, parse 4359 ms, sort 137 ms, write 9423 ms, index 582 ms: 3 candidates, 88132 repo-hours, 1166 releases; waiting 541 ms; commit 1240 ms)
2026-11-07T14:51:13Z [load_day 2023-01-31] 2023-01-31 hour 19: 199861 events in 4 files, snapshot 5151767745964704709 (task 16432 ms: download 9155 ms overlapping gunzip 1018 ms, parse 4320 ms, sort 155 ms, write 9506 ms, index 608 ms: 3 candidates, 89717 repo-hours, 1011 releases; waiting 521 ms; commit 1409 ms)
2026-11-07T14:51:24Z [load_day 2023-01-31] 2023-01-31 hour 20: 187325 events in 4 files, snapshot 7992937362388828094 (task 16858 ms: download 10023 ms overlapping gunzip 1000 ms, parse 4224 ms, sort 133 ms, write 9117 ms, index 585 ms: 4 candidates, 77617 repo-hours, 974 releases; waiting 1302 ms; commit 1356 ms)
2026-11-07T14:51:29Z [load_day 2023-01-31] 2023-01-31 hour 21: 181567 events in 4 files, snapshot 1479879759724688356 (task 15870 ms: download 9312 ms overlapping gunzip 1003 ms, parse 4085 ms, sort 123 ms, write 8786 ms, index 574 ms: 2 candidates, 75703 repo-hours, 1048 releases; waiting 925 ms; commit 1246 ms)
2026-11-07T14:51:42Z [load_day 2023-01-31] 2023-01-31 hour 22: 169549 events in 4 files, snapshot 5350780122034164609 (task 15045 ms: download 9331 ms overlapping gunzip 1026 ms, parse 4027 ms, sort 122 ms, write 8576 ms, index 470 ms: 4 candidates, 66979 repo-hours, 946 releases; waiting 516 ms; commit 3744 ms)
2026-11-07T14:51:44Z [load_day 2023-01-31] 2023-01-31 hour 23: 161028 events in 4 files, snapshot 7883413642824013615 (task 13885 ms: download 6406 ms overlapping gunzip 847 ms, parse 3509 ms, sort 112 ms, write 7575 ms, index 448 ms: 6 candidates, 68769 repo-hours, 939 releases; waiting 1065 ms; commit 1337 ms)
2026-11-07T14:51:52Z [load_day 2023-01-31] 2023-01-31: repo_hour merged from 24 files to 1 (1956629 rows, 7719 ms)
2026-11-07T14:51:54Z [load_day 2023-01-31] 2023-01-31: index committed in 9668 ms (24 + 1 + 24 files)
2026-11-07T14:51:54Z [load_day 2023-01-31] 2023-01-31: 4429038 events in 24 hours
2026-11-07T14:51:54Z [load_day 2023-01-31] attempt 1 succeeded