orcaLog in

Runs · run 819

load_day 2023-02-14, attempt 1 succeeded

Host
caf251265124:53444
Started
2026-11-07T15:32:35Z
Ended
2026-11-07T15:36:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/819/load_day/2023-02-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:32:35Z [load_day 2023-02-14] attempt 1 started
2026-11-07T15:32:36Z [load_day 2023-02-14] 2023-02-14: 2 hours in flight, about 1200 MB
2026-11-07T15:32:54Z [load_day 2023-02-14] 2023-02-14 hour 0: 180825 events in 4 files, snapshot 2184811205487106982 (task 15653 ms: download 9914 ms overlapping gunzip 1025 ms, parse 4333 ms, sort 116 ms, write 8470 ms, index 526 ms: 9 candidates, 78322 repo-hours, 946 releases; waiting 972 ms; commit 1351 ms)
2026-11-07T15:32:56Z [load_day 2023-02-14] 2023-02-14 hour 1: 182448 events in 4 files, snapshot 1539081060847127811 (task 15003 ms: download 9148 ms overlapping gunzip 993 ms, parse 4085 ms, sort 98 ms, write 8466 ms, index 506 ms: 7 candidates, 83257 repo-hours, 879 releases; waiting 571 ms; commit 1466 ms)
2026-11-07T15:33:09Z [load_day 2023-02-14] 2023-02-14 hour 2: 159218 events in 4 files, snapshot 7241382983136475056 (task 13592 ms: download 6555 ms overlapping gunzip 821 ms, parse 3415 ms, sort 95 ms, write 6978 ms, index 475 ms: 10 candidates, 71552 repo-hours, 677 releases; waiting 1441 ms; commit 1696 ms)
2026-11-07T15:33:10Z [load_day 2023-02-14] 2023-02-14 hour 3: 148238 events in 3 files, snapshot 3689986357072646007 (task 11521 ms: download 5088 ms overlapping gunzip 716 ms, parse 3127 ms, sort 93 ms, write 6241 ms, index 408 ms: 6 candidates, 60873 repo-hours, 870 releases; waiting 606 ms; commit 1555 ms)
2026-11-07T15:33:21Z [load_day 2023-02-14] 2023-02-14 hour 4: 136682 events in 3 files, snapshot 9204318952137808740 (task 11295 ms: download 5285 ms overlapping gunzip 705 ms, parse 2906 ms, sort 91 ms, write 6376 ms, index 371 ms: 6 candidates, 55089 repo-hours, 593 releases; waiting 531 ms; commit 1562 ms)
2026-11-07T15:33:40Z [load_day 2023-02-14] 2023-02-14 hour 5: 146000 events in 3 files, snapshot 3406500357847749493 (task 18354 ms: download 5415 ms overlapping gunzip 754 ms, parse 3273 ms, sort 100 ms, write 6463 ms, index 6972 ms: 8 candidates, 60201 repo-hours, 764 releases; waiting 505 ms; commit 12448 ms)
2026-11-07T15:33:42Z [load_day 2023-02-14] 2023-02-14 hour 6: 160538 events in 4 files, snapshot 7284656663464401095 (task 12750 ms: download 5678 ms overlapping gunzip 764 ms, parse 3247 ms, sort 89 ms, write 6854 ms, index 501 ms: 10 candidates, 71343 repo-hours, 898 releases; waiting 919 ms; commit 1389 ms)
2026-11-07T15:33:49Z [load_day 2023-02-14] 2023-02-14 hour 7: 169050 events in 4 files, snapshot 4499771965729240430 (task 13932 ms: download 8104 ms overlapping gunzip 860 ms, parse 3716 ms, sort 105 ms, write 7636 ms, index 480 ms: 9 candidates, 73100 repo-hours, 979 releases; waiting 746 ms; commit 1383 ms)
2026-11-07T15:33:58Z [load_day 2023-02-14] 2023-02-14 hour 8: 180343 events in 4 files, snapshot 4884840878099192954 (task 15375 ms: download 9154 ms overlapping gunzip 939 ms, parse 4120 ms, sort 99 ms, write 8579 ms, index 518 ms: 8 candidates, 80413 repo-hours, 976 releases; waiting 808 ms; commit 1199 ms)
2026-11-07T15:34:06Z [load_day 2023-02-14] 2023-02-14 hour 9: 196399 events in 4 files, snapshot 5525307108721901580 (task 16527 ms: download 9297 ms overlapping gunzip 1035 ms, parse 4492 ms, sort 131 ms, write 9439 ms, index 577 ms: 5 candidates, 83971 repo-hours, 1264 releases; waiting 547 ms; commit 1390 ms)
2026-11-07T15:34:15Z [load_day 2023-02-14] 2023-02-14 hour 10: 195767 events in 4 files, snapshot 5564370192238189031 (task 16727 ms: download 9512 ms overlapping gunzip 1028 ms, parse 4493 ms, sort 113 ms, write 9493 ms, index 574 ms: 1 candidates, 83103 repo-hours, 1111 releases; waiting 701 ms; commit 1312 ms)
2026-11-07T15:34:23Z [load_day 2023-02-14] 2023-02-14 hour 11: 206399 events in 5 files, snapshot 9163298414234229081 (task 16408 ms: download 8882 ms overlapping gunzip 1026 ms, parse 4309 ms, sort 136 ms, write 9461 ms, index 564 ms: 4 candidates, 96119 repo-hours, 1060 releases; waiting 560 ms; commit 1351 ms)
2026-11-07T15:34:33Z [load_day 2023-02-14] 2023-02-14 hour 12: 224286 events in 5 files, snapshot 5021223879626685884 (task 16736 ms: download 10838 ms overlapping gunzip 1029 ms, parse 4504 ms, sort 139 ms, write 9518 ms, index 660 ms: 2 candidates, 106178 repo-hours, 1164 releases; waiting 546 ms; commit 1441 ms)
2026-11-07T15:34:41Z [load_day 2023-02-14] 2023-02-14 hour 13: 229858 events in 5 files, snapshot 7507887753038476739 (task 17319 ms: download 10850 ms overlapping gunzip 1062 ms, parse 4624 ms, sort 121 ms, write 10227 ms, index 690 ms: 2 candidates, 110341 repo-hours, 1079 releases; waiting 280 ms; commit 1436 ms)
2026-11-07T15:34:51Z [load_day 2023-02-14] 2023-02-14 hour 14: 205599 events in 5 files, snapshot 4269514377588186175 (task 17452 ms: download 9600 ms overlapping gunzip 1082 ms, parse 4667 ms, sort 129 ms, write 10148 ms, index 614 ms: 2 candidates, 90250 repo-hours, 1060 releases; waiting 514 ms; commit 1367 ms)
2026-11-07T15:35:01Z [load_day 2023-02-14] 2023-02-14 hour 15: 223866 events in 5 files, snapshot 3773008739528553477 (task 18902 ms: download 12760 ms overlapping gunzip 1229 ms, parse 5226 ms, sort 143 ms, write 10978 ms, index 622 ms: 2 candidates, 96524 repo-hours, 1325 releases; waiting 393 ms; commit 1307 ms)
2026-11-07T15:35:11Z [load_day 2023-02-14] 2023-02-14 hour 16: 210247 events in 5 files, snapshot 5157714790018829264 (task 18933 ms: download 13268 ms overlapping gunzip 1165 ms, parse 4948 ms, sort 132 ms, write 10645 ms, index 615 ms: 0 candidates, 92251 repo-hours, 1155 releases; waiting 1094 ms; commit 1550 ms)
2026-11-07T15:35:19Z [load_day 2023-02-14] 2023-02-14 hour 17: 205533 events in 5 files, snapshot 8589273716547568490 (task 17398 ms: download 9909 ms overlapping gunzip 1064 ms, parse 4577 ms, sort 132 ms, write 9693 ms, index 584 ms: 4 candidates, 86149 repo-hours, 994 releases; waiting 957 ms; commit 1351 ms)
2026-11-07T15:35:28Z [load_day 2023-02-14] 2023-02-14 hour 18: 201745 events in 5 files, snapshot 896462188746175452 (task 16630 ms: download 9197 ms overlapping gunzip 1003 ms, parse 4402 ms, sort 136 ms, write 9574 ms, index 578 ms: 5 candidates, 87169 repo-hours, 1035 releases; waiting 626 ms; commit 1431 ms)
2026-11-07T15:35:35Z [load_day 2023-02-14] 2023-02-14 hour 19: 193940 events in 4 files, snapshot 4516792684787666417 (task 15538 ms: download 8819 ms overlapping gunzip 965 ms, parse 4266 ms, sort 136 ms, write 8863 ms, index 509 ms: 6 candidates, 78151 repo-hours, 1095 releases; waiting 519 ms; commit 1406 ms)
2026-11-07T15:35:46Z [load_day 2023-02-14] 2023-02-14 hour 20: 183912 events in 4 files, snapshot 2779271053839533563 (task 17064 ms: download 10700 ms overlapping gunzip 932 ms, parse 4109 ms, sort 147 ms, write 8025 ms, index 506 ms: 5 candidates, 75252 repo-hours, 1021 releases; waiting 2920 ms; commit 1597 ms)
2026-11-07T15:35:51Z [load_day 2023-02-14] 2023-02-14 hour 21: 177787 events in 4 files, snapshot 5500118123447687990 (task 15202 ms: download 8912 ms overlapping gunzip 910 ms, parse 3974 ms, sort 103 ms, write 8499 ms, index 497 ms: 6 candidates, 69849 repo-hours, 1014 releases; waiting 914 ms; commit 1341 ms)
2026-11-07T15:36:03Z [load_day 2023-02-14] 2023-02-14 hour 22: 179315 events in 4 files, snapshot 8574594885379237541 (task 15928 ms: download 9806 ms overlapping gunzip 1080 ms, parse 4355 ms, sort 111 ms, write 9171 ms, index 452 ms: 4 candidates, 66019 repo-hours, 886 releases; waiting 528 ms; commit 1410 ms)
2026-11-07T15:36:04Z [load_day 2023-02-14] 2023-02-14 hour 23: 152961 events in 4 files, snapshot 8388226983747145052 (task 12383 ms: download 5398 ms overlapping gunzip 750 ms, parse 3253 ms, sort 100 ms, write 7013 ms, index 418 ms: 4 candidates, 60161 repo-hours, 674 releases; waiting 523 ms; commit 1417 ms)
2026-11-07T15:36:12Z [load_day 2023-02-14] 2023-02-14: repo_hour merged from 24 files to 1 (1915637 rows, 7988 ms)
2026-11-07T15:36:14Z [load_day 2023-02-14] 2023-02-14: index committed in 9883 ms (23 + 1 + 24 files)
2026-11-07T15:36:14Z [load_day 2023-02-14] 2023-02-14: 4450956 events in 24 hours
2026-11-07T15:36:14Z [load_day 2023-02-14] attempt 1 succeeded