orcaLog in

Runs · run 146

load_day 2026-09-30, attempt 1 succeeded

Host
4e84322b8c45:25115
Started
2026-11-07T03:46:03Z
Ended
2026-11-07T03:47:03Z
Log file
s3://census-mlake-dev/logs/gharchive/146/load_day/2026-09-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:46:03Z [load_day 2026-09-30] attempt 1 started
2026-11-07T03:46:09Z [load_day 2026-09-30] 2026-09-30 hour 0: 46643 events in 1 files, snapshot 7600563755688367746 (task 3824 ms: download 1449 ms overlapping gunzip 238 ms, parse 766 ms, sort 77 ms, write 1634 ms, index 233 ms: 4 candidates, 28179 repo-hours, 510 releases; waiting 555 ms; commit 760 ms)
2026-11-07T03:46:10Z [load_day 2026-09-30] 2026-09-30 hour 1: 53538 events in 2 files, snapshot 3948987530892490862 (task 5248 ms: download 2480 ms overlapping gunzip 352 ms, parse 1098 ms, sort 105 ms, write 1980 ms, index 205 ms: 4 candidates, 31296 repo-hours, 691 releases; waiting 1242 ms; commit 704 ms)
2026-11-07T03:46:14Z [load_day 2026-09-30] 2026-09-30 hour 2: 53890 events in 2 files, snapshot 672688896875927589 (task 4614 ms: download 1553 ms overlapping gunzip 260 ms, parse 739 ms, sort 49 ms, write 2019 ms, index 218 ms: 3 candidates, 32499 repo-hours, 625 releases; waiting 679 ms; commit 556 ms)
2026-11-07T03:46:15Z [load_day 2026-09-30] 2026-09-30 hour 3: 57049 events in 2 files, snapshot 463708791102413370 (task 3764 ms: download 1391 ms overlapping gunzip 271 ms, parse 810 ms, sort 51 ms, write 1614 ms, index 229 ms: 8 candidates, 35031 repo-hours, 479 releases; waiting 543 ms; commit 611 ms)
2026-11-07T03:46:18Z [load_day 2026-09-30] 2026-09-30 hour 4: 54903 events in 2 files, snapshot 7204938540342598938 (task 3840 ms: download 1651 ms overlapping gunzip 200 ms, parse 593 ms, sort 50 ms, write 1544 ms, index 228 ms: 2 candidates, 34541 repo-hours, 521 releases; waiting 920 ms; commit 616 ms)
2026-11-07T03:46:19Z [load_day 2026-09-30] 2026-09-30 hour 5: 55485 events in 2 files, snapshot 7940422525879553932 (task 3512 ms: download 1467 ms overlapping gunzip 239 ms, parse 653 ms, sort 47 ms, write 1407 ms, index 227 ms: 2 candidates, 34847 repo-hours, 426 releases; waiting 592 ms; commit 697 ms)
2026-11-07T03:46:22Z [load_day 2026-09-30] 2026-09-30 hour 6: 55263 events in 2 files, snapshot 5498085432228346372 (task 3664 ms: download 1548 ms overlapping gunzip 192 ms, parse 570 ms, sort 89 ms, write 1478 ms, index 233 ms: 3 candidates, 35303 repo-hours, 414 releases; waiting 855 ms; commit 582 ms)
2026-11-07T03:46:23Z [load_day 2026-09-30] 2026-09-30 hour 7: 48683 events in 1 files, snapshot 269653321756607199 (task 3073 ms: download 1346 ms overlapping gunzip 186 ms, parse 577 ms, sort 39 ms, write 1122 ms, index 210 ms: 2 candidates, 31451 repo-hours, 404 releases; waiting 625 ms; commit 762 ms)
2026-11-07T03:46:26Z [load_day 2026-09-30] 2026-09-30 hour 8: 45470 events in 1 files, snapshot 3924433673365737480 (task 2967 ms: download 978 ms overlapping gunzip 166 ms, parse 530 ms, sort 36 ms, write 1249 ms, index 200 ms: 6 candidates, 31023 repo-hours, 360 releases; waiting 536 ms; commit 857 ms)
2026-11-07T03:46:27Z [load_day 2026-09-30] 2026-09-30 hour 9: 45003 events in 1 files, snapshot 5589364846519225806 (task 2515 ms: download 712 ms overlapping gunzip 121 ms, parse 375 ms, sort 36 ms, write 1125 ms, index 199 ms: 4 candidates, 30579 repo-hours, 263 releases; waiting 329 ms; commit 605 ms)
2026-11-07T03:46:29Z [load_day 2026-09-30] 2026-09-30 hour 10: 46576 events in 1 files, snapshot 5875607723731464993 (task 2448 ms: download 946 ms overlapping gunzip 128 ms, parse 383 ms, sort 33 ms, write 867 ms, index 219 ms: 2 candidates, 32584 repo-hours, 274 releases; waiting 543 ms; commit 649 ms)
2026-11-07T03:46:30Z [load_day 2026-09-30] 2026-09-30 hour 11: 48723 events in 1 files, snapshot 1363840746036186992 (task 2744 ms: download 1056 ms overlapping gunzip 143 ms, parse 468 ms, sort 38 ms, write 1014 ms, index 223 ms: 6 candidates, 35028 repo-hours, 295 releases; waiting 555 ms; commit 731 ms)
2026-11-07T03:46:33Z [load_day 2026-09-30] 2026-09-30 hour 12: 51451 events in 2 files, snapshot 6608846604959218325 (task 2903 ms: download 1149 ms overlapping gunzip 167 ms, parse 512 ms, sort 42 ms, write 1072 ms, index 261 ms: 4 candidates, 37838 repo-hours, 320 releases; waiting 567 ms; commit 707 ms)
2026-11-07T03:46:36Z [load_day 2026-09-30] 2026-09-30 hour 13: 52494 events in 2 files, snapshot 4866799024804209675 (task 4140 ms: download 1893 ms overlapping gunzip 164 ms, parse 486 ms, sort 40 ms, write 1322 ms, index 295 ms: 3 candidates, 39355 repo-hours, 291 releases; waiting 1279 ms; commit 1346 ms)
2026-11-07T03:46:36Z [load_day 2026-09-30] 2026-09-30 hour 14: 52505 events in 2 files, snapshot 2760328971007513528 (task 3099 ms: download 1082 ms overlapping gunzip 182 ms, parse 542 ms, sort 63 ms, write 1365 ms, index 253 ms: 7 candidates, 39547 repo-hours, 509 releases; waiting 413 ms; commit 549 ms)
2026-11-07T03:46:40Z [load_day 2026-09-30] 2026-09-30 hour 15: 56625 events in 2 files, snapshot 2575193516811154053 (task 4442 ms: download 1585 ms overlapping gunzip 275 ms, parse 795 ms, sort 87 ms, write 2013 ms, index 262 ms: 5 candidates, 39324 repo-hours, 662 releases; waiting 725 ms; commit 707 ms)
2026-11-07T03:46:41Z [load_day 2026-09-30] 2026-09-30 hour 16: 56407 events in 2 files, snapshot 503363694693926970 (task 4157 ms: download 1297 ms overlapping gunzip 307 ms, parse 867 ms, sort 79 ms, write 1840 ms, index 249 ms: 6 candidates, 38533 repo-hours, 621 releases; waiting 568 ms; commit 682 ms)
2026-11-07T03:46:44Z [load_day 2026-09-30] 2026-09-30 hour 17: 55966 events in 2 files, snapshot 2022854909721028330 (task 3680 ms: download 936 ms overlapping gunzip 246 ms, parse 696 ms, sort 49 ms, write 1827 ms, index 344 ms: 3 candidates, 38792 repo-hours, 608 releases; waiting 217 ms; commit 611 ms)
2026-11-07T03:46:45Z [load_day 2026-09-30] 2026-09-30 hour 18: 51393 events in 2 files, snapshot 584652959978436189 (task 3730 ms: download 1486 ms overlapping gunzip 238 ms, parse 667 ms, sort 48 ms, write 1624 ms, index 221 ms: 11 candidates, 34924 repo-hours, 441 releases; waiting 670 ms; commit 489 ms)
2026-11-07T03:46:49Z [load_day 2026-09-30] 2026-09-30 hour 19: 51377 events in 2 files, snapshot 1861854094643858520 (task 4153 ms: download 1761 ms overlapping gunzip 216 ms, parse 620 ms, sort 46 ms, write 1782 ms, index 242 ms: 4 candidates, 34536 repo-hours, 431 releases; waiting 951 ms; commit 564 ms)
2026-11-07T03:46:49Z [load_day 2026-09-30] 2026-09-30 hour 20: 52626 events in 2 files, snapshot 4486815356820090606 (task 3445 ms: download 1288 ms overlapping gunzip 217 ms, parse 611 ms, sort 46 ms, write 1479 ms, index 217 ms: 5 candidates, 34021 repo-hours, 399 releases; waiting 549 ms; commit 576 ms)
2026-11-07T03:46:53Z [load_day 2026-09-30] 2026-09-30 hour 21: 52209 events in 2 files, snapshot 1795172574100217469 (task 3647 ms: download 1448 ms overlapping gunzip 209 ms, parse 623 ms, sort 48 ms, write 1525 ms, index 231 ms: 4 candidates, 33048 repo-hours, 436 releases; waiting 671 ms; commit 583 ms)
2026-11-07T03:46:54Z [load_day 2026-09-30] 2026-09-30 hour 22: 56274 events in 2 files, snapshot 3869198691654133051 (task 3829 ms: download 1684 ms overlapping gunzip 238 ms, parse 725 ms, sort 49 ms, write 1477 ms, index 217 ms: 6 candidates, 33582 repo-hours, 408 releases; waiting 808 ms; commit 741 ms)
2026-11-07T03:46:57Z [load_day 2026-09-30] 2026-09-30 hour 23: 55289 events in 2 files, snapshot 2521665598038168883 (task 3530 ms: download 1374 ms overlapping gunzip 213 ms, parse 646 ms, sort 73 ms, write 1455 ms, index 233 ms: 4 candidates, 31862 repo-hours, 381 releases; waiting 583 ms; commit 759 ms)
2026-11-07T03:47:01Z [load_day 2026-09-30] 2026-09-30: repo_hour merged from 24 files to 1 (827723 rows, 4007 ms)
2026-11-07T03:47:03Z [load_day 2026-09-30] 2026-09-30: index committed in 5855 ms (24 + 1 + 24 files)
2026-11-07T03:47:03Z [load_day 2026-09-30] 2026-09-30: 1255842 events in 24 hours
2026-11-07T03:47:03Z [load_day 2026-09-30] attempt 1 succeeded