orcaLog in

Runs · run 996

load_day 2023-04-14, attempt 1 succeeded

Host
caf251265124:268164
Started
2026-11-07T18:38:50Z
Ended
2026-11-07T18:41:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/996/load_day/2023-04-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:38:50Z [load_day 2023-04-14] attempt 1 started
2026-11-07T18:38:51Z [load_day 2023-04-14] 2023-04-14: 2 hours in flight, about 1200 MB
2026-11-07T18:39:04Z [load_day 2023-04-14] 2023-04-14 hour 0: 152257 events in 4 files, snapshot 483179558182293050 (task 10901 ms: download 4609 ms overlapping gunzip 610 ms, parse 2832 ms, sort 95 ms, write 6063 ms, index 488 ms: 4 candidates, 77008 repo-hours, 863 releases; waiting 527 ms; commit 1479 ms)
2026-11-07T18:39:06Z [load_day 2023-04-14] 2023-04-14 hour 1: 176862 events in 4 files, snapshot 2987969968990395565 (task 12616 ms: download 5133 ms overlapping gunzip 767 ms, parse 3428 ms, sort 115 ms, write 7143 ms, index 567 ms: 5 candidates, 90157 repo-hours, 786 releases; waiting 293 ms; commit 1579 ms)
2026-11-07T18:39:16Z [load_day 2023-04-14] 2023-04-14 hour 2: 146010 events in 3 files, snapshot 3424712881600050370 (task 10457 ms: download 4255 ms overlapping gunzip 604 ms, parse 2599 ms, sort 87 ms, write 5924 ms, index 448 ms: 6 candidates, 66117 repo-hours, 849 releases; waiting 500 ms; commit 1635 ms)
2026-11-07T18:39:17Z [load_day 2023-04-14] 2023-04-14 hour 3: 136918 events in 3 files, snapshot 930339943980059307 (task 9914 ms: download 4093 ms overlapping gunzip 572 ms, parse 2466 ms, sort 98 ms, write 5490 ms, index 380 ms: 4 candidates, 60741 repo-hours, 897 releases; waiting 577 ms; commit 1469 ms)
2026-11-07T18:39:26Z [load_day 2023-04-14] 2023-04-14 hour 4: 125882 events in 3 files, snapshot 7108087790599518650 (task 9001 ms: download 1955 ms overlapping gunzip 540 ms, parse 2339 ms, sort 85 ms, write 5053 ms, index 349 ms: 5 candidates, 54498 repo-hours, 738 releases; waiting 218 ms; commit 1676 ms)
2026-11-07T18:39:29Z [load_day 2023-04-14] 2023-04-14 hour 5: 140745 events in 3 files, snapshot 6778604831407915063 (task 10695 ms: download 4427 ms overlapping gunzip 665 ms, parse 2842 ms, sort 96 ms, write 5809 ms, index 442 ms: 3 candidates, 61323 repo-hours, 839 releases; waiting 539 ms; commit 1630 ms)
2026-11-07T18:39:39Z [load_day 2023-04-14] 2023-04-14 hour 6: 172297 events in 4 files, snapshot 8238499457100141366 (task 12771 ms: download 7110 ms overlapping gunzip 755 ms, parse 3311 ms, sort 102 ms, write 7261 ms, index 556 ms: 6 candidates, 77649 repo-hours, 989 releases; waiting 541 ms; commit 1893 ms)
2026-11-07T18:39:43Z [load_day 2023-04-14] 2023-04-14 hour 7: 163540 events in 4 files, snapshot 4799367402913074083 (task 13254 ms: download 5474 ms overlapping gunzip 799 ms, parse 3345 ms, sort 104 ms, write 7571 ms, index 462 ms: 4 candidates, 74038 repo-hours, 921 releases; waiting 621 ms; commit 1536 ms)
2026-11-07T18:39:54Z [load_day 2023-04-14] 2023-04-14 hour 8: 167525 events in 4 files, snapshot 927875458258177986 (task 14205 ms: download 8438 ms overlapping gunzip 838 ms, parse 3642 ms, sort 102 ms, write 8035 ms, index 548 ms: 6 candidates, 78663 repo-hours, 929 releases; waiting 735 ms; commit 1474 ms)
2026-11-07T18:40:00Z [load_day 2023-04-14] 2023-04-14 hour 9: 190821 events in 4 files, snapshot 6060345799026183809 (task 16523 ms: download 8926 ms overlapping gunzip 1011 ms, parse 4256 ms, sort 136 ms, write 9717 ms, index 569 ms: 7 candidates, 83245 repo-hours, 1121 releases; waiting 526 ms; commit 1638 ms)
2026-11-07T18:40:10Z [load_day 2023-04-14] 2023-04-14 hour 10: 179588 events in 4 files, snapshot 2942175555845938521 (task 15008 ms: download 8555 ms overlapping gunzip 860 ms, parse 3777 ms, sort 122 ms, write 8475 ms, index 623 ms: 3 candidates, 80076 repo-hours, 1051 releases; waiting 848 ms; commit 2097 ms)
2026-11-07T18:40:16Z [load_day 2023-04-14] 2023-04-14 hour 11: 183625 events in 4 files, snapshot 5765218036126911515 (task 14662 ms: download 8256 ms overlapping gunzip 871 ms, parse 3790 ms, sort 126 ms, write 8440 ms, index 569 ms: 3 candidates, 79011 repo-hours, 993 releases; waiting 513 ms; commit 1765 ms)
2026-11-07T18:40:27Z [load_day 2023-04-14] 2023-04-14 hour 12: 235244 events in 5 files, snapshot 3911288030428482444 (task 16637 ms: download 10492 ms overlapping gunzip 934 ms, parse 4131 ms, sort 133 ms, write 9891 ms, index 751 ms: 6 candidates, 110560 repo-hours, 1088 releases; waiting 526 ms; commit 1562 ms)
2026-11-07T18:40:33Z [load_day 2023-04-14] 2023-04-14 hour 13: 205857 events in 5 files, snapshot 1208221574033172511 (task 16916 ms: download 9018 ms overlapping gunzip 953 ms, parse 4259 ms, sort 131 ms, write 10009 ms, index 652 ms: 6 candidates, 102158 repo-hours, 1158 releases; waiting 573 ms; commit 1456 ms)
2026-11-07T18:40:44Z [load_day 2023-04-14] 2023-04-14 hour 14: 196024 events in 4 files, snapshot 2597753191269176930 (task 16565 ms: download 8952 ms overlapping gunzip 953 ms, parse 4296 ms, sort 126 ms, write 9890 ms, index 617 ms: 6 candidates, 90591 repo-hours, 1310 releases; waiting 382 ms; commit 1422 ms)
2026-11-07T18:40:51Z [load_day 2023-04-14] 2023-04-14 hour 15: 177201 events in 4 files, snapshot 4647216941935538891 (task 16556 ms: download 10204 ms overlapping gunzip 890 ms, parse 3881 ms, sort 114 ms, write 8506 ms, index 567 ms: 3 candidates, 84495 repo-hours, 1161 releases; waiting 2327 ms; commit 1608 ms)
2026-11-07T18:41:00Z [load_day 2023-04-14] 2023-04-14 hour 16: 178928 events in 4 files, snapshot 1283735219272871830 (task 15171 ms: download 8598 ms overlapping gunzip 894 ms, parse 3849 ms, sort 110 ms, write 8857 ms, index 553 ms: 4 candidates, 81888 repo-hours, 1131 releases; waiting 669 ms; commit 1489 ms)
2026-11-07T18:41:11Z [load_day 2023-04-14] 2023-04-14 hour 17: 193587 events in 4 files, snapshot 3439070436634734743 (task 19553 ms: download 11460 ms overlapping gunzip 1142 ms, parse 4953 ms, sort 138 ms, write 10179 ms, index 622 ms: 5 candidates, 85393 repo-hours, 928 releases; waiting 2106 ms; commit 1613 ms)
2026-11-07T18:41:16Z [load_day 2023-04-14] 2023-04-14 hour 18: 183733 events in 4 files, snapshot 3884010863640609816 (task 14876 ms: download 8279 ms overlapping gunzip 893 ms, parse 4042 ms, sort 115 ms, write 8508 ms, index 559 ms: 5 candidates, 82745 repo-hours, 953 releases; waiting 529 ms; commit 1653 ms)
2026-11-07T18:41:25Z [load_day 2023-04-14] 2023-04-14 hour 19: 170097 events in 4 files, snapshot 3325450285806011423 (task 13464 ms: download 7760 ms overlapping gunzip 771 ms, parse 3538 ms, sort 111 ms, write 8012 ms, index 477 ms: 3 candidates, 71370 repo-hours, 1160 releases; waiting 273 ms; commit 1606 ms)
2026-11-07T18:41:30Z [load_day 2023-04-14] 2023-04-14 hour 20: 164727 events in 4 files, snapshot 3234262185088235623 (task 12770 ms: download 7294 ms overlapping gunzip 770 ms, parse 3312 ms, sort 103 ms, write 7609 ms, index 476 ms: 2 candidates, 68768 repo-hours, 954 releases; waiting 233 ms; commit 1551 ms)
2026-11-07T18:41:38Z [load_day 2023-04-14] 2023-04-14 hour 21: 151422 events in 4 files, snapshot 844073025726177141 (task 11533 ms: download 4600 ms overlapping gunzip 703 ms, parse 3064 ms, sort 111 ms, write 6776 ms, index 412 ms: 3 candidates, 60730 repo-hours, 1000 releases; waiting 193 ms; commit 1544 ms)
2026-11-07T18:41:42Z [load_day 2023-04-14] 2023-04-14 hour 22: 135410 events in 3 files, snapshot 8409015477768485941 (task 11154 ms: download 5142 ms overlapping gunzip 669 ms, parse 2831 ms, sort 88 ms, write 6042 ms, index 353 ms: 7 candidates, 54157 repo-hours, 828 releases; waiting 826 ms; commit 1593 ms)
2026-11-07T18:41:48Z [load_day 2023-04-14] 2023-04-14 hour 23: 118912 events in 3 files, snapshot 6008437911476370550 (task 9348 ms: download 4190 ms overlapping gunzip 554 ms, parse 2425 ms, sort 78 ms, write 5109 ms, index 343 ms: 2 candidates, 49358 repo-hours, 653 releases; waiting 546 ms; commit 1539 ms)
2026-11-07T18:41:56Z [load_day 2023-04-14] 2023-04-14: repo_hour merged from 24 files to 1 (1824739 rows, 7862 ms)
2026-11-07T18:41:58Z [load_day 2023-04-14] 2023-04-14: index committed in 9986 ms (24 + 1 + 24 files)
2026-11-07T18:41:58Z [load_day 2023-04-14] 2023-04-14: 4047212 events in 24 hours
2026-11-07T18:41:58Z [load_day 2023-04-14] attempt 1 succeeded