orcaLog in

Runs · run 1629

load_day 2023-10-16, attempt 1 succeeded

Host
3c2b29713ce8:441830
Started
2026-11-08T01:49:11Z
Ended
2026-11-08T01:53:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1629/load_day/2023-10-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:49:11Z [load_day 2023-10-16] attempt 1 started
2026-11-08T01:49:12Z [load_day 2023-10-16] 2023-10-16: 2 hours in flight, about 1200 MB
2026-11-08T01:49:31Z [load_day 2023-10-16] 2023-10-16 hour 0: 154613 events in 4 files, snapshot 7175692972632894341 (task 13638 ms: download 5682 ms overlapping gunzip 757 ms, parse 3297 ms, sort 89 ms, write 8085 ms, index 625 ms: 8 candidates, 83670 repo-hours, 856 releases; waiting 516 ms; commit 3451 ms)
2026-11-08T01:49:37Z [load_day 2023-10-16] 2023-10-16 hour 1: 167392 events in 4 files, snapshot 3148395163748181961 (task 15354 ms: download 6806 ms overlapping gunzip 1047 ms, parse 4465 ms, sort 134 ms, write 8145 ms, index 748 ms: 5 candidates, 90922 repo-hours, 790 releases; waiting 495 ms; commit 5804 ms)
2026-11-08T01:49:47Z [load_day 2023-10-16] 2023-10-16 hour 2: 139272 events in 3 files, snapshot 7471366409145725604 (task 14195 ms: download 6419 ms overlapping gunzip 861 ms, parse 3637 ms, sort 93 ms, write 8342 ms, index 413 ms: 7 candidates, 59789 repo-hours, 734 releases; waiting 560 ms; commit 3772 ms)
2026-11-08T01:49:49Z [load_day 2023-10-16] 2023-10-16 hour 3: 138500 events in 3 files, snapshot 970816723336703070 (task 13989 ms: download 5876 ms overlapping gunzip 835 ms, parse 3499 ms, sort 105 ms, write 8061 ms, index 743 ms: 4 candidates, 58790 repo-hours, 935 releases; waiting 519 ms; commit 2598 ms)
2026-11-08T01:50:03Z [load_day 2023-10-16] 2023-10-16 hour 4: 136568 events in 3 files, snapshot 7728239723723033845 (task 15985 ms: download 6878 ms overlapping gunzip 1261 ms, parse 5049 ms, sort 147 ms, write 8254 ms, index 454 ms: 3 candidates, 55250 repo-hours, 672 releases; waiting 499 ms; commit 2946 ms)
2026-11-08T01:50:08Z [load_day 2023-10-16] 2023-10-16 hour 5: 143584 events in 3 files, snapshot 7931102155944143521 (task 16644 ms: download 7697 ms overlapping gunzip 976 ms, parse 4017 ms, sort 105 ms, write 10036 ms, index 645 ms: 4 candidates, 61391 repo-hours, 701 releases; waiting 549 ms; commit 3769 ms)
2026-11-08T01:50:25Z [load_day 2023-10-16] 2023-10-16 hour 6: 175664 events in 4 files, snapshot 1633619253534054415 (task 20528 ms: download 12062 ms overlapping gunzip 1324 ms, parse 5640 ms, sort 166 ms, write 11959 ms, index 630 ms: 2 candidates, 79440 repo-hours, 876 releases; waiting 543 ms; commit 2969 ms)
2026-11-08T01:50:30Z [load_day 2023-10-16] 2023-10-16 hour 7: 177177 events in 4 files, snapshot 8604316525428045050 (task 20927 ms: download 12212 ms overlapping gunzip 1182 ms, parse 5085 ms, sort 198 ms, write 13024 ms, index 700 ms: 4 candidates, 78208 repo-hours, 897 releases; waiting 482 ms; commit 2625 ms)
2026-11-08T01:50:47Z [load_day 2023-10-16] 2023-10-16 hour 8: 181148 events in 4 files, snapshot 886239099843954272 (task 21732 ms: download 12939 ms overlapping gunzip 1462 ms, parse 6242 ms, sort 126 ms, write 12264 ms, index 741 ms: 11 candidates, 83186 repo-hours, 945 releases; waiting 571 ms; commit 2528 ms)
2026-11-08T01:50:55Z [load_day 2023-10-16] 2023-10-16 hour 9: 207038 events in 5 files, snapshot 7814550085437087946 (task 24008 ms: download 13501 ms overlapping gunzip 1515 ms, parse 6923 ms, sort 250 ms, write 13927 ms, index 581 ms: 5 candidates, 88032 repo-hours, 1331 releases; waiting 495 ms; commit 2956 ms)
2026-11-08T01:51:12Z [load_day 2023-10-16] 2023-10-16 hour 10: 196739 events in 4 files, snapshot 1975697532040065608 (task 23062 ms: download 13107 ms overlapping gunzip 1392 ms, parse 5966 ms, sort 236 ms, write 13990 ms, index 680 ms: 8 candidates, 84174 repo-hours, 1221 releases; waiting 504 ms; commit 3921 ms)
2026-11-08T01:51:19Z [load_day 2023-10-16] 2023-10-16 hour 11: 194415 events in 4 files, snapshot 1350578841444053391 (task 23083 ms: download 13700 ms overlapping gunzip 1426 ms, parse 6368 ms, sort 140 ms, write 13391 ms, index 981 ms: 10 candidates, 82535 repo-hours, 1111 releases; waiting 550 ms; commit 2609 ms)
2026-11-08T01:51:35Z [load_day 2023-10-16] 2023-10-16 hour 12: 245378 events in 5 files, snapshot 8254275519826731361 (task 22638 ms: download 14940 ms overlapping gunzip 1399 ms, parse 6410 ms, sort 217 ms, write 13414 ms, index 737 ms: 9 candidates, 115702 repo-hours, 1093 releases; waiting 178 ms; commit 2480 ms)
2026-11-08T01:51:43Z [load_day 2023-10-16] 2023-10-16 hour 13: 226426 events in 5 files, snapshot 4414021366351515367 (task 22798 ms: download 15235 ms overlapping gunzip 1260 ms, parse 5425 ms, sort 207 ms, write 14044 ms, index 802 ms: 14 candidates, 111848 repo-hours, 1169 releases; waiting 532 ms; commit 2383 ms)
2026-11-08T01:52:01Z [load_day 2023-10-16] 2023-10-16 hour 14: 216729 events in 5 files, snapshot 5271895030336902675 (task 25322 ms: download 16864 ms overlapping gunzip 1600 ms, parse 6699 ms, sort 214 ms, write 15484 ms, index 785 ms: 11 candidates, 98661 repo-hours, 1197 releases; waiting 302 ms; commit 2468 ms)
2026-11-08T01:52:10Z [load_day 2023-10-16] 2023-10-16 hour 15: 187000 events in 4 files, snapshot 1006493666305129992 (task 23241 ms: download 14190 ms overlapping gunzip 1241 ms, parse 5199 ms, sort 149 ms, write 14848 ms, index 792 ms: 10 candidates, 89108 repo-hours, 1123 releases; waiting 671 ms; commit 5006 ms)
2026-11-08T01:52:27Z [load_day 2023-10-16] 2023-10-16 hour 16: 189883 events in 4 files, snapshot 8132753993891826766 (task 23817 ms: download 14002 ms overlapping gunzip 1348 ms, parse 5817 ms, sort 178 ms, write 15017 ms, index 674 ms: 8 candidates, 88456 repo-hours, 1035 releases; waiting 530 ms; commit 3057 ms)
2026-11-08T01:52:32Z [load_day 2023-10-16] 2023-10-16 hour 17: 193319 events in 4 files, snapshot 4732723714665283463 (task 23733 ms: download 13491 ms overlapping gunzip 1483 ms, parse 6347 ms, sort 156 ms, write 14261 ms, index 678 ms: 9 candidates, 84691 repo-hours, 998 releases; waiting 503 ms; commit 2407 ms)
2026-11-08T01:52:50Z [load_day 2023-10-16] 2023-10-16 hour 18: 199849 events in 4 files, snapshot 6452834342612039960 (task 22680 ms: download 12604 ms overlapping gunzip 1278 ms, parse 5433 ms, sort 170 ms, write 14173 ms, index 812 ms: 5 candidates, 90954 repo-hours, 1000 releases; waiting 529 ms; commit 2696 ms)
2026-11-08T01:52:57Z [load_day 2023-10-16] 2023-10-16 hour 19: 192944 events in 4 files, snapshot 8019266691781896751 (task 23098 ms: download 13344 ms overlapping gunzip 1273 ms, parse 5420 ms, sort 166 ms, write 14749 ms, index 661 ms: 5 candidates, 82593 repo-hours, 1087 releases; waiting 584 ms; commit 2892 ms)
2026-11-08T01:53:14Z [load_day 2023-10-16] 2023-10-16 hour 20: 186623 events in 4 files, snapshot 6078944013122950776 (task 22520 ms: download 12931 ms overlapping gunzip 1357 ms, parse 5776 ms, sort 200 ms, write 13492 ms, index 729 ms: 11 candidates, 78233 repo-hours, 968 releases; waiting 562 ms; commit 2678 ms)
2026-11-08T01:53:21Z [load_day 2023-10-16] 2023-10-16 hour 21: 170379 events in 4 files, snapshot 8195453853486839778 (task 20598 ms: download 13192 ms overlapping gunzip 1464 ms, parse 6186 ms, sort 151 ms, write 11214 ms, index 733 ms: 12 candidates, 67915 repo-hours, 1004 releases; waiting 486 ms; commit 4821 ms)
2026-11-08T01:53:34Z [load_day 2023-10-16] 2023-10-16 hour 22: 157030 events in 4 files, snapshot 8163274370333434830 (task 19522 ms: download 12664 ms overlapping gunzip 1362 ms, parse 5609 ms, sort 157 ms, write 11122 ms, index 477 ms: 6 candidates, 61509 repo-hours, 994 releases; waiting 523 ms; commit 2493 ms)
2026-11-08T01:53:37Z [load_day 2023-10-16] 2023-10-16 hour 23: 142970 events in 3 files, snapshot 1927422337007538565 (task 16551 ms: download 7776 ms overlapping gunzip 930 ms, parse 4104 ms, sort 98 ms, write 10190 ms, index 461 ms: 3 candidates, 57352 repo-hours, 899 releases; waiting 522 ms; commit 2449 ms)
2026-11-08T01:53:45Z [load_day 2023-10-16] 2023-10-16: repo_hour merged from 24 files to 1 (1932409 rows, 8567 ms)
2026-11-08T01:53:48Z [load_day 2023-10-16] 2023-10-16: index committed in 10913 ms (24 + 1 + 24 files)
2026-11-08T01:53:48Z [load_day 2023-10-16] 2023-10-16: 4320640 events in 24 hours
2026-11-08T01:53:48Z [load_day 2023-10-16] attempt 1 succeeded