orcaLog in

Runs · run 1623

load_day 2023-10-14, attempt 1 succeeded

Host
3c2b29713ce8:437212
Started
2026-11-08T01:46:29Z
Ended
2026-11-08T01:49:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1623/load_day/2023-10-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:46:29Z [load_day 2023-10-14] attempt 1 started
2026-11-08T01:46:31Z [load_day 2023-10-14] 2023-10-14: 2 hours in flight, about 1200 MB
2026-11-08T01:46:47Z [load_day 2023-10-14] 2023-10-14 hour 0: 135073 events in 3 files, snapshot 7480218918728342139 (task 12270 ms: download 2436 ms overlapping gunzip 696 ms, parse 3518 ms, sort 134 ms, write 6514 ms, index 581 ms: 9 candidates, 75185 repo-hours, 898 releases; waiting 512 ms; commit 2527 ms)
2026-11-08T01:46:51Z [load_day 2023-10-14] 2023-10-14 hour 1: 133241 events in 3 files, snapshot 8803950783683366621 (task 11451 ms: download 2379 ms overlapping gunzip 569 ms, parse 2671 ms, sort 150 ms, write 6538 ms, index 759 ms: 2 candidates, 74525 repo-hours, 785 releases; waiting 498 ms; commit 3125 ms)
2026-11-08T01:46:58Z [load_day 2023-10-14] 2023-10-14 hour 2: 102934 events in 3 files, snapshot 9008724604387032531 (task 9122 ms: download 2573 ms overlapping gunzip 512 ms, parse 2201 ms, sort 154 ms, write 4739 ms, index 450 ms: 3 candidates, 42946 repo-hours, 583 releases; waiting 696 ms; commit 2466 ms)
2026-11-08T01:47:02Z [load_day 2023-10-14] 2023-10-14 hour 3: 103025 events in 3 files, snapshot 8884482051125883243 (task 8290 ms: download 1566 ms overlapping gunzip 494 ms, parse 2249 ms, sort 73 ms, write 4714 ms, index 335 ms: 0 candidates, 43011 repo-hours, 793 releases; waiting 187 ms; commit 4659 ms)
2026-11-08T01:47:10Z [load_day 2023-10-14] 2023-10-14 hour 4: 104852 events in 3 files, snapshot 3017740578431936083 (task 8109 ms: download 1829 ms overlapping gunzip 446 ms, parse 1920 ms, sort 69 ms, write 4926 ms, index 298 ms: 2 candidates, 42222 repo-hours, 532 releases; waiting 192 ms; commit 5685 ms)
2026-11-08T01:47:13Z [load_day 2023-10-14] 2023-10-14 hour 5: 107241 events in 3 files, snapshot 1550905264098047396 (task 9943 ms: download 2283 ms overlapping gunzip 623 ms, parse 2678 ms, sort 73 ms, write 5307 ms, index 366 ms: 4 candidates, 45944 repo-hours, 484 releases; waiting 532 ms; commit 2746 ms)
2026-11-08T01:47:19Z [load_day 2023-10-14] 2023-10-14 hour 6: 121896 events in 3 files, snapshot 4567475546479138805 (task 10954 ms: download 2391 ms overlapping gunzip 626 ms, parse 2753 ms, sort 83 ms, write 6379 ms, index 341 ms: 9 candidates, 54780 repo-hours, 657 releases; waiting 517 ms; commit 3184 ms)
2026-11-08T01:47:24Z [load_day 2023-10-14] 2023-10-14 hour 7: 117178 events in 3 files, snapshot 1286069966604729490 (task 10493 ms: download 2111 ms overlapping gunzip 579 ms, parse 2788 ms, sort 78 ms, write 6051 ms, index 376 ms: 8 candidates, 50228 repo-hours, 628 releases; waiting 379 ms; commit 2869 ms)
2026-11-08T01:47:30Z [load_day 2023-10-14] 2023-10-14 hour 8: 121635 events in 3 files, snapshot 8749321260403872905 (task 9795 ms: download 2032 ms overlapping gunzip 653 ms, parse 2715 ms, sort 93 ms, write 5151 ms, index 366 ms: 7 candidates, 52318 repo-hours, 625 releases; waiting 533 ms; commit 2992 ms)
2026-11-08T01:47:37Z [load_day 2023-10-14] 2023-10-14 hour 9: 130266 events in 3 files, snapshot 6283058555890342645 (task 11585 ms: download 3150 ms overlapping gunzip 707 ms, parse 3041 ms, sort 91 ms, write 6446 ms, index 352 ms: 8 candidates, 53710 repo-hours, 728 releases; waiting 501 ms; commit 2621 ms)
2026-11-08T01:47:42Z [load_day 2023-10-14] 2023-10-14 hour 10: 128897 events in 3 files, snapshot 3693554807902218986 (task 11470 ms: download 2307 ms overlapping gunzip 702 ms, parse 3133 ms, sort 124 ms, write 6344 ms, index 351 ms: 5 candidates, 54700 repo-hours, 664 releases; waiting 485 ms; commit 2585 ms)
2026-11-08T01:47:49Z [load_day 2023-10-14] 2023-10-14 hour 11: 124928 events in 3 files, snapshot 5607218606038921741 (task 10059 ms: download 2548 ms overlapping gunzip 530 ms, parse 2395 ms, sort 89 ms, write 5780 ms, index 473 ms: 7 candidates, 51361 repo-hours, 666 releases; waiting 525 ms; commit 4298 ms)
2026-11-08T01:47:58Z [load_day 2023-10-14] 2023-10-14 hour 12: 204925 events in 5 files, snapshot 6679890214898938447 (task 13815 ms: download 4059 ms overlapping gunzip 731 ms, parse 3591 ms, sort 156 ms, write 7847 ms, index 589 ms: 12 candidates, 86946 repo-hours, 888 releases; waiting 589 ms; commit 2744 ms)
2026-11-08T01:48:02Z [load_day 2023-10-14] 2023-10-14 hour 13: 161810 events in 4 files, snapshot 6277592183336849882 (task 13252 ms: download 4815 ms overlapping gunzip 676 ms, parse 3005 ms, sort 149 ms, write 7956 ms, index 654 ms: 10 candidates, 80199 repo-hours, 690 releases; waiting 495 ms; commit 2821 ms)
2026-11-08T01:48:11Z [load_day 2023-10-14] 2023-10-14 hour 14: 145334 events in 3 files, snapshot 8286684923655856347 (task 11986 ms: download 4452 ms overlapping gunzip 647 ms, parse 2913 ms, sort 157 ms, write 6774 ms, index 639 ms: 8 candidates, 63717 repo-hours, 767 releases; waiting 540 ms; commit 3576 ms)
2026-11-08T01:48:17Z [load_day 2023-10-14] 2023-10-14 hour 15: 149783 events in 3 files, snapshot 8012494010551461887 (task 13071 ms: download 4739 ms overlapping gunzip 676 ms, parse 3085 ms, sort 113 ms, write 7917 ms, index 507 ms: 3 candidates, 66413 repo-hours, 919 releases; waiting 508 ms; commit 3476 ms)
2026-11-08T01:48:26Z [load_day 2023-10-14] 2023-10-14 hour 16: 146497 events in 3 files, snapshot 235814650944367334 (task 12717 ms: download 5135 ms overlapping gunzip 688 ms, parse 3033 ms, sort 135 ms, write 7541 ms, index 481 ms: 2 candidates, 64689 repo-hours, 743 releases; waiting 521 ms; commit 4019 ms)
2026-11-08T01:48:30Z [load_day 2023-10-14] 2023-10-14 hour 17: 143766 events in 3 files, snapshot 2763038675871346264 (task 12171 ms: download 4680 ms overlapping gunzip 649 ms, parse 2951 ms, sort 165 ms, write 7119 ms, index 456 ms: 8 candidates, 60507 repo-hours, 808 releases; waiting 511 ms; commit 3695 ms)
2026-11-08T01:48:42Z [load_day 2023-10-14] 2023-10-14 hour 18: 145186 events in 3 files, snapshot 6914303789730298830 (task 11991 ms: download 4648 ms overlapping gunzip 683 ms, parse 3144 ms, sort 106 ms, write 7127 ms, index 460 ms: 7 candidates, 66055 repo-hours, 865 releases; waiting 205 ms; commit 7582 ms)
2026-11-08T01:48:49Z [load_day 2023-10-14] 2023-10-14 hour 19: 130100 events in 3 files, snapshot 4098814407444882502 (task 10751 ms: download 4414 ms overlapping gunzip 630 ms, parse 2701 ms, sort 85 ms, write 6087 ms, index 444 ms: 1 candidates, 53651 repo-hours, 764 releases; waiting 527 ms; commit 6572 ms)
2026-11-08T01:48:51Z [load_day 2023-10-14] 2023-10-14 hour 20: 120157 events in 3 files, snapshot 3339724857413339102 (task 8516 ms: download 2155 ms overlapping gunzip 451 ms, parse 2053 ms, sort 72 ms, write 4711 ms, index 448 ms: 2 candidates, 51297 repo-hours, 711 releases; waiting 539 ms; commit 2246 ms)
2026-11-08T01:48:53Z [load_day 2023-10-14] 2023-10-14 hour 21: 110515 events in 3 files, snapshot 6742039330451454821 (task 7861 ms: download 1861 ms overlapping gunzip 427 ms, parse 1956 ms, sort 72 ms, write 4314 ms, index 328 ms: 4 candidates, 45524 repo-hours, 770 releases; waiting 541 ms; commit 2321 ms)
2026-11-08T01:48:59Z [load_day 2023-10-14] 2023-10-14 hour 22: 100436 events in 3 files, snapshot 8509385472126091420 (task 7013 ms: download 2199 ms overlapping gunzip 377 ms, parse 1697 ms, sort 67 ms, write 3686 ms, index 280 ms: 4 candidates, 40308 repo-hours, 627 releases; waiting 557 ms; commit 2340 ms)
2026-11-08T01:49:01Z [load_day 2023-10-14] 2023-10-14 hour 23: 96670 events in 2 files, snapshot 2225087647308388048 (task 6679 ms: download 1753 ms overlapping gunzip 366 ms, parse 1717 ms, sort 70 ms, write 3315 ms, index 380 ms: 1 candidates, 42928 repo-hours, 635 releases; waiting 511 ms; commit 2161 ms)
2026-11-08T01:49:08Z [load_day 2023-10-14] 2023-10-14: repo_hour merged from 24 files to 1 (1363164 rows, 6530 ms)
2026-11-08T01:49:10Z [load_day 2023-10-14] 2023-10-14: index committed in 9160 ms (23 + 1 + 24 files)
2026-11-08T01:49:10Z [load_day 2023-10-14] 2023-10-14: 3086345 events in 24 hours
2026-11-08T01:49:10Z [load_day 2023-10-14] attempt 1 succeeded