orcaLog in

Runs · run 1050

load_day 2023-05-02, attempt 1 succeeded

Host
caf251265124:326820
Started
2026-11-07T19:31:09Z
Ended
2026-11-07T19:34:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1050/load_day/2023-05-02/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:31:09Z [load_day 2023-05-02] attempt 1 started
2026-11-07T19:31:11Z [load_day 2023-05-02] 2023-05-02: 2 hours in flight, about 1200 MB
2026-11-07T19:31:27Z [load_day 2023-05-02] 2023-05-02 hour 0: 162371 events in 4 files, snapshot 1993940276970664829 (task 13215 ms: download 6253 ms overlapping gunzip 887 ms, parse 3781 ms, sort 84 ms, write 7132 ms, index 515 ms: 4 candidates, 76498 repo-hours, 922 releases; waiting 528 ms; commit 1590 ms)
2026-11-07T19:31:29Z [load_day 2023-05-02] 2023-05-02 hour 1: 153168 events in 4 files, snapshot 6681940665173817089 (task 11053 ms: download 4358 ms overlapping gunzip 635 ms, parse 2901 ms, sort 79 ms, write 6061 ms, index 523 ms: 3 candidates, 82732 repo-hours, 781 releases; waiting 509 ms; commit 1431 ms)
2026-11-07T19:31:38Z [load_day 2023-05-02] 2023-05-02 hour 2: 129308 events in 3 files, snapshot 3704106942583979470 (task 9799 ms: download 4266 ms overlapping gunzip 585 ms, parse 2534 ms, sort 69 ms, write 5445 ms, index 368 ms: 2 candidates, 55870 repo-hours, 747 releases; waiting 497 ms; commit 1537 ms)
2026-11-07T19:31:40Z [load_day 2023-05-02] 2023-05-02 hour 3: 128800 events in 3 files, snapshot 8508357156916756359 (task 9693 ms: download 3914 ms overlapping gunzip 567 ms, parse 2490 ms, sort 79 ms, write 5223 ms, index 342 ms: 1 candidates, 51780 repo-hours, 752 releases; waiting 538 ms; commit 2087 ms)
2026-11-07T19:31:48Z [load_day 2023-05-02] 2023-05-02 hour 4: 125900 events in 3 files, snapshot 9181092942529973577 (task 9172 ms: download 2166 ms overlapping gunzip 534 ms, parse 2333 ms, sort 74 ms, write 5007 ms, index 365 ms: 1 candidates, 53174 repo-hours, 596 releases; waiting 513 ms; commit 1549 ms)
2026-11-07T19:31:50Z [load_day 2023-05-02] 2023-05-02 hour 5: 134109 events in 3 files, snapshot 2760581850051442880 (task 10217 ms: download 4222 ms overlapping gunzip 682 ms, parse 2800 ms, sort 97 ms, write 5659 ms, index 371 ms: 4 candidates, 57284 repo-hours, 732 releases; waiting 360 ms; commit 1532 ms)
2026-11-07T19:32:01Z [load_day 2023-05-02] 2023-05-02 hour 6: 154624 events in 4 files, snapshot 5492579960720316353 (task 12305 ms: download 5217 ms overlapping gunzip 707 ms, parse 3139 ms, sort 84 ms, write 6703 ms, index 454 ms: 6 candidates, 68470 repo-hours, 866 releases; waiting 878 ms; commit 1705 ms)
2026-11-07T19:32:04Z [load_day 2023-05-02] 2023-05-02 hour 7: 157512 events in 4 files, snapshot 3078204858346686321 (task 13119 ms: download 5519 ms overlapping gunzip 780 ms, parse 3436 ms, sort 93 ms, write 7456 ms, index 522 ms: 4 candidates, 69141 repo-hours, 813 releases; waiting 561 ms; commit 1810 ms)
2026-11-07T19:32:15Z [load_day 2023-05-02] 2023-05-02 hour 8: 161313 events in 4 files, snapshot 618145988809684798 (task 13768 ms: download 8287 ms overlapping gunzip 803 ms, parse 3597 ms, sort 116 ms, write 7917 ms, index 490 ms: 8 candidates, 73488 repo-hours, 900 releases; waiting 516 ms; commit 1534 ms)
2026-11-07T19:32:20Z [load_day 2023-05-02] 2023-05-02 hour 9: 177869 events in 4 files, snapshot 3314647761591105596 (task 14850 ms: download 8563 ms overlapping gunzip 909 ms, parse 3951 ms, sort 106 ms, write 8474 ms, index 542 ms: 6 candidates, 77069 repo-hours, 1197 releases; waiting 526 ms; commit 1654 ms)
2026-11-07T19:32:31Z [load_day 2023-05-02] 2023-05-02 hour 10: 178600 events in 4 files, snapshot 8340643460195543654 (task 14572 ms: download 8334 ms overlapping gunzip 909 ms, parse 4028 ms, sort 116 ms, write 8525 ms, index 515 ms: 5 candidates, 77362 repo-hours, 1370 releases; waiting 221 ms; commit 1642 ms)
2026-11-07T19:32:35Z [load_day 2023-05-02] 2023-05-02 hour 11: 177420 events in 4 files, snapshot 7484061992976048876 (task 14598 ms: download 8206 ms overlapping gunzip 866 ms, parse 3810 ms, sort 112 ms, write 8413 ms, index 545 ms: 8 candidates, 77844 repo-hours, 1050 releases; waiting 543 ms; commit 1581 ms)
2026-11-07T19:32:46Z [load_day 2023-05-02] 2023-05-02 hour 12: 201819 events in 5 files, snapshot 231000429659174570 (task 14699 ms: download 7941 ms overlapping gunzip 868 ms, parse 3915 ms, sort 119 ms, write 8359 ms, index 644 ms: 6 candidates, 103412 repo-hours, 1073 releases; waiting 514 ms; commit 1676 ms)
2026-11-07T19:32:52Z [load_day 2023-05-02] 2023-05-02 hour 13: 185310 events in 4 files, snapshot 1239953156063058945 (task 16190 ms: download 9350 ms overlapping gunzip 878 ms, parse 3878 ms, sort 102 ms, write 8788 ms, index 630 ms: 8 candidates, 96599 repo-hours, 1054 releases; waiting 1616 ms; commit 2020 ms)
2026-11-07T19:33:03Z [load_day 2023-05-02] 2023-05-02 hour 14: 181080 events in 4 files, snapshot 1604758029581692191 (task 16490 ms: download 9553 ms overlapping gunzip 909 ms, parse 4072 ms, sort 109 ms, write 9426 ms, index 678 ms: 10 candidates, 88182 repo-hours, 1053 releases; waiting 935 ms; commit 1582 ms)
2026-11-07T19:33:07Z [load_day 2023-05-02] 2023-05-02 hour 15: 165116 events in 4 files, snapshot 7331766720761979446 (task 14354 ms: download 8563 ms overlapping gunzip 826 ms, parse 3569 ms, sort 96 ms, write 8469 ms, index 549 ms: 16 candidates, 82114 repo-hours, 1119 releases; waiting 513 ms; commit 1531 ms)
2026-11-07T19:33:22Z [load_day 2023-05-02] 2023-05-02 hour 16: 167828 events in 4 files, snapshot 8112928873604878015 (task 14333 ms: download 8332 ms overlapping gunzip 834 ms, parse 3622 ms, sort 112 ms, write 8233 ms, index 578 ms: 6 candidates, 81889 repo-hours, 979 releases; waiting 555 ms; commit 5138 ms)
2026-11-07T19:33:24Z [load_day 2023-05-02] 2023-05-02 hour 17: 176877 events in 4 files, snapshot 3569859761460003224 (task 15032 ms: download 8509 ms overlapping gunzip 874 ms, parse 3781 ms, sort 113 ms, write 8817 ms, index 567 ms: 8 candidates, 79720 repo-hours, 924 releases; waiting 577 ms; commit 1629 ms)
2026-11-07T19:33:35Z [load_day 2023-05-02] 2023-05-02 hour 18: 183848 events in 4 files, snapshot 7421656077456373967 (task 15432 ms: download 8810 ms overlapping gunzip 925 ms, parse 4069 ms, sort 110 ms, write 8839 ms, index 630 ms: 8 candidates, 86831 repo-hours, 978 releases; waiting 516 ms; commit 1762 ms)
2026-11-07T19:33:40Z [load_day 2023-05-02] 2023-05-02 hour 19: 175545 events in 4 files, snapshot 4424081792257301396 (task 14744 ms: download 8391 ms overlapping gunzip 872 ms, parse 3851 ms, sort 113 ms, write 8509 ms, index 569 ms: 9 candidates, 76180 repo-hours, 1095 releases; waiting 523 ms; commit 1775 ms)
2026-11-07T19:33:50Z [load_day 2023-05-02] 2023-05-02 hour 20: 173299 events in 4 files, snapshot 2543488303422940131 (task 14245 ms: download 8210 ms overlapping gunzip 822 ms, parse 3611 ms, sort 107 ms, write 8396 ms, index 516 ms: 8 candidates, 76283 repo-hours, 1043 releases; waiting 563 ms; commit 1560 ms)
2026-11-07T19:33:53Z [load_day 2023-05-02] 2023-05-02 hour 21: 158808 events in 4 files, snapshot 8772804323537047957 (task 13183 ms: download 5669 ms overlapping gunzip 741 ms, parse 3290 ms, sort 112 ms, write 7360 ms, index 517 ms: 7 candidates, 67741 repo-hours, 998 releases; waiting 868 ms; commit 1629 ms)
2026-11-07T19:34:03Z [load_day 2023-05-02] 2023-05-02 hour 22: 142512 events in 3 files, snapshot 4252841143162713753 (task 12305 ms: download 5476 ms overlapping gunzip 703 ms, parse 3065 ms, sort 92 ms, write 6664 ms, index 437 ms: 8 candidates, 59959 repo-hours, 798 releases; waiting 1001 ms; commit 1558 ms)
2026-11-07T19:34:05Z [load_day 2023-05-02] 2023-05-02 hour 23: 132333 events in 3 files, snapshot 1891090363489952332 (task 10142 ms: download 4190 ms overlapping gunzip 601 ms, parse 2657 ms, sort 85 ms, write 5897 ms, index 365 ms: 5 candidates, 55865 repo-hours, 697 releases; waiting 249 ms; commit 1731 ms)
2026-11-07T19:34:12Z [load_day 2023-05-02] 2023-05-02: repo_hour merged from 24 files to 1 (1775487 rows, 7182 ms)
2026-11-07T19:34:14Z [load_day 2023-05-02] 2023-05-02: index committed in 9129 ms (24 + 1 + 24 files)
2026-11-07T19:34:14Z [load_day 2023-05-02] 2023-05-02: 3885369 events in 24 hours
2026-11-07T19:34:14Z [load_day 2023-05-02] attempt 1 succeeded