orcaLog in

Runs · run 1248

load_day 2023-06-29, attempt 1 succeeded

Host
3c2b29713ce8:63617
Started
2026-11-07T22:21:43Z
Ended
2026-11-07T22:26:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1248/load_day/2023-06-29/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:21:43Z [load_day 2023-06-29] attempt 1 started
2026-11-07T22:21:45Z [load_day 2023-06-29] 2023-06-29: 1 hours in flight, about 750 MB
2026-11-07T22:21:58Z [load_day 2023-06-29] 2023-06-29 hour 0: 143457 events in 3 files, snapshot 4814173636144785257 (task 10139 ms: download 4527 ms overlapping gunzip 671 ms, parse 3078 ms, sort 84 ms, write 5057 ms, index 464 ms: 4 candidates, 71432 repo-hours, 881 releases; waiting 481 ms; commit 1605 ms)
2026-11-07T22:22:09Z [load_day 2023-06-29] 2023-06-29 hour 1: 153860 events in 4 files, snapshot 7553169679280586527 (task 9566 ms: download 3750 ms overlapping gunzip 657 ms, parse 2909 ms, sort 83 ms, write 4871 ms, index 511 ms: 6 candidates, 86045 repo-hours, 834 releases; waiting 190 ms; commit 1861 ms)
2026-11-07T22:22:19Z [load_day 2023-06-29] 2023-06-29 hour 2: 140708 events in 3 files, snapshot 4073899314112074203 (task 9472 ms: download 3913 ms overlapping gunzip 604 ms, parse 2637 ms, sort 72 ms, write 4835 ms, index 474 ms: 7 candidates, 70378 repo-hours, 671 releases; waiting 504 ms; commit 2043 ms)
2026-11-07T22:22:28Z [load_day 2023-06-29] 2023-06-29 hour 3: 126295 events in 3 files, snapshot 4325188358855285754 (task 8464 ms: download 3575 ms overlapping gunzip 553 ms, parse 2451 ms, sort 76 ms, write 4225 ms, index 345 ms: 5 candidates, 56878 repo-hours, 789 releases; waiting 501 ms; commit 1779 ms)
2026-11-07T22:22:37Z [load_day 2023-06-29] 2023-06-29 hour 4: 121780 events in 3 files, snapshot 3844631958585475723 (task 8065 ms: download 3427 ms overlapping gunzip 536 ms, parse 2342 ms, sort 69 ms, write 4098 ms, index 341 ms: 3 candidates, 52166 repo-hours, 581 releases; waiting 390 ms; commit 1940 ms)
2026-11-07T22:22:46Z [load_day 2023-06-29] 2023-06-29 hour 5: 128155 events in 3 files, snapshot 7008104560527650572 (task 8794 ms: download 3761 ms overlapping gunzip 565 ms, parse 2444 ms, sort 74 ms, write 4477 ms, index 361 ms: 2 candidates, 57114 repo-hours, 760 releases; waiting 552 ms; commit 1897 ms)
2026-11-07T22:22:58Z [load_day 2023-06-29] 2023-06-29 hour 6: 154303 events in 4 files, snapshot 4707808968879895452 (task 10638 ms: download 4558 ms overlapping gunzip 673 ms, parse 2988 ms, sort 92 ms, write 5335 ms, index 455 ms: 4 candidates, 72454 repo-hours, 971 releases; waiting 714 ms; commit 1724 ms)
2026-11-07T22:23:11Z [load_day 2023-06-29] 2023-06-29 hour 7: 167946 events in 4 files, snapshot 8102175172511018044 (task 12246 ms: download 7301 ms overlapping gunzip 813 ms, parse 3688 ms, sort 88 ms, write 6418 ms, index 501 ms: 4 candidates, 76163 repo-hours, 1149 releases; waiting 489 ms; commit 1906 ms)
2026-11-07T22:23:24Z [load_day 2023-06-29] 2023-06-29 hour 8: 177868 events in 4 files, snapshot 8894940319172975663 (task 12607 ms: download 7149 ms overlapping gunzip 853 ms, parse 3848 ms, sort 90 ms, write 6765 ms, index 522 ms: 3 candidates, 81348 repo-hours, 933 releases; waiting 196 ms; commit 1862 ms)
2026-11-07T22:23:39Z [load_day 2023-06-29] 2023-06-29 hour 9: 181942 events in 4 files, snapshot 6738612632752729735 (task 13484 ms: download 7771 ms overlapping gunzip 907 ms, parse 4044 ms, sort 104 ms, write 6998 ms, index 516 ms: 5 candidates, 80948 repo-hours, 1173 releases; waiting 571 ms; commit 1988 ms)
2026-11-07T22:23:56Z [load_day 2023-06-29] 2023-06-29 hour 10: 174063 events in 4 files, snapshot 2686832933946889975 (task 12507 ms: download 7351 ms overlapping gunzip 869 ms, parse 3848 ms, sort 104 ms, write 6460 ms, index 496 ms: 5 candidates, 77752 repo-hours, 1077 releases; waiting 504 ms; commit 5933 ms)
2026-11-07T22:24:05Z [load_day 2023-06-29] 2023-06-29 hour 11: 172943 events in 4 files, snapshot 7485137096593582211 (task 12392 ms: download 7025 ms overlapping gunzip 835 ms, parse 3741 ms, sort 109 ms, write 6730 ms, index 488 ms: 5 candidates, 74924 repo-hours, 969 releases; waiting 202 ms; commit 1713 ms)
2026-11-07T22:24:21Z [load_day 2023-06-29] 2023-06-29 hour 12: 218976 events in 5 files, snapshot 642472345204936352 (task 14453 ms: download 7454 ms overlapping gunzip 923 ms, parse 4237 ms, sort 124 ms, write 7663 ms, index 717 ms: 8 candidates, 107901 repo-hours, 1168 releases; waiting 511 ms; commit 1881 ms)
2026-11-07T22:24:36Z [load_day 2023-06-29] 2023-06-29 hour 13: 214224 events in 5 files, snapshot 5619542713079862395 (task 15072 ms: download 9956 ms overlapping gunzip 998 ms, parse 4572 ms, sort 115 ms, write 7885 ms, index 652 ms: 4 candidates, 106595 repo-hours, 1135 releases; waiting 581 ms; commit 1841 ms)
2026-11-07T22:24:52Z [load_day 2023-06-29] 2023-06-29 hour 14: 193295 events in 4 files, snapshot 5756951054757896677 (task 14569 ms: download 8388 ms overlapping gunzip 976 ms, parse 4418 ms, sort 110 ms, write 7662 ms, index 534 ms: 8 candidates, 89766 repo-hours, 1146 releases; waiting 516 ms; commit 1846 ms)
2026-11-07T22:25:05Z [load_day 2023-06-29] 2023-06-29 hour 15: 169048 events in 4 files, snapshot 6380816423462408541 (task 12487 ms: download 7268 ms overlapping gunzip 809 ms, parse 3610 ms, sort 90 ms, write 6593 ms, index 597 ms: 8 candidates, 82875 repo-hours, 1024 releases; waiting 509 ms; commit 1931 ms)
2026-11-07T22:25:19Z [load_day 2023-06-29] 2023-06-29 hour 16: 161173 events in 4 files, snapshot 592621553906912125 (task 12977 ms: download 6137 ms overlapping gunzip 823 ms, parse 3669 ms, sort 84 ms, write 6326 ms, index 502 ms: 4 candidates, 76867 repo-hours, 910 releases; waiting 1289 ms; commit 1823 ms)
2026-11-07T22:25:27Z [load_day 2023-06-29] 2023-06-29 hour 17: 98361 events in 2 files, snapshot 5066304049858903654 (task 7211 ms: download 1799 ms overlapping gunzip 476 ms, parse 2118 ms, sort 63 ms, write 3598 ms, index 307 ms: 7 candidates, 47751 repo-hours, 633 releases; waiting 338 ms; commit 1832 ms)
2026-11-07T22:25:40Z [load_day 2023-06-29] 2023-06-29 hour 18: 161175 events in 4 files, snapshot 8422477490899176280 (task 11398 ms: download 4784 ms overlapping gunzip 730 ms, parse 3394 ms, sort 113 ms, write 5883 ms, index 505 ms: 4 candidates, 75406 repo-hours, 1016 releases; waiting 493 ms; commit 1994 ms)
2026-11-07T22:25:53Z [load_day 2023-06-29] 2023-06-29 hour 19: 165740 events in 4 files, snapshot 5586536120345669055 (task 11948 ms: download 6944 ms overlapping gunzip 781 ms, parse 3538 ms, sort 94 ms, write 6232 ms, index 481 ms: 9 candidates, 70866 repo-hours, 990 releases; waiting 482 ms; commit 2366 ms)
2026-11-07T22:26:05Z [load_day 2023-06-29] 2023-06-29 hour 20: 162599 events in 4 files, snapshot 9039416699730788452 (task 11525 ms: download 6727 ms overlapping gunzip 788 ms, parse 3544 ms, sort 98 ms, write 6159 ms, index 462 ms: 8 candidates, 71341 repo-hours, 936 releases; waiting 231 ms; commit 1716 ms)
2026-11-07T22:26:17Z [load_day 2023-06-29] 2023-06-29 hour 21: 148635 events in 3 files, snapshot 4574648297218974685 (task 10802 ms: download 4920 ms overlapping gunzip 714 ms, parse 3248 ms, sort 73 ms, write 5253 ms, index 434 ms: 5 candidates, 63506 repo-hours, 1000 releases; waiting 707 ms; commit 1941 ms)
2026-11-07T22:26:27Z [load_day 2023-06-29] 2023-06-29 hour 22: 134130 events in 3 files, snapshot 7065051633335161185 (task 9563 ms: download 4381 ms overlapping gunzip 646 ms, parse 2879 ms, sort 71 ms, write 4815 ms, index 354 ms: 10 candidates, 56278 repo-hours, 821 releases; waiting 531 ms; commit 2167 ms)
2026-11-07T22:26:36Z [load_day 2023-06-29] 2023-06-29 hour 23: 126274 events in 3 files, snapshot 5913152676118519403 (task 8492 ms: download 3857 ms overlapping gunzip 567 ms, parse 2532 ms, sort 81 ms, write 4318 ms, index 348 ms: 6 candidates, 53840 repo-hours, 745 releases; waiting 344 ms; commit 1740 ms)
2026-11-07T22:26:44Z [load_day 2023-06-29] 2023-06-29: repo_hour merged from 24 files to 1 (1760594 rows, 7327 ms)
2026-11-07T22:26:46Z [load_day 2023-06-29] 2023-06-29: index committed in 9750 ms (24 + 1 + 24 files)
2026-11-07T22:26:46Z [load_day 2023-06-29] 2023-06-29: 3796950 events in 24 hours
2026-11-07T22:26:46Z [load_day 2023-06-29] attempt 1 succeeded