orcaLog in

Runs · run 1200

load_day 2023-06-21, attempt 1 succeeded

Host
3c2b29713ce8:8847
Started
2026-11-07T21:43:03Z
Ended
2026-11-07T21:48:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1200/load_day/2023-06-21/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:43:03Z [load_day 2023-06-21] attempt 1 started
2026-11-07T21:43:04Z [load_day 2023-06-21] 2023-06-21: 1 hours in flight, about 750 MB
2026-11-07T21:43:20Z [load_day 2023-06-21] 2023-06-21 hour 0: 150598 events in 4 files, snapshot 159638055206632108 (task 10113 ms: download 4520 ms overlapping gunzip 674 ms, parse 3103 ms, sort 96 ms, write 4938 ms, index 493 ms: 11 candidates, 75143 repo-hours, 865 releases; waiting 503 ms; commit 3931 ms)
2026-11-07T21:43:31Z [load_day 2023-06-21] 2023-06-21 hour 1: 165334 events in 4 files, snapshot 3213393776911462680 (task 10844 ms: download 4548 ms overlapping gunzip 718 ms, parse 3171 ms, sort 89 ms, write 5528 ms, index 555 ms: 10 candidates, 89951 repo-hours, 858 releases; waiting 508 ms; commit 1865 ms)
2026-11-07T21:43:43Z [load_day 2023-06-21] 2023-06-21 hour 2: 151343 events in 4 files, snapshot 7697722326409013451 (task 11189 ms: download 5167 ms overlapping gunzip 742 ms, parse 3013 ms, sort 95 ms, write 5315 ms, index 478 ms: 4 candidates, 73867 repo-hours, 763 releases; waiting 1212 ms; commit 1801 ms)
2026-11-07T21:43:53Z [load_day 2023-06-21] 2023-06-21 hour 3: 139304 events in 3 files, snapshot 7672986483098367700 (task 9136 ms: download 3761 ms overlapping gunzip 596 ms, parse 2602 ms, sort 95 ms, write 4771 ms, index 381 ms: 3 candidates, 62183 repo-hours, 819 releases; waiting 389 ms; commit 1682 ms)
2026-11-07T21:44:07Z [load_day 2023-06-21] 2023-06-21 hour 4: 129534 events in 3 files, snapshot 3774065510569581492 (task 8582 ms: download 3661 ms overlapping gunzip 550 ms, parse 2410 ms, sort 74 ms, write 4340 ms, index 369 ms: 4 candidates, 56656 repo-hours, 658 releases; waiting 527 ms; commit 5800 ms)
2026-11-07T21:44:12Z [load_day 2023-06-21] 2023-06-21 hour 5: 141294 events in 3 files, snapshot 2018104641816704239 (task 9206 ms: download 3827 ms overlapping gunzip 633 ms, parse 2714 ms, sort 100 ms, write 4819 ms, index 388 ms: 4 candidates, 62014 repo-hours, 740 releases; waiting 224 ms; commit 1626 ms)
2026-11-07T21:44:24Z [load_day 2023-06-21] 2023-06-21 hour 6: 164006 events in 4 files, snapshot 3477921881339256598 (task 10894 ms: download 4513 ms overlapping gunzip 709 ms, parse 3160 ms, sort 82 ms, write 5637 ms, index 483 ms: 7 candidates, 78456 repo-hours, 986 releases; waiting 514 ms; commit 1662 ms)
2026-11-07T21:44:39Z [load_day 2023-06-21] 2023-06-21 hour 7: 176131 events in 4 files, snapshot 2268315980718733195 (task 14113 ms: download 8784 ms overlapping gunzip 870 ms, parse 3820 ms, sort 109 ms, write 6516 ms, index 495 ms: 8 candidates, 81574 repo-hours, 1017 releases; waiting 2025 ms; commit 1786 ms)
2026-11-07T21:44:53Z [load_day 2023-06-21] 2023-06-21 hour 8: 185926 events in 4 files, snapshot 2582683045557585858 (task 12844 ms: download 7004 ms overlapping gunzip 865 ms, parse 3871 ms, sort 101 ms, write 7023 ms, index 514 ms: 13 candidates, 87417 repo-hours, 1124 releases; waiting 204 ms; commit 2070 ms)
2026-11-07T21:45:11Z [load_day 2023-06-21] 2023-06-21 hour 9: 189951 events in 4 files, snapshot 5011241182037827511 (task 14197 ms: download 7832 ms overlapping gunzip 900 ms, parse 4066 ms, sort 126 ms, write 7852 ms, index 581 ms: 6 candidates, 87367 repo-hours, 1336 releases; waiting 403 ms; commit 5540 ms)
2026-11-07T21:45:26Z [load_day 2023-06-21] 2023-06-21 hour 10: 182516 events in 4 files, snapshot 3760939899726854472 (task 13335 ms: download 7587 ms overlapping gunzip 831 ms, parse 3767 ms, sort 98 ms, write 7101 ms, index 508 ms: 6 candidates, 83393 repo-hours, 1026 releases; waiting 699 ms; commit 1939 ms)
2026-11-07T21:45:39Z [load_day 2023-06-21] 2023-06-21 hour 11: 182000 events in 4 files, snapshot 1627359490091476425 (task 12843 ms: download 7144 ms overlapping gunzip 846 ms, parse 3822 ms, sort 112 ms, write 6785 ms, index 557 ms: 6 candidates, 80478 repo-hours, 1001 releases; waiting 390 ms; commit 1641 ms)
2026-11-07T21:45:54Z [load_day 2023-06-21] 2023-06-21 hour 12: 223672 events in 5 files, snapshot 2890319730651427833 (task 14172 ms: download 7282 ms overlapping gunzip 907 ms, parse 4136 ms, sort 100 ms, write 7542 ms, index 667 ms: 10 candidates, 111145 repo-hours, 1061 releases; waiting 509 ms; commit 1732 ms)
2026-11-07T21:46:10Z [load_day 2023-06-21] 2023-06-21 hour 13: 194678 events in 4 files, snapshot 6198354570184659710 (task 14367 ms: download 7931 ms overlapping gunzip 880 ms, parse 4012 ms, sort 118 ms, write 7553 ms, index 605 ms: 9 candidates, 99268 repo-hours, 1017 releases; waiting 796 ms; commit 1698 ms)
2026-11-07T21:46:25Z [load_day 2023-06-21] 2023-06-21 hour 14: 185221 events in 4 files, snapshot 931851886336551695 (task 14285 ms: download 8303 ms overlapping gunzip 963 ms, parse 4130 ms, sort 109 ms, write 7677 ms, index 569 ms: 12 candidates, 89405 repo-hours, 974 releases; waiting 497 ms; commit 1878 ms)
2026-11-07T21:46:39Z [load_day 2023-06-21] 2023-06-21 hour 15: 169884 events in 4 files, snapshot 5591012231544421740 (task 13360 ms: download 8150 ms overlapping gunzip 869 ms, parse 3813 ms, sort 95 ms, write 6896 ms, index 540 ms: 12 candidates, 83228 repo-hours, 936 releases; waiting 809 ms; commit 1820 ms)
2026-11-07T21:46:53Z [load_day 2023-06-21] 2023-06-21 hour 16: 171725 events in 4 files, snapshot 3505034873478726917 (task 13023 ms: download 7544 ms overlapping gunzip 837 ms, parse 3725 ms, sort 109 ms, write 6861 ms, index 535 ms: 7 candidates, 80601 repo-hours, 870 releases; waiting 522 ms; commit 1706 ms)
2026-11-07T21:47:07Z [load_day 2023-06-21] 2023-06-21 hour 17: 176741 events in 4 files, snapshot 61451368590947030 (task 13517 ms: download 7813 ms overlapping gunzip 870 ms, parse 3830 ms, sort 114 ms, write 7224 ms, index 531 ms: 8 candidates, 78918 repo-hours, 879 releases; waiting 657 ms; commit 1992 ms)
2026-11-07T21:47:22Z [load_day 2023-06-21] 2023-06-21 hour 18: 185588 events in 4 files, snapshot 6862897582075389577 (task 13695 ms: download 7556 ms overlapping gunzip 880 ms, parse 3874 ms, sort 115 ms, write 7145 ms, index 545 ms: 11 candidates, 83965 repo-hours, 979 releases; waiting 552 ms; commit 2068 ms)
2026-11-07T21:47:36Z [load_day 2023-06-21] 2023-06-21 hour 19: 175048 events in 4 files, snapshot 1369005035729671116 (task 12934 ms: download 7396 ms overlapping gunzip 832 ms, parse 3686 ms, sort 102 ms, write 6919 ms, index 528 ms: 9 candidates, 74371 repo-hours, 986 releases; waiting 546 ms; commit 1529 ms)
2026-11-07T21:47:49Z [load_day 2023-06-21] 2023-06-21 hour 20: 171776 events in 4 files, snapshot 3143107528735414753 (task 12378 ms: download 7230 ms overlapping gunzip 859 ms, parse 3737 ms, sort 101 ms, write 6360 ms, index 480 ms: 5 candidates, 73369 repo-hours, 932 releases; waiting 526 ms; commit 1758 ms)
2026-11-07T21:48:01Z [load_day 2023-06-21] 2023-06-21 hour 21: 157921 events in 4 files, snapshot 6369466048380543571 (task 11547 ms: download 5080 ms overlapping gunzip 778 ms, parse 3443 ms, sort 95 ms, write 6179 ms, index 398 ms: 5 candidates, 64512 repo-hours, 1148 releases; waiting 364 ms; commit 1969 ms)
2026-11-07T21:48:13Z [load_day 2023-06-21] 2023-06-21 hour 22: 148497 events in 3 files, snapshot 3005008749055633322 (task 11338 ms: download 6991 ms overlapping gunzip 809 ms, parse 3418 ms, sort 82 ms, write 5907 ms, index 397 ms: 5 candidates, 60263 repo-hours, 889 releases; waiting 404 ms; commit 1629 ms)
2026-11-07T21:48:25Z [load_day 2023-06-21] 2023-06-21 hour 23: 135906 events in 3 files, snapshot 1603798602357069918 (task 10451 ms: download 4966 ms overlapping gunzip 709 ms, parse 3059 ms, sort 95 ms, write 5387 ms, index 386 ms: 4 candidates, 56046 repo-hours, 675 releases; waiting 518 ms; commit 1879 ms)
2026-11-07T21:48:32Z [load_day 2023-06-21] 2023-06-21: repo_hour merged from 24 files to 1 (1873590 rows, 7630 ms)
2026-11-07T21:48:34Z [load_day 2023-06-21] 2023-06-21: index committed in 9563 ms (24 + 1 + 24 files)
2026-11-07T21:48:34Z [load_day 2023-06-21] 2023-06-21: 4054594 events in 24 hours
2026-11-07T21:48:34Z [load_day 2023-06-21] attempt 1 succeeded