orcaLog in

Runs · run 807

load_day 2023-02-10, attempt 1 succeeded

Host
caf251265124:40180
Started
2026-11-07T15:21:12Z
Ended
2026-11-07T15:24:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/807/load_day/2023-02-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:21:12Z [load_day 2023-02-10] attempt 1 started
2026-11-07T15:21:13Z [load_day 2023-02-10] 2023-02-10: 2 hours in flight, about 1200 MB
2026-11-07T15:21:27Z [load_day 2023-02-10] 2023-02-10 hour 0: 164471 events in 4 files, snapshot 5841683939199482763 (task 11634 ms: download 4897 ms overlapping gunzip 729 ms, parse 3281 ms, sort 103 ms, write 6466 ms, index 487 ms: 4 candidates, 75815 repo-hours, 858 releases; waiting 270 ms; commit 1370 ms)
2026-11-07T15:21:28Z [load_day 2023-02-10] 2023-02-10 hour 1: 167702 events in 4 files, snapshot 6938882329231883589 (task 12480 ms: download 5335 ms overlapping gunzip 768 ms, parse 3338 ms, sort 94 ms, write 6689 ms, index 518 ms: 7 candidates, 80989 repo-hours, 857 releases; waiting 741 ms; commit 1424 ms)
2026-11-07T15:21:40Z [load_day 2023-02-10] 2023-02-10 hour 2: 143567 events in 3 files, snapshot 3734563380517814206 (task 11728 ms: download 5408 ms overlapping gunzip 673 ms, parse 2889 ms, sort 95 ms, write 6361 ms, index 448 ms: 5 candidates, 67933 repo-hours, 685 releases; waiting 906 ms; commit 1318 ms)
2026-11-07T15:21:41Z [load_day 2023-02-10] 2023-02-10 hour 3: 136925 events in 3 files, snapshot 6650921199989488752 (task 10615 ms: download 4928 ms overlapping gunzip 608 ms, parse 2650 ms, sort 94 ms, write 5485 ms, index 372 ms: 4 candidates, 57862 repo-hours, 882 releases; waiting 1041 ms; commit 1322 ms)
2026-11-07T15:21:50Z [load_day 2023-02-10] 2023-02-10 hour 4: 126732 events in 3 files, snapshot 1464793533287504400 (task 9372 ms: download 4042 ms overlapping gunzip 548 ms, parse 2377 ms, sort 67 ms, write 5199 ms, index 349 ms: 0 candidates, 52486 repo-hours, 746 releases; waiting 529 ms; commit 1322 ms)
2026-11-07T15:21:52Z [load_day 2023-02-10] 2023-02-10 hour 5: 134582 events in 3 files, snapshot 2661933014198677083 (task 10189 ms: download 4255 ms overlapping gunzip 601 ms, parse 2580 ms, sort 79 ms, write 5447 ms, index 416 ms: 2 candidates, 57546 repo-hours, 719 releases; waiting 665 ms; commit 1532 ms)
2026-11-07T15:22:02Z [load_day 2023-02-10] 2023-02-10 hour 6: 153399 events in 4 files, snapshot 2096494428690401480 (task 11462 ms: download 4643 ms overlapping gunzip 705 ms, parse 2980 ms, sort 102 ms, write 6483 ms, index 458 ms: 5 candidates, 68555 repo-hours, 764 releases; waiting 344 ms; commit 1286 ms)
2026-11-07T15:22:06Z [load_day 2023-02-10] 2023-02-10 hour 7: 157470 events in 4 files, snapshot 2316695032408208797 (task 12758 ms: download 5546 ms overlapping gunzip 803 ms, parse 3370 ms, sort 110 ms, write 6984 ms, index 470 ms: 5 candidates, 69262 repo-hours, 725 releases; waiting 684 ms; commit 1525 ms)
2026-11-07T15:22:18Z [load_day 2023-02-10] 2023-02-10 hour 8: 177099 events in 4 files, snapshot 1252097682384351755 (task 15171 ms: download 8893 ms overlapping gunzip 877 ms, parse 3764 ms, sort 117 ms, write 8678 ms, index 576 ms: 5 candidates, 78253 repo-hours, 921 releases; waiting 866 ms; commit 1387 ms)
2026-11-07T15:22:23Z [load_day 2023-02-10] 2023-02-10 hour 9: 188342 events in 4 files, snapshot 705702468902820881 (task 16355 ms: download 9469 ms overlapping gunzip 997 ms, parse 4258 ms, sort 138 ms, write 9282 ms, index 535 ms: 2 candidates, 81435 repo-hours, 1372 releases; waiting 777 ms; commit 1450 ms)
2026-11-07T15:22:34Z [load_day 2023-02-10] 2023-02-10 hour 10: 187612 events in 4 files, snapshot 3333487053970513831 (task 15802 ms: download 8977 ms overlapping gunzip 951 ms, parse 4101 ms, sort 102 ms, write 9110 ms, index 554 ms: 7 candidates, 81019 repo-hours, 1798 releases; waiting 626 ms; commit 1277 ms)
2026-11-07T15:22:39Z [load_day 2023-02-10] 2023-02-10 hour 11: 184584 events in 4 files, snapshot 8478104717687465855 (task 15318 ms: download 8476 ms overlapping gunzip 925 ms, parse 3961 ms, sort 121 ms, write 8659 ms, index 624 ms: 4 candidates, 80020 repo-hours, 1007 releases; waiting 524 ms; commit 1279 ms)
2026-11-07T15:22:51Z [load_day 2023-02-10] 2023-02-10 hour 12: 212703 events in 5 files, snapshot 9219470402654405192 (task 16175 ms: download 8653 ms overlapping gunzip 934 ms, parse 4123 ms, sort 128 ms, write 9034 ms, index 670 ms: 4 candidates, 101953 repo-hours, 1056 releases; waiting 748 ms; commit 1298 ms)
2026-11-07T15:22:57Z [load_day 2023-02-10] 2023-02-10 hour 13: 210005 events in 5 files, snapshot 6004407793837553556 (task 17247 ms: download 9600 ms overlapping gunzip 1030 ms, parse 4508 ms, sort 119 ms, write 9168 ms, index 635 ms: 3 candidates, 100553 repo-hours, 1039 releases; waiting 1380 ms; commit 1429 ms)
2026-11-07T15:23:10Z [load_day 2023-02-10] 2023-02-10 hour 14: 202596 events in 5 files, snapshot 1187133840789927519 (task 17304 ms: download 9423 ms overlapping gunzip 1032 ms, parse 4543 ms, sort 143 ms, write 10106 ms, index 632 ms: 2 candidates, 89317 repo-hours, 1250 releases; waiting 543 ms; commit 1356 ms)
2026-11-07T15:23:16Z [load_day 2023-02-10] 2023-02-10 hour 15: 204669 events in 5 files, snapshot 6043674146924843785 (task 17849 ms: download 9728 ms overlapping gunzip 1112 ms, parse 4764 ms, sort 137 ms, write 10277 ms, index 611 ms: 5 candidates, 90529 repo-hours, 1282 releases; waiting 528 ms; commit 1502 ms)
2026-11-07T15:23:27Z [load_day 2023-02-10] 2023-02-10 hour 16: 198055 events in 4 files, snapshot 4444351158622805292 (task 16599 ms: download 9190 ms overlapping gunzip 987 ms, parse 4299 ms, sort 141 ms, write 9730 ms, index 634 ms: 5 candidates, 89729 repo-hours, 1230 releases; waiting 500 ms; commit 1411 ms)
2026-11-07T15:23:32Z [load_day 2023-02-10] 2023-02-10 hour 17: 187313 events in 4 files, snapshot 1064503885893386392 (task 16213 ms: download 9195 ms overlapping gunzip 961 ms, parse 4169 ms, sort 129 ms, write 9346 ms, index 524 ms: 9 candidates, 80923 repo-hours, 877 releases; waiting 733 ms; commit 1401 ms)
2026-11-07T15:23:43Z [load_day 2023-02-10] 2023-02-10 hour 18: 182689 events in 4 files, snapshot 7213458433916553980 (task 15100 ms: download 8594 ms overlapping gunzip 932 ms, parse 4039 ms, sort 123 ms, write 8635 ms, index 527 ms: 6 candidates, 81134 repo-hours, 918 releases; waiting 528 ms; commit 1352 ms)
2026-11-07T15:23:47Z [load_day 2023-02-10] 2023-02-10 hour 19: 171048 events in 4 files, snapshot 7934038531204441664 (task 14213 ms: download 8406 ms overlapping gunzip 871 ms, parse 3733 ms, sort 116 ms, write 7866 ms, index 513 ms: 3 candidates, 71938 repo-hours, 883 releases; waiting 782 ms; commit 1337 ms)
2026-11-07T15:23:58Z [load_day 2023-02-10] 2023-02-10 hour 20: 169264 events in 4 files, snapshot 3204586616375369944 (task 13911 ms: download 8307 ms overlapping gunzip 870 ms, parse 3730 ms, sort 108 ms, write 7976 ms, index 469 ms: 8 candidates, 70699 repo-hours, 834 releases; waiting 390 ms; commit 1331 ms)
2026-11-07T15:24:01Z [load_day 2023-02-10] 2023-02-10 hour 21: 157437 events in 4 files, snapshot 4762690567332556277 (task 13008 ms: download 5724 ms overlapping gunzip 808 ms, parse 3427 ms, sort 101 ms, write 7202 ms, index 443 ms: 1 candidates, 64597 repo-hours, 954 releases; waiting 749 ms; commit 1484 ms)
2026-11-07T15:24:14Z [load_day 2023-02-10] 2023-02-10 hour 22: 155785 events in 4 files, snapshot 3813561240423061981 (task 15078 ms: download 9799 ms overlapping gunzip 1124 ms, parse 4457 ms, sort 125 ms, write 8079 ms, index 412 ms: 2 candidates, 60237 repo-hours, 816 releases; waiting 518 ms; commit 1361 ms)
2026-11-07T15:24:15Z [load_day 2023-02-10] 2023-02-10 hour 23: 137464 events in 3 files, snapshot 2345730757327071333 (task 12110 ms: download 5695 ms overlapping gunzip 799 ms, parse 3280 ms, sort 95 ms, write 6751 ms, index 368 ms: 1 candidates, 58074 repo-hours, 722 releases; waiting 521 ms; commit 1236 ms)
2026-11-07T15:24:22Z [load_day 2023-02-10] 2023-02-10: repo_hour merged from 24 files to 1 (1810858 rows, 7306 ms)
2026-11-07T15:24:24Z [load_day 2023-02-10] 2023-02-10: index committed in 9440 ms (23 + 1 + 24 files)
2026-11-07T15:24:24Z [load_day 2023-02-10] 2023-02-10: 4111513 events in 24 hours
2026-11-07T15:24:24Z [load_day 2023-02-10] attempt 1 succeeded