orcaLog in

Runs · run 1185

load_day 2023-06-16, attempt 1 succeeded

Host
3c2b29713ce8:8031
Started
2026-11-07T21:33:39Z
Ended
2026-11-07T21:35:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1185/load_day/2023-06-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:33:39Z [load_day 2023-06-16] attempt 1 started
2026-11-07T21:33:41Z [load_day 2023-06-16] 2023-06-16: 4 hours in flight, about 2100 MB
2026-11-07T21:33:57Z [load_day 2023-06-16] 2023-06-16 hour 0: 139599 events in 3 files, snapshot 459218616306536758 (task 13075 ms: download 6147 ms overlapping gunzip 775 ms, parse 3493 ms, sort 141 ms, write 7319 ms, index 469 ms: 6 candidates, 69077 repo-hours, 792 releases; waiting 495 ms; commit 1474 ms)
2026-11-07T21:33:58Z [load_day 2023-06-16] 2023-06-16 hour 1: 157155 events in 4 files, snapshot 3855578732497307338 (task 14475 ms: download 6512 ms overlapping gunzip 840 ms, parse 3887 ms, sort 138 ms, write 8408 ms, index 496 ms: 8 candidates, 82898 repo-hours, 852 releases; waiting 398 ms; commit 1652 ms)
2026-11-07T21:34:00Z [load_day 2023-06-16] 2023-06-16 hour 2: 140060 events in 3 files, snapshot 4398911037495076780 (task 13462 ms: download 6211 ms overlapping gunzip 768 ms, parse 3621 ms, sort 86 ms, write 7688 ms, index 462 ms: 6 candidates, 68974 repo-hours, 780 releases; waiting 534 ms; commit 1933 ms)
2026-11-07T21:34:02Z [load_day 2023-06-16] 2023-06-16 hour 3: 125074 events in 3 files, snapshot 7558910669933162922 (task 12406 ms: download 6120 ms overlapping gunzip 778 ms, parse 3493 ms, sort 72 ms, write 6877 ms, index 365 ms: 4 candidates, 56987 repo-hours, 754 releases; waiting 515 ms; commit 1887 ms)
2026-11-07T21:34:10Z [load_day 2023-06-16] 2023-06-16 hour 4: 124902 events in 3 files, snapshot 1912582755431685279 (task 11759 ms: download 2007 ms overlapping gunzip 534 ms, parse 2341 ms, sort 82 ms, write 7500 ms, index 529 ms: 3 candidates, 54147 repo-hours, 646 releases; waiting 519 ms; commit 1908 ms)
2026-11-07T21:34:12Z [load_day 2023-06-16] 2023-06-16 hour 5: 134173 events in 3 files, snapshot 5100352779051915066 (task 13137 ms: download 5686 ms overlapping gunzip 715 ms, parse 3030 ms, sort 100 ms, write 8041 ms, index 490 ms: 2 candidates, 59464 repo-hours, 761 releases; waiting 494 ms; commit 2036 ms)
2026-11-07T21:34:17Z [load_day 2023-06-16] 2023-06-16 hour 6: 158983 events in 4 files, snapshot 3477538952146714888 (task 16526 ms: download 6201 ms overlapping gunzip 797 ms, parse 3596 ms, sort 100 ms, write 10617 ms, index 660 ms: 7 candidates, 74561 repo-hours, 946 releases; waiting 444 ms; commit 1789 ms)
2026-11-07T21:34:21Z [load_day 2023-06-16] 2023-06-16 hour 7: 162540 events in 4 files, snapshot 249867079160165696 (task 17457 ms: download 10157 ms overlapping gunzip 935 ms, parse 4141 ms, sort 113 ms, write 10756 ms, index 724 ms: 6 candidates, 75284 repo-hours, 869 releases; waiting 476 ms; commit 2246 ms)
2026-11-07T21:34:29Z [load_day 2023-06-16] 2023-06-16 hour 8: 175615 events in 4 files, snapshot 8651908104560756546 (task 18517 ms: download 10405 ms overlapping gunzip 922 ms, parse 4205 ms, sort 114 ms, write 12195 ms, index 559 ms: 20 candidates, 81631 repo-hours, 1100 releases; waiting 210 ms; commit 1668 ms)
2026-11-07T21:34:32Z [load_day 2023-06-16] 2023-06-16 hour 9: 177020 events in 4 files, snapshot 5404873245982859839 (task 19271 ms: download 11333 ms overlapping gunzip 1023 ms, parse 4721 ms, sort 133 ms, write 12279 ms, index 608 ms: 7 candidates, 81460 repo-hours, 1144 releases; waiting 220 ms; commit 1857 ms)
2026-11-07T21:34:36Z [load_day 2023-06-16] 2023-06-16 hour 10: 171358 events in 4 files, snapshot 2447314314323814140 (task 17278 ms: download 9988 ms overlapping gunzip 886 ms, parse 3909 ms, sort 145 ms, write 10963 ms, index 517 ms: 9 candidates, 77425 repo-hours, 943 releases; waiting 548 ms; commit 2196 ms)
2026-11-07T21:34:39Z [load_day 2023-06-16] 2023-06-16 hour 11: 173667 events in 4 files, snapshot 4307944934519338053 (task 17839 ms: download 9888 ms overlapping gunzip 899 ms, parse 4166 ms, sort 99 ms, write 11128 ms, index 658 ms: 4 candidates, 77667 repo-hours, 938 releases; waiting 528 ms; commit 2219 ms)
2026-11-07T21:34:51Z [load_day 2023-06-16] 2023-06-16 hour 12: 220274 events in 5 files, snapshot 3171964772622832267 (task 20731 ms: download 10690 ms overlapping gunzip 1017 ms, parse 4772 ms, sort 127 ms, write 13219 ms, index 685 ms: 14 candidates, 107594 repo-hours, 1029 releases; waiting 557 ms; commit 1966 ms)
2026-11-07T21:34:53Z [load_day 2023-06-16] 2023-06-16 hour 13: 195309 events in 4 files, snapshot 152964578133753898 (task 19531 ms: download 10482 ms overlapping gunzip 943 ms, parse 4215 ms, sort 115 ms, write 12620 ms, index 783 ms: 9 candidates, 98696 repo-hours, 1030 releases; waiting 523 ms; commit 2056 ms)
2026-11-07T21:34:57Z [load_day 2023-06-16] 2023-06-16 hour 14: 185660 events in 4 files, snapshot 2588395994920990881 (task 20583 ms: download 11838 ms overlapping gunzip 1127 ms, parse 5021 ms, sort 148 ms, write 12726 ms, index 803 ms: 7 candidates, 85197 repo-hours, 1024 releases; waiting 483 ms; commit 1934 ms)
2026-11-07T21:34:59Z [load_day 2023-06-16] 2023-06-16 hour 15: 167480 events in 4 files, snapshot 469015148018192464 (task 18568 ms: download 10938 ms overlapping gunzip 883 ms, parse 3972 ms, sort 99 ms, write 11722 ms, index 667 ms: 10 candidates, 78610 repo-hours, 1019 releases; waiting 741 ms; commit 2034 ms)
2026-11-07T21:35:10Z [load_day 2023-06-16] 2023-06-16 hour 16: 169015 events in 4 files, snapshot 4479173317223798405 (task 18006 ms: download 10639 ms overlapping gunzip 921 ms, parse 4014 ms, sort 120 ms, write 11549 ms, index 548 ms: 5 candidates, 76490 repo-hours, 824 releases; waiting 521 ms; commit 1817 ms)
2026-11-07T21:35:12Z [load_day 2023-06-16] 2023-06-16 hour 17: 161026 events in 4 files, snapshot 7706666077191844172 (task 17062 ms: download 7035 ms overlapping gunzip 844 ms, parse 3815 ms, sort 109 ms, write 10771 ms, index 553 ms: 5 candidates, 70577 repo-hours, 812 releases; waiting 551 ms; commit 2320 ms)
2026-11-07T21:35:15Z [load_day 2023-06-16] 2023-06-16 hour 18: 162970 events in 4 files, snapshot 1339669880854073010 (task 17199 ms: download 10097 ms overlapping gunzip 849 ms, parse 3579 ms, sort 117 ms, write 11192 ms, index 712 ms: 7 candidates, 73939 repo-hours, 869 releases; waiting 346 ms; commit 1843 ms)
2026-11-07T21:35:18Z [load_day 2023-06-16] 2023-06-16 hour 19: 150677 events in 4 files, snapshot 6534481168405274005 (task 15974 ms: download 6540 ms overlapping gunzip 793 ms, parse 3634 ms, sort 158 ms, write 10023 ms, index 469 ms: 9 candidates, 63867 repo-hours, 903 releases; waiting 533 ms; commit 2379 ms)
2026-11-07T21:35:26Z [load_day 2023-06-16] 2023-06-16 hour 20: 147757 events in 3 files, snapshot 6133763534975363490 (task 14960 ms: download 6093 ms overlapping gunzip 739 ms, parse 3437 ms, sort 92 ms, write 9523 ms, index 411 ms: 8 candidates, 63909 repo-hours, 893 releases; waiting 524 ms; commit 1562 ms)
2026-11-07T21:35:27Z [load_day 2023-06-16] 2023-06-16 hour 21: 138043 events in 3 files, snapshot 6619867669369042525 (task 13708 ms: download 5987 ms overlapping gunzip 745 ms, parse 3265 ms, sort 85 ms, write 8352 ms, index 345 ms: 10 candidates, 55720 repo-hours, 967 releases; waiting 571 ms; commit 1732 ms)
2026-11-07T21:35:29Z [load_day 2023-06-16] 2023-06-16 hour 22: 126755 events in 3 files, snapshot 4626096102652663088 (task 13139 ms: download 6394 ms overlapping gunzip 738 ms, parse 2891 ms, sort 88 ms, write 8332 ms, index 317 ms: 7 candidates, 51767 repo-hours, 759 releases; waiting 525 ms; commit 1833 ms)
2026-11-07T21:35:31Z [load_day 2023-06-16] 2023-06-16 hour 23: 115411 events in 3 files, snapshot 4287227546755999757 (task 11064 ms: download 5262 ms overlapping gunzip 615 ms, parse 2626 ms, sort 74 ms, write 6606 ms, index 303 ms: 4 candidates, 49031 repo-hours, 631 releases; waiting 519 ms; commit 1812 ms)
2026-11-07T21:35:38Z [load_day 2023-06-16] 2023-06-16: repo_hour merged from 24 files to 1 (1734972 rows, 7218 ms)
2026-11-07T21:35:40Z [load_day 2023-06-16] 2023-06-16: index committed in 8860 ms (24 + 1 + 24 files)
2026-11-07T21:35:40Z [load_day 2023-06-16] 2023-06-16: 3780523 events in 24 hours
2026-11-07T21:35:40Z [load_day 2023-06-16] attempt 1 succeeded