orcaLog in

Runs · run 1194

load_day 2023-06-19, attempt 1 succeeded

Host
3c2b29713ce8:8409
Started
2026-11-07T21:38:35Z
Ended
2026-11-07T21:40:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1194/load_day/2023-06-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:38:35Z [load_day 2023-06-19] attempt 1 started
2026-11-07T21:38:37Z [load_day 2023-06-19] 2023-06-19: 4 hours in flight, about 2100 MB
2026-11-07T21:38:51Z [load_day 2023-06-19] 2023-06-19 hour 0: 121768 events in 3 files, snapshot 6181913333099880263 (task 11043 ms: download 2270 ms overlapping gunzip 589 ms, parse 2777 ms, sort 90 ms, write 6335 ms, index 387 ms: 5 candidates, 63475 repo-hours, 786 releases; waiting 514 ms; commit 1898 ms)
2026-11-07T21:38:55Z [load_day 2023-06-19] 2023-06-19 hour 1: 150724 events in 4 files, snapshot 5294442563502367798 (task 15169 ms: download 6414 ms overlapping gunzip 880 ms, parse 3741 ms, sort 91 ms, write 9185 ms, index 516 ms: 7 candidates, 79899 repo-hours, 745 releases; waiting 499 ms; commit 1711 ms)
2026-11-07T21:38:57Z [load_day 2023-06-19] 2023-06-19 hour 2: 136265 events in 3 files, snapshot 7456236790948794487 (task 15181 ms: download 7660 ms overlapping gunzip 848 ms, parse 3719 ms, sort 81 ms, write 8088 ms, index 463 ms: 9 candidates, 66309 repo-hours, 638 releases; waiting 1677 ms; commit 1914 ms)
2026-11-07T21:38:59Z [load_day 2023-06-19] 2023-06-19 hour 3: 131250 events in 3 files, snapshot 4841543933256429578 (task 13609 ms: download 6869 ms overlapping gunzip 782 ms, parse 3287 ms, sort 98 ms, write 7828 ms, index 519 ms: 4 candidates, 56389 repo-hours, 787 releases; waiting 790 ms; commit 2155 ms)
2026-11-07T21:39:05Z [load_day 2023-06-19] 2023-06-19 hour 4: 128394 events in 3 files, snapshot 5973334973002594230 (task 12776 ms: download 5449 ms overlapping gunzip 707 ms, parse 2868 ms, sort 85 ms, write 8160 ms, index 386 ms: 2 candidates, 53081 repo-hours, 668 releases; waiting 216 ms; commit 2456 ms)
2026-11-07T21:39:11Z [load_day 2023-06-19] 2023-06-19 hour 5: 142707 events in 3 files, snapshot 2260581603904806723 (task 15190 ms: download 7181 ms overlapping gunzip 873 ms, parse 3657 ms, sort 98 ms, write 9384 ms, index 393 ms: 3 candidates, 59447 repo-hours, 774 releases; waiting 511 ms; commit 2340 ms)
2026-11-07T21:39:18Z [load_day 2023-06-19] 2023-06-19 hour 6: 166292 events in 4 files, snapshot 1457495387494391910 (task 18162 ms: download 10857 ms overlapping gunzip 1066 ms, parse 4294 ms, sort 97 ms, write 11134 ms, index 726 ms: 4 candidates, 75413 repo-hours, 886 releases; waiting 525 ms; commit 3821 ms)
2026-11-07T21:39:20Z [load_day 2023-06-19] 2023-06-19 hour 7: 161926 events in 4 files, snapshot 4710235025533552717 (task 18049 ms: download 11125 ms overlapping gunzip 919 ms, parse 4052 ms, sort 111 ms, write 11284 ms, index 544 ms: 5 candidates, 75767 repo-hours, 860 releases; waiting 821 ms; commit 2457 ms)
2026-11-07T21:39:27Z [load_day 2023-06-19] 2023-06-19 hour 8: 164467 events in 4 files, snapshot 2237458583698893932 (task 21589 ms: download 13614 ms overlapping gunzip 1140 ms, parse 5018 ms, sort 131 ms, write 12198 ms, index 533 ms: 6 candidates, 78559 repo-hours, 833 releases; waiting 2240 ms; commit 2019 ms)
2026-11-07T21:39:32Z [load_day 2023-06-19] 2023-06-19 hour 9: 175707 events in 4 files, snapshot 3105589001971332811 (task 19887 ms: download 11648 ms overlapping gunzip 1018 ms, parse 4338 ms, sort 105 ms, write 13147 ms, index 589 ms: 8 candidates, 82366 repo-hours, 1055 releases; waiting 382 ms; commit 1904 ms)
2026-11-07T21:39:38Z [load_day 2023-06-19] 2023-06-19 hour 10: 170964 events in 4 files, snapshot 126954550778963136 (task 18924 ms: download 11172 ms overlapping gunzip 1067 ms, parse 4634 ms, sort 110 ms, write 11928 ms, index 542 ms: 7 candidates, 78065 repo-hours, 912 releases; waiting 346 ms; commit 2122 ms)
2026-11-07T21:39:42Z [load_day 2023-06-19] 2023-06-19 hour 11: 173327 events in 4 files, snapshot 2296693069009359885 (task 20500 ms: download 12048 ms overlapping gunzip 1100 ms, parse 4829 ms, sort 101 ms, write 13009 ms, index 760 ms: 7 candidates, 77444 repo-hours, 942 releases; waiting 440 ms; commit 2041 ms)
2026-11-07T21:39:49Z [load_day 2023-06-19] 2023-06-19 hour 12: 198355 events in 4 files, snapshot 225105220863870495 (task 20670 ms: download 10955 ms overlapping gunzip 1079 ms, parse 4841 ms, sort 112 ms, write 13197 ms, index 678 ms: 5 candidates, 102433 repo-hours, 892 releases; waiting 484 ms; commit 1952 ms)
2026-11-07T21:39:53Z [load_day 2023-06-19] 2023-06-19 hour 13: 186955 events in 4 files, snapshot 137933549166901868 (task 20579 ms: download 11312 ms overlapping gunzip 1040 ms, parse 4638 ms, sort 118 ms, write 13278 ms, index 698 ms: 5 candidates, 96051 repo-hours, 884 releases; waiting 511 ms; commit 1927 ms)
2026-11-07T21:40:00Z [load_day 2023-06-19] 2023-06-19 hour 14: 185640 events in 4 files, snapshot 8688179260946229733 (task 21544 ms: download 12309 ms overlapping gunzip 1228 ms, parse 5311 ms, sort 121 ms, write 13542 ms, index 621 ms: 8 candidates, 87155 repo-hours, 945 releases; waiting 428 ms; commit 1833 ms)
2026-11-07T21:40:03Z [load_day 2023-06-19] 2023-06-19 hour 15: 176822 events in 4 files, snapshot 4185438912026720760 (task 20081 ms: download 11851 ms overlapping gunzip 996 ms, parse 4306 ms, sort 151 ms, write 12905 ms, index 908 ms: 13 candidates, 83085 repo-hours, 996 releases; waiting 531 ms; commit 2481 ms)
2026-11-07T21:40:09Z [load_day 2023-06-19] 2023-06-19 hour 16: 169931 events in 4 files, snapshot 6078335293714781372 (task 19176 ms: download 10791 ms overlapping gunzip 1008 ms, parse 4334 ms, sort 97 ms, write 12101 ms, index 747 ms: 10 candidates, 78954 repo-hours, 864 releases; waiting 672 ms; commit 1934 ms)
2026-11-07T21:40:14Z [load_day 2023-06-19] 2023-06-19 hour 17: 167508 events in 4 files, snapshot 8149699025232247047 (task 19550 ms: download 11777 ms overlapping gunzip 1045 ms, parse 4443 ms, sort 208 ms, write 12367 ms, index 666 ms: 11 candidates, 74496 repo-hours, 823 releases; waiting 545 ms; commit 1975 ms)
2026-11-07T21:40:21Z [load_day 2023-06-19] 2023-06-19 hour 18: 185856 events in 4 files, snapshot 8037042258474207933 (task 20025 ms: download 11851 ms overlapping gunzip 1058 ms, parse 4684 ms, sort 140 ms, write 12789 ms, index 629 ms: 7 candidates, 82240 repo-hours, 1028 releases; waiting 490 ms; commit 2233 ms)
2026-11-07T21:40:23Z [load_day 2023-06-19] 2023-06-19 hour 19: 172134 events in 4 files, snapshot 7089804961505153697 (task 18844 ms: download 11431 ms overlapping gunzip 1006 ms, parse 4195 ms, sort 118 ms, write 12192 ms, index 488 ms: 9 candidates, 72025 repo-hours, 912 releases; waiting 504 ms; commit 2138 ms)
2026-11-07T21:40:29Z [load_day 2023-06-19] 2023-06-19 hour 20: 174980 events in 4 files, snapshot 1886824435993976345 (task 18805 ms: download 11122 ms overlapping gunzip 1048 ms, parse 4448 ms, sort 109 ms, write 11694 ms, index 585 ms: 4 candidates, 71946 repo-hours, 832 releases; waiting 529 ms; commit 1638 ms)
2026-11-07T21:40:31Z [load_day 2023-06-19] 2023-06-19 hour 21: 154778 events in 4 files, snapshot 8058987559257865669 (task 16698 ms: download 7252 ms overlapping gunzip 909 ms, parse 3791 ms, sort 106 ms, write 10494 ms, index 436 ms: 9 candidates, 61544 repo-hours, 858 releases; waiting 641 ms; commit 1829 ms)
2026-11-07T21:40:37Z [load_day 2023-06-19] 2023-06-19 hour 22: 139556 events in 3 files, snapshot 6619312314174986377 (task 14565 ms: download 6549 ms overlapping gunzip 819 ms, parse 3360 ms, sort 86 ms, write 9088 ms, index 385 ms: 11 candidates, 54960 repo-hours, 777 releases; waiting 538 ms; commit 2394 ms)
2026-11-07T21:40:38Z [load_day 2023-06-19] 2023-06-19 hour 23: 130036 events in 3 files, snapshot 7304441626950681759 (task 12183 ms: download 5631 ms overlapping gunzip 679 ms, parse 2834 ms, sort 99 ms, write 7592 ms, index 357 ms: 11 candidates, 53207 repo-hours, 648 releases; waiting 397 ms; commit 1608 ms)
2026-11-07T21:40:46Z [load_day 2023-06-19] 2023-06-19: repo_hour merged from 24 files to 1 (1764310 rows, 7058 ms)
2026-11-07T21:40:48Z [load_day 2023-06-19] 2023-06-19: index committed in 9213 ms (24 + 1 + 24 files)
2026-11-07T21:40:48Z [load_day 2023-06-19] 2023-06-19: 3866342 events in 24 hours
2026-11-07T21:40:48Z [load_day 2023-06-19] attempt 1 succeeded