orcaLog in

Runs · run 1262

load_day 2023-07-03, attempt 1 succeeded

Host
3c2b29713ce8:83576
Started
2026-11-07T22:36:27Z
Ended
2026-11-07T22:40:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1262/load_day/2023-07-03/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:36:27Z [load_day 2023-07-03] attempt 1 started
2026-11-07T22:36:28Z [load_day 2023-07-03] 2023-07-03: 2 hours in flight, about 1200 MB
2026-11-07T22:36:42Z [load_day 2023-07-03] 2023-07-03 hour 0: 115832 events in 3 files, snapshot 214352911532500823 (task 10661 ms: download 5174 ms overlapping gunzip 634 ms, parse 2709 ms, sort 99 ms, write 5762 ms, index 396 ms: 5 candidates, 57871 repo-hours, 768 releases; waiting 722 ms; commit 2299 ms)
2026-11-07T22:36:44Z [load_day 2023-07-03] 2023-07-03 hour 1: 140394 events in 3 files, snapshot 9126792915047018580 (task 11829 ms: download 5290 ms overlapping gunzip 703 ms, parse 3045 ms, sort 76 ms, write 6672 ms, index 538 ms: 6 candidates, 78217 repo-hours, 764 releases; waiting 502 ms; commit 1774 ms)
2026-11-07T22:36:54Z [load_day 2023-07-03] 2023-07-03 hour 2: 130995 events in 3 files, snapshot 1931310064889566019 (task 11203 ms: download 5170 ms overlapping gunzip 742 ms, parse 3078 ms, sort 86 ms, write 6038 ms, index 482 ms: 7 candidates, 63849 repo-hours, 695 releases; waiting 504 ms; commit 1959 ms)
2026-11-07T22:36:57Z [load_day 2023-07-03] 2023-07-03 hour 3: 123191 events in 3 files, snapshot 4050198171618541491 (task 10632 ms: download 4889 ms overlapping gunzip 634 ms, parse 2556 ms, sort 71 ms, write 6176 ms, index 385 ms: 5 candidates, 53610 repo-hours, 914 releases; waiting 517 ms; commit 2199 ms)
2026-11-07T22:37:07Z [load_day 2023-07-03] 2023-07-03 hour 4: 121471 events in 3 files, snapshot 8626287177478204006 (task 11250 ms: download 5384 ms overlapping gunzip 654 ms, parse 2752 ms, sort 74 ms, write 6587 ms, index 367 ms: 12 candidates, 49360 repo-hours, 615 releases; waiting 517 ms; commit 2005 ms)
2026-11-07T22:37:10Z [load_day 2023-07-03] 2023-07-03 hour 5: 130372 events in 3 files, snapshot 2558253933004642992 (task 11863 ms: download 5632 ms overlapping gunzip 776 ms, parse 3374 ms, sort 111 ms, write 6326 ms, index 402 ms: 9 candidates, 55130 repo-hours, 766 releases; waiting 591 ms; commit 2923 ms)
2026-11-07T22:37:25Z [load_day 2023-07-03] 2023-07-03 hour 6: 156741 events in 4 files, snapshot 4734853034589373878 (task 13985 ms: download 6055 ms overlapping gunzip 892 ms, parse 3812 ms, sort 108 ms, write 7773 ms, index 598 ms: 8 candidates, 72460 repo-hours, 864 releases; waiting 514 ms; commit 4965 ms)
2026-11-07T22:37:27Z [load_day 2023-07-03] 2023-07-03 hour 7: 171518 events in 4 files, snapshot 3966749434936312960 (task 16088 ms: download 9596 ms overlapping gunzip 990 ms, parse 4237 ms, sort 103 ms, write 9415 ms, index 536 ms: 11 candidates, 74878 repo-hours, 894 releases; waiting 509 ms; commit 2022 ms)
2026-11-07T22:37:42Z [load_day 2023-07-03] 2023-07-03 hour 8: 184041 events in 4 files, snapshot 2983380882172866495 (task 18401 ms: download 10934 ms overlapping gunzip 1104 ms, parse 4756 ms, sort 131 ms, write 10978 ms, index 655 ms: 10 candidates, 80984 repo-hours, 1031 releases; waiting 513 ms; commit 2037 ms)
2026-11-07T22:37:46Z [load_day 2023-07-03] 2023-07-03 hour 9: 185784 events in 4 files, snapshot 4841456274293087784 (task 18876 ms: download 11080 ms overlapping gunzip 1089 ms, parse 4601 ms, sort 117 ms, write 11704 ms, index 536 ms: 10 candidates, 81543 repo-hours, 1218 releases; waiting 376 ms; commit 2172 ms)
2026-11-07T22:38:01Z [load_day 2023-07-03] 2023-07-03 hour 10: 178589 events in 4 files, snapshot 2777557262997697882 (task 17642 ms: download 10476 ms overlapping gunzip 1046 ms, parse 4415 ms, sort 110 ms, write 10626 ms, index 643 ms: 3 candidates, 78924 repo-hours, 946 releases; waiting 491 ms; commit 2065 ms)
2026-11-07T22:38:06Z [load_day 2023-07-03] 2023-07-03 hour 11: 180116 events in 4 files, snapshot 3393552930146701150 (task 18592 ms: download 10847 ms overlapping gunzip 1077 ms, parse 4638 ms, sort 146 ms, write 11427 ms, index 496 ms: 5 candidates, 76707 repo-hours, 961 releases; waiting 510 ms; commit 2262 ms)
2026-11-07T22:38:20Z [load_day 2023-07-03] 2023-07-03 hour 12: 201111 events in 5 files, snapshot 4200382985082882131 (task 18543 ms: download 10106 ms overlapping gunzip 975 ms, parse 4187 ms, sort 159 ms, write 11773 ms, index 665 ms: 7 candidates, 102999 repo-hours, 922 releases; waiting 548 ms; commit 1992 ms)
2026-11-07T22:38:27Z [load_day 2023-07-03] 2023-07-03 hour 13: 212441 events in 5 files, snapshot 1108377907242763602 (task 20166 ms: download 13739 ms overlapping gunzip 1190 ms, parse 5370 ms, sort 193 ms, write 11544 ms, index 788 ms: 17 candidates, 105934 repo-hours, 1075 releases; waiting 787 ms; commit 2338 ms)
2026-11-07T22:38:45Z [load_day 2023-07-03] 2023-07-03 hour 14: 198882 events in 4 files, snapshot 6055455059261577142 (task 19409 ms: download 10999 ms overlapping gunzip 1131 ms, parse 4889 ms, sort 142 ms, write 11828 ms, index 606 ms: 8 candidates, 89740 repo-hours, 1106 releases; waiting 502 ms; commit 6924 ms)
2026-11-07T22:38:47Z [load_day 2023-07-03] 2023-07-03 hour 15: 191594 events in 4 files, snapshot 8441784824401454020 (task 18005 ms: download 10125 ms overlapping gunzip 1057 ms, parse 4720 ms, sort 122 ms, write 10620 ms, index 604 ms: 10 candidates, 85413 repo-hours, 1130 releases; waiting 526 ms; commit 1831 ms)
2026-11-07T22:38:58Z [load_day 2023-07-03] 2023-07-03 hour 16: 186149 events in 4 files, snapshot 2360867770961101012 (task 16766 ms: download 9880 ms overlapping gunzip 1037 ms, parse 4391 ms, sort 118 ms, write 9339 ms, index 573 ms: 9 candidates, 81883 repo-hours, 991 releases; waiting 954 ms; commit 2350 ms)
2026-11-07T22:39:06Z [load_day 2023-07-03] 2023-07-03 hour 17: 179065 events in 4 files, snapshot 1004592359129952919 (task 18012 ms: download 9511 ms overlapping gunzip 1022 ms, parse 4224 ms, sort 110 ms, write 10660 ms, index 821 ms: 14 candidates, 76089 repo-hours, 972 releases; waiting 877 ms; commit 2182 ms)
2026-11-07T22:39:19Z [load_day 2023-07-03] 2023-07-03 hour 18: 184362 events in 4 files, snapshot 3603717345811503914 (task 19564 ms: download 11624 ms overlapping gunzip 1457 ms, parse 5980 ms, sort 153 ms, write 10617 ms, index 582 ms: 10 candidates, 81379 repo-hours, 1098 releases; waiting 493 ms; commit 2507 ms)
2026-11-07T22:39:24Z [load_day 2023-07-03] 2023-07-03 hour 19: 168500 events in 4 files, snapshot 7482377362225827489 (task 17197 ms: download 10225 ms overlapping gunzip 984 ms, parse 4007 ms, sort 103 ms, write 10711 ms, index 537 ms: 6 candidates, 70421 repo-hours, 1007 releases; waiting 551 ms; commit 2163 ms)
2026-11-07T22:39:39Z [load_day 2023-07-03] 2023-07-03 hour 20: 166120 events in 4 files, snapshot 2530916337338391500 (task 18515 ms: download 11329 ms overlapping gunzip 1136 ms, parse 4792 ms, sort 159 ms, write 10920 ms, index 674 ms: 6 candidates, 70231 repo-hours, 851 releases; waiting 547 ms; commit 3475 ms)
2026-11-07T22:39:42Z [load_day 2023-07-03] 2023-07-03 hour 21: 150214 events in 4 files, snapshot 6588389715775000518 (task 15615 ms: download 6944 ms overlapping gunzip 917 ms, parse 3970 ms, sort 107 ms, write 9227 ms, index 682 ms: 8 candidates, 58341 repo-hours, 891 releases; waiting 391 ms; commit 2367 ms)
2026-11-07T22:39:53Z [load_day 2023-07-03] 2023-07-03 hour 22: 136052 events in 3 files, snapshot 285154046576242801 (task 14415 ms: download 6872 ms overlapping gunzip 1098 ms, parse 4335 ms, sort 137 ms, write 7627 ms, index 352 ms: 10 candidates, 51539 repo-hours, 774 releases; waiting 468 ms; commit 2054 ms)
2026-11-07T22:39:55Z [load_day 2023-07-03] 2023-07-03 hour 23: 122426 events in 3 files, snapshot 5312356589235828856 (task 12266 ms: download 5777 ms overlapping gunzip 706 ms, parse 2984 ms, sort 92 ms, write 7633 ms, index 365 ms: 6 candidates, 51138 repo-hours, 624 releases; waiting 241 ms; commit 1812 ms)
2026-11-07T22:40:03Z [load_day 2023-07-03] 2023-07-03: repo_hour merged from 24 files to 1 (1748640 rows, 7539 ms)
2026-11-07T22:40:05Z [load_day 2023-07-03] 2023-07-03: index committed in 9668 ms (24 + 1 + 24 files)
2026-11-07T22:40:05Z [load_day 2023-07-03] 2023-07-03: 3915960 events in 24 hours
2026-11-07T22:40:05Z [load_day 2023-07-03] attempt 1 succeeded