orcaLog in

Runs · run 1390

load_day 2023-08-14, attempt 1 succeeded

Host
3c2b29713ce8:223599
Started
2026-11-07T23:52:04Z
Ended
2026-11-07T23:56:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1390/load_day/2023-08-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:52:04Z [load_day 2023-08-14] attempt 1 started
2026-11-07T23:52:05Z [load_day 2023-08-14] 2023-08-14: 2 hours in flight, about 1200 MB
2026-11-07T23:52:22Z [load_day 2023-08-14] 2023-08-14 hour 0: 145168 events in 3 files, snapshot 2694751270888910664 (task 12349 ms: download 5603 ms overlapping gunzip 795 ms, parse 3426 ms, sort 96 ms, write 6652 ms, index 599 ms: 4 candidates, 76844 repo-hours, 895 releases; waiting 497 ms; commit 2281 ms)
2026-11-07T23:52:26Z [load_day 2023-08-14] 2023-08-14 hour 1: 158569 events in 4 files, snapshot 1556654838936338333 (task 15477 ms: download 6589 ms overlapping gunzip 1044 ms, parse 4516 ms, sort 123 ms, write 8103 ms, index 887 ms: 5 candidates, 84349 repo-hours, 710 releases; waiting 515 ms; commit 3283 ms)
2026-11-07T23:52:38Z [load_day 2023-08-14] 2023-08-14 hour 2: 132689 events in 3 files, snapshot 252610883658663864 (task 13573 ms: download 5949 ms overlapping gunzip 843 ms, parse 3444 ms, sort 139 ms, write 7941 ms, index 391 ms: 3 candidates, 55218 repo-hours, 741 releases; waiting 536 ms; commit 3837 ms)
2026-11-07T23:52:40Z [load_day 2023-08-14] 2023-08-14 hour 3: 136153 events in 3 files, snapshot 2141747135296459928 (task 13994 ms: download 5999 ms overlapping gunzip 740 ms, parse 3088 ms, sort 125 ms, write 8569 ms, index 631 ms: 3 candidates, 56024 repo-hours, 835 releases; waiting 524 ms; commit 2197 ms)
2026-11-07T23:52:51Z [load_day 2023-08-14] 2023-08-14 hour 4: 132466 events in 3 files, snapshot 2471475481485856338 (task 13595 ms: download 5785 ms overlapping gunzip 984 ms, parse 3875 ms, sort 143 ms, write 7331 ms, index 442 ms: 3 candidates, 51714 repo-hours, 593 releases; waiting 421 ms; commit 1952 ms)
2026-11-07T23:52:57Z [load_day 2023-08-14] 2023-08-14 hour 5: 141822 events in 3 files, snapshot 6412384162794717324 (task 15327 ms: download 6629 ms overlapping gunzip 1004 ms, parse 4232 ms, sort 171 ms, write 8669 ms, index 393 ms: 1 candidates, 57228 repo-hours, 865 releases; waiting 543 ms; commit 2710 ms)
2026-11-07T23:53:11Z [load_day 2023-08-14] 2023-08-14 hour 6: 169078 events in 4 files, snapshot 3732375184332126737 (task 17605 ms: download 10430 ms overlapping gunzip 967 ms, parse 4083 ms, sort 196 ms, write 10758 ms, index 774 ms: 4 candidates, 77687 repo-hours, 901 releases; waiting 523 ms; commit 4075 ms)
2026-11-07T23:53:25Z [load_day 2023-08-14] 2023-08-14 hour 7: 168152 events in 4 files, snapshot 840120090586199650 (task 19272 ms: download 11549 ms overlapping gunzip 1214 ms, parse 5108 ms, sort 166 ms, write 11464 ms, index 533 ms: 4 candidates, 70461 repo-hours, 935 releases; waiting 499 ms; commit 10403 ms)
2026-11-07T23:53:32Z [load_day 2023-08-14] 2023-08-14 hour 8: 169704 events in 4 files, snapshot 8109839474916989098 (task 20744 ms: download 12899 ms overlapping gunzip 1271 ms, parse 5272 ms, sort 123 ms, write 12627 ms, index 721 ms: 4 candidates, 75810 repo-hours, 1028 releases; waiting 506 ms; commit 2489 ms)
2026-11-07T23:53:41Z [load_day 2023-08-14] 2023-08-14 hour 9: 179249 events in 4 files, snapshot 7295346073549859661 (task 20866 ms: download 12652 ms overlapping gunzip 1263 ms, parse 5410 ms, sort 193 ms, write 12643 ms, index 612 ms: 6 candidates, 80687 repo-hours, 1113 releases; waiting 488 ms; commit 5189 ms)
2026-11-07T23:53:52Z [load_day 2023-08-14] 2023-08-14 hour 10: 186406 events in 4 files, snapshot 4769163616275098311 (task 19047 ms: download 11179 ms overlapping gunzip 1137 ms, parse 4789 ms, sort 130 ms, write 11477 ms, index 746 ms: 4 candidates, 86206 repo-hours, 1007 releases; waiting 533 ms; commit 2411 ms)
2026-11-07T23:54:03Z [load_day 2023-08-14] 2023-08-14 hour 11: 182086 events in 4 files, snapshot 4964457538548745334 (task 19347 ms: download 11386 ms overlapping gunzip 1290 ms, parse 5552 ms, sort 121 ms, write 10874 ms, index 534 ms: 4 candidates, 73442 repo-hours, 958 releases; waiting 710 ms; commit 2782 ms)
2026-11-07T23:54:15Z [load_day 2023-08-14] 2023-08-14 hour 12: 210069 events in 5 files, snapshot 1749127469558347277 (task 19748 ms: download 10173 ms overlapping gunzip 1149 ms, parse 4930 ms, sort 138 ms, write 11996 ms, index 750 ms: 6 candidates, 101006 repo-hours, 890 releases; waiting 496 ms; commit 4835 ms)
2026-11-07T23:54:26Z [load_day 2023-08-14] 2023-08-14 hour 13: 192187 events in 4 files, snapshot 958605195183098834 (task 20435 ms: download 10655 ms overlapping gunzip 1236 ms, parse 5197 ms, sort 172 ms, write 12433 ms, index 788 ms: 7 candidates, 93806 repo-hours, 908 releases; waiting 365 ms; commit 4313 ms)
2026-11-07T23:54:33Z [load_day 2023-08-14] 2023-08-14 hour 14: 178946 events in 4 files, snapshot 3277469760668387530 (task 19111 ms: download 11574 ms overlapping gunzip 1175 ms, parse 5215 ms, sort 127 ms, write 11259 ms, index 553 ms: 8 candidates, 83964 repo-hours, 971 releases; waiting 490 ms; commit 2485 ms)
2026-11-07T23:54:41Z [load_day 2023-08-14] 2023-08-14 hour 15: 175596 events in 4 files, snapshot 5819261480431140880 (task 16535 ms: download 9497 ms overlapping gunzip 1016 ms, parse 4234 ms, sort 101 ms, write 9820 ms, index 551 ms: 9 candidates, 80903 repo-hours, 992 releases; waiting 495 ms; commit 1991 ms)
2026-11-07T23:54:51Z [load_day 2023-08-14] 2023-08-14 hour 16: 168950 events in 4 files, snapshot 7131207479650027779 (task 17100 ms: download 9086 ms overlapping gunzip 951 ms, parse 4113 ms, sort 117 ms, write 10592 ms, index 529 ms: 6 candidates, 76214 repo-hours, 866 releases; waiting 534 ms; commit 2605 ms)
2026-11-07T23:55:01Z [load_day 2023-08-14] 2023-08-14 hour 17: 173062 events in 4 files, snapshot 9165947381364123900 (task 18415 ms: download 11508 ms overlapping gunzip 1040 ms, parse 4421 ms, sort 164 ms, write 11225 ms, index 516 ms: 13 candidates, 73643 repo-hours, 785 releases; waiting 737 ms; commit 2836 ms)
2026-11-07T23:55:11Z [load_day 2023-08-14] 2023-08-14 hour 18: 177654 events in 4 files, snapshot 5026433802728087009 (task 19429 ms: download 10036 ms overlapping gunzip 1071 ms, parse 4575 ms, sort 183 ms, write 12021 ms, index 781 ms: 5 candidates, 77567 repo-hours, 937 releases; waiting 525 ms; commit 2582 ms)
2026-11-07T23:55:25Z [load_day 2023-08-14] 2023-08-14 hour 19: 176228 events in 4 files, snapshot 4251066010401575508 (task 20189 ms: download 11695 ms overlapping gunzip 1366 ms, parse 5680 ms, sort 199 ms, write 11590 ms, index 536 ms: 7 candidates, 69210 repo-hours, 877 releases; waiting 492 ms; commit 4803 ms)
2026-11-07T23:55:34Z [load_day 2023-08-14] 2023-08-14 hour 20: 171773 events in 4 files, snapshot 4180013513775452572 (task 18793 ms: download 11606 ms overlapping gunzip 1301 ms, parse 5419 ms, sort 175 ms, write 10578 ms, index 533 ms: 2 candidates, 71041 repo-hours, 977 releases; waiting 486 ms; commit 5268 ms)
2026-11-07T23:55:44Z [load_day 2023-08-14] 2023-08-14 hour 21: 162783 events in 4 files, snapshot 3511681935632442116 (task 17893 ms: download 11367 ms overlapping gunzip 1090 ms, parse 4541 ms, sort 152 ms, write 10894 ms, index 456 ms: 6 candidates, 62208 repo-hours, 862 releases; waiting 492 ms; commit 2634 ms)
2026-11-07T23:55:51Z [load_day 2023-08-14] 2023-08-14 hour 22: 146735 events in 3 files, snapshot 4555876146289635349 (task 16696 ms: download 7805 ms overlapping gunzip 1168 ms, parse 4814 ms, sort 123 ms, write 9383 ms, index 423 ms: 3 candidates, 55018 repo-hours, 873 releases; waiting 460 ms; commit 3541 ms)
2026-11-07T23:55:58Z [load_day 2023-08-14] 2023-08-14 hour 23: 139968 events in 3 files, snapshot 2773036847192240522 (task 13781 ms: download 6636 ms overlapping gunzip 980 ms, parse 4049 ms, sort 99 ms, write 7727 ms, index 418 ms: 2 candidates, 53777 repo-hours, 730 releases; waiting 184 ms; commit 1875 ms)
2026-11-07T23:56:06Z [load_day 2023-08-14] 2023-08-14: repo_hour merged from 24 files to 1 (1744027 rows, 7862 ms)
2026-11-07T23:56:08Z [load_day 2023-08-14] 2023-08-14: index committed in 9757 ms (24 + 1 + 24 files)
2026-11-07T23:56:08Z [load_day 2023-08-14] 2023-08-14: 3975493 events in 24 hours
2026-11-07T23:56:08Z [load_day 2023-08-14] attempt 1 succeeded