orcaLog in

Runs · run 1284

load_day 2023-07-10, attempt 1 succeeded

Host
3c2b29713ce8:108364
Started
2026-11-07T22:49:19Z
Ended
2026-11-07T22:53:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1284/load_day/2023-07-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:49:20Z [load_day 2023-07-10] attempt 1 started
2026-11-07T22:49:21Z [load_day 2023-07-10] 2023-07-10: 2 hours in flight, about 1200 MB
2026-11-07T22:49:40Z [load_day 2023-07-10] 2023-07-10 hour 0: 126272 events in 3 files, snapshot 8814823877100823853 (task 13918 ms: download 6628 ms overlapping gunzip 973 ms, parse 4473 ms, sort 102 ms, write 7049 ms, index 499 ms: 7 candidates, 61393 repo-hours, 742 releases; waiting 503 ms; commit 3873 ms)
2026-11-07T22:49:44Z [load_day 2023-07-10] 2023-07-10 hour 1: 156347 events in 4 files, snapshot 2658159396373557027 (task 16775 ms: download 8012 ms overlapping gunzip 1083 ms, parse 5224 ms, sort 118 ms, write 8645 ms, index 924 ms: 4 candidates, 81810 repo-hours, 771 releases; waiting 501 ms; commit 3725 ms)
2026-11-07T22:49:55Z [load_day 2023-07-10] 2023-07-10 hour 2: 138394 events in 3 files, snapshot 4225905104233860603 (task 14185 ms: download 6719 ms overlapping gunzip 876 ms, parse 3872 ms, sort 115 ms, write 7893 ms, index 634 ms: 3 candidates, 65237 repo-hours, 648 releases; waiting 489 ms; commit 3254 ms)
2026-11-07T22:49:57Z [load_day 2023-07-10] 2023-07-10 hour 3: 135163 events in 3 files, snapshot 9003721255739161213 (task 12958 ms: download 5574 ms overlapping gunzip 781 ms, parse 3384 ms, sort 69 ms, write 7408 ms, index 466 ms: 3 candidates, 57200 repo-hours, 785 releases; waiting 526 ms; commit 2212 ms)
2026-11-07T22:50:09Z [load_day 2023-07-10] 2023-07-10 hour 4: 134230 events in 3 files, snapshot 1850001082306163720 (task 13950 ms: download 6208 ms overlapping gunzip 906 ms, parse 3738 ms, sort 101 ms, write 8007 ms, index 384 ms: 4 candidates, 53887 repo-hours, 611 releases; waiting 497 ms; commit 2136 ms)
2026-11-07T22:50:13Z [load_day 2023-07-10] 2023-07-10 hour 5: 144597 events in 3 files, snapshot 5444253267696294158 (task 14949 ms: download 6313 ms overlapping gunzip 923 ms, parse 3673 ms, sort 83 ms, write 8936 ms, index 449 ms: 4 candidates, 59416 repo-hours, 739 releases; waiting 506 ms; commit 2531 ms)
2026-11-07T22:50:24Z [load_day 2023-07-10] 2023-07-10 hour 6: 170894 events in 4 files, snapshot 5162148377971306426 (task 14631 ms: download 8548 ms overlapping gunzip 933 ms, parse 4057 ms, sort 115 ms, write 8248 ms, index 474 ms: 4 candidates, 77421 repo-hours, 888 releases; waiting 497 ms; commit 2060 ms)
2026-11-07T22:50:30Z [load_day 2023-07-10] 2023-07-10 hour 7: 174460 events in 4 files, snapshot 6180391672993863979 (task 15436 ms: download 8991 ms overlapping gunzip 982 ms, parse 4205 ms, sort 101 ms, write 8759 ms, index 572 ms: 10 candidates, 76507 repo-hours, 898 releases; waiting 521 ms; commit 2611 ms)
2026-11-07T22:50:46Z [load_day 2023-07-10] 2023-07-10 hour 8: 174834 events in 4 files, snapshot 6726515762561026833 (task 20672 ms: download 12013 ms overlapping gunzip 1141 ms, parse 4860 ms, sort 174 ms, write 12965 ms, index 678 ms: 3 candidates, 80510 repo-hours, 923 releases; waiting 505 ms; commit 2128 ms)
2026-11-07T22:50:54Z [load_day 2023-07-10] 2023-07-10 hour 9: 186452 events in 4 files, snapshot 7084012909797976866 (task 21767 ms: download 13836 ms overlapping gunzip 1442 ms, parse 6393 ms, sort 173 ms, write 12389 ms, index 581 ms: 4 candidates, 80757 repo-hours, 1184 releases; waiting 497 ms; commit 4882 ms)
2026-11-07T22:51:06Z [load_day 2023-07-10] 2023-07-10 hour 10: 184394 events in 4 files, snapshot 8023961177736476702 (task 19512 ms: download 11454 ms overlapping gunzip 1172 ms, parse 5108 ms, sort 121 ms, write 11991 ms, index 549 ms: 7 candidates, 79319 repo-hours, 913 releases; waiting 202 ms; commit 1866 ms)
2026-11-07T22:51:13Z [load_day 2023-07-10] 2023-07-10 hour 11: 178884 events in 4 files, snapshot 7398511072727480797 (task 19687 ms: download 12184 ms overlapping gunzip 1276 ms, parse 5754 ms, sort 180 ms, write 11144 ms, index 609 ms: 5 candidates, 75660 repo-hours, 965 releases; waiting 441 ms; commit 2472 ms)
2026-11-07T22:51:30Z [load_day 2023-07-10] 2023-07-10 hour 12: 213589 events in 5 files, snapshot 7300052605981839367 (task 21303 ms: download 11407 ms overlapping gunzip 1162 ms, parse 5071 ms, sort 212 ms, write 13312 ms, index 724 ms: 5 candidates, 106586 repo-hours, 1031 releases; waiting 510 ms; commit 3392 ms)
2026-11-07T22:51:36Z [load_day 2023-07-10] 2023-07-10 hour 13: 194821 events in 4 files, snapshot 884885095564696665 (task 21693 ms: download 11301 ms overlapping gunzip 1380 ms, parse 6138 ms, sort 215 ms, write 12730 ms, index 775 ms: 10 candidates, 99773 repo-hours, 958 releases; waiting 186 ms; commit 2584 ms)
2026-11-07T22:51:52Z [load_day 2023-07-10] 2023-07-10 hour 14: 192047 events in 4 files, snapshot 8452481617806781984 (task 22539 ms: download 13258 ms overlapping gunzip 1405 ms, parse 6176 ms, sort 186 ms, write 13130 ms, index 774 ms: 5 candidates, 87835 repo-hours, 1060 releases; waiting 527 ms; commit 2424 ms)
2026-11-07T22:51:56Z [load_day 2023-07-10] 2023-07-10 hour 15: 179019 events in 4 files, snapshot 9062583539917624803 (task 19807 ms: download 11463 ms overlapping gunzip 1183 ms, parse 5115 ms, sort 102 ms, write 12190 ms, index 633 ms: 3 candidates, 85058 repo-hours, 1077 releases; waiting 308 ms; commit 2426 ms)
2026-11-07T22:52:15Z [load_day 2023-07-10] 2023-07-10 hour 16: 181762 events in 4 files, snapshot 2920528178885806448 (task 21719 ms: download 12620 ms overlapping gunzip 1206 ms, parse 5284 ms, sort 116 ms, write 13658 ms, index 689 ms: 5 candidates, 83403 repo-hours, 904 releases; waiting 464 ms; commit 2251 ms)
2026-11-07T22:52:19Z [load_day 2023-07-10] 2023-07-10 hour 17: 181308 events in 4 files, snapshot 5281355072663957912 (task 21516 ms: download 12401 ms overlapping gunzip 1302 ms, parse 5436 ms, sort 119 ms, write 12809 ms, index 878 ms: 6 candidates, 78850 repo-hours, 968 releases; waiting 487 ms; commit 2108 ms)
2026-11-07T22:52:38Z [load_day 2023-07-10] 2023-07-10 hour 18: 189374 events in 4 files, snapshot 5549681703128914956 (task 21560 ms: download 12032 ms overlapping gunzip 1349 ms, parse 5724 ms, sort 132 ms, write 12968 ms, index 599 ms: 5 candidates, 86733 repo-hours, 959 releases; waiting 474 ms; commit 2764 ms)
2026-11-07T22:52:42Z [load_day 2023-07-10] 2023-07-10 hour 19: 184036 events in 4 files, snapshot 5489973887065145584 (task 22400 ms: download 12879 ms overlapping gunzip 1374 ms, parse 5514 ms, sort 167 ms, write 13925 ms, index 582 ms: 4 candidates, 77427 repo-hours, 941 releases; waiting 494 ms; commit 2324 ms)
2026-11-07T22:53:01Z [load_day 2023-07-10] 2023-07-10 hour 20: 187613 events in 4 files, snapshot 6429492089260099730 (task 22369 ms: download 13276 ms overlapping gunzip 1523 ms, parse 6320 ms, sort 119 ms, write 12780 ms, index 788 ms: 5 candidates, 76782 repo-hours, 1003 releases; waiting 525 ms; commit 2438 ms)
2026-11-07T22:53:03Z [load_day 2023-07-10] 2023-07-10 hour 21: 175233 events in 4 files, snapshot 3416434768201346098 (task 19690 ms: download 11630 ms overlapping gunzip 1208 ms, parse 5255 ms, sort 230 ms, write 11450 ms, index 749 ms: 3 candidates, 66780 repo-hours, 1110 releases; waiting 522 ms; commit 2591 ms)
2026-11-07T22:53:19Z [load_day 2023-07-10] 2023-07-10 hour 22: 161762 events in 4 files, snapshot 7329524604493377859 (task 17065 ms: download 10835 ms overlapping gunzip 1153 ms, parse 4766 ms, sort 116 ms, write 9933 ms, index 413 ms: 9 candidates, 60205 repo-hours, 851 releases; waiting 425 ms; commit 2043 ms)
2026-11-07T22:53:22Z [load_day 2023-07-10] 2023-07-10 hour 23: 152427 events in 4 files, snapshot 6054209297201590303 (task 16655 ms: download 7719 ms overlapping gunzip 1032 ms, parse 4290 ms, sort 96 ms, write 10020 ms, index 428 ms: 7 candidates, 58834 repo-hours, 864 releases; waiting 514 ms; commit 3128 ms)
2026-11-07T22:53:29Z [load_day 2023-07-10] 2023-07-10: repo_hour merged from 24 files to 1 (1817383 rows, 7739 ms)
2026-11-07T22:53:32Z [load_day 2023-07-10] 2023-07-10: index committed in 9884 ms (24 + 1 + 24 files)
2026-11-07T22:53:32Z [load_day 2023-07-10] 2023-07-10: 4097912 events in 24 hours
2026-11-07T22:53:32Z [load_day 2023-07-10] attempt 1 succeeded