orcaLog in

Runs · run 1173

load_day 2023-06-12, attempt 1 succeeded

Host
3c2b29713ce8:7491
Started
2026-11-07T21:24:36Z
Ended
2026-11-07T21:27:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1173/load_day/2023-06-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:24:36Z [load_day 2023-06-12] attempt 1 started
2026-11-07T21:24:38Z [load_day 2023-06-12] 2023-06-12: 4 hours in flight, about 2100 MB
2026-11-07T21:24:52Z [load_day 2023-06-12] 2023-06-12 hour 0: 120627 events in 3 files, snapshot 5662914220026579348 (task 11346 ms: download 2906 ms overlapping gunzip 700 ms, parse 3156 ms, sort 88 ms, write 6064 ms, index 379 ms: 6 candidates, 62744 repo-hours, 711 releases; waiting 596 ms; commit 1651 ms)
2026-11-07T21:24:57Z [load_day 2023-06-12] 2023-06-12 hour 1: 157507 events in 4 files, snapshot 8034265866693365525 (task 16491 ms: download 7146 ms overlapping gunzip 1041 ms, parse 4521 ms, sort 185 ms, write 9395 ms, index 491 ms: 6 candidates, 80316 repo-hours, 792 releases; waiting 523 ms; commit 1697 ms)
2026-11-07T21:24:59Z [load_day 2023-06-12] 2023-06-12 hour 2: 135053 events in 3 files, snapshot 1564188281595771958 (task 14125 ms: download 6998 ms overlapping gunzip 908 ms, parse 3979 ms, sort 85 ms, write 7909 ms, index 435 ms: 9 candidates, 66281 repo-hours, 679 releases; waiting 498 ms; commit 1861 ms)
2026-11-07T21:25:01Z [load_day 2023-06-12] 2023-06-12 hour 3: 130283 events in 3 files, snapshot 9096086049833927458 (task 13361 ms: download 6707 ms overlapping gunzip 862 ms, parse 3857 ms, sort 79 ms, write 7323 ms, index 434 ms: 6 candidates, 55520 repo-hours, 793 releases; waiting 515 ms; commit 2363 ms)
2026-11-07T21:25:06Z [load_day 2023-06-12] 2023-06-12 hour 4: 125214 events in 3 files, snapshot 8960933067980538364 (task 12551 ms: download 5170 ms overlapping gunzip 672 ms, parse 2815 ms, sort 77 ms, write 7752 ms, index 458 ms: 3 candidates, 52321 repo-hours, 592 releases; waiting 513 ms; commit 2078 ms)
2026-11-07T21:25:14Z [load_day 2023-06-12] 2023-06-12 hour 5: 161690 events in 4 files, snapshot 3041179633365378412 (task 15563 ms: download 6512 ms overlapping gunzip 855 ms, parse 4019 ms, sort 101 ms, write 9390 ms, index 654 ms: 5 candidates, 75668 repo-hours, 751 releases; waiting 209 ms; commit 1892 ms)
2026-11-07T21:25:18Z [load_day 2023-06-12] 2023-06-12 hour 6: 172338 events in 4 files, snapshot 2297847543619573215 (task 18473 ms: download 10524 ms overlapping gunzip 946 ms, parse 4143 ms, sort 137 ms, write 11768 ms, index 547 ms: 9 candidates, 78229 repo-hours, 898 releases; waiting 557 ms; commit 1901 ms)
2026-11-07T21:25:21Z [load_day 2023-06-12] 2023-06-12 hour 7: 170531 events in 4 files, snapshot 3933192344232503217 (task 18680 ms: download 10721 ms overlapping gunzip 1037 ms, parse 4459 ms, sort 113 ms, write 11817 ms, index 656 ms: 5 candidates, 78027 repo-hours, 850 releases; waiting 302 ms; commit 2014 ms)
2026-11-07T21:25:26Z [load_day 2023-06-12] 2023-06-12 hour 8: 176091 events in 4 files, snapshot 2773660998182125438 (task 19878 ms: download 11484 ms overlapping gunzip 1087 ms, parse 4766 ms, sort 148 ms, write 12548 ms, index 550 ms: 14 candidates, 80518 repo-hours, 987 releases; waiting 351 ms; commit 1981 ms)
2026-11-07T21:25:36Z [load_day 2023-06-12] 2023-06-12 hour 9: 187576 events in 4 files, snapshot 5599252375698802604 (task 21642 ms: download 12246 ms overlapping gunzip 1088 ms, parse 4907 ms, sort 140 ms, write 14116 ms, index 532 ms: 15 candidates, 84660 repo-hours, 1048 releases; waiting 514 ms; commit 1726 ms)
2026-11-07T21:25:41Z [load_day 2023-06-12] 2023-06-12 hour 10: 189454 events in 4 files, snapshot 830770169826494887 (task 21974 ms: download 13178 ms overlapping gunzip 1066 ms, parse 4563 ms, sort 126 ms, write 13745 ms, index 734 ms: 4 candidates, 88977 repo-hours, 1003 releases; waiting 1500 ms; commit 1918 ms)
2026-11-07T21:25:54Z [load_day 2023-06-12] 2023-06-12 hour 11: 183422 events in 4 files, snapshot 8947672521795786239 (task 20760 ms: download 12241 ms overlapping gunzip 1244 ms, parse 5543 ms, sort 121 ms, write 12473 ms, index 561 ms: 12 candidates, 79619 repo-hours, 912 releases; waiting 515 ms; commit 12845 ms)
2026-11-07T21:25:56Z [load_day 2023-06-12] 2023-06-12 hour 12: 210179 events in 5 files, snapshot 7815514959357255622 (task 20235 ms: download 11199 ms overlapping gunzip 1147 ms, parse 4931 ms, sort 132 ms, write 12877 ms, index 635 ms: 12 candidates, 104310 repo-hours, 997 releases; waiting 207 ms; commit 1864 ms)
2026-11-07T21:25:58Z [load_day 2023-06-12] 2023-06-12 hour 13: 195597 events in 4 files, snapshot 853213772432658595 (task 20641 ms: download 11394 ms overlapping gunzip 1062 ms, parse 4865 ms, sort 116 ms, write 13029 ms, index 735 ms: 7 candidates, 100028 repo-hours, 1014 releases; waiting 482 ms; commit 2333 ms)
2026-11-07T21:26:03Z [load_day 2023-06-12] 2023-06-12 hour 14: 195097 events in 4 files, snapshot 1234629771454104774 (task 20802 ms: download 11355 ms overlapping gunzip 1047 ms, parse 4560 ms, sort 128 ms, write 13558 ms, index 729 ms: 8 candidates, 97087 repo-hours, 1017 releases; waiting 541 ms; commit 2289 ms)
2026-11-07T21:26:15Z [load_day 2023-06-12] 2023-06-12 hour 15: 181253 events in 4 files, snapshot 6304904538670306105 (task 20549 ms: download 12105 ms overlapping gunzip 1029 ms, parse 4683 ms, sort 123 ms, write 13218 ms, index 584 ms: 10 candidates, 92916 repo-hours, 1005 releases; waiting 631 ms; commit 1871 ms)
2026-11-07T21:26:17Z [load_day 2023-06-12] 2023-06-12 hour 16: 186104 events in 4 files, snapshot 730129353603072330 (task 20260 ms: download 11528 ms overlapping gunzip 1064 ms, parse 4681 ms, sort 128 ms, write 12863 ms, index 639 ms: 5 candidates, 87739 repo-hours, 1009 releases; waiting 510 ms; commit 2212 ms)
2026-11-07T21:26:20Z [load_day 2023-06-12] 2023-06-12 hour 17: 170500 events in 4 files, snapshot 8271462959220291791 (task 18870 ms: download 11525 ms overlapping gunzip 960 ms, parse 4378 ms, sort 112 ms, write 11969 ms, index 643 ms: 9 candidates, 75970 repo-hours, 851 releases; waiting 483 ms; commit 2245 ms)
2026-11-07T21:26:22Z [load_day 2023-06-12] 2023-06-12 hour 18: 172695 events in 4 files, snapshot 803913500293907513 (task 18583 ms: download 10762 ms overlapping gunzip 960 ms, parse 4364 ms, sort 128 ms, write 11834 ms, index 687 ms: 7 candidates, 81369 repo-hours, 852 releases; waiting 320 ms; commit 2122 ms)
2026-11-07T21:26:36Z [load_day 2023-06-12] 2023-06-12 hour 19: 171781 events in 4 files, snapshot 1727636167133060921 (task 19502 ms: download 12088 ms overlapping gunzip 905 ms, parse 4065 ms, sort 109 ms, write 13050 ms, index 523 ms: 6 candidates, 76957 repo-hours, 831 releases; waiting 538 ms; commit 1771 ms)
2026-11-07T21:26:37Z [load_day 2023-06-12] 2023-06-12 hour 20: 181121 events in 4 files, snapshot 4828968113380196304 (task 19096 ms: download 11158 ms overlapping gunzip 966 ms, parse 4358 ms, sort 118 ms, write 12386 ms, index 562 ms: 12 candidates, 82429 repo-hours, 825 releases; waiting 352 ms; commit 1790 ms)
2026-11-07T21:26:39Z [load_day 2023-06-12] 2023-06-12 hour 21: 165506 events in 4 files, snapshot 7488886958716327762 (task 17893 ms: download 11343 ms overlapping gunzip 893 ms, parse 3871 ms, sort 110 ms, write 11696 ms, index 510 ms: 4 candidates, 73877 repo-hours, 805 releases; waiting 512 ms; commit 1670 ms)
2026-11-07T21:26:45Z [load_day 2023-06-12] 2023-06-12 hour 22: 147132 events in 3 files, snapshot 5975921011629185822 (task 15682 ms: download 7636 ms overlapping gunzip 853 ms, parse 3797 ms, sort 99 ms, write 9724 ms, index 426 ms: 5 candidates, 59647 repo-hours, 720 releases; waiting 498 ms; commit 5472 ms)
2026-11-07T21:26:51Z [load_day 2023-06-12] 2023-06-12 hour 23: 144826 events in 3 files, snapshot 4355004159363327844 (task 13804 ms: download 6350 ms overlapping gunzip 739 ms, parse 3242 ms, sort 99 ms, write 8303 ms, index 486 ms: 6 candidates, 61013 repo-hours, 664 releases; waiting 609 ms; commit 1939 ms)
2026-11-07T21:26:58Z [load_day 2023-06-12] 2023-06-12: repo_hour merged from 24 files to 1 (1876222 rows, 7528 ms)
2026-11-07T21:27:01Z [load_day 2023-06-12] 2023-06-12: index committed in 9854 ms (24 + 1 + 24 files)
2026-11-07T21:27:01Z [load_day 2023-06-12] 2023-06-12: 4031577 events in 24 hours
2026-11-07T21:27:01Z [load_day 2023-06-12] attempt 1 succeeded