orcaLog in

Runs · run 795

load_day 2023-02-06, attempt 1 succeeded

Host
caf251265124:22750
Started
2026-11-07T15:07:05Z
Ended
2026-11-07T15:10:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/795/load_day/2023-02-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:07:05Z [load_day 2023-02-06] attempt 1 started
2026-11-07T15:07:07Z [load_day 2023-02-06] 2023-02-06: 2 hours in flight, about 1200 MB
2026-11-07T15:07:20Z [load_day 2023-02-06] 2023-02-06 hour 0: 136315 events in 3 files, snapshot 3040909586080845116 (task 10535 ms: download 4794 ms overlapping gunzip 645 ms, parse 2759 ms, sort 84 ms, write 5575 ms, index 429 ms: 4 candidates, 66100 repo-hours, 846 releases; waiting 677 ms; commit 1259 ms)
2026-11-07T15:07:22Z [load_day 2023-02-06] 2023-02-06 hour 1: 155501 events in 4 files, snapshot 2004930121219073484 (task 12884 ms: download 7888 ms overlapping gunzip 831 ms, parse 3402 ms, sort 115 ms, write 6876 ms, index 481 ms: 2 candidates, 73540 repo-hours, 865 releases; waiting 796 ms; commit 1427 ms)
2026-11-07T15:07:34Z [load_day 2023-02-06] 2023-02-06 hour 2: 150079 events in 4 files, snapshot 6898850378043929370 (task 13203 ms: download 5921 ms overlapping gunzip 878 ms, parse 3463 ms, sort 95 ms, write 7459 ms, index 415 ms: 5 candidates, 63336 repo-hours, 724 releases; waiting 555 ms; commit 1539 ms)
2026-11-07T15:07:36Z [load_day 2023-02-06] 2023-02-06 hour 3: 148076 events in 3 files, snapshot 2625855691006707564 (task 12540 ms: download 5882 ms overlapping gunzip 856 ms, parse 3418 ms, sort 95 ms, write 6950 ms, index 378 ms: 1 candidates, 56585 repo-hours, 998 releases; waiting 496 ms; commit 1476 ms)
2026-11-07T15:07:47Z [load_day 2023-02-06] 2023-02-06 hour 4: 142052 events in 3 files, snapshot 1048125967257381454 (task 12303 ms: download 5891 ms overlapping gunzip 821 ms, parse 3376 ms, sort 85 ms, write 6824 ms, index 346 ms: 3 candidates, 52781 repo-hours, 582 releases; waiting 554 ms; commit 1254 ms)
2026-11-07T15:07:48Z [load_day 2023-02-06] 2023-02-06 hour 5: 143505 events in 3 files, snapshot 3655367400064330368 (task 11523 ms: download 5339 ms overlapping gunzip 751 ms, parse 3165 ms, sort 94 ms, write 6307 ms, index 371 ms: 6 candidates, 56306 repo-hours, 731 releases; waiting 555 ms; commit 1261 ms)
2026-11-07T15:08:01Z [load_day 2023-02-06] 2023-02-06 hour 6: 156197 events in 4 files, snapshot 7742868494554764780 (task 12593 ms: download 5756 ms overlapping gunzip 788 ms, parse 3293 ms, sort 78 ms, write 7120 ms, index 431 ms: 3 candidates, 66893 repo-hours, 830 releases; waiting 565 ms; commit 1535 ms)
2026-11-07T15:08:07Z [load_day 2023-02-06] 2023-02-06 hour 7: 167230 events in 4 files, snapshot 8603778545305693091 (task 13913 ms: download 6309 ms overlapping gunzip 920 ms, parse 3830 ms, sort 112 ms, write 7656 ms, index 550 ms: 2 candidates, 70505 repo-hours, 807 releases; waiting 528 ms; commit 4972 ms)
2026-11-07T15:08:19Z [load_day 2023-02-06] 2023-02-06 hour 8: 188482 events in 4 files, snapshot 7455061764146406625 (task 17142 ms: download 10451 ms overlapping gunzip 1055 ms, parse 4328 ms, sort 130 ms, write 10089 ms, index 545 ms: 6 candidates, 79774 repo-hours, 851 releases; waiting 595 ms; commit 1665 ms)
2026-11-07T15:08:24Z [load_day 2023-02-06] 2023-02-06 hour 9: 196951 events in 4 files, snapshot 5320282858964726334 (task 17135 ms: download 9598 ms overlapping gunzip 1097 ms, parse 4688 ms, sort 143 ms, write 9975 ms, index 567 ms: 1 candidates, 84234 repo-hours, 1057 releases; waiting 29 ms; commit 1407 ms)
2026-11-07T15:08:37Z [load_day 2023-02-06] 2023-02-06 hour 10: 195686 events in 4 files, snapshot 575105808037908122 (task 17540 ms: download 10287 ms overlapping gunzip 1095 ms, parse 4630 ms, sort 138 ms, write 10204 ms, index 576 ms: 7 candidates, 81409 repo-hours, 958 releases; waiting 568 ms; commit 1361 ms)
2026-11-07T15:08:42Z [load_day 2023-02-06] 2023-02-06 hour 11: 191946 events in 4 files, snapshot 3619863093818068552 (task 17192 ms: download 10063 ms overlapping gunzip 1081 ms, parse 4535 ms, sort 128 ms, write 10076 ms, index 527 ms: 6 candidates, 77422 repo-hours, 1082 releases; waiting 521 ms; commit 1348 ms)
2026-11-07T15:08:55Z [load_day 2023-02-06] 2023-02-06 hour 12: 218521 events in 5 files, snapshot 6740456040570739952 (task 17318 ms: download 9298 ms overlapping gunzip 1088 ms, parse 4717 ms, sort 132 ms, write 9898 ms, index 696 ms: 4 candidates, 105000 repo-hours, 1135 releases; waiting 422 ms; commit 1375 ms)
2026-11-07T15:09:04Z [load_day 2023-02-06] 2023-02-06 hour 13: 220299 events in 5 files, snapshot 6345519822819839072 (task 20514 ms: download 14155 ms overlapping gunzip 1215 ms, parse 5128 ms, sort 136 ms, write 10722 ms, index 670 ms: 7 candidates, 106448 repo-hours, 998 releases; waiting 1976 ms; commit 1292 ms)
2026-11-07T15:09:16Z [load_day 2023-02-06] 2023-02-06 hour 14: 215503 events in 5 files, snapshot 8026496212265803790 (task 20052 ms: download 14180 ms overlapping gunzip 1244 ms, parse 5286 ms, sort 125 ms, write 11242 ms, index 668 ms: 6 candidates, 96108 repo-hours, 1265 releases; waiting 1157 ms; commit 1489 ms)
2026-11-07T15:09:24Z [load_day 2023-02-06] 2023-02-06 hour 15: 219681 events in 5 files, snapshot 5445466058246749708 (task 20013 ms: download 14132 ms overlapping gunzip 1225 ms, parse 5161 ms, sort 142 ms, write 12210 ms, index 621 ms: 9 candidates, 99413 repo-hours, 1463 releases; waiting 351 ms; commit 1340 ms)
2026-11-07T15:09:36Z [load_day 2023-02-06] 2023-02-06 hour 16: 202989 events in 5 files, snapshot 4215330961155458457 (task 19513 ms: download 11528 ms overlapping gunzip 1175 ms, parse 4972 ms, sort 136 ms, write 10745 ms, index 637 ms: 11 candidates, 93769 repo-hours, 1020 releases; waiting 1527 ms; commit 1196 ms)
2026-11-07T15:09:44Z [load_day 2023-02-06] 2023-02-06 hour 17: 209193 events in 5 files, snapshot 2145618401098227000 (task 18539 ms: download 10541 ms overlapping gunzip 1216 ms, parse 5097 ms, sort 135 ms, write 10586 ms, index 596 ms: 8 candidates, 92373 repo-hours, 924 releases; waiting 520 ms; commit 1263 ms)
2026-11-07T15:09:55Z [load_day 2023-02-06] 2023-02-06 hour 18: 203214 events in 5 files, snapshot 2096290791298553019 (task 17793 ms: download 10288 ms overlapping gunzip 1140 ms, parse 4883 ms, sort 126 ms, write 10091 ms, index 605 ms: 11 candidates, 89455 repo-hours, 959 releases; waiting 614 ms; commit 1278 ms)
2026-11-07T15:10:02Z [load_day 2023-02-06] 2023-02-06 hour 19: 189485 events in 4 files, snapshot 3940492097436773291 (task 17275 ms: download 9962 ms overlapping gunzip 1092 ms, parse 4559 ms, sort 129 ms, write 9894 ms, index 560 ms: 18 candidates, 78744 repo-hours, 933 releases; waiting 668 ms; commit 1435 ms)
2026-11-07T15:10:14Z [load_day 2023-02-06] 2023-02-06 hour 20: 194440 events in 4 files, snapshot 2700912144205213271 (task 18533 ms: download 11295 ms overlapping gunzip 1180 ms, parse 4836 ms, sort 127 ms, write 10714 ms, index 572 ms: 5 candidates, 79811 repo-hours, 1017 releases; waiting 720 ms; commit 1356 ms)
2026-11-07T15:10:21Z [load_day 2023-02-06] 2023-02-06 hour 21: 186043 events in 4 files, snapshot 5634485691082113214 (task 18221 ms: download 11077 ms overlapping gunzip 1135 ms, parse 4755 ms, sort 114 ms, write 10245 ms, index 517 ms: 6 candidates, 73854 repo-hours, 1055 releases; waiting 1123 ms; commit 1363 ms)
2026-11-07T15:10:32Z [load_day 2023-02-06] 2023-02-06 hour 22: 169227 events in 4 files, snapshot 6517468074488785545 (task 17476 ms: download 11841 ms overlapping gunzip 1068 ms, parse 4371 ms, sort 103 ms, write 9036 ms, index 472 ms: 8 candidates, 67085 repo-hours, 923 releases; waiting 2098 ms; commit 1352 ms)
2026-11-07T15:10:36Z [load_day 2023-02-06] 2023-02-06 hour 23: 154397 events in 4 files, snapshot 6306845074533850866 (task 14360 ms: download 6818 ms overlapping gunzip 975 ms, parse 3969 ms, sort 107 ms, write 8057 ms, index 387 ms: 4 candidates, 61466 repo-hours, 715 releases; waiting 537 ms; commit 1373 ms)
2026-11-07T15:10:44Z [load_day 2023-02-06] 2023-02-06: repo_hour merged from 24 files to 1 (1872411 rows, 7821 ms)
2026-11-07T15:10:46Z [load_day 2023-02-06] 2023-02-06: index committed in 9708 ms (24 + 1 + 24 files)
2026-11-07T15:10:46Z [load_day 2023-02-06] 2023-02-06: 4355012 events in 24 hours
2026-11-07T15:10:46Z [load_day 2023-02-06] attempt 1 succeeded