orcaLog in

Runs · run 834

load_day 2023-02-19, attempt 1 succeeded

Host
caf251265124:72248
Started
2026-11-07T15:48:59Z
Ended
2026-11-07T15:50:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/834/load_day/2023-02-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:48:59Z [load_day 2023-02-19] attempt 1 started
2026-11-07T15:49:00Z [load_day 2023-02-19] 2023-02-19: 2 hours in flight, about 1200 MB
2026-11-07T15:49:11Z [load_day 2023-02-19] 2023-02-19 hour 0: 111400 events in 3 files, snapshot 8913838417573461234 (task 8422 ms: download 2815 ms overlapping gunzip 404 ms, parse 1918 ms, sort 63 ms, write 3686 ms, index 343 ms: 1 candidates, 56335 repo-hours, 864 releases; waiting 1693 ms; commit 1318 ms)
2026-11-07T15:49:12Z [load_day 2023-02-19] 2023-02-19 hour 1: 113888 events in 3 files, snapshot 4903865699813417064 (task 7525 ms: download 2093 ms overlapping gunzip 438 ms, parse 1978 ms, sort 66 ms, write 3846 ms, index 374 ms: 4 candidates, 61548 repo-hours, 777 releases; waiting 482 ms; commit 1327 ms)
2026-11-07T15:49:18Z [load_day 2023-02-19] 2023-02-19 hour 2: 103772 events in 3 files, snapshot 2127324643096222604 (task 7180 ms: download 1924 ms overlapping gunzip 416 ms, parse 1774 ms, sort 81 ms, write 3762 ms, index 312 ms: 7 candidates, 50857 repo-hours, 579 releases; waiting 552 ms; commit 1350 ms)
2026-11-07T15:49:20Z [load_day 2023-02-19] 2023-02-19 hour 3: 94877 events in 2 files, snapshot 3484693218579721802 (task 6279 ms: download 1957 ms overlapping gunzip 330 ms, parse 1518 ms, sort 54 ms, write 3161 ms, index 284 ms: 4 candidates, 39636 repo-hours, 688 releases; waiting 564 ms; commit 1314 ms)
2026-11-07T15:49:25Z [load_day 2023-02-19] 2023-02-19 hour 4: 91920 events in 2 files, snapshot 2805191926489137434 (task 5981 ms: download 2108 ms overlapping gunzip 331 ms, parse 1492 ms, sort 55 ms, write 3014 ms, index 299 ms: 2 candidates, 38840 repo-hours, 469 releases; waiting 515 ms; commit 1508 ms)
2026-11-07T15:49:27Z [load_day 2023-02-19] 2023-02-19 hour 5: 96296 events in 2 files, snapshot 4083971506927063563 (task 6039 ms: download 2708 ms overlapping gunzip 331 ms, parse 1479 ms, sort 57 ms, write 2906 ms, index 300 ms: 3 candidates, 41553 repo-hours, 512 releases; waiting 602 ms; commit 1368 ms)
2026-11-07T15:49:32Z [load_day 2023-02-19] 2023-02-19 hour 6: 104798 events in 3 files, snapshot 8599175033160430527 (task 6258 ms: download 1928 ms overlapping gunzip 346 ms, parse 1611 ms, sort 74 ms, write 3305 ms, index 327 ms: 2 candidates, 47898 repo-hours, 572 releases; waiting 285 ms; commit 1740 ms)
2026-11-07T15:49:34Z [load_day 2023-02-19] 2023-02-19 hour 7: 106059 events in 3 files, snapshot 6508379654105014151 (task 6909 ms: download 2223 ms overlapping gunzip 366 ms, parse 1664 ms, sort 67 ms, write 3560 ms, index 311 ms: 2 candidates, 45409 repo-hours, 564 releases; waiting 608 ms; commit 1456 ms)
2026-11-07T15:49:39Z [load_day 2023-02-19] 2023-02-19 hour 8: 111322 events in 3 files, snapshot 2796310727162136567 (task 6960 ms: download 1470 ms overlapping gunzip 399 ms, parse 1812 ms, sort 72 ms, write 3853 ms, index 314 ms: 3 candidates, 49249 repo-hours, 647 releases; waiting 207 ms; commit 1294 ms)
2026-11-07T15:49:42Z [load_day 2023-02-19] 2023-02-19 hour 9: 120062 events in 3 files, snapshot 3977409179477951301 (task 7576 ms: download 1966 ms overlapping gunzip 451 ms, parse 2075 ms, sort 74 ms, write 4028 ms, index 352 ms: 5 candidates, 51092 repo-hours, 676 releases; waiting 189 ms; commit 1311 ms)
2026-11-07T15:49:48Z [load_day 2023-02-19] 2023-02-19 hour 10: 123917 events in 3 files, snapshot 5801223011216322987 (task 8202 ms: download 2668 ms overlapping gunzip 477 ms, parse 2064 ms, sort 66 ms, write 4380 ms, index 338 ms: 2 candidates, 54045 repo-hours, 667 releases; waiting 530 ms; commit 1337 ms)
2026-11-07T15:49:51Z [load_day 2023-02-19] 2023-02-19 hour 11: 131433 events in 3 files, snapshot 5530358225905425773 (task 8391 ms: download 2028 ms overlapping gunzip 480 ms, parse 2132 ms, sort 88 ms, write 4458 ms, index 425 ms: 3 candidates, 58513 repo-hours, 640 releases; waiting 500 ms; commit 1421 ms)
2026-11-07T15:49:59Z [load_day 2023-02-19] 2023-02-19 hour 12: 179631 events in 4 files, snapshot 3333186115857708572 (task 9989 ms: download 3548 ms overlapping gunzip 547 ms, parse 2584 ms, sort 102 ms, write 5389 ms, index 556 ms: 3 candidates, 86940 repo-hours, 814 releases; waiting 506 ms; commit 1511 ms)
2026-11-07T15:50:02Z [load_day 2023-02-19] 2023-02-19 hour 13: 158500 events in 4 files, snapshot 3049146755267392371 (task 9523 ms: download 3230 ms overlapping gunzip 512 ms, parse 2362 ms, sort 79 ms, write 5269 ms, index 552 ms: 1 candidates, 80547 repo-hours, 726 releases; waiting 500 ms; commit 1664 ms)
2026-11-07T15:50:11Z [load_day 2023-02-19] 2023-02-19 hour 14: 149058 events in 3 files, snapshot 2149614893951768578 (task 11018 ms: download 5208 ms overlapping gunzip 558 ms, parse 2502 ms, sort 107 ms, write 5202 ms, index 433 ms: 5 candidates, 66731 repo-hours, 781 releases; waiting 1910 ms; commit 1236 ms)
2026-11-07T15:50:12Z [load_day 2023-02-19] 2023-02-19 hour 15: 154579 events in 4 files, snapshot 7154366043074272972 (task 9550 ms: download 3450 ms overlapping gunzip 551 ms, parse 2451 ms, sort 93 ms, write 5483 ms, index 425 ms: 3 candidates, 68868 repo-hours, 951 releases; waiting 272 ms; commit 1186 ms)
2026-11-07T15:50:22Z [load_day 2023-02-19] 2023-02-19 hour 16: 150989 events in 4 files, snapshot 211949645717840711 (task 9776 ms: download 3644 ms overlapping gunzip 548 ms, parse 2470 ms, sort 98 ms, write 5365 ms, index 463 ms: 1 candidates, 67630 repo-hours, 785 releases; waiting 518 ms; commit 1396 ms)
2026-11-07T15:50:23Z [load_day 2023-02-19] 2023-02-19 hour 17: 146899 events in 3 files, snapshot 3787529685280374581 (task 9572 ms: download 3741 ms overlapping gunzip 563 ms, parse 2421 ms, sort 87 ms, write 5154 ms, index 453 ms: 3 candidates, 63099 repo-hours, 743 releases; waiting 577 ms; commit 1456 ms)
2026-11-07T15:50:31Z [load_day 2023-02-19] 2023-02-19 hour 18: 149675 events in 3 files, snapshot 3466815345645539932 (task 9305 ms: download 3317 ms overlapping gunzip 536 ms, parse 2388 ms, sort 99 ms, write 5307 ms, index 445 ms: 4 candidates, 68282 repo-hours, 848 releases; waiting 276 ms; commit 1343 ms)
2026-11-07T15:50:33Z [load_day 2023-02-19] 2023-02-19 hour 19: 137551 events in 3 files, snapshot 1224464723717197738 (task 9267 ms: download 3849 ms overlapping gunzip 499 ms, parse 2226 ms, sort 87 ms, write 4811 ms, index 427 ms: 2 candidates, 58232 repo-hours, 833 releases; waiting 901 ms; commit 1289 ms)
2026-11-07T15:50:41Z [load_day 2023-02-19] 2023-02-19 hour 20: 143013 events in 3 files, snapshot 5740351091739039758 (task 9020 ms: download 2125 ms overlapping gunzip 504 ms, parse 2336 ms, sort 83 ms, write 4872 ms, index 419 ms: 2 candidates, 69626 repo-hours, 747 releases; waiting 520 ms; commit 1312 ms)
2026-11-07T15:50:43Z [load_day 2023-02-19] 2023-02-19 hour 21: 127195 events in 3 files, snapshot 6555746522519518633 (task 7882 ms: download 1358 ms overlapping gunzip 455 ms, parse 2069 ms, sort 62 ms, write 4439 ms, index 354 ms: 4 candidates, 52148 repo-hours, 807 releases; waiting 220 ms; commit 1431 ms)
2026-11-07T15:50:50Z [load_day 2023-02-19] 2023-02-19 hour 22: 116814 events in 3 files, snapshot 5207736883564706919 (task 8481 ms: download 3466 ms overlapping gunzip 477 ms, parse 2128 ms, sort 79 ms, write 4433 ms, index 482 ms: 1 candidates, 47841 repo-hours, 899 releases; waiting 532 ms; commit 1329 ms)
2026-11-07T15:50:52Z [load_day 2023-02-19] 2023-02-19 hour 23: 105618 events in 3 files, snapshot 9098026847042519026 (task 7255 ms: download 1932 ms overlapping gunzip 397 ms, parse 1821 ms, sort 70 ms, write 3850 ms, index 315 ms: 2 candidates, 45526 repo-hours, 668 releases; waiting 521 ms; commit 1296 ms)
2026-11-07T15:50:58Z [load_day 2023-02-19] 2023-02-19: repo_hour merged from 24 files to 1 (1370445 rows, 5842 ms)
2026-11-07T15:50:59Z [load_day 2023-02-19] 2023-02-19: index committed in 7805 ms (24 + 1 + 24 files)
2026-11-07T15:50:59Z [load_day 2023-02-19] 2023-02-19: 3029266 events in 24 hours
2026-11-07T15:50:59Z [load_day 2023-02-19] attempt 1 succeeded