orcaLog in

Runs · run 1191

load_day 2023-06-18, attempt 1 succeeded

Host
3c2b29713ce8:8289
Started
2026-11-07T21:37:09Z
Ended
2026-11-07T21:38:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1191/load_day/2023-06-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:37:09Z [load_day 2023-06-18] attempt 1 started
2026-11-07T21:37:11Z [load_day 2023-06-18] 2023-06-18: 4 hours in flight, about 2100 MB
2026-11-07T21:37:23Z [load_day 2023-06-18] 2023-06-18 hour 0: 100432 events in 3 files, snapshot 7764054270825605657 (task 8345 ms: download 1694 ms overlapping gunzip 501 ms, parse 2383 ms, sort 75 ms, write 4481 ms, index 326 ms: 4 candidates, 51740 repo-hours, 820 releases; waiting 301 ms; commit 1801 ms)
2026-11-07T21:37:25Z [load_day 2023-06-18] 2023-06-18 hour 1: 109686 events in 3 files, snapshot 3562927631027608097 (task 8793 ms: download 2223 ms overlapping gunzip 503 ms, parse 2353 ms, sort 76 ms, write 4598 ms, index 436 ms: 5 candidates, 65889 repo-hours, 800 releases; waiting 497 ms; commit 1827 ms)
2026-11-07T21:37:27Z [load_day 2023-06-18] 2023-06-18 hour 2: 91667 events in 2 files, snapshot 598304537475497939 (task 7589 ms: download 2027 ms overlapping gunzip 426 ms, parse 2012 ms, sort 65 ms, write 3937 ms, index 309 ms: 4 candidates, 48530 repo-hours, 626 releases; waiting 518 ms; commit 2121 ms)
2026-11-07T21:37:29Z [load_day 2023-06-18] 2023-06-18 hour 3: 90341 events in 2 files, snapshot 2109703002761983017 (task 7354 ms: download 2084 ms overlapping gunzip 438 ms, parse 2097 ms, sort 47 ms, write 3709 ms, index 268 ms: 5 candidates, 39130 repo-hours, 757 releases; waiting 500 ms; commit 2332 ms)
2026-11-07T21:37:31Z [load_day 2023-06-18] 2023-06-18 hour 4: 89068 events in 2 files, snapshot 6907271407197340995 (task 6994 ms: download 1636 ms overlapping gunzip 310 ms, parse 1411 ms, sort 65 ms, write 3966 ms, index 400 ms: 1 candidates, 38495 repo-hours, 448 releases; waiting 520 ms; commit 2186 ms)
2026-11-07T21:37:34Z [load_day 2023-06-18] 2023-06-18 hour 5: 92989 events in 2 files, snapshot 6742658558966773052 (task 7288 ms: download 1468 ms overlapping gunzip 366 ms, parse 1702 ms, sort 61 ms, write 4236 ms, index 303 ms: 4 candidates, 41474 repo-hours, 574 releases; waiting 379 ms; commit 2314 ms)
2026-11-07T21:37:36Z [load_day 2023-06-18] 2023-06-18 hour 6: 108313 events in 3 files, snapshot 6461565619604953026 (task 8676 ms: download 1800 ms overlapping gunzip 418 ms, parse 1947 ms, sort 67 ms, write 4948 ms, index 354 ms: 3 candidates, 49592 repo-hours, 585 releases; waiting 689 ms; commit 1984 ms)
2026-11-07T21:37:39Z [load_day 2023-06-18] 2023-06-18 hour 7: 109118 events in 3 files, snapshot 4231709870843979127 (task 9123 ms: download 1936 ms overlapping gunzip 456 ms, parse 2100 ms, sort 93 ms, write 5280 ms, index 383 ms: 3 candidates, 47257 repo-hours, 471 releases; waiting 486 ms; commit 1767 ms)
2026-11-07T21:37:41Z [load_day 2023-06-18] 2023-06-18 hour 8: 116510 events in 3 files, snapshot 6307004820342135996 (task 9177 ms: download 2045 ms overlapping gunzip 476 ms, parse 2121 ms, sort 70 ms, write 5490 ms, index 352 ms: 5 candidates, 51621 repo-hours, 587 releases; waiting 340 ms; commit 2272 ms)
2026-11-07T21:37:45Z [load_day 2023-06-18] 2023-06-18 hour 9: 121535 events in 3 files, snapshot 3033423637930159782 (task 10421 ms: download 2163 ms overlapping gunzip 527 ms, parse 2354 ms, sort 73 ms, write 5893 ms, index 730 ms: 6 candidates, 52419 repo-hours, 687 releases; waiting 541 ms; commit 2323 ms)
2026-11-07T21:37:48Z [load_day 2023-06-18] 2023-06-18 hour 10: 125783 events in 3 files, snapshot 6540153005932767802 (task 10469 ms: download 2267 ms overlapping gunzip 513 ms, parse 2225 ms, sort 69 ms, write 6608 ms, index 361 ms: 5 candidates, 55386 repo-hours, 647 releases; waiting 331 ms; commit 2198 ms)
2026-11-07T21:37:50Z [load_day 2023-06-18] 2023-06-18 hour 11: 122259 events in 3 files, snapshot 7742919104440321548 (task 9959 ms: download 2512 ms overlapping gunzip 476 ms, parse 2229 ms, sort 78 ms, write 6025 ms, index 354 ms: 3 candidates, 52539 repo-hours, 691 releases; waiting 513 ms; commit 2163 ms)
2026-11-07T21:37:55Z [load_day 2023-06-18] 2023-06-18 hour 12: 196377 events in 4 files, snapshot 3034728705910033867 (task 13088 ms: download 3947 ms overlapping gunzip 643 ms, parse 3022 ms, sort 130 ms, write 8282 ms, index 528 ms: 3 candidates, 87477 repo-hours, 770 releases; waiting 212 ms; commit 2206 ms)
2026-11-07T21:37:58Z [load_day 2023-06-18] 2023-06-18 hour 13: 160314 events in 4 files, snapshot 1239863580865463270 (task 12406 ms: download 4210 ms overlapping gunzip 623 ms, parse 2820 ms, sort 98 ms, write 7184 ms, index 739 ms: 2 candidates, 82205 repo-hours, 725 releases; waiting 493 ms; commit 1955 ms)
2026-11-07T21:38:01Z [load_day 2023-06-18] 2023-06-18 hour 14: 150513 events in 4 files, snapshot 3525174722300840333 (task 12152 ms: download 4217 ms overlapping gunzip 626 ms, parse 2868 ms, sort 113 ms, write 7537 ms, index 456 ms: 7 candidates, 66033 repo-hours, 784 releases; waiting 285 ms; commit 2130 ms)
2026-11-07T21:38:03Z [load_day 2023-06-18] 2023-06-18 hour 15: 155872 events in 4 files, snapshot 4865972893875013748 (task 12215 ms: download 4358 ms overlapping gunzip 564 ms, parse 2582 ms, sort 93 ms, write 7645 ms, index 517 ms: 6 candidates, 68277 repo-hours, 889 releases; waiting 474 ms; commit 1933 ms)
2026-11-07T21:38:07Z [load_day 2023-06-18] 2023-06-18 hour 16: 145389 events in 3 files, snapshot 882834061811549352 (task 11279 ms: download 3982 ms overlapping gunzip 587 ms, parse 2571 ms, sort 86 ms, write 6786 ms, index 436 ms: 3 candidates, 63755 repo-hours, 716 releases; waiting 520 ms; commit 2082 ms)
2026-11-07T21:38:10Z [load_day 2023-06-18] 2023-06-18 hour 17: 137847 events in 3 files, snapshot 8394623907012634973 (task 10346 ms: download 3026 ms overlapping gunzip 486 ms, parse 2250 ms, sort 95 ms, write 6316 ms, index 366 ms: 8 candidates, 58128 repo-hours, 670 releases; waiting 569 ms; commit 2715 ms)
2026-11-07T21:38:13Z [load_day 2023-06-18] 2023-06-18 hour 18: 142741 events in 3 files, snapshot 8403661297027267797 (task 11251 ms: download 3777 ms overlapping gunzip 528 ms, parse 2551 ms, sort 91 ms, write 6798 ms, index 425 ms: 7 candidates, 63440 repo-hours, 741 releases; waiting 242 ms; commit 1927 ms)
2026-11-07T21:38:15Z [load_day 2023-06-18] 2023-06-18 hour 19: 127009 events in 3 files, snapshot 5763323774612921858 (task 10046 ms: download 2420 ms overlapping gunzip 483 ms, parse 2223 ms, sort 75 ms, write 6128 ms, index 358 ms: 10 candidates, 52648 repo-hours, 702 releases; waiting 497 ms; commit 2145 ms)
2026-11-07T21:38:18Z [load_day 2023-06-18] 2023-06-18 hour 20: 124151 events in 3 files, snapshot 7736631131000261595 (task 9867 ms: download 2085 ms overlapping gunzip 486 ms, parse 2243 ms, sort 68 ms, write 5805 ms, index 441 ms: 8 candidates, 52976 repo-hours, 650 releases; waiting 509 ms; commit 1741 ms)
2026-11-07T21:38:20Z [load_day 2023-06-18] 2023-06-18 hour 21: 112931 events in 3 files, snapshot 8572424933060573177 (task 9100 ms: download 1844 ms overlapping gunzip 451 ms, parse 2093 ms, sort 60 ms, write 5374 ms, index 324 ms: 11 candidates, 46237 repo-hours, 689 releases; waiting 491 ms; commit 1884 ms)
2026-11-07T21:38:22Z [load_day 2023-06-18] 2023-06-18 hour 22: 102476 events in 3 files, snapshot 2059540497774029223 (task 8060 ms: download 1757 ms overlapping gunzip 403 ms, parse 1748 ms, sort 65 ms, write 4746 ms, index 282 ms: 2 candidates, 41935 repo-hours, 659 releases; waiting 534 ms; commit 1750 ms)
2026-11-07T21:38:24Z [load_day 2023-06-18] 2023-06-18 hour 23: 96017 events in 2 files, snapshot 2459709717047598917 (task 8011 ms: download 2175 ms overlapping gunzip 436 ms, parse 1930 ms, sort 62 ms, write 4506 ms, index 288 ms: 1 candidates, 40770 repo-hours, 626 releases; waiting 488 ms; commit 1896 ms)
2026-11-07T21:38:29Z [load_day 2023-06-18] 2023-06-18: repo_hour merged from 24 files to 1 (1317953 rows, 5635 ms)
2026-11-07T21:38:35Z [load_day 2023-06-18] 2023-06-18: index committed in 10792 ms (24 + 1 + 24 files)
2026-11-07T21:38:35Z [load_day 2023-06-18] 2023-06-18: 2929338 events in 24 hours
2026-11-07T21:38:35Z [load_day 2023-06-18] attempt 1 succeeded