orcaLog in

Runs · run 1275

load_day 2023-07-08, attempt 1 succeeded

Host
3c2b29713ce8:103928
Started
2026-11-07T22:46:48Z
Ended
2026-11-07T22:49:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1275/load_day/2023-07-08/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:46:48Z [load_day 2023-07-08] attempt 1 started
2026-11-07T22:46:49Z [load_day 2023-07-08] 2023-07-08: 2 hours in flight, about 1200 MB
2026-11-07T22:47:07Z [load_day 2023-07-08] 2023-07-08 hour 0: 125201 events in 3 files, snapshot 803859488091587339 (task 12701 ms: download 2984 ms overlapping gunzip 833 ms, parse 3607 ms, sort 82 ms, write 6933 ms, index 411 ms: 5 candidates, 64161 repo-hours, 785 releases; waiting 529 ms; commit 3595 ms)
2026-11-07T22:47:09Z [load_day 2023-07-08] 2023-07-08 hour 1: 129680 events in 3 files, snapshot 1873319901544457368 (task 11943 ms: download 5519 ms overlapping gunzip 647 ms, parse 2940 ms, sort 147 ms, write 6920 ms, index 519 ms: 4 candidates, 73869 repo-hours, 807 releases; waiting 509 ms; commit 2320 ms)
2026-11-07T22:47:16Z [load_day 2023-07-08] 2023-07-08 hour 2: 106487 events in 3 files, snapshot 8921991628774667894 (task 9914 ms: download 2109 ms overlapping gunzip 575 ms, parse 2365 ms, sort 61 ms, write 5756 ms, index 399 ms: 3 candidates, 53039 repo-hours, 591 releases; waiting 507 ms; commit 2252 ms)
2026-11-07T22:47:19Z [load_day 2023-07-08] 2023-07-08 hour 3: 100218 events in 3 files, snapshot 4248826887956127324 (task 8901 ms: download 1854 ms overlapping gunzip 445 ms, parse 2148 ms, sort 76 ms, write 5022 ms, index 475 ms: 1 candidates, 44656 repo-hours, 734 releases; waiting 390 ms; commit 2161 ms)
2026-11-07T22:47:26Z [load_day 2023-07-08] 2023-07-08 hour 4: 102475 events in 3 files, snapshot 7374862710211083110 (task 8647 ms: download 2325 ms overlapping gunzip 521 ms, parse 2294 ms, sort 57 ms, write 4503 ms, index 487 ms: 5 candidates, 46133 repo-hours, 466 releases; waiting 453 ms; commit 2790 ms)
2026-11-07T22:47:30Z [load_day 2023-07-08] 2023-07-08 hour 5: 105751 events in 3 files, snapshot 1094913247380856020 (task 9434 ms: download 1860 ms overlapping gunzip 507 ms, parse 2205 ms, sort 57 ms, write 5363 ms, index 468 ms: 2 candidates, 47406 repo-hours, 649 releases; waiting 518 ms; commit 2955 ms)
2026-11-07T22:47:38Z [load_day 2023-07-08] 2023-07-08 hour 6: 114837 events in 3 files, snapshot 5222074088506325166 (task 10447 ms: download 1894 ms overlapping gunzip 618 ms, parse 2955 ms, sort 86 ms, write 5662 ms, index 344 ms: 8 candidates, 54452 repo-hours, 700 releases; waiting 481 ms; commit 2457 ms)
2026-11-07T22:47:41Z [load_day 2023-07-08] 2023-07-08 hour 7: 113711 events in 3 files, snapshot 573996675387295495 (task 9805 ms: download 2363 ms overlapping gunzip 578 ms, parse 2497 ms, sort 77 ms, write 5625 ms, index 374 ms: 3 candidates, 50243 repo-hours, 579 releases; waiting 273 ms; commit 2254 ms)
2026-11-07T22:47:47Z [load_day 2023-07-08] 2023-07-08 hour 8: 121424 events in 3 files, snapshot 254706893574876219 (task 8881 ms: download 2187 ms overlapping gunzip 482 ms, parse 2206 ms, sort 75 ms, write 4868 ms, index 354 ms: 7 candidates, 54935 repo-hours, 674 releases; waiting 508 ms; commit 2071 ms)
2026-11-07T22:47:50Z [load_day 2023-07-08] 2023-07-08 hour 9: 120381 events in 3 files, snapshot 4469802840127507825 (task 8349 ms: download 2581 ms overlapping gunzip 468 ms, parse 2082 ms, sort 62 ms, write 4411 ms, index 468 ms: 2 candidates, 54980 repo-hours, 746 releases; waiting 567 ms; commit 2181 ms)
2026-11-07T22:47:56Z [load_day 2023-07-08] 2023-07-08 hour 10: 123718 events in 3 files, snapshot 7629673973277904565 (task 8187 ms: download 2374 ms overlapping gunzip 458 ms, parse 2090 ms, sort 74 ms, write 4385 ms, index 363 ms: 1 candidates, 55254 repo-hours, 756 releases; waiting 515 ms; commit 1794 ms)
2026-11-07T22:47:58Z [load_day 2023-07-08] 2023-07-08 hour 11: 120046 events in 3 files, snapshot 4378803739893046530 (task 7742 ms: download 2282 ms overlapping gunzip 428 ms, parse 1913 ms, sort 65 ms, write 4172 ms, index 329 ms: 4 candidates, 52362 repo-hours, 769 releases; waiting 513 ms; commit 2020 ms)
2026-11-07T22:48:11Z [load_day 2023-07-08] 2023-07-08 hour 12: 176679 events in 4 files, snapshot 3197600377847702345 (task 12795 ms: download 4079 ms overlapping gunzip 722 ms, parse 3311 ms, sort 135 ms, write 7150 ms, index 583 ms: 4 candidates, 87249 repo-hours, 810 releases; waiting 508 ms; commit 3252 ms)
2026-11-07T22:48:15Z [load_day 2023-07-08] 2023-07-08 hour 13: 155869 events in 4 files, snapshot 2091701524105221245 (task 12853 ms: download 5097 ms overlapping gunzip 654 ms, parse 2829 ms, sort 108 ms, write 7481 ms, index 976 ms: 3 candidates, 82492 repo-hours, 755 releases; waiting 513 ms; commit 3234 ms)
2026-11-07T22:48:23Z [load_day 2023-07-08] 2023-07-08 hour 14: 140970 events in 3 files, snapshot 5015694882091368728 (task 11500 ms: download 4429 ms overlapping gunzip 755 ms, parse 3254 ms, sort 106 ms, write 6374 ms, index 475 ms: 3 candidates, 63627 repo-hours, 758 releases; waiting 205 ms; commit 2498 ms)
2026-11-07T22:48:26Z [load_day 2023-07-08] 2023-07-08 hour 15: 141986 events in 3 files, snapshot 6583273733792771014 (task 11322 ms: download 4058 ms overlapping gunzip 633 ms, parse 2788 ms, sort 79 ms, write 6223 ms, index 830 ms: 7 candidates, 65121 repo-hours, 1024 releases; waiting 501 ms; commit 2271 ms)
2026-11-07T22:48:35Z [load_day 2023-07-08] 2023-07-08 hour 16: 139031 events in 3 files, snapshot 4908243078709861840 (task 11390 ms: download 4057 ms overlapping gunzip 565 ms, parse 2608 ms, sort 71 ms, write 6772 ms, index 566 ms: 7 candidates, 62707 repo-hours, 1001 releases; waiting 523 ms; commit 2401 ms)
2026-11-07T22:48:40Z [load_day 2023-07-08] 2023-07-08 hour 17: 132128 events in 3 files, snapshot 4660926875554293534 (task 11083 ms: download 3126 ms overlapping gunzip 579 ms, parse 2292 ms, sort 59 ms, write 6548 ms, index 511 ms: 4 candidates, 58497 repo-hours, 733 releases; waiting 748 ms; commit 4191 ms)
2026-11-07T22:48:47Z [load_day 2023-07-08] 2023-07-08 hour 18: 135816 events in 3 files, snapshot 6237965994390462903 (task 11035 ms: download 2281 ms overlapping gunzip 597 ms, parse 2763 ms, sort 142 ms, write 6298 ms, index 469 ms: 1 candidates, 62825 repo-hours, 819 releases; waiting 477 ms; commit 2416 ms)
2026-11-07T22:48:52Z [load_day 2023-07-08] 2023-07-08 hour 19: 120162 events in 3 files, snapshot 8829473797139489430 (task 10100 ms: download 2193 ms overlapping gunzip 674 ms, parse 3177 ms, sort 62 ms, write 4951 ms, index 422 ms: 7 candidates, 52045 repo-hours, 716 releases; waiting 486 ms; commit 4309 ms)
2026-11-07T22:48:58Z [load_day 2023-07-08] 2023-07-08 hour 20: 115337 events in 3 files, snapshot 8813105090522477678 (task 10139 ms: download 2359 ms overlapping gunzip 483 ms, parse 2205 ms, sort 160 ms, write 6010 ms, index 395 ms: 3 candidates, 50911 repo-hours, 690 releases; waiting 527 ms; commit 1970 ms)
2026-11-07T22:49:01Z [load_day 2023-07-08] 2023-07-08 hour 21: 123873 events in 3 files, snapshot 1993789804492083496 (task 9860 ms: download 3614 ms overlapping gunzip 567 ms, parse 2428 ms, sort 90 ms, write 5226 ms, index 514 ms: 1 candidates, 64355 repo-hours, 783 releases; waiting 629 ms; commit 1972 ms)
2026-11-07T22:49:07Z [load_day 2023-07-08] 2023-07-08 hour 22: 98480 events in 2 files, snapshot 5898732348966188412 (task 7684 ms: download 2134 ms overlapping gunzip 426 ms, parse 1982 ms, sort 96 ms, write 4033 ms, index 315 ms: 3 candidates, 40418 repo-hours, 700 releases; waiting 519 ms; commit 2212 ms)
2026-11-07T22:49:09Z [load_day 2023-07-08] 2023-07-08 hour 23: 90145 events in 2 files, snapshot 1978991062300051210 (task 7736 ms: download 2180 ms overlapping gunzip 456 ms, parse 2120 ms, sort 77 ms, write 3961 ms, index 261 ms: 1 candidates, 38230 repo-hours, 603 releases; waiting 487 ms; commit 1851 ms)
2026-11-07T22:49:16Z [load_day 2023-07-08] 2023-07-08: repo_hour merged from 24 files to 1 (1379967 rows, 6233 ms)
2026-11-07T22:49:18Z [load_day 2023-07-08] 2023-07-08: index committed in 8171 ms (24 + 1 + 24 files)
2026-11-07T22:49:18Z [load_day 2023-07-08] 2023-07-08: 2954405 events in 24 hours
2026-11-07T22:49:18Z [load_day 2023-07-08] attempt 1 succeeded