orcaLog in

Runs · run 1409

load_day 2023-08-19, attempt 1 succeeded

Host
3c2b29713ce8:243077
Started
2026-11-08T00:02:22Z
Ended
2026-11-08T00:04:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1409/load_day/2023-08-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:02:22Z [load_day 2023-08-19] attempt 1 started
2026-11-08T00:02:24Z [load_day 2023-08-19] 2023-08-19: 2 hours in flight, about 1200 MB
2026-11-08T00:02:42Z [load_day 2023-08-19] 2023-08-19 hour 0: 151280 events in 4 files, snapshot 3985367077850846121 (task 13315 ms: download 5812 ms overlapping gunzip 646 ms, parse 3080 ms, sort 188 ms, write 8023 ms, index 658 ms: 3 candidates, 83082 repo-hours, 955 releases; waiting 365 ms; commit 3355 ms)
2026-11-08T00:02:44Z [load_day 2023-08-19] 2023-08-19 hour 1: 131833 events in 3 files, snapshot 2466339472342191655 (task 10535 ms: download 4288 ms overlapping gunzip 636 ms, parse 2874 ms, sort 117 ms, write 5420 ms, index 796 ms: 1 candidates, 73223 repo-hours, 639 releases; waiting 481 ms; commit 2089 ms)
2026-11-08T00:02:51Z [load_day 2023-08-19] 2023-08-19 hour 2: 103022 events in 3 files, snapshot 4834501645101630875 (task 8694 ms: download 1971 ms overlapping gunzip 539 ms, parse 2363 ms, sort 100 ms, write 4593 ms, index 271 ms: 0 candidates, 41949 repo-hours, 588 releases; waiting 509 ms; commit 2800 ms)
2026-11-08T00:02:54Z [load_day 2023-08-19] 2023-08-19 hour 3: 100751 events in 3 files, snapshot 9153836720820726624 (task 8192 ms: download 1742 ms overlapping gunzip 434 ms, parse 1966 ms, sort 88 ms, write 4516 ms, index 405 ms: 2 candidates, 40433 repo-hours, 766 releases; waiting 466 ms; commit 3345 ms)
2026-11-08T00:03:00Z [load_day 2023-08-19] 2023-08-19 hour 4: 101835 events in 3 files, snapshot 4355719208591906999 (task 8534 ms: download 1809 ms overlapping gunzip 651 ms, parse 2593 ms, sort 74 ms, write 4095 ms, index 324 ms: 2 candidates, 40405 repo-hours, 506 releases; waiting 516 ms; commit 2509 ms)
2026-11-08T00:03:03Z [load_day 2023-08-19] 2023-08-19 hour 5: 107276 events in 3 files, snapshot 7096786774771611618 (task 9088 ms: download 1909 ms overlapping gunzip 466 ms, parse 2241 ms, sort 71 ms, write 5047 ms, index 432 ms: 4 candidates, 43052 repo-hours, 659 releases; waiting 516 ms; commit 2297 ms)
2026-11-08T00:03:10Z [load_day 2023-08-19] 2023-08-19 hour 6: 121407 events in 3 files, snapshot 7092806193877359941 (task 8899 ms: download 1556 ms overlapping gunzip 511 ms, parse 2331 ms, sort 108 ms, write 5051 ms, index 364 ms: 5 candidates, 51647 repo-hours, 632 releases; waiting 208 ms; commit 2337 ms)
2026-11-08T00:03:14Z [load_day 2023-08-19] 2023-08-19 hour 7: 111605 events in 3 files, snapshot 2893253177343210022 (task 8795 ms: download 2008 ms overlapping gunzip 536 ms, parse 2369 ms, sort 67 ms, write 4599 ms, index 416 ms: 4 candidates, 45967 repo-hours, 536 releases; waiting 475 ms; commit 3455 ms)
2026-11-08T00:03:22Z [load_day 2023-08-19] 2023-08-19 hour 8: 119359 events in 3 files, snapshot 8014458475409593069 (task 10393 ms: download 2035 ms overlapping gunzip 557 ms, parse 2375 ms, sort 89 ms, write 6204 ms, index 341 ms: 5 candidates, 49953 repo-hours, 592 releases; waiting 216 ms; commit 2688 ms)
2026-11-08T00:03:24Z [load_day 2023-08-19] 2023-08-19 hour 9: 123768 events in 3 files, snapshot 781796338845875072 (task 9825 ms: download 2261 ms overlapping gunzip 523 ms, parse 2446 ms, sort 100 ms, write 5404 ms, index 513 ms: 2 candidates, 52663 repo-hours, 752 releases; waiting 532 ms; commit 2329 ms)
2026-11-08T00:03:33Z [load_day 2023-08-19] 2023-08-19 hour 10: 123760 events in 3 files, snapshot 7520016775383400168 (task 10027 ms: download 1998 ms overlapping gunzip 655 ms, parse 2944 ms, sort 116 ms, write 5084 ms, index 390 ms: 2 candidates, 51762 repo-hours, 573 releases; waiting 500 ms; commit 2478 ms)
2026-11-08T00:03:35Z [load_day 2023-08-19] 2023-08-19 hour 11: 122140 events in 3 files, snapshot 1169495460841838649 (task 8990 ms: download 2010 ms overlapping gunzip 464 ms, parse 2111 ms, sort 74 ms, write 5003 ms, index 446 ms: 1 candidates, 51599 repo-hours, 584 releases; waiting 508 ms; commit 2485 ms)
2026-11-08T00:03:45Z [load_day 2023-08-19] 2023-08-19 hour 12: 199446 events in 4 files, snapshot 5431218791382591256 (task 11553 ms: download 3691 ms overlapping gunzip 578 ms, parse 3157 ms, sort 164 ms, write 6271 ms, index 553 ms: 3 candidates, 82029 repo-hours, 760 releases; waiting 522 ms; commit 2148 ms)
2026-11-08T00:03:48Z [load_day 2023-08-19] 2023-08-19 hour 13: 156398 events in 4 files, snapshot 4385940770541445090 (task 9981 ms: download 3825 ms overlapping gunzip 497 ms, parse 2345 ms, sort 104 ms, write 5712 ms, index 492 ms: 2 candidates, 77491 repo-hours, 683 releases; waiting 504 ms; commit 2167 ms)
2026-11-08T00:03:55Z [load_day 2023-08-19] 2023-08-19 hour 14: 140670 events in 3 files, snapshot 4799590102508089059 (task 9255 ms: download 2926 ms overlapping gunzip 490 ms, parse 2203 ms, sort 86 ms, write 5111 ms, index 391 ms: 3 candidates, 58743 repo-hours, 778 releases; waiting 686 ms; commit 2065 ms)
2026-11-08T00:03:58Z [load_day 2023-08-19] 2023-08-19 hour 15: 144187 events in 3 files, snapshot 4408139182822499159 (task 8962 ms: download 3428 ms overlapping gunzip 493 ms, parse 2218 ms, sort 90 ms, write 5035 ms, index 420 ms: 3 candidates, 62832 repo-hours, 980 releases; waiting 386 ms; commit 2304 ms)
2026-11-08T00:04:07Z [load_day 2023-08-19] 2023-08-19 hour 16: 135771 events in 3 files, snapshot 1230915257984135430 (task 10663 ms: download 2507 ms overlapping gunzip 608 ms, parse 2840 ms, sort 125 ms, write 5813 ms, index 408 ms: 6 candidates, 58241 repo-hours, 804 releases; waiting 513 ms; commit 2378 ms)
2026-11-08T00:04:13Z [load_day 2023-08-19] 2023-08-19 hour 17: 131218 events in 3 files, snapshot 2318186830050586018 (task 10337 ms: download 2117 ms overlapping gunzip 502 ms, parse 2313 ms, sort 138 ms, write 6219 ms, index 347 ms: 4 candidates, 53195 repo-hours, 662 releases; waiting 534 ms; commit 5099 ms)
2026-11-08T00:04:19Z [load_day 2023-08-19] 2023-08-19 hour 18: 134533 events in 3 files, snapshot 8873709091863181790 (task 9825 ms: download 1886 ms overlapping gunzip 570 ms, parse 2450 ms, sort 171 ms, write 5259 ms, index 547 ms: 2 candidates, 60414 repo-hours, 688 releases; waiting 521 ms; commit 3044 ms)
2026-11-08T00:04:24Z [load_day 2023-08-19] 2023-08-19 hour 19: 114268 events in 3 files, snapshot 1767632084216470851 (task 9504 ms: download 1837 ms overlapping gunzip 548 ms, parse 2520 ms, sort 91 ms, write 5128 ms, index 424 ms: 2 candidates, 45969 repo-hours, 657 releases; waiting 503 ms; commit 4513 ms)
2026-11-08T00:04:28Z [load_day 2023-08-19] 2023-08-19 hour 20: 109959 events in 3 files, snapshot 99141069807144972 (task 8938 ms: download 1817 ms overlapping gunzip 507 ms, parse 2304 ms, sort 90 ms, write 4618 ms, index 663 ms: 3 candidates, 45388 repo-hours, 611 releases; waiting 492 ms; commit 2107 ms)
2026-11-08T00:04:33Z [load_day 2023-08-19] 2023-08-19 hour 21: 102938 events in 3 files, snapshot 5290995370371584849 (task 8360 ms: download 2134 ms overlapping gunzip 430 ms, parse 2057 ms, sort 59 ms, write 4385 ms, index 423 ms: 3 candidates, 41057 repo-hours, 678 releases; waiting 510 ms; commit 4093 ms)
2026-11-08T00:04:37Z [load_day 2023-08-19] 2023-08-19 hour 22: 95734 events in 2 files, snapshot 1874112134465312171 (task 7619 ms: download 2131 ms overlapping gunzip 398 ms, parse 1806 ms, sort 65 ms, write 4030 ms, index 399 ms: 2 candidates, 37400 repo-hours, 624 releases; waiting 566 ms; commit 2325 ms)
2026-11-08T00:04:41Z [load_day 2023-08-19] 2023-08-19 hour 23: 93745 events in 2 files, snapshot 7902877199278680483 (task 6781 ms: download 1835 ms overlapping gunzip 366 ms, parse 1785 ms, sort 56 ms, write 3499 ms, index 263 ms: 1 candidates, 35580 repo-hours, 561 releases; waiting 495 ms; commit 3631 ms)
2026-11-08T00:04:47Z [load_day 2023-08-19] 2023-08-19: repo_hour merged from 24 files to 1 (1284074 rows, 5932 ms)
2026-11-08T00:04:49Z [load_day 2023-08-19] 2023-08-19: index committed in 8017 ms (23 + 1 + 24 files)
2026-11-08T00:04:49Z [load_day 2023-08-19] 2023-08-19: 2976903 events in 24 hours
2026-11-08T00:04:49Z [load_day 2023-08-19] attempt 1 succeeded