orcaLog in

Runs · run 1167

load_day 2023-06-10, attempt 1 succeeded

Host
3c2b29713ce8:7263
Started
2026-11-07T21:21:40Z
Ended
2026-11-07T21:23:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1167/load_day/2023-06-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:21:40Z [load_day 2023-06-10] attempt 1 started
2026-11-07T21:21:41Z [load_day 2023-06-10] 2023-06-10: 4 hours in flight, about 2100 MB
2026-11-07T21:22:03Z [load_day 2023-06-10] 2023-06-10 hour 0: 158903 events in 4 files, snapshot 6539035022503285363 (task 18361 ms: download 8288 ms overlapping gunzip 997 ms, parse 4825 ms, sort 157 ms, write 11001 ms, index 558 ms: 3 candidates, 81309 repo-hours, 1015 releases; waiting 513 ms; commit 1767 ms)
2026-11-07T21:22:05Z [load_day 2023-06-10] 2023-06-10 hour 1: 125968 events in 3 files, snapshot 8238454208551341940 (task 11782 ms: download 3231 ms overlapping gunzip 626 ms, parse 2856 ms, sort 116 ms, write 6492 ms, index 445 ms: 3 candidates, 65709 repo-hours, 932 releases; waiting 946 ms; commit 1777 ms)
2026-11-07T21:22:06Z [load_day 2023-06-10] 2023-06-10 hour 2: 108068 events in 3 files, snapshot 2860575800616384406 (task 9530 ms: download 3373 ms overlapping gunzip 433 ms, parse 2024 ms, sort 58 ms, write 5433 ms, index 321 ms: 2 candidates, 52253 repo-hours, 675 releases; waiting 924 ms; commit 1760 ms)
2026-11-07T21:22:08Z [load_day 2023-06-10] 2023-06-10 hour 3: 101733 events in 3 files, snapshot 4819064999883394000 (task 9299 ms: download 1940 ms overlapping gunzip 472 ms, parse 2161 ms, sort 71 ms, write 5357 ms, index 309 ms: 1 candidates, 45691 repo-hours, 753 releases; waiting 516 ms; commit 1790 ms)
2026-11-07T21:22:12Z [load_day 2023-06-10] 2023-06-10 hour 4: 96781 events in 2 files, snapshot 3369233298188603110 (task 7804 ms: download 1813 ms overlapping gunzip 373 ms, parse 1647 ms, sort 79 ms, write 4589 ms, index 278 ms: 6 candidates, 42783 repo-hours, 552 releases; waiting 526 ms; commit 1925 ms)
2026-11-07T21:22:14Z [load_day 2023-06-10] 2023-06-10 hour 5: 101005 events in 3 files, snapshot 320434472978211542 (task 8705 ms: download 1723 ms overlapping gunzip 425 ms, parse 1862 ms, sort 91 ms, write 5286 ms, index 335 ms: 3 candidates, 44931 repo-hours, 680 releases; waiting 386 ms; commit 1930 ms)
2026-11-07T21:22:16Z [load_day 2023-06-10] 2023-06-10 hour 6: 112868 events in 3 files, snapshot 7687857161625542668 (task 8849 ms: download 1776 ms overlapping gunzip 442 ms, parse 2071 ms, sort 72 ms, write 5036 ms, index 416 ms: 3 candidates, 52019 repo-hours, 735 releases; waiting 523 ms; commit 1842 ms)
2026-11-07T21:22:19Z [load_day 2023-06-10] 2023-06-10 hour 7: 117488 events in 3 files, snapshot 2768533998111034690 (task 9722 ms: download 2325 ms overlapping gunzip 473 ms, parse 2209 ms, sort 70 ms, write 5542 ms, index 553 ms: 5 candidates, 54212 repo-hours, 669 releases; waiting 520 ms; commit 2166 ms)
2026-11-07T21:22:23Z [load_day 2023-06-10] 2023-06-10 hour 8: 134134 events in 3 files, snapshot 918465608781708134 (task 10410 ms: download 2036 ms overlapping gunzip 485 ms, parse 2168 ms, sort 97 ms, write 6468 ms, index 389 ms: 10 candidates, 64314 repo-hours, 670 releases; waiting 527 ms; commit 1936 ms)
2026-11-07T21:22:25Z [load_day 2023-06-10] 2023-06-10 hour 9: 123785 events in 3 files, snapshot 8692514087183359261 (task 9795 ms: download 2427 ms overlapping gunzip 425 ms, parse 1968 ms, sort 65 ms, write 6069 ms, index 364 ms: 4 candidates, 56022 repo-hours, 799 releases; waiting 577 ms; commit 2293 ms)
2026-11-07T21:22:28Z [load_day 2023-06-10] 2023-06-10 hour 10: 124407 events in 3 files, snapshot 222851071372393297 (task 9577 ms: download 1841 ms overlapping gunzip 432 ms, parse 2059 ms, sort 77 ms, write 5758 ms, index 460 ms: 6 candidates, 58574 repo-hours, 721 releases; waiting 505 ms; commit 2058 ms)
2026-11-07T21:22:30Z [load_day 2023-06-10] 2023-06-10 hour 11: 121911 events in 3 files, snapshot 8969248927621024403 (task 10406 ms: download 2053 ms overlapping gunzip 523 ms, parse 2452 ms, sort 80 ms, write 5995 ms, index 562 ms: 7 candidates, 52890 repo-hours, 616 releases; waiting 506 ms; commit 2094 ms)
2026-11-07T21:22:37Z [load_day 2023-06-10] 2023-06-10 hour 12: 193351 events in 4 files, snapshot 6081625606006541711 (task 12923 ms: download 4142 ms overlapping gunzip 622 ms, parse 3010 ms, sort 115 ms, write 7770 ms, index 575 ms: 7 candidates, 84957 repo-hours, 752 releases; waiting 530 ms; commit 2119 ms)
2026-11-07T21:22:39Z [load_day 2023-06-10] 2023-06-10 hour 13: 153380 events in 4 files, snapshot 2938746255647696704 (task 11517 ms: download 3483 ms overlapping gunzip 547 ms, parse 2528 ms, sort 119 ms, write 7170 ms, index 616 ms: 4 candidates, 80278 repo-hours, 706 releases; waiting 311 ms; commit 1995 ms)
2026-11-07T21:22:41Z [load_day 2023-06-10] 2023-06-10 hour 14: 141494 events in 3 files, snapshot 1394041203978593225 (task 11360 ms: download 4380 ms overlapping gunzip 532 ms, parse 2514 ms, sort 93 ms, write 6939 ms, index 466 ms: 10 candidates, 61697 repo-hours, 675 releases; waiting 513 ms; commit 2016 ms)
2026-11-07T21:22:43Z [load_day 2023-06-10] 2023-06-10 hour 15: 143462 events in 3 files, snapshot 2857868590845347645 (task 11694 ms: download 4596 ms overlapping gunzip 533 ms, parse 2459 ms, sort 94 ms, write 7071 ms, index 463 ms: 7 candidates, 64995 repo-hours, 839 releases; waiting 721 ms; commit 1991 ms)
2026-11-07T21:22:49Z [load_day 2023-06-10] 2023-06-10 hour 16: 135654 events in 3 files, snapshot 2544227528081373717 (task 10522 ms: download 2043 ms overlapping gunzip 491 ms, parse 2241 ms, sort 84 ms, write 6481 ms, index 395 ms: 3 candidates, 62712 repo-hours, 745 releases; waiting 524 ms; commit 2018 ms)
2026-11-07T21:22:51Z [load_day 2023-06-10] 2023-06-10 hour 17: 127064 events in 3 files, snapshot 5302369481149916741 (task 10215 ms: download 2031 ms overlapping gunzip 467 ms, parse 2184 ms, sort 88 ms, write 6238 ms, index 438 ms: 5 candidates, 54551 repo-hours, 678 releases; waiting 492 ms; commit 1983 ms)
2026-11-07T21:22:53Z [load_day 2023-06-10] 2023-06-10 hour 18: 134909 events in 3 files, snapshot 180882374150688559 (task 10648 ms: download 1836 ms overlapping gunzip 505 ms, parse 2304 ms, sort 102 ms, write 6478 ms, index 526 ms: 5 candidates, 62067 repo-hours, 730 releases; waiting 506 ms; commit 1667 ms)
2026-11-07T21:22:55Z [load_day 2023-06-10] 2023-06-10 hour 19: 114641 events in 3 files, snapshot 405217627363789268 (task 9247 ms: download 1716 ms overlapping gunzip 456 ms, parse 2089 ms, sort 84 ms, write 5526 ms, index 377 ms: 5 candidates, 48964 repo-hours, 720 releases; waiting 495 ms; commit 2523 ms)
2026-11-07T21:22:58Z [load_day 2023-06-10] 2023-06-10 hour 20: 108897 events in 3 files, snapshot 5261531272962299256 (task 8798 ms: download 2053 ms overlapping gunzip 418 ms, parse 1903 ms, sort 64 ms, write 5304 ms, index 306 ms: 6 candidates, 46210 repo-hours, 691 releases; waiting 534 ms; commit 1732 ms)
2026-11-07T21:23:01Z [load_day 2023-06-10] 2023-06-10 hour 21: 104547 events in 3 files, snapshot 6425366360411729346 (task 9308 ms: download 2512 ms overlapping gunzip 452 ms, parse 1991 ms, sort 84 ms, write 5542 ms, index 320 ms: 4 candidates, 46393 repo-hours, 847 releases; waiting 618 ms; commit 1752 ms)
2026-11-07T21:23:03Z [load_day 2023-06-10] 2023-06-10 hour 22: 98500 events in 2 files, snapshot 8919717747873203962 (task 7588 ms: download 2040 ms overlapping gunzip 359 ms, parse 1549 ms, sort 89 ms, write 4457 ms, index 294 ms: 6 candidates, 46593 repo-hours, 649 releases; waiting 541 ms; commit 1761 ms)
2026-11-07T21:23:04Z [load_day 2023-06-10] 2023-06-10 hour 23: 87435 events in 2 files, snapshot 7255503710957386371 (task 6695 ms: download 1478 ms overlapping gunzip 307 ms, parse 1444 ms, sort 57 ms, write 3864 ms, index 250 ms: 1 candidates, 38897 repo-hours, 522 releases; waiting 534 ms; commit 1729 ms)
2026-11-07T21:23:10Z [load_day 2023-06-10] 2023-06-10: repo_hour merged from 24 files to 1 (1369021 rows, 5722 ms)
2026-11-07T21:23:12Z [load_day 2023-06-10] 2023-06-10: index committed in 7718 ms (24 + 1 + 24 files)
2026-11-07T21:23:12Z [load_day 2023-06-10] 2023-06-10: 2970385 events in 24 hours
2026-11-07T21:23:12Z [load_day 2023-06-10] attempt 1 succeeded