orcaLog in

Runs · run 1387

load_day 2023-08-13, attempt 1 succeeded

Host
3c2b29713ce8:223565
Started
2026-11-07T23:52:00Z
Ended
2026-11-07T23:54:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1387/load_day/2023-08-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:52:00Z [load_day 2023-08-13] attempt 1 started
2026-11-07T23:52:02Z [load_day 2023-08-13] 2023-08-13: 2 hours in flight, about 1200 MB
2026-11-07T23:52:15Z [load_day 2023-08-13] 2023-08-13 hour 0: 125372 events in 3 files, snapshot 4490250801295200777 (task 9604 ms: download 1754 ms overlapping gunzip 483 ms, parse 2393 ms, sort 127 ms, write 5344 ms, index 506 ms: 2 candidates, 73133 repo-hours, 930 releases; waiting 516 ms; commit 2479 ms)
2026-11-07T23:52:18Z [load_day 2023-08-13] 2023-08-13 hour 1: 122997 events in 3 files, snapshot 2055020277090499326 (task 9052 ms: download 1852 ms overlapping gunzip 402 ms, parse 1967 ms, sort 91 ms, write 5251 ms, index 541 ms: 1 candidates, 71772 repo-hours, 675 releases; waiting 530 ms; commit 2652 ms)
2026-11-07T23:52:24Z [load_day 2023-08-13] 2023-08-13 hour 2: 91065 events in 2 files, snapshot 3358294623025413998 (task 6412 ms: download 1672 ms overlapping gunzip 396 ms, parse 1727 ms, sort 51 ms, write 3109 ms, index 347 ms: 2 candidates, 36874 repo-hours, 602 releases; waiting 497 ms; commit 3615 ms)
2026-11-07T23:52:28Z [load_day 2023-08-13] 2023-08-13 hour 3: 93486 events in 2 files, snapshot 2634702868495489432 (task 7275 ms: download 1649 ms overlapping gunzip 364 ms, parse 1703 ms, sort 55 ms, write 3868 ms, index 462 ms: 2 candidates, 36700 repo-hours, 826 releases; waiting 498 ms; commit 4601 ms)
2026-11-07T23:52:32Z [load_day 2023-08-13] 2023-08-13 hour 4: 93085 events in 2 files, snapshot 7233284242382518805 (task 8321 ms: download 1965 ms overlapping gunzip 585 ms, parse 2627 ms, sort 79 ms, write 3912 ms, index 259 ms: 1 candidates, 36749 repo-hours, 511 releases; waiting 502 ms; commit 2459 ms)
2026-11-07T23:52:36Z [load_day 2023-08-13] 2023-08-13 hour 5: 99943 events in 2 files, snapshot 8225820342830726970 (task 8132 ms: download 2069 ms overlapping gunzip 447 ms, parse 2085 ms, sort 70 ms, write 4353 ms, index 383 ms: 1 candidates, 40990 repo-hours, 616 releases; waiting 515 ms; commit 2904 ms)
2026-11-07T23:52:43Z [load_day 2023-08-13] 2023-08-13 hour 6: 111654 events in 3 files, snapshot 5411558869052411733 (task 8422 ms: download 1829 ms overlapping gunzip 490 ms, parse 2154 ms, sort 74 ms, write 4595 ms, index 321 ms: 0 candidates, 49125 repo-hours, 616 releases; waiting 491 ms; commit 3912 ms)
2026-11-07T23:52:46Z [load_day 2023-08-13] 2023-08-13 hour 7: 112471 events in 3 files, snapshot 3411250344093746331 (task 9296 ms: download 1575 ms overlapping gunzip 567 ms, parse 2505 ms, sort 94 ms, write 5308 ms, index 354 ms: 0 candidates, 44912 repo-hours, 681 releases; waiting 189 ms; commit 2515 ms)
2026-11-07T23:52:53Z [load_day 2023-08-13] 2023-08-13 hour 8: 122191 events in 3 files, snapshot 5021316579755042043 (task 9766 ms: download 1961 ms overlapping gunzip 564 ms, parse 2555 ms, sort 72 ms, write 5421 ms, index 348 ms: 2 candidates, 49721 repo-hours, 609 releases; waiting 530 ms; commit 3359 ms)
2026-11-07T23:52:59Z [load_day 2023-08-13] 2023-08-13 hour 9: 119418 events in 3 files, snapshot 2888466160249525094 (task 10128 ms: download 2026 ms overlapping gunzip 563 ms, parse 2583 ms, sort 79 ms, write 5706 ms, index 347 ms: 2 candidates, 48804 repo-hours, 767 releases; waiting 521 ms; commit 4683 ms)
2026-11-07T23:53:03Z [load_day 2023-08-13] 2023-08-13 hour 10: 122080 events in 3 files, snapshot 4425684924525948947 (task 10338 ms: download 2419 ms overlapping gunzip 585 ms, parse 2493 ms, sort 89 ms, write 5892 ms, index 391 ms: 6 candidates, 51086 repo-hours, 680 releases; waiting 526 ms; commit 2495 ms)
2026-11-07T23:53:09Z [load_day 2023-08-13] 2023-08-13 hour 11: 121060 events in 3 files, snapshot 4891432526045053226 (task 10739 ms: download 2326 ms overlapping gunzip 622 ms, parse 2811 ms, sort 80 ms, write 6047 ms, index 384 ms: 4 candidates, 48808 repo-hours, 670 releases; waiting 515 ms; commit 2522 ms)
2026-11-07T23:53:27Z [load_day 2023-08-13] 2023-08-13 hour 12: 204951 events in 5 files, snapshot 4658686169060390417 (task 13709 ms: download 4342 ms overlapping gunzip 772 ms, parse 3769 ms, sort 148 ms, write 7478 ms, index 713 ms: 4 candidates, 83959 repo-hours, 755 releases; waiting 515 ms; commit 11047 ms)
2026-11-07T23:53:29Z [load_day 2023-08-13] 2023-08-13 hour 13: 153914 events in 4 files, snapshot 957108368760026995 (task 14885 ms: download 4864 ms overlapping gunzip 730 ms, parse 3442 ms, sort 113 ms, write 8623 ms, index 1080 ms: 3 candidates, 75330 repo-hours, 768 releases; waiting 501 ms; commit 2182 ms)
2026-11-07T23:53:36Z [load_day 2023-08-13] 2023-08-13 hour 14: 142499 events in 3 files, snapshot 6285306987312402975 (task 11969 ms: download 5087 ms overlapping gunzip 761 ms, parse 3268 ms, sort 85 ms, write 6557 ms, index 485 ms: 4 candidates, 59805 repo-hours, 761 releases; waiting 491 ms; commit 7047 ms)
2026-11-07T23:53:46Z [load_day 2023-08-13] 2023-08-13 hour 15: 145883 events in 3 files, snapshot 2855815571049488845 (task 13476 ms: download 5327 ms overlapping gunzip 740 ms, parse 3123 ms, sort 109 ms, write 8007 ms, index 476 ms: 3 candidates, 63264 repo-hours, 875 releases; waiting 592 ms; commit 4357 ms)
2026-11-07T23:53:49Z [load_day 2023-08-13] 2023-08-13 hour 16: 139192 events in 3 files, snapshot 4624711450448418782 (task 10628 ms: download 4772 ms overlapping gunzip 643 ms, parse 2862 ms, sort 82 ms, write 5862 ms, index 429 ms: 6 candidates, 59661 repo-hours, 728 releases; waiting 472 ms; commit 2875 ms)
2026-11-07T23:53:58Z [load_day 2023-08-13] 2023-08-13 hour 17: 130211 events in 3 files, snapshot 7042623479832697837 (task 10737 ms: download 2053 ms overlapping gunzip 589 ms, parse 2641 ms, sort 77 ms, write 6179 ms, index 434 ms: 4 candidates, 53728 repo-hours, 682 releases; waiting 521 ms; commit 2426 ms)
2026-11-07T23:54:00Z [load_day 2023-08-13] 2023-08-13 hour 18: 144782 events in 3 files, snapshot 4481080891804539045 (task 10709 ms: download 3643 ms overlapping gunzip 638 ms, parse 2936 ms, sort 192 ms, write 5887 ms, index 580 ms: 3 candidates, 69096 repo-hours, 776 releases; waiting 197 ms; commit 2610 ms)
2026-11-07T23:54:10Z [load_day 2023-08-13] 2023-08-13 hour 19: 130467 events in 3 files, snapshot 659147134914519810 (task 10975 ms: download 2718 ms overlapping gunzip 597 ms, parse 2811 ms, sort 138 ms, write 6121 ms, index 491 ms: 3 candidates, 56145 repo-hours, 746 releases; waiting 503 ms; commit 2613 ms)
2026-11-07T23:54:12Z [load_day 2023-08-13] 2023-08-13 hour 20: 123615 events in 3 files, snapshot 2686591212305737236 (task 10003 ms: download 1923 ms overlapping gunzip 558 ms, parse 2468 ms, sort 76 ms, write 5712 ms, index 448 ms: 0 candidates, 51547 repo-hours, 693 releases; waiting 461 ms; commit 2427 ms)
2026-11-07T23:54:21Z [load_day 2023-08-13] 2023-08-13 hour 21: 113351 events in 3 files, snapshot 3043303631904723553 (task 9892 ms: download 2329 ms overlapping gunzip 699 ms, parse 2855 ms, sort 87 ms, write 5130 ms, index 334 ms: 4 candidates, 45432 repo-hours, 758 releases; waiting 483 ms; commit 2693 ms)
2026-11-07T23:54:23Z [load_day 2023-08-13] 2023-08-13 hour 22: 107485 events in 3 files, snapshot 5550659212751938409 (task 9942 ms: download 2011 ms overlapping gunzip 571 ms, parse 2434 ms, sort 82 ms, write 5639 ms, index 402 ms: 3 candidates, 43023 repo-hours, 628 releases; waiting 495 ms; commit 2171 ms)
2026-11-07T23:54:29Z [load_day 2023-08-13] 2023-08-13 hour 23: 98700 events in 2 files, snapshot 9070345837155346884 (task 7791 ms: download 1811 ms overlapping gunzip 452 ms, parse 2116 ms, sort 126 ms, write 3981 ms, index 294 ms: 2 candidates, 40887 repo-hours, 596 releases; waiting 517 ms; commit 1974 ms)
2026-11-07T23:54:36Z [load_day 2023-08-13] 2023-08-13: repo_hour merged from 24 files to 1 (1290551 rows, 6353 ms)
2026-11-07T23:54:38Z [load_day 2023-08-13] 2023-08-13: index committed in 8419 ms (21 + 1 + 24 files)
2026-11-07T23:54:38Z [load_day 2023-08-13] 2023-08-13: 2969872 events in 24 hours
2026-11-07T23:54:38Z [load_day 2023-08-13] attempt 1 succeeded