orcaLog in

Runs · run 1164

load_day 2023-06-09, attempt 1 succeeded

Host
3c2b29713ce8:7133
Started
2026-11-07T21:19:35Z
Ended
2026-11-07T21:21:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1164/load_day/2023-06-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:19:35Z [load_day 2023-06-09] attempt 1 started
2026-11-07T21:19:36Z [load_day 2023-06-09] 2023-06-09: 4 hours in flight, about 2100 MB
2026-11-07T21:19:54Z [load_day 2023-06-09] 2023-06-09 hour 0: 142673 events in 3 files, snapshot 7613319029783914939 (task 14484 ms: download 7353 ms overlapping gunzip 756 ms, parse 3579 ms, sort 95 ms, write 7821 ms, index 455 ms: 4 candidates, 70379 repo-hours, 803 releases; waiting 1473 ms; commit 1686 ms)
2026-11-07T21:19:56Z [load_day 2023-06-09] 2023-06-09 hour 1: 153321 events in 4 files, snapshot 233714003741295421 (task 14577 ms: download 6550 ms overlapping gunzip 733 ms, parse 3393 ms, sort 139 ms, write 9014 ms, index 543 ms: 13 candidates, 84472 repo-hours, 769 releases; waiting 470 ms; commit 1866 ms)
2026-11-07T21:19:58Z [load_day 2023-06-09] 2023-06-09 hour 2: 140924 events in 3 files, snapshot 3144872071848410990 (task 13431 ms: download 6068 ms overlapping gunzip 672 ms, parse 3040 ms, sort 90 ms, write 8262 ms, index 429 ms: 8 candidates, 69581 repo-hours, 632 releases; waiting 577 ms; commit 2377 ms)
2026-11-07T21:20:00Z [load_day 2023-06-09] 2023-06-09 hour 3: 132174 events in 3 files, snapshot 7566802071032691951 (task 13013 ms: download 6152 ms overlapping gunzip 735 ms, parse 3375 ms, sort 122 ms, write 7407 ms, index 390 ms: 10 candidates, 58899 repo-hours, 879 releases; waiting 657 ms; commit 2112 ms)
2026-11-07T21:20:07Z [load_day 2023-06-09] 2023-06-09 hour 4: 123758 events in 3 files, snapshot 5797169680762332753 (task 12376 ms: download 4357 ms overlapping gunzip 595 ms, parse 2561 ms, sort 95 ms, write 7154 ms, index 504 ms: 6 candidates, 53470 repo-hours, 685 releases; waiting 736 ms; commit 1874 ms)
2026-11-07T21:20:10Z [load_day 2023-06-09] 2023-06-09 hour 5: 137093 events in 3 files, snapshot 8752734310080900667 (task 13352 ms: download 4921 ms overlapping gunzip 685 ms, parse 3148 ms, sort 130 ms, write 8097 ms, index 533 ms: 7 candidates, 60819 repo-hours, 757 releases; waiting 526 ms; commit 1928 ms)
2026-11-07T21:20:14Z [load_day 2023-06-09] 2023-06-09 hour 6: 160742 events in 4 files, snapshot 1632219679520190011 (task 15940 ms: download 5571 ms overlapping gunzip 780 ms, parse 3681 ms, sort 106 ms, write 10320 ms, index 554 ms: 13 candidates, 75104 repo-hours, 841 releases; waiting 175 ms; commit 1814 ms)
2026-11-07T21:20:18Z [load_day 2023-06-09] 2023-06-09 hour 7: 157689 events in 4 files, snapshot 3339668427002933296 (task 16891 ms: download 6723 ms overlapping gunzip 843 ms, parse 3704 ms, sort 112 ms, write 10731 ms, index 707 ms: 7 candidates, 72692 repo-hours, 747 releases; waiting 489 ms; commit 2223 ms)
2026-11-07T21:20:26Z [load_day 2023-06-09] 2023-06-09 hour 8: 164666 events in 4 files, snapshot 8204907203023289584 (task 18045 ms: download 7074 ms overlapping gunzip 913 ms, parse 4160 ms, sort 110 ms, write 11185 ms, index 630 ms: 11 candidates, 77250 repo-hours, 813 releases; waiting 685 ms; commit 2000 ms)
2026-11-07T21:20:30Z [load_day 2023-06-09] 2023-06-09 hour 9: 172258 events in 4 files, snapshot 5429916000673625572 (task 18603 ms: download 10520 ms overlapping gunzip 1034 ms, parse 4548 ms, sort 155 ms, write 11566 ms, index 626 ms: 12 candidates, 84916 repo-hours, 975 releases; waiting 383 ms; commit 2082 ms)
2026-11-07T21:20:33Z [load_day 2023-06-09] 2023-06-09 hour 10: 170068 events in 4 files, snapshot 5101637037951263188 (task 17638 ms: download 10140 ms overlapping gunzip 850 ms, parse 3782 ms, sort 127 ms, write 11420 ms, index 690 ms: 7 candidates, 77382 repo-hours, 1016 releases; waiting 491 ms; commit 1890 ms)
2026-11-07T21:20:37Z [load_day 2023-06-09] 2023-06-09 hour 11: 172758 events in 4 files, snapshot 7866902107481504857 (task 18227 ms: download 10291 ms overlapping gunzip 899 ms, parse 4015 ms, sort 111 ms, write 11801 ms, index 643 ms: 3 candidates, 73598 repo-hours, 997 releases; waiting 458 ms; commit 2200 ms)
2026-11-07T21:20:48Z [load_day 2023-06-09] 2023-06-09 hour 12: 214882 events in 5 files, snapshot 2736215919571200495 (task 20359 ms: download 10412 ms overlapping gunzip 999 ms, parse 4501 ms, sort 141 ms, write 13149 ms, index 688 ms: 12 candidates, 104044 repo-hours, 1069 releases; waiting 551 ms; commit 2153 ms)
2026-11-07T21:20:51Z [load_day 2023-06-09] 2023-06-09 hour 13: 193102 events in 4 files, snapshot 819458493201427461 (task 19831 ms: download 10851 ms overlapping gunzip 1009 ms, parse 4491 ms, sort 174 ms, write 12470 ms, index 836 ms: 8 candidates, 98303 repo-hours, 989 releases; waiting 572 ms; commit 2276 ms)
2026-11-07T21:20:53Z [load_day 2023-06-09] 2023-06-09 hour 14: 173612 events in 4 files, snapshot 673664640607760555 (task 18519 ms: download 10428 ms overlapping gunzip 904 ms, parse 4024 ms, sort 104 ms, write 12120 ms, index 622 ms: 7 candidates, 83642 repo-hours, 943 releases; waiting 403 ms; commit 2068 ms)
2026-11-07T21:20:56Z [load_day 2023-06-09] 2023-06-09 hour 15: 167554 events in 4 files, snapshot 7214532388379362290 (task 17502 ms: download 9923 ms overlapping gunzip 908 ms, parse 4038 ms, sort 107 ms, write 11078 ms, index 592 ms: 10 candidates, 80383 repo-hours, 968 releases; waiting 451 ms; commit 2589 ms)
2026-11-07T21:21:06Z [load_day 2023-06-09] 2023-06-09 hour 16: 159560 events in 4 files, snapshot 7441797972111972951 (task 17362 ms: download 6624 ms overlapping gunzip 825 ms, parse 3764 ms, sort 122 ms, write 11304 ms, index 582 ms: 8 candidates, 75747 repo-hours, 880 releases; waiting 488 ms; commit 1939 ms)
2026-11-07T21:21:09Z [load_day 2023-06-09] 2023-06-09 hour 17: 168420 events in 4 files, snapshot 1626262463413228142 (task 17418 ms: download 10179 ms overlapping gunzip 937 ms, parse 4234 ms, sort 109 ms, write 10820 ms, index 515 ms: 5 candidates, 76465 repo-hours, 896 releases; waiting 503 ms; commit 1792 ms)
2026-11-07T21:21:12Z [load_day 2023-06-09] 2023-06-09 hour 18: 168272 events in 4 files, snapshot 1137912077736457863 (task 18028 ms: download 10607 ms overlapping gunzip 912 ms, parse 4252 ms, sort 121 ms, write 11257 ms, index 778 ms: 13 candidates, 77486 repo-hours, 920 releases; waiting 377 ms; commit 1844 ms)
2026-11-07T21:21:14Z [load_day 2023-06-09] 2023-06-09 hour 19: 152857 events in 4 files, snapshot 3433787546132982077 (task 15895 ms: download 6525 ms overlapping gunzip 830 ms, parse 3742 ms, sort 101 ms, write 9906 ms, index 552 ms: 6 candidates, 64887 repo-hours, 1005 releases; waiting 477 ms; commit 1900 ms)
2026-11-07T21:21:24Z [load_day 2023-06-09] 2023-06-09 hour 20: 150659 events in 4 files, snapshot 6904489636259156 (task 17212 ms: download 8226 ms overlapping gunzip 842 ms, parse 3725 ms, sort 123 ms, write 9774 ms, index 422 ms: 7 candidates, 64272 repo-hours, 847 releases; waiting 2052 ms; commit 2097 ms)
2026-11-07T21:21:26Z [load_day 2023-06-09] 2023-06-09 hour 21: 140455 events in 3 files, snapshot 2192452653648278359 (task 13733 ms: download 5784 ms overlapping gunzip 739 ms, parse 3262 ms, sort 103 ms, write 8549 ms, index 375 ms: 8 candidates, 61661 repo-hours, 841 releases; waiting 465 ms; commit 1728 ms)
2026-11-07T21:21:28Z [load_day 2023-06-09] 2023-06-09 hour 22: 124698 events in 3 files, snapshot 6416280490181746199 (task 11855 ms: download 5199 ms overlapping gunzip 607 ms, parse 2651 ms, sort 74 ms, write 7613 ms, index 327 ms: 3 candidates, 52537 repo-hours, 755 releases; waiting 330 ms; commit 1602 ms)
2026-11-07T21:21:29Z [load_day 2023-06-09] 2023-06-09 hour 23: 117281 events in 3 files, snapshot 6453666477347118240 (task 12127 ms: download 5703 ms overlapping gunzip 673 ms, parse 2955 ms, sort 76 ms, write 7304 ms, index 313 ms: 5 candidates, 49291 repo-hours, 755 releases; waiting 502 ms; commit 1749 ms)
2026-11-07T21:21:37Z [load_day 2023-06-09] 2023-06-09: repo_hour merged from 24 files to 1 (1747280 rows, 7377 ms)
2026-11-07T21:21:39Z [load_day 2023-06-09] 2023-06-09: index committed in 9737 ms (24 + 1 + 24 files)
2026-11-07T21:21:39Z [load_day 2023-06-09] 2023-06-09: 3759476 events in 24 hours
2026-11-07T21:21:39Z [load_day 2023-06-09] attempt 1 succeeded