orcaLog in

Runs · run 1029

load_day 2023-04-25, attempt 1 succeeded

Host
caf251265124:304188
Started
2026-11-07T19:10:55Z
Ended
2026-11-07T19:14:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1029/load_day/2023-04-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:10:55Z [load_day 2023-04-25] attempt 1 started
2026-11-07T19:10:56Z [load_day 2023-04-25] 2023-04-25: 2 hours in flight, about 1200 MB
2026-11-07T19:11:11Z [load_day 2023-04-25] 2023-04-25 hour 0: 156578 events in 4 files, snapshot 6520595624793287975 (task 12774 ms: download 5934 ms overlapping gunzip 747 ms, parse 3279 ms, sort 108 ms, write 7076 ms, index 501 ms: 6 candidates, 79255 repo-hours, 810 releases; waiting 721 ms; commit 1538 ms)
2026-11-07T19:11:13Z [load_day 2023-04-25] 2023-04-25 hour 1: 162001 events in 4 files, snapshot 2764122117818389934 (task 12520 ms: download 5467 ms overlapping gunzip 803 ms, parse 3682 ms, sort 94 ms, write 6475 ms, index 637 ms: 4 candidates, 90435 repo-hours, 748 releases; waiting 502 ms; commit 1710 ms)
2026-11-07T19:11:23Z [load_day 2023-04-25] 2023-04-25 hour 2: 144681 events in 3 files, snapshot 8692811081272137612 (task 11034 ms: download 4767 ms overlapping gunzip 669 ms, parse 2889 ms, sort 81 ms, write 6000 ms, index 453 ms: 5 candidates, 68260 repo-hours, 744 releases; waiting 633 ms; commit 1519 ms)
2026-11-07T19:11:25Z [load_day 2023-04-25] 2023-04-25 hour 3: 138779 events in 3 files, snapshot 3303376941695315838 (task 11409 ms: download 5013 ms overlapping gunzip 632 ms, parse 2732 ms, sort 77 ms, write 6320 ms, index 431 ms: 1 candidates, 61822 repo-hours, 844 releases; waiting 935 ms; commit 1715 ms)
2026-11-07T19:11:35Z [load_day 2023-04-25] 2023-04-25 hour 4: 129043 events in 3 files, snapshot 1106718756474339481 (task 10213 ms: download 4603 ms overlapping gunzip 594 ms, parse 2489 ms, sort 75 ms, write 5552 ms, index 410 ms: 0 candidates, 56616 repo-hours, 630 releases; waiting 775 ms; commit 1734 ms)
2026-11-07T19:11:38Z [load_day 2023-04-25] 2023-04-25 hour 5: 142991 events in 3 files, snapshot 1290879769862282010 (task 11436 ms: download 4851 ms overlapping gunzip 700 ms, parse 2930 ms, sort 79 ms, write 6386 ms, index 433 ms: 1 candidates, 64097 repo-hours, 759 releases; waiting 555 ms; commit 1698 ms)
2026-11-07T19:11:49Z [load_day 2023-04-25] 2023-04-25 hour 6: 169406 events in 4 files, snapshot 3401728423537642150 (task 13832 ms: download 7899 ms overlapping gunzip 793 ms, parse 3461 ms, sort 103 ms, write 7605 ms, index 560 ms: 3 candidates, 79910 repo-hours, 921 releases; waiting 900 ms; commit 1703 ms)
2026-11-07T19:11:51Z [load_day 2023-04-25] 2023-04-25 hour 7: 151464 events in 4 files, snapshot 932502901019442746 (task 12588 ms: download 5349 ms overlapping gunzip 745 ms, parse 3192 ms, sort 96 ms, write 7221 ms, index 489 ms: 4 candidates, 75537 repo-hours, 696 releases; waiting 506 ms; commit 1713 ms)
2026-11-07T19:12:05Z [load_day 2023-04-25] 2023-04-25 hour 8: 175856 events in 4 files, snapshot 2678372275487063246 (task 15356 ms: download 9122 ms overlapping gunzip 891 ms, parse 3846 ms, sort 108 ms, write 9156 ms, index 539 ms: 2 candidates, 83620 repo-hours, 889 releases; waiting 515 ms; commit 1613 ms)
2026-11-07T19:12:07Z [load_day 2023-04-25] 2023-04-25 hour 9: 175024 events in 4 files, snapshot 9127602349772501992 (task 14806 ms: download 8557 ms overlapping gunzip 887 ms, parse 3836 ms, sort 115 ms, write 8653 ms, index 574 ms: 4 candidates, 82929 repo-hours, 1054 releases; waiting 388 ms; commit 1538 ms)
2026-11-07T19:12:23Z [load_day 2023-04-25] 2023-04-25 hour 10: 169051 events in 4 files, snapshot 2159461924474537227 (task 15339 ms: download 8292 ms overlapping gunzip 832 ms, parse 3649 ms, sort 109 ms, write 8215 ms, index 1747 ms: 1 candidates, 79242 repo-hours, 970 releases; waiting 487 ms; commit 3072 ms)
2026-11-07T19:12:25Z [load_day 2023-04-25] 2023-04-25 hour 11: 172449 events in 4 files, snapshot 2923403781313989623 (task 14548 ms: download 8374 ms overlapping gunzip 863 ms, parse 3723 ms, sort 104 ms, write 8379 ms, index 587 ms: 1 candidates, 80021 repo-hours, 926 releases; waiting 539 ms; commit 1545 ms)
2026-11-07T19:12:41Z [load_day 2023-04-25] 2023-04-25 hour 12: 211042 events in 5 files, snapshot 515027160024353677 (task 18404 ms: download 10818 ms overlapping gunzip 967 ms, parse 4232 ms, sort 127 ms, write 9417 ms, index 733 ms: 5 candidates, 110276 repo-hours, 919 releases; waiting 2595 ms; commit 1575 ms)
2026-11-07T19:12:42Z [load_day 2023-04-25] 2023-04-25 hour 13: 196284 events in 4 files, snapshot 9203881243215739518 (task 16219 ms: download 8927 ms overlapping gunzip 948 ms, parse 4179 ms, sort 115 ms, write 9344 ms, index 663 ms: 8 candidates, 103274 repo-hours, 1133 releases; waiting 701 ms; commit 1655 ms)
2026-11-07T19:12:58Z [load_day 2023-04-25] 2023-04-25 hour 14: 188532 events in 4 files, snapshot 8312109978664833585 (task 16308 ms: download 9001 ms overlapping gunzip 948 ms, parse 4172 ms, sort 107 ms, write 9808 ms, index 597 ms: 7 candidates, 93189 repo-hours, 1088 releases; waiting 403 ms; commit 1864 ms)
2026-11-07T19:13:00Z [load_day 2023-04-25] 2023-04-25 hour 15: 179151 events in 4 files, snapshot 825799140227857248 (task 15838 ms: download 9246 ms overlapping gunzip 913 ms, parse 3963 ms, sort 101 ms, write 9189 ms, index 587 ms: 4 candidates, 92734 repo-hours, 1030 releases; waiting 814 ms; commit 1521 ms)
2026-11-07T19:13:14Z [load_day 2023-04-25] 2023-04-25 hour 16: 173329 events in 4 files, snapshot 3228697849157726904 (task 14934 ms: download 8851 ms overlapping gunzip 881 ms, parse 3890 ms, sort 119 ms, write 8882 ms, index 529 ms: 1 candidates, 84832 repo-hours, 852 releases; waiting 335 ms; commit 1710 ms)
2026-11-07T19:13:15Z [load_day 2023-04-25] 2023-04-25 hour 17: 180747 events in 4 files, snapshot 5065325318783545889 (task 15065 ms: download 8590 ms overlapping gunzip 878 ms, parse 3840 ms, sort 114 ms, write 8691 ms, index 648 ms: 5 candidates, 83945 repo-hours, 1014 releases; waiting 543 ms; commit 1535 ms)
2026-11-07T19:13:29Z [load_day 2023-04-25] 2023-04-25 hour 18: 187070 events in 4 files, snapshot 697192454924101661 (task 15288 ms: download 8484 ms overlapping gunzip 939 ms, parse 4136 ms, sort 144 ms, write 8602 ms, index 614 ms: 5 candidates, 90233 repo-hours, 1118 releases; waiting 528 ms; commit 1459 ms)
2026-11-07T19:13:32Z [load_day 2023-04-25] 2023-04-25 hour 19: 175588 events in 4 files, snapshot 7644675762608784913 (task 15177 ms: download 9195 ms overlapping gunzip 840 ms, parse 3693 ms, sort 112 ms, write 8252 ms, index 543 ms: 2 candidates, 81552 repo-hours, 948 releases; waiting 1388 ms; commit 1578 ms)
2026-11-07T19:13:45Z [load_day 2023-04-25] 2023-04-25 hour 20: 178692 events in 4 files, snapshot 5012934205292742449 (task 14727 ms: download 8508 ms overlapping gunzip 929 ms, parse 3969 ms, sort 103 ms, write 8291 ms, index 547 ms: 5 candidates, 80662 repo-hours, 969 releases; waiting 430 ms; commit 1613 ms)
2026-11-07T19:13:47Z [load_day 2023-04-25] 2023-04-25 hour 21: 165044 events in 4 files, snapshot 4296453132428322591 (task 13624 ms: download 8175 ms overlapping gunzip 840 ms, parse 3651 ms, sort 96 ms, write 7989 ms, index 486 ms: 6 candidates, 70028 repo-hours, 987 releases; waiting 288 ms; commit 1622 ms)
2026-11-07T19:13:58Z [load_day 2023-04-25] 2023-04-25 hour 22: 148068 events in 3 files, snapshot 8044944225562789813 (task 12012 ms: download 5413 ms overlapping gunzip 709 ms, parse 3084 ms, sort 87 ms, write 6898 ms, index 420 ms: 1 candidates, 62411 repo-hours, 806 releases; waiting 518 ms; commit 1534 ms)
2026-11-07T19:14:00Z [load_day 2023-04-25] 2023-04-25 hour 23: 136529 events in 3 files, snapshot 7355342992632018623 (task 10691 ms: download 4605 ms overlapping gunzip 643 ms, parse 2852 ms, sort 86 ms, write 6043 ms, index 391 ms: 2 candidates, 57997 repo-hours, 654 releases; waiting 390 ms; commit 2197 ms)
2026-11-07T19:14:08Z [load_day 2023-04-25] 2023-04-25: repo_hour merged from 24 files to 1 (1912877 rows, 8300 ms)
2026-11-07T19:14:10Z [load_day 2023-04-25] 2023-04-25: index committed in 10521 ms (23 + 1 + 24 files)
2026-11-07T19:14:10Z [load_day 2023-04-25] 2023-04-25: 4007399 events in 24 hours
2026-11-07T19:14:10Z [load_day 2023-04-25] attempt 1 succeeded