orcaLog in

Runs · run 921

load_day 2023-03-20, attempt 1 succeeded

Host
caf251265124:180468
Started
2026-11-07T17:22:24Z
Ended
2026-11-07T17:25:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/921/load_day/2023-03-20/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:22:24Z [load_day 2023-03-20] attempt 1 started
2026-11-07T17:22:27Z [load_day 2023-03-20] 2023-03-20: 2 hours in flight, about 1200 MB
2026-11-07T17:22:40Z [load_day 2023-03-20] 2023-03-20 hour 0: 134444 events in 3 files, snapshot 5572275760739919160 (task 9361 ms: download 3407 ms overlapping gunzip 523 ms, parse 2426 ms, sort 72 ms, write 4697 ms, index 420 ms: 6 candidates, 65880 repo-hours, 829 releases; waiting 596 ms; commit 1504 ms)
2026-11-07T17:22:42Z [load_day 2023-03-20] 2023-03-20 hour 1: 155943 events in 4 files, snapshot 3155832507020616966 (task 11591 ms: download 4727 ms overlapping gunzip 690 ms, parse 3039 ms, sort 99 ms, write 6412 ms, index 514 ms: 5 candidates, 80179 repo-hours, 805 releases; waiting 502 ms; commit 1604 ms)
2026-11-07T17:22:53Z [load_day 2023-03-20] 2023-03-20 hour 2: 149193 events in 3 files, snapshot 6843524658496692868 (task 12110 ms: download 4995 ms overlapping gunzip 740 ms, parse 3039 ms, sort 112 ms, write 6729 ms, index 469 ms: 6 candidates, 69259 repo-hours, 722 releases; waiting 587 ms; commit 1809 ms)
2026-11-07T17:22:54Z [load_day 2023-03-20] 2023-03-20 hour 3: 142672 events in 3 files, snapshot 5564261048982684694 (task 11059 ms: download 4965 ms overlapping gunzip 669 ms, parse 2798 ms, sort 95 ms, write 5969 ms, index 411 ms: 2 candidates, 58171 repo-hours, 839 releases; waiting 802 ms; commit 1538 ms)
2026-11-07T17:23:05Z [load_day 2023-03-20] 2023-03-20 hour 4: 130661 events in 3 files, snapshot 4976468261907481590 (task 11747 ms: download 5051 ms overlapping gunzip 769 ms, parse 3360 ms, sort 117 ms, write 5801 ms, index 345 ms: 3 candidates, 52616 repo-hours, 625 releases; waiting 1000 ms; commit 1580 ms)
2026-11-07T17:23:09Z [load_day 2023-03-20] 2023-03-20 hour 5: 141109 events in 3 files, snapshot 7277654160449905843 (task 13968 ms: download 7905 ms overlapping gunzip 766 ms, parse 3203 ms, sort 91 ms, write 6144 ms, index 423 ms: 2 candidates, 57978 repo-hours, 808 releases; waiting 3041 ms; commit 1449 ms)
2026-11-07T17:23:18Z [load_day 2023-03-20] 2023-03-20 hour 6: 161733 events in 4 files, snapshot 1709875012918573615 (task 12734 ms: download 5443 ms overlapping gunzip 780 ms, parse 3275 ms, sort 98 ms, write 7206 ms, index 520 ms: 6 candidates, 71861 repo-hours, 887 releases; waiting 545 ms; commit 1557 ms)
2026-11-07T17:23:24Z [load_day 2023-03-20] 2023-03-20 hour 7: 171394 events in 4 files, snapshot 9086557219969680161 (task 14374 ms: download 8384 ms overlapping gunzip 883 ms, parse 3755 ms, sort 115 ms, write 8238 ms, index 569 ms: 15 candidates, 74032 repo-hours, 826 releases; waiting 539 ms; commit 1533 ms)
2026-11-07T17:23:35Z [load_day 2023-03-20] 2023-03-20 hour 8: 179218 events in 4 files, snapshot 6364569504059328182 (task 15632 ms: download 8951 ms overlapping gunzip 961 ms, parse 4027 ms, sort 108 ms, write 9188 ms, index 520 ms: 7 candidates, 81490 repo-hours, 860 releases; waiting 506 ms; commit 1751 ms)
2026-11-07T17:23:41Z [load_day 2023-03-20] 2023-03-20 hour 9: 185773 events in 4 files, snapshot 7706188911419383463 (task 16638 ms: download 9636 ms overlapping gunzip 1010 ms, parse 4345 ms, sort 127 ms, write 9690 ms, index 615 ms: 10 candidates, 84635 repo-hours, 1067 releases; waiting 532 ms; commit 1439 ms)
2026-11-07T17:23:52Z [load_day 2023-03-20] 2023-03-20 hour 10: 182294 events in 4 files, snapshot 7917467896381574317 (task 16648 ms: download 9442 ms overlapping gunzip 1032 ms, parse 4289 ms, sort 117 ms, write 9377 ms, index 568 ms: 5 candidates, 82497 repo-hours, 1096 releases; waiting 616 ms; commit 1303 ms)
2026-11-07T17:23:59Z [load_day 2023-03-20] 2023-03-20 hour 11: 189427 events in 4 files, snapshot 6251293293365535307 (task 17060 ms: download 10066 ms overlapping gunzip 991 ms, parse 4205 ms, sort 111 ms, write 9115 ms, index 584 ms: 8 candidates, 84766 repo-hours, 1021 releases; waiting 1721 ms; commit 1424 ms)
2026-11-07T17:24:09Z [load_day 2023-03-20] 2023-03-20 hour 12: 206207 events in 5 files, snapshot 8704127876683551791 (task 15673 ms: download 8230 ms overlapping gunzip 897 ms, parse 3883 ms, sort 124 ms, write 9227 ms, index 686 ms: 10 candidates, 117078 repo-hours, 1043 releases; waiting 567 ms; commit 1544 ms)
2026-11-07T17:24:16Z [load_day 2023-03-20] 2023-03-20 hour 13: 192101 events in 4 files, snapshot 2259698005485183640 (task 16569 ms: download 9122 ms overlapping gunzip 984 ms, parse 4282 ms, sort 120 ms, write 9792 ms, index 682 ms: 6 candidates, 101301 repo-hours, 987 releases; waiting 397 ms; commit 1526 ms)
2026-11-07T17:24:26Z [load_day 2023-03-20] 2023-03-20 hour 14: 189658 events in 4 files, snapshot 8564454178762166160 (task 17005 ms: download 9444 ms overlapping gunzip 993 ms, parse 4136 ms, sort 134 ms, write 9821 ms, index 705 ms: 7 candidates, 101276 repo-hours, 992 releases; waiting 589 ms; commit 1649 ms)
2026-11-07T17:24:34Z [load_day 2023-03-20] 2023-03-20 hour 15: 184754 events in 4 files, snapshot 1830027656785909795 (task 17123 ms: download 9801 ms overlapping gunzip 1022 ms, parse 4337 ms, sort 109 ms, write 10175 ms, index 622 ms: 7 candidates, 90046 repo-hours, 1180 releases; waiting 499 ms; commit 1399 ms)
2026-11-07T17:24:45Z [load_day 2023-03-20] 2023-03-20 hour 16: 187156 events in 4 files, snapshot 9114759542221741214 (task 17768 ms: download 10748 ms overlapping gunzip 1056 ms, parse 4531 ms, sort 123 ms, write 10220 ms, index 604 ms: 10 candidates, 87626 repo-hours, 995 releases; waiting 898 ms; commit 1705 ms)
2026-11-07T17:24:51Z [load_day 2023-03-20] 2023-03-20 hour 17: 204064 events in 5 files, snapshot 7562955766078464804 (task 16656 ms: download 9407 ms overlapping gunzip 1030 ms, parse 4461 ms, sort 138 ms, write 9565 ms, index 651 ms: 7 candidates, 104461 repo-hours, 967 releases; waiting 339 ms; commit 1497 ms)
2026-11-07T17:25:02Z [load_day 2023-03-20] 2023-03-20 hour 18: 185610 events in 4 files, snapshot 3086625244553721097 (task 16179 ms: download 9237 ms overlapping gunzip 974 ms, parse 4227 ms, sort 108 ms, write 9298 ms, index 696 ms: 8 candidates, 84487 repo-hours, 1021 releases; waiting 574 ms; commit 1291 ms)
2026-11-07T17:25:09Z [load_day 2023-03-20] 2023-03-20 hour 19: 176110 events in 4 files, snapshot 1920046001398740668 (task 16694 ms: download 10215 ms overlapping gunzip 988 ms, parse 4204 ms, sort 124 ms, write 9149 ms, index 531 ms: 4 candidates, 76570 repo-hours, 878 releases; waiting 1254 ms; commit 1458 ms)
2026-11-07T17:25:18Z [load_day 2023-03-20] 2023-03-20 hour 20: 170902 events in 4 files, snapshot 5260796504310099106 (task 14970 ms: download 8916 ms overlapping gunzip 923 ms, parse 3864 ms, sort 100 ms, write 8637 ms, index 584 ms: 8 candidates, 74545 repo-hours, 857 releases; waiting 545 ms; commit 1557 ms)
2026-11-07T17:25:25Z [load_day 2023-03-20] 2023-03-20 hour 21: 175105 events in 4 files, snapshot 4949378576958174826 (task 15825 ms: download 9978 ms overlapping gunzip 912 ms, parse 3914 ms, sort 140 ms, write 8239 ms, index 527 ms: 18 candidates, 81539 repo-hours, 914 releases; waiting 1741 ms; commit 1453 ms)
2026-11-07T17:25:34Z [load_day 2023-03-20] 2023-03-20 hour 22: 166887 events in 4 files, snapshot 2328492060889138687 (task 14605 ms: download 8687 ms overlapping gunzip 939 ms, parse 3973 ms, sort 126 ms, write 8185 ms, index 460 ms: 9 candidates, 65591 repo-hours, 832 releases; waiting 563 ms; commit 1573 ms)
2026-11-07T17:25:39Z [load_day 2023-03-20] 2023-03-20 hour 23: 147314 events in 3 files, snapshot 1020457645641853422 (task 13223 ms: download 5918 ms overlapping gunzip 805 ms, parse 3413 ms, sort 103 ms, write 7288 ms, index 407 ms: 9 candidates, 61631 repo-hours, 674 releases; waiting 571 ms; commit 1390 ms)
2026-11-07T17:25:47Z [load_day 2023-03-20] 2023-03-20: repo_hour merged from 24 files to 1 (1909515 rows, 7952 ms)
2026-11-07T17:25:49Z [load_day 2023-03-20] 2023-03-20: index committed in 10289 ms (24 + 1 + 24 files)
2026-11-07T17:25:49Z [load_day 2023-03-20] 2023-03-20: 4109729 events in 24 hours
2026-11-07T17:25:49Z [load_day 2023-03-20] attempt 1 succeeded