orcaLog in

Runs · run 3453

load_day 2025-01-19, attempt 1 succeeded

Host
73ccef5e07c2:240220
Started
2026-11-08T09:53:50Z
Ended
2026-11-08T09:55:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
670 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
128.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3453/load_day/2025-01-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:53:50Z [load_day 2025-01-19] attempt 1 started
2026-11-08T09:53:51Z [load_day 2025-01-19] 2025-01-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:53:58Z [load_day 2025-01-19] 2025-01-19 hour 0: 158290 events in 0 files, snapshot none (task 6028 ms: download 3308 ms overlapping gunzip 783 ms, parse 3554 ms, sort 0 ms, write 0 ms, index 789 ms: 2 candidates, 76162 repo-hours, 1195 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:53:58Z [load_day 2025-01-19] 2025-01-19 hour 1: 172721 events in 0 files, snapshot none (task 5983 ms: download 2949 ms overlapping gunzip 750 ms, parse 3506 ms, sort 0 ms, write 0 ms, index 968 ms: 5 candidates, 98628 repo-hours, 924 releases; waiting 474 ms; commit 0 ms)
2026-11-08T09:54:03Z [load_day 2025-01-19] 2025-01-19 hour 2: 133882 events in 0 files, snapshot none (task 4849 ms: download 2766 ms overlapping gunzip 669 ms, parse 2782 ms, sort 0 ms, write 0 ms, index 453 ms: 3 candidates, 60434 repo-hours, 781 releases; waiting 648 ms; commit 0 ms)
2026-11-08T09:54:03Z [load_day 2025-01-19] 2025-01-19 hour 3: 154030 events in 0 files, snapshot none (task 4797 ms: download 2632 ms overlapping gunzip 676 ms, parse 2908 ms, sort 0 ms, write 0 ms, index 457 ms: 2 candidates, 60395 repo-hours, 3879 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:54:09Z [load_day 2025-01-19] 2025-01-19 hour 4: 149100 events in 0 files, snapshot none (task 5629 ms: download 2826 ms overlapping gunzip 866 ms, parse 3560 ms, sort 0 ms, write 0 ms, index 452 ms: 4 candidates, 51641 repo-hours, 559 releases; waiting 467 ms; commit 0 ms)
2026-11-08T09:54:09Z [load_day 2025-01-19] 2025-01-19 hour 5: 149539 events in 0 files, snapshot none (task 5406 ms: download 2598 ms overlapping gunzip 780 ms, parse 3356 ms, sort 0 ms, write 0 ms, index 496 ms: 4 candidates, 53860 repo-hours, 706 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:54:15Z [load_day 2025-01-19] 2025-01-19 hour 6: 173376 events in 0 files, snapshot none (task 5487 ms: download 2840 ms overlapping gunzip 777 ms, parse 3445 ms, sort 0 ms, write 0 ms, index 504 ms: 3 candidates, 70572 repo-hours, 800 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:54:15Z [load_day 2025-01-19] 2025-01-19 hour 7: 160143 events in 0 files, snapshot none (task 5634 ms: download 2831 ms overlapping gunzip 795 ms, parse 3578 ms, sort 0 ms, write 0 ms, index 483 ms: 2 candidates, 56132 repo-hours, 577 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:54:21Z [load_day 2025-01-19] 2025-01-19 hour 8: 176776 events in 0 files, snapshot none (task 4959 ms: download 2769 ms overlapping gunzip 698 ms, parse 3019 ms, sort 0 ms, write 0 ms, index 510 ms: 4 candidates, 65957 repo-hours, 716 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:54:21Z [load_day 2025-01-19] 2025-01-19 hour 9: 190836 events in 0 files, snapshot none (task 5617 ms: download 3178 ms overlapping gunzip 814 ms, parse 3353 ms, sort 0 ms, write 0 ms, index 556 ms: 1 candidates, 73767 repo-hours, 861 releases; waiting 639 ms; commit 0 ms)
2026-11-08T09:54:25Z [load_day 2025-01-19] 2025-01-19 hour 10: 180159 events in 0 files, snapshot none (task 4411 ms: download 3386 ms overlapping gunzip 630 ms, parse 2725 ms, sort 0 ms, write 0 ms, index 532 ms: 3 candidates, 72371 repo-hours, 748 releases; waiting 260 ms; commit 0 ms)
2026-11-08T09:54:27Z [load_day 2025-01-19] 2025-01-19 hour 11: 176073 events in 0 files, snapshot none (task 5432 ms: download 3775 ms overlapping gunzip 583 ms, parse 2600 ms, sort 0 ms, write 0 ms, index 476 ms: 2 candidates, 65425 repo-hours, 869 releases; waiting 1230 ms; commit 0 ms)
2026-11-08T09:54:33Z [load_day 2025-01-19] 2025-01-19 hour 12: 247545 events in 0 files, snapshot none (task 6954 ms: download 2858 ms overlapping gunzip 951 ms, parse 4275 ms, sort 0 ms, write 0 ms, index 997 ms: 4 candidates, 116398 repo-hours, 1101 releases; waiting 467 ms; commit 0 ms)
2026-11-08T09:54:35Z [load_day 2025-01-19] 2025-01-19 hour 13: 216321 events in 0 files, snapshot none (task 7702 ms: download 4755 ms overlapping gunzip 1069 ms, parse 4906 ms, sort 0 ms, write 0 ms, index 877 ms: 8 candidates, 96661 repo-hours, 869 releases; waiting 593 ms; commit 0 ms)
2026-11-08T09:54:40Z [load_day 2025-01-19] 2025-01-19 hour 14: 198730 events in 0 files, snapshot none (task 6708 ms: download 2835 ms overlapping gunzip 920 ms, parse 3987 ms, sort 0 ms, write 0 ms, index 975 ms: 8 candidates, 78934 repo-hours, 941 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:54:43Z [load_day 2025-01-19] 2025-01-19 hour 15: 212577 events in 0 files, snapshot none (task 7127 ms: download 3643 ms overlapping gunzip 985 ms, parse 4297 ms, sort 0 ms, write 0 ms, index 1097 ms: 6 candidates, 86581 repo-hours, 1086 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:54:47Z [load_day 2025-01-19] 2025-01-19 hour 16: 208716 events in 0 files, snapshot none (task 6579 ms: download 3393 ms overlapping gunzip 886 ms, parse 3806 ms, sort 0 ms, write 0 ms, index 1073 ms: 3 candidates, 82336 repo-hours, 982 releases; waiting 475 ms; commit 0 ms)
2026-11-08T09:54:52Z [load_day 2025-01-19] 2025-01-19 hour 17: 203477 events in 0 files, snapshot none (task 8096 ms: download 3466 ms overlapping gunzip 1133 ms, parse 5168 ms, sort 0 ms, write 0 ms, index 961 ms: 6 candidates, 77012 repo-hours, 942 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:54:56Z [load_day 2025-01-19] 2025-01-19 hour 18: 210475 events in 0 files, snapshot none (task 7896 ms: download 4353 ms overlapping gunzip 1148 ms, parse 5290 ms, sort 0 ms, write 0 ms, index 909 ms: 8 candidates, 90816 repo-hours, 1089 releases; waiting 262 ms; commit 0 ms)
2026-11-08T09:54:59Z [load_day 2025-01-19] 2025-01-19 hour 19: 186540 events in 0 files, snapshot none (task 6946 ms: download 3931 ms overlapping gunzip 919 ms, parse 4238 ms, sort 0 ms, write 0 ms, index 951 ms: 6 candidates, 68522 repo-hours, 888 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:55:03Z [load_day 2025-01-19] 2025-01-19 hour 20: 183179 events in 0 files, snapshot none (task 6938 ms: download 3600 ms overlapping gunzip 1023 ms, parse 4311 ms, sort 0 ms, write 0 ms, index 782 ms: 7 candidates, 69374 repo-hours, 903 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:55:05Z [load_day 2025-01-19] 2025-01-19 hour 21: 181432 events in 0 files, snapshot none (task 5771 ms: download 3018 ms overlapping gunzip 789 ms, parse 3367 ms, sort 0 ms, write 0 ms, index 813 ms: 5 candidates, 69990 repo-hours, 951 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:55:10Z [load_day 2025-01-19] 2025-01-19 hour 22: 158871 events in 0 files, snapshot none (task 5988 ms: download 2191 ms overlapping gunzip 825 ms, parse 3663 ms, sort 0 ms, write 0 ms, index 734 ms: 5 candidates, 58622 repo-hours, 1071 releases; waiting 469 ms; commit 0 ms)
2026-11-08T09:55:11Z [load_day 2025-01-19] 2025-01-19 hour 23: 149498 events in 0 files, snapshot none (task 5042 ms: download 2932 ms overlapping gunzip 690 ms, parse 3176 ms, sort 0 ms, write 0 ms, index 401 ms: 7 candidates, 55292 repo-hours, 809 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:55:19Z [load_day 2025-01-19] 2025-01-19: repo_hour merged from 24 files to 1 (1755882 rows, 8036 ms)
2026-11-08T09:55:22Z [load_day 2025-01-19] 2025-01-19: index committed in 10488 ms (24 + 1 + 24 files)
2026-11-08T09:55:22Z [load_day 2025-01-19] 2025-01-19: 4332286 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:55:22Z [load_day 2025-01-19] attempt 1 succeeded