orcaLog in

Runs · run 4171

load_day 2025-07-20, attempt 1 succeeded

Host
73ccef5e07c2:346119
Started
2026-11-08T13:01:05Z
Ended
2026-11-08T13:02:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
638 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4171/load_day/2025-07-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:01:05Z [load_day 2025-07-20] attempt 1 started
2026-11-08T13:01:06Z [load_day 2025-07-20] 2025-07-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:01:11Z [load_day 2025-07-20] 2025-07-20 hour 0: 127462 events in 0 files, snapshot none (task 4548 ms: download 3032 ms overlapping gunzip 682 ms, parse 2622 ms, sort 0 ms, write 0 ms, index 419 ms: 8 candidates, 54994 repo-hours, 984 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:01:11Z [load_day 2025-07-20] 2025-07-20 hour 1: 140952 events in 0 files, snapshot none (task 4348 ms: download 2055 ms overlapping gunzip 608 ms, parse 2562 ms, sort 0 ms, write 0 ms, index 690 ms: 5 candidates, 78971 repo-hours, 697 releases; waiting 191 ms; commit 0 ms)
2026-11-08T13:01:16Z [load_day 2025-07-20] 2025-07-20 hour 2: 133449 events in 0 files, snapshot none (task 4147 ms: download 2488 ms overlapping gunzip 575 ms, parse 2357 ms, sort 0 ms, write 0 ms, index 429 ms: 4 candidates, 64952 repo-hours, 747 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:01:16Z [load_day 2025-07-20] 2025-07-20 hour 3: 130934 events in 0 files, snapshot none (task 4560 ms: download 2843 ms overlapping gunzip 626 ms, parse 2603 ms, sort 0 ms, write 0 ms, index 408 ms: 2 candidates, 51662 repo-hours, 899 releases; waiting 512 ms; commit 0 ms)
2026-11-08T13:01:20Z [load_day 2025-07-20] 2025-07-20 hour 4: 133542 events in 0 files, snapshot none (task 3985 ms: download 2570 ms overlapping gunzip 545 ms, parse 2285 ms, sort 0 ms, write 0 ms, index 384 ms: 2 candidates, 55985 repo-hours, 1961 releases; waiting 496 ms; commit 0 ms)
2026-11-08T13:01:21Z [load_day 2025-07-20] 2025-07-20 hour 5: 138284 events in 0 files, snapshot none (task 4279 ms: download 2465 ms overlapping gunzip 561 ms, parse 2320 ms, sort 0 ms, write 0 ms, index 407 ms: 1 candidates, 53322 repo-hours, 592 releases; waiting 692 ms; commit 0 ms)
2026-11-08T13:01:26Z [load_day 2025-07-20] 2025-07-20 hour 6: 143964 events in 0 files, snapshot none (task 5672 ms: download 2426 ms overlapping gunzip 761 ms, parse 3440 ms, sort 0 ms, write 0 ms, index 557 ms: 2 candidates, 64398 repo-hours, 668 releases; waiting 571 ms; commit 0 ms)
2026-11-08T13:01:27Z [load_day 2025-07-20] 2025-07-20 hour 7: 146075 events in 0 files, snapshot none (task 5711 ms: download 3150 ms overlapping gunzip 871 ms, parse 3619 ms, sort 0 ms, write 0 ms, index 427 ms: 7 candidates, 58599 repo-hours, 656 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:01:33Z [load_day 2025-07-20] 2025-07-20 hour 8: 143015 events in 0 files, snapshot none (task 5888 ms: download 2972 ms overlapping gunzip 892 ms, parse 3359 ms, sort 0 ms, write 0 ms, index 823 ms: 5 candidates, 61542 repo-hours, 721 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:01:33Z [load_day 2025-07-20] 2025-07-20 hour 9: 145070 events in 0 files, snapshot none (task 5402 ms: download 2879 ms overlapping gunzip 796 ms, parse 3317 ms, sort 0 ms, write 0 ms, index 513 ms: 1 candidates, 63067 repo-hours, 763 releases; waiting 401 ms; commit 0 ms)
2026-11-08T13:01:38Z [load_day 2025-07-20] 2025-07-20 hour 10: 146791 events in 0 files, snapshot none (task 4922 ms: download 2958 ms overlapping gunzip 665 ms, parse 2810 ms, sort 0 ms, write 0 ms, index 541 ms: 0 candidates, 62859 repo-hours, 796 releases; waiting 577 ms; commit 0 ms)
2026-11-08T13:01:39Z [load_day 2025-07-20] 2025-07-20 hour 11: 148872 events in 0 files, snapshot none (task 4919 ms: download 2466 ms overlapping gunzip 709 ms, parse 2903 ms, sort 0 ms, write 0 ms, index 526 ms: 2 candidates, 61314 repo-hours, 735 releases; waiting 486 ms; commit 0 ms)
2026-11-08T13:01:45Z [load_day 2025-07-20] 2025-07-20 hour 12: 162376 events in 0 files, snapshot none (task 6025 ms: download 2460 ms overlapping gunzip 806 ms, parse 3655 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 89114 repo-hours, 763 releases; waiting 482 ms; commit 0 ms)
2026-11-08T13:01:45Z [load_day 2025-07-20] 2025-07-20 hour 13: 156788 events in 0 files, snapshot none (task 5837 ms: download 3297 ms overlapping gunzip 830 ms, parse 3676 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 78843 repo-hours, 827 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:01:52Z [load_day 2025-07-20] 2025-07-20 hour 14: 151795 events in 0 files, snapshot none (task 6461 ms: download 3616 ms overlapping gunzip 1011 ms, parse 4053 ms, sort 0 ms, write 0 ms, index 619 ms: 5 candidates, 67946 repo-hours, 801 releases; waiting 469 ms; commit 0 ms)
2026-11-08T13:01:52Z [load_day 2025-07-20] 2025-07-20 hour 15: 157625 events in 0 files, snapshot none (task 6200 ms: download 3159 ms overlapping gunzip 891 ms, parse 3852 ms, sort 0 ms, write 0 ms, index 711 ms: 6 candidates, 72318 repo-hours, 1018 releases; waiting 489 ms; commit 0 ms)
2026-11-08T13:01:58Z [load_day 2025-07-20] 2025-07-20 hour 16: 149706 events in 0 files, snapshot none (task 5652 ms: download 2826 ms overlapping gunzip 843 ms, parse 3362 ms, sort 0 ms, write 0 ms, index 602 ms: 3 candidates, 69362 repo-hours, 762 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:01:58Z [load_day 2025-07-20] 2025-07-20 hour 17: 154237 events in 0 files, snapshot none (task 5963 ms: download 3061 ms overlapping gunzip 833 ms, parse 3787 ms, sort 0 ms, write 0 ms, index 575 ms: 4 candidates, 66096 repo-hours, 1255 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:02:04Z [load_day 2025-07-20] 2025-07-20 hour 18: 154420 events in 0 files, snapshot none (task 5457 ms: download 3307 ms overlapping gunzip 723 ms, parse 3111 ms, sort 0 ms, write 0 ms, index 741 ms: 7 candidates, 72095 repo-hours, 836 releases; waiting 574 ms; commit 0 ms)
2026-11-08T13:02:04Z [load_day 2025-07-20] 2025-07-20 hour 19: 146365 events in 0 files, snapshot none (task 4995 ms: download 2314 ms overlapping gunzip 711 ms, parse 2904 ms, sort 0 ms, write 0 ms, index 626 ms: 17 candidates, 59392 repo-hours, 757 releases; waiting 366 ms; commit 0 ms)
2026-11-08T13:02:09Z [load_day 2025-07-20] 2025-07-20 hour 20: 143308 events in 0 files, snapshot none (task 4816 ms: download 2583 ms overlapping gunzip 650 ms, parse 2825 ms, sort 0 ms, write 0 ms, index 481 ms: 7 candidates, 58866 repo-hours, 741 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:02:09Z [load_day 2025-07-20] 2025-07-20 hour 21: 140584 events in 0 files, snapshot none (task 4604 ms: download 2589 ms overlapping gunzip 646 ms, parse 2890 ms, sort 0 ms, write 0 ms, index 429 ms: 4 candidates, 56353 repo-hours, 847 releases; waiting 414 ms; commit 0 ms)
2026-11-08T13:02:16Z [load_day 2025-07-20] 2025-07-20 hour 22: 135226 events in 0 files, snapshot none (task 5509 ms: download 3053 ms overlapping gunzip 799 ms, parse 3377 ms, sort 0 ms, write 0 ms, index 456 ms: 2 candidates, 52255 repo-hours, 759 releases; waiting 433 ms; commit 0 ms)
2026-11-08T13:02:16Z [load_day 2025-07-20] 2025-07-20 hour 23: 132665 events in 0 files, snapshot none (task 5648 ms: download 3056 ms overlapping gunzip 836 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 412 ms: 3 candidates, 49864 repo-hours, 787 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:02:23Z [load_day 2025-07-20] 2025-07-20: repo_hour merged from 24 files to 1 (1524169 rows, 6960 ms)
2026-11-08T13:02:25Z [load_day 2025-07-20] 2025-07-20: index committed in 9573 ms (23 + 1 + 24 files)
2026-11-08T13:02:25Z [load_day 2025-07-20] 2025-07-20: 3463505 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:02:25Z [load_day 2025-07-20] attempt 1 succeeded