orcaLog in

Runs · run 4166

load_day 2025-07-19, attempt 1 succeeded

Host
73ccef5e07c2:345261
Started
2026-11-08T12:59:57Z
Ended
2026-11-08T13:01:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
114.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4166/load_day/2025-07-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:59:57Z [load_day 2025-07-19] attempt 1 started
2026-11-08T12:59:58Z [load_day 2025-07-19] 2025-07-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:00:03Z [load_day 2025-07-19] 2025-07-19 hour 0: 137522 events in 0 files, snapshot none (task 4824 ms: download 2721 ms overlapping gunzip 665 ms, parse 2818 ms, sort 0 ms, write 0 ms, index 481 ms: 6 candidates, 61596 repo-hours, 1061 releases; waiting 519 ms; commit 0 ms)
2026-11-08T13:00:04Z [load_day 2025-07-19] 2025-07-19 hour 1: 147226 events in 0 files, snapshot none (task 5224 ms: download 3222 ms overlapping gunzip 706 ms, parse 2895 ms, sort 0 ms, write 0 ms, index 653 ms: 3 candidates, 82601 repo-hours, 663 releases; waiting 606 ms; commit 0 ms)
2026-11-08T13:00:10Z [load_day 2025-07-19] 2025-07-19 hour 2: 139104 events in 0 files, snapshot none (task 5689 ms: download 3187 ms overlapping gunzip 859 ms, parse 3396 ms, sort 0 ms, write 0 ms, index 441 ms: 0 candidates, 62989 repo-hours, 732 releases; waiting 696 ms; commit 0 ms)
2026-11-08T13:00:10Z [load_day 2025-07-19] 2025-07-19 hour 3: 137371 events in 0 files, snapshot none (task 5127 ms: download 2952 ms overlapping gunzip 775 ms, parse 3138 ms, sort 0 ms, write 0 ms, index 450 ms: 3 candidates, 58553 repo-hours, 1384 releases; waiting 459 ms; commit 0 ms)
2026-11-08T13:00:16Z [load_day 2025-07-19] 2025-07-19 hour 4: 138582 events in 0 files, snapshot none (task 6240 ms: download 3938 ms overlapping gunzip 910 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 558 ms: 4 candidates, 56337 repo-hours, 1307 releases; waiting 788 ms; commit 0 ms)
2026-11-08T13:00:16Z [load_day 2025-07-19] 2025-07-19 hour 5: 143395 events in 0 files, snapshot none (task 6251 ms: download 3008 ms overlapping gunzip 912 ms, parse 3656 ms, sort 0 ms, write 0 ms, index 649 ms: 1 candidates, 56952 repo-hours, 575 releases; waiting 751 ms; commit 0 ms)
2026-11-08T13:00:23Z [load_day 2025-07-19] 2025-07-19 hour 6: 148492 events in 0 files, snapshot none (task 5646 ms: download 3201 ms overlapping gunzip 815 ms, parse 3341 ms, sort 0 ms, write 0 ms, index 658 ms: 3 candidates, 66695 repo-hours, 728 releases; waiting 495 ms; commit 0 ms)
2026-11-08T13:00:23Z [load_day 2025-07-19] 2025-07-19 hour 7: 144078 events in 0 files, snapshot none (task 5762 ms: download 3342 ms overlapping gunzip 821 ms, parse 3186 ms, sort 0 ms, write 0 ms, index 943 ms: 6 candidates, 58445 repo-hours, 682 releases; waiting 220 ms; commit 0 ms)
2026-11-08T13:00:28Z [load_day 2025-07-19] 2025-07-19 hour 8: 147187 events in 0 files, snapshot none (task 5136 ms: download 2877 ms overlapping gunzip 668 ms, parse 3000 ms, sort 0 ms, write 0 ms, index 601 ms: 0 candidates, 62499 repo-hours, 756 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:00:28Z [load_day 2025-07-19] 2025-07-19 hour 9: 149956 events in 0 files, snapshot none (task 5107 ms: download 3089 ms overlapping gunzip 668 ms, parse 2862 ms, sort 0 ms, write 0 ms, index 589 ms: 3 candidates, 63701 repo-hours, 854 releases; waiting 644 ms; commit 0 ms)
2026-11-08T13:00:36Z [load_day 2025-07-19] 2025-07-19 hour 10: 150555 events in 0 files, snapshot none (task 6810 ms: download 3379 ms overlapping gunzip 1015 ms, parse 4313 ms, sort 0 ms, write 0 ms, index 668 ms: 7 candidates, 64000 repo-hours, 732 releases; waiting 465 ms; commit 0 ms)
2026-11-08T13:00:36Z [load_day 2025-07-19] 2025-07-19 hour 11: 142862 events in 0 files, snapshot none (task 6335 ms: download 3162 ms overlapping gunzip 924 ms, parse 3853 ms, sort 0 ms, write 0 ms, index 732 ms: 2 candidates, 58495 repo-hours, 633 releases; waiting 524 ms; commit 0 ms)
2026-11-08T13:00:42Z [load_day 2025-07-19] 2025-07-19 hour 12: 163843 events in 0 files, snapshot none (task 5630 ms: download 2748 ms overlapping gunzip 697 ms, parse 2844 ms, sort 0 ms, write 0 ms, index 1397 ms: 8 candidates, 90302 repo-hours, 696 releases; waiting 235 ms; commit 0 ms)
2026-11-08T13:00:42Z [load_day 2025-07-19] 2025-07-19 hour 13: 152135 events in 0 files, snapshot none (task 5222 ms: download 2556 ms overlapping gunzip 606 ms, parse 2731 ms, sort 0 ms, write 0 ms, index 815 ms: 6 candidates, 77275 repo-hours, 628 releases; waiting 656 ms; commit 0 ms)
2026-11-08T13:00:48Z [load_day 2025-07-19] 2025-07-19 hour 14: 148611 events in 0 files, snapshot none (task 5083 ms: download 2901 ms overlapping gunzip 670 ms, parse 2837 ms, sort 0 ms, write 0 ms, index 638 ms: 10 candidates, 65575 repo-hours, 662 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:00:48Z [load_day 2025-07-19] 2025-07-19 hour 15: 153269 events in 0 files, snapshot none (task 5533 ms: download 3173 ms overlapping gunzip 748 ms, parse 3195 ms, sort 0 ms, write 0 ms, index 739 ms: 4 candidates, 68636 repo-hours, 761 releases; waiting 499 ms; commit 0 ms)
2026-11-08T13:00:53Z [load_day 2025-07-19] 2025-07-19 hour 16: 148051 events in 0 files, snapshot none (task 5186 ms: download 2908 ms overlapping gunzip 694 ms, parse 2987 ms, sort 0 ms, write 0 ms, index 539 ms: 4 candidates, 67010 repo-hours, 729 releases; waiting 630 ms; commit 0 ms)
2026-11-08T13:00:53Z [load_day 2025-07-19] 2025-07-19 hour 17: 152203 events in 0 files, snapshot none (task 4928 ms: download 2772 ms overlapping gunzip 692 ms, parse 2990 ms, sort 0 ms, write 0 ms, index 471 ms: 4 candidates, 63683 repo-hours, 735 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:00:58Z [load_day 2025-07-19] 2025-07-19 hour 18: 149976 events in 0 files, snapshot none (task 4680 ms: download 2323 ms overlapping gunzip 645 ms, parse 2759 ms, sort 0 ms, write 0 ms, index 515 ms: 3 candidates, 70315 repo-hours, 783 releases; waiting 380 ms; commit 0 ms)
2026-11-08T13:00:58Z [load_day 2025-07-19] 2025-07-19 hour 19: 149897 events in 0 files, snapshot none (task 4643 ms: download 2433 ms overlapping gunzip 669 ms, parse 2882 ms, sort 0 ms, write 0 ms, index 428 ms: 8 candidates, 57710 repo-hours, 1067 releases; waiting 287 ms; commit 0 ms)
2026-11-08T13:01:04Z [load_day 2025-07-19] 2025-07-19 hour 20: 142163 events in 0 files, snapshot none (task 4716 ms: download 2995 ms overlapping gunzip 598 ms, parse 2529 ms, sort 0 ms, write 0 ms, index 456 ms: 4 candidates, 57482 repo-hours, 784 releases; waiting 809 ms; commit 0 ms)
2026-11-08T13:01:04Z [load_day 2025-07-19] 2025-07-19 hour 21: 139541 events in 0 files, snapshot none (task 4541 ms: download 2940 ms overlapping gunzip 604 ms, parse 2647 ms, sort 0 ms, write 0 ms, index 387 ms: 6 candidates, 54193 repo-hours, 878 releases; waiting 561 ms; commit 0 ms)
2026-11-08T13:01:09Z [load_day 2025-07-19] 2025-07-19 hour 22: 132541 events in 0 files, snapshot none (task 4620 ms: download 2513 ms overlapping gunzip 606 ms, parse 2613 ms, sort 0 ms, write 0 ms, index 541 ms: 5 candidates, 50028 repo-hours, 811 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:01:09Z [load_day 2025-07-19] 2025-07-19 hour 23: 125432 events in 0 files, snapshot none (task 4611 ms: download 2628 ms overlapping gunzip 575 ms, parse 2503 ms, sort 0 ms, write 0 ms, index 605 ms: 7 candidates, 47495 repo-hours, 875 releases; waiting 603 ms; commit 0 ms)
2026-11-08T13:01:16Z [load_day 2025-07-19] 2025-07-19: repo_hour merged from 24 files to 1 (1522567 rows, 7421 ms)
2026-11-08T13:01:19Z [load_day 2025-07-19] 2025-07-19: index committed in 10565 ms (22 + 1 + 24 files)
2026-11-08T13:01:19Z [load_day 2025-07-19] 2025-07-19: 3483992 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:01:19Z [load_day 2025-07-19] attempt 1 succeeded