orcaLog in

Runs · run 3396

load_day 2025-01-04, attempt 1 succeeded

Host
73ccef5e07c2:232568
Started
2026-11-08T09:39:32Z
Ended
2026-11-08T09:40:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
647 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
120.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3396/load_day/2025-01-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:39:32Z [load_day 2025-01-04] attempt 1 started
2026-11-08T09:39:33Z [load_day 2025-01-04] 2025-01-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:39:39Z [load_day 2025-01-04] 2025-01-04 hour 0: 172344 events in 0 files, snapshot none (task 5781 ms: download 3076 ms overlapping gunzip 846 ms, parse 3481 ms, sort 0 ms, write 0 ms, index 765 ms: 6 candidates, 84496 repo-hours, 1188 releases; waiting 448 ms; commit 0 ms)
2026-11-08T09:39:40Z [load_day 2025-01-04] 2025-01-04 hour 1: 179108 events in 0 files, snapshot none (task 6013 ms: download 3152 ms overlapping gunzip 857 ms, parse 3640 ms, sort 0 ms, write 0 ms, index 940 ms: 5 candidates, 94914 repo-hours, 942 releases; waiting 242 ms; commit 0 ms)
2026-11-08T09:39:46Z [load_day 2025-01-04] 2025-01-04 hour 2: 147974 events in 0 files, snapshot none (task 5914 ms: download 3319 ms overlapping gunzip 922 ms, parse 3691 ms, sort 0 ms, write 0 ms, index 476 ms: 6 candidates, 64148 repo-hours, 803 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:39:46Z [load_day 2025-01-04] 2025-01-04 hour 3: 163116 events in 0 files, snapshot none (task 5522 ms: download 2274 ms overlapping gunzip 835 ms, parse 3622 ms, sort 0 ms, write 0 ms, index 619 ms: 6 candidates, 62441 repo-hours, 3947 releases; waiting 215 ms; commit 0 ms)
2026-11-08T09:39:52Z [load_day 2025-01-04] 2025-01-04 hour 4: 148142 events in 0 files, snapshot none (task 5613 ms: download 2422 ms overlapping gunzip 845 ms, parse 3473 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 53430 repo-hours, 630 releases; waiting 555 ms; commit 0 ms)
2026-11-08T09:39:53Z [load_day 2025-01-04] 2025-01-04 hour 5: 151153 events in 0 files, snapshot none (task 5951 ms: download 2891 ms overlapping gunzip 842 ms, parse 3486 ms, sort 0 ms, write 0 ms, index 534 ms: 4 candidates, 54999 repo-hours, 673 releases; waiting 842 ms; commit 0 ms)
2026-11-08T09:39:58Z [load_day 2025-01-04] 2025-01-04 hour 6: 170312 events in 0 files, snapshot none (task 4937 ms: download 2152 ms overlapping gunzip 638 ms, parse 2852 ms, sort 0 ms, write 0 ms, index 664 ms: 2 candidates, 71993 repo-hours, 1024 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:39:58Z [load_day 2025-01-04] 2025-01-04 hour 7: 158738 events in 0 files, snapshot none (task 4453 ms: download 2205 ms overlapping gunzip 558 ms, parse 2540 ms, sort 0 ms, write 0 ms, index 584 ms: 2 candidates, 58746 repo-hours, 866 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:40:03Z [load_day 2025-01-04] 2025-01-04 hour 8: 161699 events in 0 files, snapshot none (task 5152 ms: download 3065 ms overlapping gunzip 735 ms, parse 3133 ms, sort 0 ms, write 0 ms, index 533 ms: 3 candidates, 62915 repo-hours, 770 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:40:04Z [load_day 2025-01-04] 2025-01-04 hour 9: 175276 events in 0 files, snapshot none (task 5876 ms: download 3174 ms overlapping gunzip 833 ms, parse 3702 ms, sort 0 ms, write 0 ms, index 563 ms: 6 candidates, 68997 repo-hours, 1070 releases; waiting 469 ms; commit 0 ms)
2026-11-08T09:40:10Z [load_day 2025-01-04] 2025-01-04 hour 10: 169069 events in 0 files, snapshot none (task 5824 ms: download 3085 ms overlapping gunzip 802 ms, parse 3616 ms, sort 0 ms, write 0 ms, index 522 ms: 3 candidates, 65159 repo-hours, 834 releases; waiting 620 ms; commit 0 ms)
2026-11-08T09:40:10Z [load_day 2025-01-04] 2025-01-04 hour 11: 171340 events in 0 files, snapshot none (task 5921 ms: download 3255 ms overlapping gunzip 871 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 436 ms: 4 candidates, 63705 repo-hours, 1001 releases; waiting 438 ms; commit 0 ms)
2026-11-08T09:40:17Z [load_day 2025-01-04] 2025-01-04 hour 12: 230375 events in 0 files, snapshot none (task 6837 ms: download 4006 ms overlapping gunzip 850 ms, parse 3930 ms, sort 0 ms, write 0 ms, index 852 ms: 5 candidates, 114026 repo-hours, 887 releases; waiting 943 ms; commit 0 ms)
2026-11-08T09:40:18Z [load_day 2025-01-04] 2025-01-04 hour 13: 206919 events in 0 files, snapshot none (task 6764 ms: download 3899 ms overlapping gunzip 918 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 718 ms: 4 candidates, 95009 repo-hours, 742 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:40:23Z [load_day 2025-01-04] 2025-01-04 hour 14: 200525 events in 0 files, snapshot none (task 5348 ms: download 2807 ms overlapping gunzip 705 ms, parse 3224 ms, sort 0 ms, write 0 ms, index 606 ms: 4 candidates, 87015 repo-hours, 926 releases; waiting 518 ms; commit 0 ms)
2026-11-08T09:40:23Z [load_day 2025-01-04] 2025-01-04 hour 15: 203227 events in 0 files, snapshot none (task 5405 ms: download 2770 ms overlapping gunzip 717 ms, parse 3116 ms, sort 0 ms, write 0 ms, index 620 ms: 8 candidates, 84224 repo-hours, 1116 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:40:28Z [load_day 2025-01-04] 2025-01-04 hour 16: 195865 events in 0 files, snapshot none (task 5156 ms: download 2621 ms overlapping gunzip 702 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 76707 repo-hours, 872 releases; waiting 558 ms; commit 0 ms)
2026-11-08T09:40:29Z [load_day 2025-01-04] 2025-01-04 hour 17: 187890 events in 0 files, snapshot none (task 4839 ms: download 2565 ms overlapping gunzip 624 ms, parse 2756 ms, sort 0 ms, write 0 ms, index 634 ms: 5 candidates, 70855 repo-hours, 838 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:40:35Z [load_day 2025-01-04] 2025-01-04 hour 18: 196368 events in 0 files, snapshot none (task 6123 ms: download 3274 ms overlapping gunzip 888 ms, parse 3840 ms, sort 0 ms, write 0 ms, index 639 ms: 8 candidates, 85903 repo-hours, 1006 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:40:35Z [load_day 2025-01-04] 2025-01-04 hour 19: 166764 events in 0 files, snapshot none (task 5150 ms: download 2634 ms overlapping gunzip 782 ms, parse 3401 ms, sort 0 ms, write 0 ms, index 454 ms: 10 candidates, 60807 repo-hours, 824 releases; waiting 276 ms; commit 0 ms)
2026-11-08T09:40:41Z [load_day 2025-01-04] 2025-01-04 hour 20: 162643 events in 0 files, snapshot none (task 5616 ms: download 2856 ms overlapping gunzip 856 ms, parse 3516 ms, sort 0 ms, write 0 ms, index 472 ms: 4 candidates, 61172 repo-hours, 859 releases; waiting 499 ms; commit 0 ms)
2026-11-08T09:40:42Z [load_day 2025-01-04] 2025-01-04 hour 21: 166204 events in 0 files, snapshot none (task 6391 ms: download 4011 ms overlapping gunzip 691 ms, parse 3426 ms, sort 0 ms, write 0 ms, index 458 ms: 8 candidates, 62622 repo-hours, 994 releases; waiting 1515 ms; commit 0 ms)
2026-11-08T09:40:47Z [load_day 2025-01-04] 2025-01-04 hour 22: 151952 events in 0 files, snapshot none (task 4917 ms: download 2533 ms overlapping gunzip 692 ms, parse 3003 ms, sort 0 ms, write 0 ms, index 399 ms: 3 candidates, 54014 repo-hours, 1145 releases; waiting 489 ms; commit 0 ms)
2026-11-08T09:40:47Z [load_day 2025-01-04] 2025-01-04 hour 23: 148460 events in 0 files, snapshot none (task 4747 ms: download 3010 ms overlapping gunzip 641 ms, parse 2675 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 54810 repo-hours, 804 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:40:55Z [load_day 2025-01-04] 2025-01-04: repo_hour merged from 24 files to 1 (1713107 rows, 7666 ms)
2026-11-08T09:40:57Z [load_day 2025-01-04] 2025-01-04: index committed in 10013 ms (24 + 1 + 24 files)
2026-11-08T09:40:57Z [load_day 2025-01-04] 2025-01-04: 4185463 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:40:57Z [load_day 2025-01-04] attempt 1 succeeded