orcaLog in

Runs · run 2498

load_day 2024-05-25, attempt 1 succeeded

Host
73ccef5e07c2:126770
Started
2026-11-08T06:15:08Z
Ended
2026-11-08T06:16:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.9 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2498/load_day/2024-05-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:15:08Z [load_day 2024-05-25] attempt 1 started
2026-11-08T06:15:09Z [load_day 2024-05-25] 2024-05-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:15:15Z [load_day 2024-05-25] 2024-05-25 hour 0: 168723 events in 0 files, snapshot none (task 5680 ms: download 2667 ms overlapping gunzip 799 ms, parse 3472 ms, sort 0 ms, write 0 ms, index 659 ms: 9 candidates, 84881 repo-hours, 1194 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:15:15Z [load_day 2024-05-25] 2024-05-25 hour 1: 166422 events in 0 files, snapshot none (task 5501 ms: download 2589 ms overlapping gunzip 749 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 821 ms: 3 candidates, 88759 repo-hours, 971 releases; waiting 455 ms; commit 0 ms)
2026-11-08T06:15:20Z [load_day 2024-05-25] 2024-05-25 hour 2: 125343 events in 0 files, snapshot none (task 3958 ms: download 1912 ms overlapping gunzip 585 ms, parse 2252 ms, sort 0 ms, write 0 ms, index 343 ms: 8 candidates, 48757 repo-hours, 948 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:15:20Z [load_day 2024-05-25] 2024-05-25 hour 3: 145657 events in 0 files, snapshot none (task 4461 ms: download 2210 ms overlapping gunzip 673 ms, parse 2713 ms, sort 0 ms, write 0 ms, index 375 ms: 5 candidates, 55970 repo-hours, 3208 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:15:24Z [load_day 2024-05-25] 2024-05-25 hour 4: 135659 events in 0 files, snapshot none (task 4194 ms: download 2216 ms overlapping gunzip 608 ms, parse 2422 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 48845 repo-hours, 805 releases; waiting 473 ms; commit 0 ms)
2026-11-08T06:15:25Z [load_day 2024-05-25] 2024-05-25 hour 5: 139830 events in 0 files, snapshot none (task 4219 ms: download 2291 ms overlapping gunzip 591 ms, parse 2443 ms, sort 0 ms, write 0 ms, index 376 ms: 5 candidates, 51435 repo-hours, 636 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:15:30Z [load_day 2024-05-25] 2024-05-25 hour 6: 163510 events in 0 files, snapshot none (task 5597 ms: download 2631 ms overlapping gunzip 739 ms, parse 3425 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 68478 repo-hours, 1052 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:15:31Z [load_day 2024-05-25] 2024-05-25 hour 7: 155822 events in 0 files, snapshot none (task 5030 ms: download 2618 ms overlapping gunzip 748 ms, parse 3090 ms, sort 0 ms, write 0 ms, index 409 ms: 3 candidates, 56929 repo-hours, 927 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:15:36Z [load_day 2024-05-25] 2024-05-25 hour 8: 154390 events in 0 files, snapshot none (task 5053 ms: download 2515 ms overlapping gunzip 778 ms, parse 3214 ms, sort 0 ms, write 0 ms, index 487 ms: 7 candidates, 60275 repo-hours, 930 releases; waiting 384 ms; commit 0 ms)
2026-11-08T06:15:36Z [load_day 2024-05-25] 2024-05-25 hour 9: 163850 events in 0 files, snapshot none (task 5091 ms: download 2727 ms overlapping gunzip 703 ms, parse 3194 ms, sort 0 ms, write 0 ms, index 506 ms: 8 candidates, 66763 repo-hours, 1098 releases; waiting 462 ms; commit 0 ms)
2026-11-08T06:15:41Z [load_day 2024-05-25] 2024-05-25 hour 10: 157711 events in 0 files, snapshot none (task 4231 ms: download 2626 ms overlapping gunzip 572 ms, parse 2475 ms, sort 0 ms, write 0 ms, index 454 ms: 9 candidates, 62271 repo-hours, 882 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:15:41Z [load_day 2024-05-25] 2024-05-25 hour 11: 150398 events in 0 files, snapshot none (task 3812 ms: download 1990 ms overlapping gunzip 470 ms, parse 2099 ms, sort 0 ms, write 0 ms, index 448 ms: 12 candidates, 58261 repo-hours, 715 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:15:46Z [load_day 2024-05-25] 2024-05-25 hour 12: 239062 events in 0 files, snapshot none (task 5236 ms: download 2472 ms overlapping gunzip 643 ms, parse 3059 ms, sort 0 ms, write 0 ms, index 719 ms: 11 candidates, 105702 repo-hours, 932 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:15:46Z [load_day 2024-05-25] 2024-05-25 hour 13: 188254 events in 0 files, snapshot none (task 4726 ms: download 2276 ms overlapping gunzip 637 ms, parse 2729 ms, sort 0 ms, write 0 ms, index 602 ms: 14 candidates, 87353 repo-hours, 792 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:15:52Z [load_day 2024-05-25] 2024-05-25 hour 14: 171927 events in 0 files, snapshot none (task 5593 ms: download 2441 ms overlapping gunzip 755 ms, parse 3558 ms, sort 0 ms, write 0 ms, index 552 ms: 13 candidates, 70918 repo-hours, 842 releases; waiting 199 ms; commit 0 ms)
2026-11-08T06:15:52Z [load_day 2024-05-25] 2024-05-25 hour 15: 181978 events in 0 files, snapshot none (task 5530 ms: download 2659 ms overlapping gunzip 775 ms, parse 3412 ms, sort 0 ms, write 0 ms, index 554 ms: 11 candidates, 76808 repo-hours, 974 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:15:58Z [load_day 2024-05-25] 2024-05-25 hour 16: 170213 events in 0 files, snapshot none (task 5432 ms: download 2886 ms overlapping gunzip 764 ms, parse 3331 ms, sort 0 ms, write 0 ms, index 604 ms: 10 candidates, 68781 repo-hours, 774 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:15:59Z [load_day 2024-05-25] 2024-05-25 hour 17: 165136 events in 0 files, snapshot none (task 5633 ms: download 3120 ms overlapping gunzip 788 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 460 ms: 4 candidates, 62592 repo-hours, 762 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:16:05Z [load_day 2024-05-25] 2024-05-25 hour 18: 180303 events in 0 files, snapshot none (task 5983 ms: download 3403 ms overlapping gunzip 891 ms, parse 3883 ms, sort 0 ms, write 0 ms, index 530 ms: 12 candidates, 76713 repo-hours, 963 releases; waiting 458 ms; commit 0 ms)
2026-11-08T06:16:05Z [load_day 2024-05-25] 2024-05-25 hour 19: 148983 events in 0 files, snapshot none (task 5331 ms: download 2720 ms overlapping gunzip 758 ms, parse 3355 ms, sort 0 ms, write 0 ms, index 458 ms: 8 candidates, 56124 repo-hours, 838 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:16:10Z [load_day 2024-05-25] 2024-05-25 hour 20: 141150 events in 0 files, snapshot none (task 4694 ms: download 2222 ms overlapping gunzip 644 ms, parse 2767 ms, sort 0 ms, write 0 ms, index 497 ms: 9 candidates, 55046 repo-hours, 734 releases; waiting 469 ms; commit 0 ms)
2026-11-08T06:16:10Z [load_day 2024-05-25] 2024-05-25 hour 21: 142927 events in 0 files, snapshot none (task 4318 ms: download 2238 ms overlapping gunzip 609 ms, parse 2632 ms, sort 0 ms, write 0 ms, index 399 ms: 12 candidates, 56812 repo-hours, 865 releases; waiting 444 ms; commit 0 ms)
2026-11-08T06:16:15Z [load_day 2024-05-25] 2024-05-25 hour 22: 128100 events in 0 files, snapshot none (task 4392 ms: download 2511 ms overlapping gunzip 641 ms, parse 2551 ms, sort 0 ms, write 0 ms, index 381 ms: 12 candidates, 47021 repo-hours, 699 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:16:15Z [load_day 2024-05-25] 2024-05-25 hour 23: 120773 events in 0 files, snapshot none (task 3804 ms: download 1825 ms overlapping gunzip 511 ms, parse 2187 ms, sort 0 ms, write 0 ms, index 404 ms: 5 candidates, 46389 repo-hours, 580 releases; waiting 435 ms; commit 0 ms)
2026-11-08T06:16:22Z [load_day 2024-05-25] 2024-05-25: repo_hour merged from 24 files to 1 (1561883 rows, 6868 ms)
2026-11-08T06:16:25Z [load_day 2024-05-25] 2024-05-25: index committed in 9562 ms (24 + 1 + 24 files)
2026-11-08T06:16:25Z [load_day 2024-05-25] 2024-05-25: 3806121 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:16:25Z [load_day 2024-05-25] attempt 1 succeeded