orcaLog in

Runs · run 3995

load_day 2025-06-08, attempt 1 succeeded

Host
73ccef5e07c2:318899
Started
2026-11-08T12:20:44Z
Ended
2026-11-08T12:22:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
634 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
109.0 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3995/load_day/2025-06-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:20:44Z [load_day 2025-06-08] attempt 1 started
2026-11-08T12:20:45Z [load_day 2025-06-08] 2025-06-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:20:50Z [load_day 2025-06-08] 2025-06-08 hour 0: 124182 events in 0 files, snapshot none (task 4732 ms: download 2421 ms overlapping gunzip 658 ms, parse 2770 ms, sort 0 ms, write 0 ms, index 511 ms: 9 candidates, 55479 repo-hours, 1071 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:20:51Z [load_day 2025-06-08] 2025-06-08 hour 1: 139279 events in 0 files, snapshot none (task 5261 ms: download 2782 ms overlapping gunzip 709 ms, parse 3102 ms, sort 0 ms, write 0 ms, index 573 ms: 9 candidates, 79015 repo-hours, 626 releases; waiting 555 ms; commit 0 ms)
2026-11-08T12:20:55Z [load_day 2025-06-08] 2025-06-08 hour 2: 132623 events in 0 files, snapshot none (task 4399 ms: download 1703 ms overlapping gunzip 563 ms, parse 2415 ms, sort 0 ms, write 0 ms, index 867 ms: 7 candidates, 62789 repo-hours, 602 releases; waiting 248 ms; commit 0 ms)
2026-11-08T12:20:56Z [load_day 2025-06-08] 2025-06-08 hour 3: 130887 events in 0 files, snapshot none (task 4917 ms: download 2479 ms overlapping gunzip 685 ms, parse 2775 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 54483 repo-hours, 1375 releases; waiting 577 ms; commit 0 ms)
2026-11-08T12:21:00Z [load_day 2025-06-08] 2025-06-08 hour 4: 127433 events in 0 files, snapshot none (task 4261 ms: download 2188 ms overlapping gunzip 582 ms, parse 2559 ms, sort 0 ms, write 0 ms, index 406 ms: 8 candidates, 52101 repo-hours, 1050 releases; waiting 441 ms; commit 0 ms)
2026-11-08T12:21:01Z [load_day 2025-06-08] 2025-06-08 hour 5: 129363 events in 0 files, snapshot none (task 4099 ms: download 2477 ms overlapping gunzip 561 ms, parse 2367 ms, sort 0 ms, write 0 ms, index 395 ms: 4 candidates, 51678 repo-hours, 583 releases; waiting 476 ms; commit 0 ms)
2026-11-08T12:21:06Z [load_day 2025-06-08] 2025-06-08 hour 6: 134507 events in 0 files, snapshot none (task 4963 ms: download 2149 ms overlapping gunzip 748 ms, parse 3119 ms, sort 0 ms, write 0 ms, index 537 ms: 12 candidates, 61843 repo-hours, 615 releases; waiting 178 ms; commit 0 ms)
2026-11-08T12:21:06Z [load_day 2025-06-08] 2025-06-08 hour 7: 137200 events in 0 files, snapshot none (task 4814 ms: download 2405 ms overlapping gunzip 755 ms, parse 2915 ms, sort 0 ms, write 0 ms, index 422 ms: 7 candidates, 55951 repo-hours, 517 releases; waiting 420 ms; commit 0 ms)
2026-11-08T12:21:13Z [load_day 2025-06-08] 2025-06-08 hour 8: 134198 events in 0 files, snapshot none (task 6353 ms: download 3181 ms overlapping gunzip 916 ms, parse 4144 ms, sort 0 ms, write 0 ms, index 507 ms: 3 candidates, 59750 repo-hours, 636 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:21:13Z [load_day 2025-06-08] 2025-06-08 hour 9: 136607 events in 0 files, snapshot none (task 6839 ms: download 3487 ms overlapping gunzip 1063 ms, parse 4502 ms, sort 0 ms, write 0 ms, index 573 ms: 13 candidates, 59581 repo-hours, 678 releases; waiting 481 ms; commit 0 ms)
2026-11-08T12:21:20Z [load_day 2025-06-08] 2025-06-08 hour 10: 141034 events in 0 files, snapshot none (task 6886 ms: download 2790 ms overlapping gunzip 1023 ms, parse 4391 ms, sort 0 ms, write 0 ms, index 648 ms: 8 candidates, 61637 repo-hours, 643 releases; waiting 519 ms; commit 0 ms)
2026-11-08T12:21:20Z [load_day 2025-06-08] 2025-06-08 hour 11: 139706 events in 0 files, snapshot none (task 6594 ms: download 3377 ms overlapping gunzip 1019 ms, parse 4271 ms, sort 0 ms, write 0 ms, index 510 ms: 10 candidates, 59251 repo-hours, 566 releases; waiting 528 ms; commit 0 ms)
2026-11-08T12:21:26Z [load_day 2025-06-08] 2025-06-08 hour 12: 157434 events in 0 files, snapshot none (task 5201 ms: download 2108 ms overlapping gunzip 608 ms, parse 2795 ms, sort 0 ms, write 0 ms, index 1194 ms: 5 candidates, 86193 repo-hours, 617 releases; waiting 192 ms; commit 0 ms)
2026-11-08T12:21:27Z [load_day 2025-06-08] 2025-06-08 hour 13: 151240 events in 0 files, snapshot none (task 5916 ms: download 2905 ms overlapping gunzip 839 ms, parse 3418 ms, sort 0 ms, write 0 ms, index 796 ms: 6 candidates, 76062 repo-hours, 591 releases; waiting 556 ms; commit 0 ms)
2026-11-08T12:21:31Z [load_day 2025-06-08] 2025-06-08 hour 14: 147721 events in 0 files, snapshot none (task 5227 ms: download 2538 ms overlapping gunzip 677 ms, parse 3067 ms, sort 0 ms, write 0 ms, index 838 ms: 3 candidates, 67885 repo-hours, 657 releases; waiting 413 ms; commit 0 ms)
2026-11-08T12:21:33Z [load_day 2025-06-08] 2025-06-08 hour 15: 150914 events in 0 files, snapshot none (task 5139 ms: download 3013 ms overlapping gunzip 658 ms, parse 2853 ms, sort 0 ms, write 0 ms, index 938 ms: 8 candidates, 70359 repo-hours, 734 releases; waiting 457 ms; commit 0 ms)
2026-11-08T12:21:38Z [load_day 2025-06-08] 2025-06-08 hour 16: 149182 events in 0 files, snapshot none (task 5632 ms: download 3105 ms overlapping gunzip 796 ms, parse 3386 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 67605 repo-hours, 699 releases; waiting 569 ms; commit 0 ms)
2026-11-08T12:21:39Z [load_day 2025-06-08] 2025-06-08 hour 17: 150350 events in 0 files, snapshot none (task 5362 ms: download 2822 ms overlapping gunzip 799 ms, parse 3236 ms, sort 0 ms, write 0 ms, index 572 ms: 6 candidates, 65060 repo-hours, 648 releases; waiting 473 ms; commit 0 ms)
2026-11-08T12:21:44Z [load_day 2025-06-08] 2025-06-08 hour 18: 149621 events in 0 files, snapshot none (task 5782 ms: download 3054 ms overlapping gunzip 782 ms, parse 3499 ms, sort 0 ms, write 0 ms, index 665 ms: 10 candidates, 71593 repo-hours, 753 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:21:45Z [load_day 2025-06-08] 2025-06-08 hour 19: 142015 events in 0 files, snapshot none (task 5728 ms: download 3679 ms overlapping gunzip 878 ms, parse 3588 ms, sort 0 ms, write 0 ms, index 428 ms: 3 candidates, 57554 repo-hours, 740 releases; waiting 560 ms; commit 0 ms)
2026-11-08T12:21:50Z [load_day 2025-06-08] 2025-06-08 hour 20: 141067 events in 0 files, snapshot none (task 5405 ms: download 2605 ms overlapping gunzip 766 ms, parse 3420 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 58129 repo-hours, 793 releases; waiting 357 ms; commit 0 ms)
2026-11-08T12:21:51Z [load_day 2025-06-08] 2025-06-08 hour 21: 137271 events in 0 files, snapshot none (task 5351 ms: download 2585 ms overlapping gunzip 749 ms, parse 3243 ms, sort 0 ms, write 0 ms, index 522 ms: 7 candidates, 56970 repo-hours, 895 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:21:55Z [load_day 2025-06-08] 2025-06-08 hour 22: 133096 events in 0 files, snapshot none (task 4419 ms: download 2564 ms overlapping gunzip 556 ms, parse 2413 ms, sort 0 ms, write 0 ms, index 608 ms: 4 candidates, 53282 repo-hours, 880 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:21:56Z [load_day 2025-06-08] 2025-06-08 hour 23: 131021 events in 0 files, snapshot none (task 4769 ms: download 3192 ms overlapping gunzip 638 ms, parse 2788 ms, sort 0 ms, write 0 ms, index 431 ms: 5 candidates, 50573 repo-hours, 778 releases; waiting 629 ms; commit 0 ms)
2026-11-08T12:22:03Z [load_day 2025-06-08] 2025-06-08: repo_hour merged from 24 files to 1 (1494823 rows, 7087 ms)
2026-11-08T12:22:06Z [load_day 2025-06-08] 2025-06-08: index committed in 9595 ms (24 + 1 + 24 files)
2026-11-08T12:22:06Z [load_day 2025-06-08] 2025-06-08: 3347951 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:22:06Z [load_day 2025-06-08] attempt 1 succeeded