orcaLog in

Runs · run 3967

load_day 2025-05-31, attempt 1 succeeded

Host
73ccef5e07c2:314685
Started
2026-11-08T12:13:15Z
Ended
2026-11-08T12:14:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3967/load_day/2025-05-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:13:15Z [load_day 2025-05-31] attempt 1 started
2026-11-08T12:13:16Z [load_day 2025-05-31] 2025-05-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:13:21Z [load_day 2025-05-31] 2025-05-31 hour 0: 136427 events in 0 files, snapshot none (task 4631 ms: download 2723 ms overlapping gunzip 630 ms, parse 2672 ms, sort 0 ms, write 0 ms, index 523 ms: 8 candidates, 67682 repo-hours, 1020 releases; waiting 519 ms; commit 0 ms)
2026-11-08T12:13:21Z [load_day 2025-05-31] 2025-05-31 hour 1: 142690 events in 0 files, snapshot none (task 4633 ms: download 2744 ms overlapping gunzip 596 ms, parse 2464 ms, sort 0 ms, write 0 ms, index 608 ms: 9 candidates, 83571 repo-hours, 722 releases; waiting 686 ms; commit 0 ms)
2026-11-08T12:13:26Z [load_day 2025-05-31] 2025-05-31 hour 2: 130522 events in 0 files, snapshot none (task 4031 ms: download 2109 ms overlapping gunzip 589 ms, parse 2429 ms, sort 0 ms, write 0 ms, index 429 ms: 7 candidates, 61789 repo-hours, 793 releases; waiting 291 ms; commit 0 ms)
2026-11-08T12:13:26Z [load_day 2025-05-31] 2025-05-31 hour 3: 134086 events in 0 files, snapshot none (task 4261 ms: download 2550 ms overlapping gunzip 532 ms, parse 2178 ms, sort 0 ms, write 0 ms, index 420 ms: 7 candidates, 59951 repo-hours, 2164 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:13:30Z [load_day 2025-05-31] 2025-05-31 hour 4: 128939 events in 0 files, snapshot none (task 4079 ms: download 3026 ms overlapping gunzip 516 ms, parse 2161 ms, sort 0 ms, write 0 ms, index 425 ms: 10 candidates, 53542 repo-hours, 601 releases; waiting 755 ms; commit 0 ms)
2026-11-08T12:13:30Z [load_day 2025-05-31] 2025-05-31 hour 5: 134286 events in 0 files, snapshot none (task 4151 ms: download 2287 ms overlapping gunzip 519 ms, parse 2255 ms, sort 0 ms, write 0 ms, index 422 ms: 8 candidates, 56201 repo-hours, 601 releases; waiting 603 ms; commit 0 ms)
2026-11-08T12:13:35Z [load_day 2025-05-31] 2025-05-31 hour 6: 142026 events in 0 files, snapshot none (task 4382 ms: download 2484 ms overlapping gunzip 563 ms, parse 2425 ms, sort 0 ms, write 0 ms, index 545 ms: 8 candidates, 65674 repo-hours, 606 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:13:35Z [load_day 2025-05-31] 2025-05-31 hour 7: 138652 events in 0 files, snapshot none (task 3955 ms: download 2180 ms overlapping gunzip 525 ms, parse 2256 ms, sort 0 ms, write 0 ms, index 426 ms: 11 candidates, 59569 repo-hours, 577 releases; waiting 327 ms; commit 0 ms)
2026-11-08T12:13:39Z [load_day 2025-05-31] 2025-05-31 hour 8: 140750 events in 0 files, snapshot none (task 4427 ms: download 2590 ms overlapping gunzip 594 ms, parse 2491 ms, sort 0 ms, write 0 ms, index 480 ms: 6 candidates, 61445 repo-hours, 668 releases; waiting 536 ms; commit 0 ms)
2026-11-08T12:13:40Z [load_day 2025-05-31] 2025-05-31 hour 9: 142253 events in 0 files, snapshot none (task 4397 ms: download 2642 ms overlapping gunzip 597 ms, parse 2429 ms, sort 0 ms, write 0 ms, index 486 ms: 7 candidates, 63881 repo-hours, 707 releases; waiting 530 ms; commit 0 ms)
2026-11-08T12:13:44Z [load_day 2025-05-31] 2025-05-31 hour 10: 142054 events in 0 files, snapshot none (task 4353 ms: download 2623 ms overlapping gunzip 576 ms, parse 2426 ms, sort 0 ms, write 0 ms, index 457 ms: 6 candidates, 63077 repo-hours, 694 releases; waiting 585 ms; commit 0 ms)
2026-11-08T12:13:46Z [load_day 2025-05-31] 2025-05-31 hour 11: 144476 events in 0 files, snapshot none (task 5392 ms: download 3095 ms overlapping gunzip 640 ms, parse 2610 ms, sort 0 ms, write 0 ms, index 446 ms: 8 candidates, 62075 repo-hours, 769 releases; waiting 1407 ms; commit 0 ms)
2026-11-08T12:13:49Z [load_day 2025-05-31] 2025-05-31 hour 12: 157414 events in 0 files, snapshot none (task 4340 ms: download 2333 ms overlapping gunzip 554 ms, parse 2386 ms, sort 0 ms, write 0 ms, index 641 ms: 3 candidates, 88858 repo-hours, 714 releases; waiting 517 ms; commit 0 ms)
2026-11-08T12:13:51Z [load_day 2025-05-31] 2025-05-31 hour 13: 148570 events in 0 files, snapshot none (task 5276 ms: download 3368 ms overlapping gunzip 598 ms, parse 2506 ms, sort 0 ms, write 0 ms, index 558 ms: 12 candidates, 77719 repo-hours, 617 releases; waiting 1292 ms; commit 0 ms)
2026-11-08T12:13:54Z [load_day 2025-05-31] 2025-05-31 hour 14: 149150 events in 0 files, snapshot none (task 4554 ms: download 3211 ms overlapping gunzip 618 ms, parse 2511 ms, sort 0 ms, write 0 ms, index 514 ms: 6 candidates, 68577 repo-hours, 749 releases; waiting 521 ms; commit 0 ms)
2026-11-08T12:13:56Z [load_day 2025-05-31] 2025-05-31 hour 15: 150410 events in 0 files, snapshot none (task 4494 ms: download 2593 ms overlapping gunzip 591 ms, parse 2429 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 72435 repo-hours, 881 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:13:59Z [load_day 2025-05-31] 2025-05-31 hour 16: 149050 events in 0 files, snapshot none (task 4710 ms: download 2843 ms overlapping gunzip 632 ms, parse 2622 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 68819 repo-hours, 703 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:14:01Z [load_day 2025-05-31] 2025-05-31 hour 17: 150526 events in 0 files, snapshot none (task 4424 ms: download 2628 ms overlapping gunzip 564 ms, parse 2409 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 66486 repo-hours, 634 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:14:04Z [load_day 2025-05-31] 2025-05-31 hour 18: 152507 events in 0 files, snapshot none (task 4454 ms: download 2793 ms overlapping gunzip 567 ms, parse 2439 ms, sort 0 ms, write 0 ms, index 562 ms: 3 candidates, 72568 repo-hours, 775 releases; waiting 569 ms; commit 0 ms)
2026-11-08T12:14:07Z [load_day 2025-05-31] 2025-05-31 hour 19: 143672 events in 0 files, snapshot none (task 5471 ms: download 3197 ms overlapping gunzip 581 ms, parse 2413 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 58936 repo-hours, 718 releases; waiting 1681 ms; commit 0 ms)
2026-11-08T12:14:09Z [load_day 2025-05-31] 2025-05-31 hour 20: 140538 events in 0 files, snapshot none (task 4231 ms: download 2697 ms overlapping gunzip 543 ms, parse 2338 ms, sort 0 ms, write 0 ms, index 507 ms: 10 candidates, 58787 repo-hours, 620 releases; waiting 611 ms; commit 0 ms)
2026-11-08T12:14:12Z [load_day 2025-05-31] 2025-05-31 hour 21: 137978 events in 0 files, snapshot none (task 4148 ms: download 2631 ms overlapping gunzip 528 ms, parse 2258 ms, sort 0 ms, write 0 ms, index 447 ms: 8 candidates, 56841 repo-hours, 844 releases; waiting 536 ms; commit 0 ms)
2026-11-08T12:14:13Z [load_day 2025-05-31] 2025-05-31 hour 22: 130181 events in 0 files, snapshot none (task 3956 ms: download 2767 ms overlapping gunzip 484 ms, parse 2099 ms, sort 0 ms, write 0 ms, index 431 ms: 8 candidates, 53305 repo-hours, 805 releases; waiting 669 ms; commit 0 ms)
2026-11-08T12:14:16Z [load_day 2025-05-31] 2025-05-31 hour 23: 124367 events in 0 files, snapshot none (task 3756 ms: download 2351 ms overlapping gunzip 472 ms, parse 2002 ms, sort 0 ms, write 0 ms, index 337 ms: 0 candidates, 49148 repo-hours, 899 releases; waiting 629 ms; commit 0 ms)
2026-11-08T12:14:23Z [load_day 2025-05-31] 2025-05-31: repo_hour merged from 24 files to 1 (1550936 rows, 6899 ms)
2026-11-08T12:14:26Z [load_day 2025-05-31] 2025-05-31: index committed in 9816 ms (23 + 1 + 24 files)
2026-11-08T12:14:26Z [load_day 2025-05-31] 2025-05-31: 3391524 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:14:26Z [load_day 2025-05-31] attempt 1 succeeded