orcaLog in

Runs · run 4672

load_day 2025-12-02, attempt 1 succeeded

Host
73ccef5e07c2:411553
Started
2026-11-08T14:38:25Z
Ended
2026-11-08T14:39:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
715 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.1 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4672/load_day/2025-12-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:38:25Z [load_day 2025-12-02] attempt 1 started
2026-11-08T14:38:26Z [load_day 2025-12-02] 2025-12-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:38:31Z [load_day 2025-12-02] 2025-12-02 hour 0: 148630 events in 0 files, snapshot none (task 4287 ms: download 2838 ms overlapping gunzip 510 ms, parse 1850 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 76901 repo-hours, 549 releases; waiting 935 ms; commit 0 ms)
2026-11-08T14:38:31Z [load_day 2025-12-02] 2025-12-02 hour 1: 157873 events in 0 files, snapshot none (task 3801 ms: download 2180 ms overlapping gunzip 489 ms, parse 1605 ms, sort 0 ms, write 0 ms, index 843 ms: 8 candidates, 95414 repo-hours, 425 releases; waiting 538 ms; commit 0 ms)
2026-11-08T14:38:36Z [load_day 2025-12-02] 2025-12-02 hour 2: 145760 events in 0 files, snapshot none (task 4208 ms: download 2566 ms overlapping gunzip 590 ms, parse 1982 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 78110 repo-hours, 429 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:38:36Z [load_day 2025-12-02] 2025-12-02 hour 3: 148288 events in 0 files, snapshot none (task 4145 ms: download 2632 ms overlapping gunzip 619 ms, parse 2039 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 76297 repo-hours, 1061 releases; waiting 593 ms; commit 0 ms)
2026-11-08T14:38:40Z [load_day 2025-12-02] 2025-12-02 hour 4: 150359 events in 0 files, snapshot none (task 3541 ms: download 2472 ms overlapping gunzip 430 ms, parse 1339 ms, sort 0 ms, write 0 ms, index 563 ms: 6 candidates, 72746 repo-hours, 673 releases; waiting 924 ms; commit 0 ms)
2026-11-08T14:38:40Z [load_day 2025-12-02] 2025-12-02 hour 5: 147526 events in 0 files, snapshot none (task 3385 ms: download 2242 ms overlapping gunzip 471 ms, parse 1328 ms, sort 0 ms, write 0 ms, index 521 ms: 3 candidates, 71723 repo-hours, 464 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:38:43Z [load_day 2025-12-02] 2025-12-02 hour 6: 143248 events in 0 files, snapshot none (task 2997 ms: download 1864 ms overlapping gunzip 354 ms, parse 1080 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 78488 repo-hours, 558 releases; waiting 693 ms; commit 0 ms)
2026-11-08T14:38:43Z [load_day 2025-12-02] 2025-12-02 hour 7: 149927 events in 0 files, snapshot none (task 3186 ms: download 2118 ms overlapping gunzip 440 ms, parse 1383 ms, sort 0 ms, write 0 ms, index 553 ms: 7 candidates, 76483 repo-hours, 568 releases; waiting 465 ms; commit 0 ms)
2026-11-08T14:38:48Z [load_day 2025-12-02] 2025-12-02 hour 8: 146634 events in 0 files, snapshot none (task 3929 ms: download 2682 ms overlapping gunzip 469 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 77131 repo-hours, 616 releases; waiting 1115 ms; commit 0 ms)
2026-11-08T14:38:48Z [load_day 2025-12-02] 2025-12-02 hour 9: 145624 events in 0 files, snapshot none (task 3376 ms: download 1906 ms overlapping gunzip 403 ms, parse 1322 ms, sort 0 ms, write 0 ms, index 684 ms: 7 candidates, 77496 repo-hours, 591 releases; waiting 665 ms; commit 0 ms)
2026-11-08T14:38:52Z [load_day 2025-12-02] 2025-12-02 hour 10: 146736 events in 0 files, snapshot none (task 3684 ms: download 2250 ms overlapping gunzip 478 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 644 ms: 3 candidates, 79068 repo-hours, 538 releases; waiting 802 ms; commit 0 ms)
2026-11-08T14:38:52Z [load_day 2025-12-02] 2025-12-02 hour 11: 146826 events in 0 files, snapshot none (task 3552 ms: download 2440 ms overlapping gunzip 409 ms, parse 1221 ms, sort 0 ms, write 0 ms, index 622 ms: 6 candidates, 76276 repo-hours, 623 releases; waiting 1006 ms; commit 0 ms)
2026-11-08T14:38:56Z [load_day 2025-12-02] 2025-12-02 hour 12: 159079 events in 0 files, snapshot none (task 3004 ms: download 1742 ms overlapping gunzip 313 ms, parse 993 ms, sort 0 ms, write 0 ms, index 663 ms: 7 candidates, 98373 repo-hours, 367 releases; waiting 745 ms; commit 0 ms)
2026-11-08T14:38:56Z [load_day 2025-12-02] 2025-12-02 hour 13: 159591 events in 0 files, snapshot none (task 2804 ms: download 1677 ms overlapping gunzip 288 ms, parse 933 ms, sort 0 ms, write 0 ms, index 692 ms: 4 candidates, 94591 repo-hours, 382 releases; waiting 571 ms; commit 0 ms)
2026-11-08T14:38:59Z [load_day 2025-12-02] 2025-12-02 hour 14: 150647 events in 0 files, snapshot none (task 3314 ms: download 2226 ms overlapping gunzip 457 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 644 ms: 7 candidates, 83267 repo-hours, 439 releases; waiting 609 ms; commit 0 ms)
2026-11-08T14:39:00Z [load_day 2025-12-02] 2025-12-02 hour 15: 151462 events in 0 files, snapshot none (task 3517 ms: download 2382 ms overlapping gunzip 415 ms, parse 1286 ms, sort 0 ms, write 0 ms, index 641 ms: 2 candidates, 83375 repo-hours, 467 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:39:04Z [load_day 2025-12-02] 2025-12-02 hour 16: 147929 events in 0 files, snapshot none (task 3862 ms: download 2291 ms overlapping gunzip 552 ms, parse 1639 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 83677 repo-hours, 533 releases; waiting 699 ms; commit 0 ms)
2026-11-08T14:39:04Z [load_day 2025-12-02] 2025-12-02 hour 17: 157604 events in 0 files, snapshot none (task 3730 ms: download 2388 ms overlapping gunzip 505 ms, parse 1588 ms, sort 0 ms, write 0 ms, index 730 ms: 6 candidates, 85046 repo-hours, 448 releases; waiting 584 ms; commit 0 ms)
2026-11-08T14:39:07Z [load_day 2025-12-02] 2025-12-02 hour 18: 154484 events in 0 files, snapshot none (task 3233 ms: download 1564 ms overlapping gunzip 457 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 807 ms: 8 candidates, 88107 repo-hours, 531 releases; waiting 221 ms; commit 0 ms)
2026-11-08T14:39:08Z [load_day 2025-12-02] 2025-12-02 hour 19: 152089 events in 0 files, snapshot none (task 3653 ms: download 2564 ms overlapping gunzip 571 ms, parse 1699 ms, sort 0 ms, write 0 ms, index 560 ms: 9 candidates, 77643 repo-hours, 656 releases; waiting 515 ms; commit 0 ms)
2026-11-08T14:39:12Z [load_day 2025-12-02] 2025-12-02 hour 20: 147837 events in 0 files, snapshot none (task 3558 ms: download 2079 ms overlapping gunzip 440 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 821 ms: 8 candidates, 75031 repo-hours, 565 releases; waiting 614 ms; commit 0 ms)
2026-11-08T14:39:12Z [load_day 2025-12-02] 2025-12-02 hour 21: 146476 events in 0 files, snapshot none (task 3996 ms: download 2792 ms overlapping gunzip 515 ms, parse 1661 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 71068 repo-hours, 601 releases; waiting 926 ms; commit 0 ms)
2026-11-08T14:39:15Z [load_day 2025-12-02] 2025-12-02 hour 22: 147146 events in 0 files, snapshot none (task 3387 ms: download 2141 ms overlapping gunzip 442 ms, parse 1426 ms, sort 0 ms, write 0 ms, index 680 ms: 6 candidates, 70616 repo-hours, 678 releases; waiting 458 ms; commit 0 ms)
2026-11-08T14:39:16Z [load_day 2025-12-02] 2025-12-02 hour 23: 146729 events in 0 files, snapshot none (task 3573 ms: download 2484 ms overlapping gunzip 520 ms, parse 1700 ms, sort 0 ms, write 0 ms, index 508 ms: 4 candidates, 68756 repo-hours, 720 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:39:25Z [load_day 2025-12-02] 2025-12-02: repo_hour merged from 24 files to 1 (1915683 rows, 8357 ms)
2026-11-08T14:39:28Z [load_day 2025-12-02] 2025-12-02: index committed in 11730 ms (24 + 1 + 24 files)
2026-11-08T14:39:28Z [load_day 2025-12-02] 2025-12-02: 3598504 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:39:28Z [load_day 2025-12-02] attempt 1 succeeded