orcaLog in

Runs · run 4648

load_day 2025-11-24, attempt 1 succeeded

Host
73ccef5e07c2:408517
Started
2026-11-08T14:34:08Z
Ended
2026-11-08T14:35:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
766 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.2 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4648/load_day/2025-11-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:34:08Z [load_day 2025-11-24] attempt 1 started
2026-11-08T14:34:09Z [load_day 2025-11-24] 2025-11-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:34:13Z [load_day 2025-11-24] 2025-11-24 hour 0: 149581 events in 0 files, snapshot none (task 3526 ms: download 2229 ms overlapping gunzip 435 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 564 ms: 6 candidates, 68365 repo-hours, 644 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:34:13Z [load_day 2025-11-24] 2025-11-24 hour 1: 153840 events in 0 files, snapshot none (task 3279 ms: download 1963 ms overlapping gunzip 396 ms, parse 1227 ms, sort 0 ms, write 0 ms, index 638 ms: 7 candidates, 87960 repo-hours, 579 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:34:18Z [load_day 2025-11-24] 2025-11-24 hour 2: 145919 events in 0 files, snapshot none (task 4150 ms: download 2809 ms overlapping gunzip 428 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 589 ms: 7 candidates, 73980 repo-hours, 491 releases; waiting 1482 ms; commit 0 ms)
2026-11-08T14:34:18Z [load_day 2025-11-24] 2025-11-24 hour 3: 145632 events in 0 files, snapshot none (task 3277 ms: download 2102 ms overlapping gunzip 413 ms, parse 1275 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 68024 repo-hours, 651 releases; waiting 664 ms; commit 0 ms)
2026-11-08T14:34:22Z [load_day 2025-11-24] 2025-11-24 hour 4: 151110 events in 0 files, snapshot none (task 3874 ms: download 2131 ms overlapping gunzip 561 ms, parse 1681 ms, sort 0 ms, write 0 ms, index 604 ms: 4 candidates, 68779 repo-hours, 1407 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:34:22Z [load_day 2025-11-24] 2025-11-24 hour 5: 151266 events in 0 files, snapshot none (task 3642 ms: download 2352 ms overlapping gunzip 548 ms, parse 1613 ms, sort 0 ms, write 0 ms, index 562 ms: 9 candidates, 70259 repo-hours, 517 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:34:26Z [load_day 2025-11-24] 2025-11-24 hour 6: 155879 events in 0 files, snapshot none (task 3881 ms: download 2286 ms overlapping gunzip 517 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 78946 repo-hours, 540 releases; waiting 717 ms; commit 0 ms)
2026-11-08T14:34:26Z [load_day 2025-11-24] 2025-11-24 hour 7: 157651 events in 0 files, snapshot none (task 3783 ms: download 2542 ms overlapping gunzip 505 ms, parse 1557 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 76305 repo-hours, 522 releases; waiting 775 ms; commit 0 ms)
2026-11-08T14:34:31Z [load_day 2025-11-24] 2025-11-24 hour 8: 150876 events in 0 files, snapshot none (task 4000 ms: download 2329 ms overlapping gunzip 583 ms, parse 1860 ms, sort 0 ms, write 0 ms, index 675 ms: 6 candidates, 77427 repo-hours, 450 releases; waiting 578 ms; commit 0 ms)
2026-11-08T14:34:31Z [load_day 2025-11-24] 2025-11-24 hour 9: 153723 events in 0 files, snapshot none (task 3896 ms: download 2445 ms overlapping gunzip 548 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 80332 repo-hours, 465 releases; waiting 778 ms; commit 0 ms)
2026-11-08T14:34:36Z [load_day 2025-11-24] 2025-11-24 hour 10: 149865 events in 0 files, snapshot none (task 4235 ms: download 2949 ms overlapping gunzip 546 ms, parse 1606 ms, sort 0 ms, write 0 ms, index 679 ms: 3 candidates, 80195 repo-hours, 415 releases; waiting 1184 ms; commit 0 ms)
2026-11-08T14:34:36Z [load_day 2025-11-24] 2025-11-24 hour 11: 149408 events in 0 files, snapshot none (task 4294 ms: download 2848 ms overlapping gunzip 595 ms, parse 1894 ms, sort 0 ms, write 0 ms, index 664 ms: 8 candidates, 76102 repo-hours, 395 releases; waiting 803 ms; commit 0 ms)
2026-11-08T14:34:40Z [load_day 2025-11-24] 2025-11-24 hour 12: 158830 events in 0 files, snapshot none (task 3646 ms: download 2238 ms overlapping gunzip 438 ms, parse 1533 ms, sort 0 ms, write 0 ms, index 764 ms: 5 candidates, 98083 repo-hours, 286 releases; waiting 603 ms; commit 0 ms)
2026-11-08T14:34:40Z [load_day 2025-11-24] 2025-11-24 hour 13: 160484 events in 0 files, snapshot none (task 3685 ms: download 1503 ms overlapping gunzip 516 ms, parse 1720 ms, sort 0 ms, write 0 ms, index 697 ms: 3 candidates, 93872 repo-hours, 211 releases; waiting 395 ms; commit 0 ms)
2026-11-08T14:34:44Z [load_day 2025-11-24] 2025-11-24 hour 14: 153122 events in 0 files, snapshot none (task 3937 ms: download 2323 ms overlapping gunzip 548 ms, parse 1546 ms, sort 0 ms, write 0 ms, index 715 ms: 9 candidates, 82941 repo-hours, 370 releases; waiting 643 ms; commit 0 ms)
2026-11-08T14:34:44Z [load_day 2025-11-24] 2025-11-24 hour 15: 151615 events in 0 files, snapshot none (task 3944 ms: download 2164 ms overlapping gunzip 474 ms, parse 1577 ms, sort 0 ms, write 0 ms, index 932 ms: 9 candidates, 82390 repo-hours, 448 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:34:49Z [load_day 2025-11-24] 2025-11-24 hour 16: 154198 events in 0 files, snapshot none (task 4290 ms: download 2898 ms overlapping gunzip 601 ms, parse 1717 ms, sort 0 ms, write 0 ms, index 683 ms: 6 candidates, 83568 repo-hours, 407 releases; waiting 1020 ms; commit 0 ms)
2026-11-08T14:34:49Z [load_day 2025-11-24] 2025-11-24 hour 17: 150831 events in 0 files, snapshot none (task 3982 ms: download 2450 ms overlapping gunzip 514 ms, parse 1770 ms, sort 0 ms, write 0 ms, index 589 ms: 13 candidates, 80429 repo-hours, 383 releases; waiting 867 ms; commit 0 ms)
2026-11-08T14:34:53Z [load_day 2025-11-24] 2025-11-24 hour 18: 156551 events in 0 files, snapshot none (task 3782 ms: download 2068 ms overlapping gunzip 543 ms, parse 1728 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 86023 repo-hours, 377 releases; waiting 584 ms; commit 0 ms)
2026-11-08T14:34:53Z [load_day 2025-11-24] 2025-11-24 hour 19: 150807 events in 0 files, snapshot none (task 3733 ms: download 2280 ms overlapping gunzip 569 ms, parse 1812 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 73817 repo-hours, 489 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:34:57Z [load_day 2025-11-24] 2025-11-24 hour 20: 154182 events in 0 files, snapshot none (task 3845 ms: download 2784 ms overlapping gunzip 542 ms, parse 1596 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 76377 repo-hours, 508 releases; waiting 781 ms; commit 0 ms)
2026-11-08T14:34:57Z [load_day 2025-11-24] 2025-11-24 hour 21: 148007 events in 0 files, snapshot none (task 3880 ms: download 2179 ms overlapping gunzip 557 ms, parse 1667 ms, sort 0 ms, write 0 ms, index 551 ms: 6 candidates, 73494 repo-hours, 607 releases; waiting 493 ms; commit 0 ms)
2026-11-08T14:35:02Z [load_day 2025-11-24] 2025-11-24 hour 22: 146756 events in 0 files, snapshot none (task 4081 ms: download 2681 ms overlapping gunzip 607 ms, parse 1909 ms, sort 0 ms, write 0 ms, index 589 ms: 9 candidates, 70657 repo-hours, 648 releases; waiting 691 ms; commit 0 ms)
2026-11-08T14:35:02Z [load_day 2025-11-24] 2025-11-24 hour 23: 146566 events in 0 files, snapshot none (task 3716 ms: download 2350 ms overlapping gunzip 539 ms, parse 1779 ms, sort 0 ms, write 0 ms, index 570 ms: 7 candidates, 66157 repo-hours, 548 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:35:10Z [load_day 2025-11-24] 2025-11-24: repo_hour merged from 24 files to 1 (1874482 rows, 8421 ms)
2026-11-08T14:35:13Z [load_day 2025-11-24] 2025-11-24: index committed in 11165 ms (24 + 1 + 24 files)
2026-11-08T14:35:13Z [load_day 2025-11-24] 2025-11-24: 3646699 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:35:13Z [load_day 2025-11-24] attempt 1 succeeded