orcaLog in

Runs · run 4976

load_day 2026-02-26, attempt 1 succeeded

Host
73ccef5e07c2:448018
Started
2026-11-08T15:25:29Z
Ended
2026-11-08T15:26:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
713 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.4 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4976/load_day/2026-02-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:25:29Z [load_day 2026-02-26] attempt 1 started
2026-11-08T15:25:30Z [load_day 2026-02-26] 2026-02-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:25:34Z [load_day 2026-02-26] 2026-02-26 hour 0: 144297 events in 0 files, snapshot none (task 3806 ms: download 2651 ms overlapping gunzip 586 ms, parse 1731 ms, sort 0 ms, write 0 ms, index 558 ms: 5 candidates, 72437 repo-hours, 1042 releases; waiting 622 ms; commit 0 ms)
2026-11-08T15:25:34Z [load_day 2026-02-26] 2026-02-26 hour 1: 154293 events in 0 files, snapshot none (task 3331 ms: download 1745 ms overlapping gunzip 457 ms, parse 1388 ms, sort 0 ms, write 0 ms, index 732 ms: 5 candidates, 90619 repo-hours, 625 releases; waiting 288 ms; commit 0 ms)
2026-11-08T15:25:39Z [load_day 2026-02-26] 2026-02-26 hour 2: 151478 events in 0 files, snapshot none (task 3727 ms: download 2179 ms overlapping gunzip 501 ms, parse 1559 ms, sort 0 ms, write 0 ms, index 638 ms: 3 candidates, 86726 repo-hours, 695 releases; waiting 595 ms; commit 0 ms)
2026-11-08T15:25:39Z [load_day 2026-02-26] 2026-02-26 hour 3: 146070 events in 0 files, snapshot none (task 3467 ms: download 2406 ms overlapping gunzip 526 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 529 ms: 7 candidates, 70760 repo-hours, 889 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:25:43Z [load_day 2026-02-26] 2026-02-26 hour 4: 147179 events in 0 files, snapshot none (task 3772 ms: download 2196 ms overlapping gunzip 600 ms, parse 1701 ms, sort 0 ms, write 0 ms, index 591 ms: 12 candidates, 75466 repo-hours, 1282 releases; waiting 515 ms; commit 0 ms)
2026-11-08T15:25:43Z [load_day 2026-02-26] 2026-02-26 hour 5: 151633 events in 0 files, snapshot none (task 3661 ms: download 2575 ms overlapping gunzip 509 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 605 ms: 11 candidates, 79967 repo-hours, 1358 releases; waiting 712 ms; commit 0 ms)
2026-11-08T15:25:47Z [load_day 2026-02-26] 2026-02-26 hour 6: 149389 events in 0 files, snapshot none (task 3797 ms: download 2312 ms overlapping gunzip 539 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 81210 repo-hours, 883 releases; waiting 693 ms; commit 0 ms)
2026-11-08T15:25:47Z [load_day 2026-02-26] 2026-02-26 hour 7: 152325 events in 0 files, snapshot none (task 3706 ms: download 2397 ms overlapping gunzip 572 ms, parse 1584 ms, sort 0 ms, write 0 ms, index 640 ms: 8 candidates, 83427 repo-hours, 737 releases; waiting 560 ms; commit 0 ms)
2026-11-08T15:25:51Z [load_day 2026-02-26] 2026-02-26 hour 8: 148686 events in 0 files, snapshot none (task 3665 ms: download 2215 ms overlapping gunzip 504 ms, parse 1390 ms, sort 0 ms, write 0 ms, index 690 ms: 4 candidates, 81911 repo-hours, 769 releases; waiting 716 ms; commit 0 ms)
2026-11-08T15:25:51Z [load_day 2026-02-26] 2026-02-26 hour 9: 146468 events in 0 files, snapshot none (task 3580 ms: download 2323 ms overlapping gunzip 513 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 677 ms: 5 candidates, 81471 repo-hours, 731 releases; waiting 634 ms; commit 0 ms)
2026-11-08T15:25:56Z [load_day 2026-02-26] 2026-02-26 hour 10: 143113 events in 0 files, snapshot none (task 3752 ms: download 2159 ms overlapping gunzip 545 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 718 ms: 6 candidates, 81384 repo-hours, 694 releases; waiting 648 ms; commit 0 ms)
2026-11-08T15:25:56Z [load_day 2026-02-26] 2026-02-26 hour 11: 147742 events in 0 files, snapshot none (task 3746 ms: download 2412 ms overlapping gunzip 523 ms, parse 1545 ms, sort 0 ms, write 0 ms, index 687 ms: 10 candidates, 83343 repo-hours, 756 releases; waiting 752 ms; commit 0 ms)
2026-11-08T15:26:00Z [load_day 2026-02-26] 2026-02-26 hour 12: 154150 events in 0 files, snapshot none (task 4455 ms: download 2646 ms overlapping gunzip 365 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 707 ms: 6 candidates, 93557 repo-hours, 500 releases; waiting 1849 ms; commit 0 ms)
2026-11-08T15:26:00Z [load_day 2026-02-26] 2026-02-26 hour 13: 149098 events in 0 files, snapshot none (task 2990 ms: download 1635 ms overlapping gunzip 396 ms, parse 1135 ms, sort 0 ms, write 0 ms, index 733 ms: 7 candidates, 93076 repo-hours, 338 releases; waiting 435 ms; commit 0 ms)
2026-11-08T15:26:04Z [load_day 2026-02-26] 2026-02-26 hour 14: 124282 events in 0 files, snapshot none (task 2980 ms: download 1688 ms overlapping gunzip 314 ms, parse 1028 ms, sort 0 ms, write 0 ms, index 571 ms: 3 candidates, 76789 repo-hours, 446 releases; waiting 733 ms; commit 0 ms)
2026-11-08T15:26:04Z [load_day 2026-02-26] 2026-02-26 hour 15: 140781 events in 0 files, snapshot none (task 3237 ms: download 2043 ms overlapping gunzip 439 ms, parse 1260 ms, sort 0 ms, write 0 ms, index 623 ms: 4 candidates, 83663 repo-hours, 524 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:26:08Z [load_day 2026-02-26] 2026-02-26 hour 16: 140325 events in 0 files, snapshot none (task 3510 ms: download 1674 ms overlapping gunzip 520 ms, parse 1669 ms, sort 0 ms, write 0 ms, index 732 ms: 7 candidates, 78962 repo-hours, 523 releases; waiting 325 ms; commit 0 ms)
2026-11-08T15:26:08Z [load_day 2026-02-26] 2026-02-26 hour 17: 145758 events in 0 files, snapshot none (task 3423 ms: download 2222 ms overlapping gunzip 452 ms, parse 1355 ms, sort 0 ms, write 0 ms, index 628 ms: 9 candidates, 81346 repo-hours, 510 releases; waiting 611 ms; commit 0 ms)
2026-11-08T15:26:11Z [load_day 2026-02-26] 2026-02-26 hour 18: 120842 events in 0 files, snapshot none (task 2441 ms: download 1343 ms overlapping gunzip 287 ms, parse 872 ms, sort 0 ms, write 0 ms, index 616 ms: 6 candidates, 74519 repo-hours, 444 releases; waiting 365 ms; commit 0 ms)
2026-11-08T15:26:12Z [load_day 2026-02-26] 2026-02-26 hour 19: 136968 events in 0 files, snapshot none (task 3069 ms: download 1779 ms overlapping gunzip 378 ms, parse 1251 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 77094 repo-hours, 592 releases; waiting 565 ms; commit 0 ms)
2026-11-08T15:26:16Z [load_day 2026-02-26] 2026-02-26 hour 20: 148922 events in 0 files, snapshot none (task 4029 ms: download 2260 ms overlapping gunzip 571 ms, parse 1732 ms, sort 0 ms, write 0 ms, index 830 ms: 7 candidates, 80398 repo-hours, 773 releases; waiting 605 ms; commit 0 ms)
2026-11-08T15:26:17Z [load_day 2026-02-26] 2026-02-26 hour 21: 154526 events in 0 files, snapshot none (task 4206 ms: download 2698 ms overlapping gunzip 572 ms, parse 1683 ms, sort 0 ms, write 0 ms, index 712 ms: 7 candidates, 81809 repo-hours, 796 releases; waiting 895 ms; commit 0 ms)
2026-11-08T15:26:19Z [load_day 2026-02-26] 2026-02-26 hour 22: 147261 events in 0 files, snapshot none (task 3066 ms: download 1765 ms overlapping gunzip 425 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 753 ms: 3 candidates, 74276 repo-hours, 1011 releases; waiting 318 ms; commit 0 ms)
2026-11-08T15:26:21Z [load_day 2026-02-26] 2026-02-26 hour 23: 145277 events in 0 files, snapshot none (task 4022 ms: download 2771 ms overlapping gunzip 480 ms, parse 1500 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 69659 repo-hours, 1414 releases; waiting 943 ms; commit 0 ms)
2026-11-08T15:26:30Z [load_day 2026-02-26] 2026-02-26: repo_hour merged from 24 files to 1 (1933869 rows, 8659 ms)
2026-11-08T15:26:33Z [load_day 2026-02-26] 2026-02-26: index committed in 11669 ms (24 + 1 + 24 files)
2026-11-08T15:26:33Z [load_day 2026-02-26] 2026-02-26: 3490863 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:26:33Z [load_day 2026-02-26] attempt 1 succeeded