orcaLog in

Runs · run 4728

load_day 2025-12-18, attempt 1 succeeded

Host
73ccef5e07c2:418412
Started
2026-11-08T14:47:34Z
Ended
2026-11-08T14:48:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
733 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.7 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4728/load_day/2025-12-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:47:34Z [load_day 2025-12-18] attempt 1 started
2026-11-08T14:47:35Z [load_day 2025-12-18] 2025-12-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:47:39Z [load_day 2025-12-18] 2025-12-18 hour 0: 145878 events in 0 files, snapshot none (task 3410 ms: download 2125 ms overlapping gunzip 499 ms, parse 1555 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 75741 repo-hours, 808 releases; waiting 382 ms; commit 0 ms)
2026-11-08T14:47:39Z [load_day 2025-12-18] 2025-12-18 hour 1: 148953 events in 0 files, snapshot none (task 3611 ms: download 2505 ms overlapping gunzip 499 ms, parse 1620 ms, sort 0 ms, write 0 ms, index 682 ms: 2 candidates, 86012 repo-hours, 758 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:47:44Z [load_day 2025-12-18] 2025-12-18 hour 2: 145166 events in 0 files, snapshot none (task 4392 ms: download 2379 ms overlapping gunzip 664 ms, parse 2094 ms, sort 0 ms, write 0 ms, index 720 ms: 7 candidates, 76294 repo-hours, 614 releases; waiting 623 ms; commit 0 ms)
2026-11-08T14:47:44Z [load_day 2025-12-18] 2025-12-18 hour 3: 143593 events in 0 files, snapshot none (task 4449 ms: download 2169 ms overlapping gunzip 647 ms, parse 2018 ms, sort 0 ms, write 0 ms, index 931 ms: 10 candidates, 71795 repo-hours, 898 releases; waiting 507 ms; commit 0 ms)
2026-11-08T14:47:48Z [load_day 2025-12-18] 2025-12-18 hour 4: 145394 events in 0 files, snapshot none (task 3588 ms: download 1352 ms overlapping gunzip 483 ms, parse 1621 ms, sort 0 ms, write 0 ms, index 646 ms: 8 candidates, 71655 repo-hours, 1270 releases; waiting 236 ms; commit 0 ms)
2026-11-08T14:47:48Z [load_day 2025-12-18] 2025-12-18 hour 5: 144628 events in 0 files, snapshot none (task 3541 ms: download 2096 ms overlapping gunzip 444 ms, parse 1418 ms, sort 0 ms, write 0 ms, index 677 ms: 7 candidates, 71574 repo-hours, 583 releases; waiting 274 ms; commit 0 ms)
2026-11-08T14:47:51Z [load_day 2025-12-18] 2025-12-18 hour 6: 145289 events in 0 files, snapshot none (task 3149 ms: download 1554 ms overlapping gunzip 467 ms, parse 1410 ms, sort 0 ms, write 0 ms, index 654 ms: 3 candidates, 75172 repo-hours, 696 releases; waiting 231 ms; commit 0 ms)
2026-11-08T14:47:52Z [load_day 2025-12-18] 2025-12-18 hour 7: 154089 events in 0 files, snapshot none (task 3394 ms: download 2172 ms overlapping gunzip 512 ms, parse 1387 ms, sort 0 ms, write 0 ms, index 613 ms: 4 candidates, 78075 repo-hours, 644 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:47:56Z [load_day 2025-12-18] 2025-12-18 hour 8: 148129 events in 0 files, snapshot none (task 4564 ms: download 3063 ms overlapping gunzip 441 ms, parse 1381 ms, sort 0 ms, write 0 ms, index 600 ms: 8 candidates, 78552 repo-hours, 717 releases; waiting 1788 ms; commit 0 ms)
2026-11-08T14:47:56Z [load_day 2025-12-18] 2025-12-18 hour 9: 144752 events in 0 files, snapshot none (task 3218 ms: download 2107 ms overlapping gunzip 491 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 579 ms: 11 candidates, 78513 repo-hours, 709 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:48:01Z [load_day 2025-12-18] 2025-12-18 hour 10: 145754 events in 0 files, snapshot none (task 3713 ms: download 2390 ms overlapping gunzip 609 ms, parse 1619 ms, sort 0 ms, write 0 ms, index 647 ms: 4 candidates, 76933 repo-hours, 706 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:48:01Z [load_day 2025-12-18] 2025-12-18 hour 11: 143755 events in 0 files, snapshot none (task 3769 ms: download 1847 ms overlapping gunzip 623 ms, parse 1722 ms, sort 0 ms, write 0 ms, index 719 ms: 5 candidates, 76977 repo-hours, 678 releases; waiting 410 ms; commit 0 ms)
2026-11-08T14:48:05Z [load_day 2025-12-18] 2025-12-18 hour 12: 155341 events in 0 files, snapshot none (task 4242 ms: download 2855 ms overlapping gunzip 483 ms, parse 1523 ms, sort 0 ms, write 0 ms, index 740 ms: 5 candidates, 97519 repo-hours, 509 releases; waiting 1185 ms; commit 0 ms)
2026-11-08T14:48:05Z [load_day 2025-12-18] 2025-12-18 hour 13: 152590 events in 0 files, snapshot none (task 3731 ms: download 1998 ms overlapping gunzip 417 ms, parse 1321 ms, sort 0 ms, write 0 ms, index 1029 ms: 5 candidates, 91826 repo-hours, 443 releases; waiting 620 ms; commit 0 ms)
2026-11-08T14:48:10Z [load_day 2025-12-18] 2025-12-18 hour 14: 150326 events in 0 files, snapshot none (task 4036 ms: download 2184 ms overlapping gunzip 494 ms, parse 1652 ms, sort 0 ms, write 0 ms, index 797 ms: 7 candidates, 80470 repo-hours, 541 releases; waiting 619 ms; commit 0 ms)
2026-11-08T14:48:10Z [load_day 2025-12-18] 2025-12-18 hour 15: 158953 events in 0 files, snapshot none (task 3787 ms: download 1922 ms overlapping gunzip 498 ms, parse 1529 ms, sort 0 ms, write 0 ms, index 875 ms: 5 candidates, 78384 repo-hours, 443 releases; waiting 502 ms; commit 0 ms)
2026-11-08T14:48:15Z [load_day 2025-12-18] 2025-12-18 hour 16: 150494 events in 0 files, snapshot none (task 4354 ms: download 2616 ms overlapping gunzip 642 ms, parse 1760 ms, sort 0 ms, write 0 ms, index 714 ms: 2 candidates, 81345 repo-hours, 716 releases; waiting 796 ms; commit 0 ms)
2026-11-08T14:48:15Z [load_day 2025-12-18] 2025-12-18 hour 17: 150874 events in 0 files, snapshot none (task 3889 ms: download 2302 ms overlapping gunzip 547 ms, parse 1738 ms, sort 0 ms, write 0 ms, index 685 ms: 5 candidates, 79455 repo-hours, 708 releases; waiting 565 ms; commit 0 ms)
2026-11-08T14:48:19Z [load_day 2025-12-18] 2025-12-18 hour 18: 146922 events in 0 files, snapshot none (task 3848 ms: download 2313 ms overlapping gunzip 500 ms, parse 1559 ms, sort 0 ms, write 0 ms, index 793 ms: 3 candidates, 80762 repo-hours, 745 releases; waiting 667 ms; commit 0 ms)
2026-11-08T14:48:19Z [load_day 2025-12-18] 2025-12-18 hour 19: 144261 events in 0 files, snapshot none (task 3829 ms: download 2003 ms overlapping gunzip 568 ms, parse 1843 ms, sort 0 ms, write 0 ms, index 669 ms: 6 candidates, 68972 repo-hours, 679 releases; waiting 479 ms; commit 0 ms)
2026-11-08T14:48:23Z [load_day 2025-12-18] 2025-12-18 hour 20: 146135 events in 0 files, snapshot none (task 3736 ms: download 2507 ms overlapping gunzip 489 ms, parse 1406 ms, sort 0 ms, write 0 ms, index 796 ms: 8 candidates, 72499 repo-hours, 753 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:48:23Z [load_day 2025-12-18] 2025-12-18 hour 21: 150418 events in 0 files, snapshot none (task 3831 ms: download 2235 ms overlapping gunzip 520 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 887 ms: 6 candidates, 71432 repo-hours, 874 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:48:28Z [load_day 2025-12-18] 2025-12-18 hour 22: 142656 events in 0 files, snapshot none (task 3867 ms: download 2020 ms overlapping gunzip 482 ms, parse 1519 ms, sort 0 ms, write 0 ms, index 751 ms: 4 candidates, 66333 repo-hours, 836 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:48:28Z [load_day 2025-12-18] 2025-12-18 hour 23: 143578 events in 0 files, snapshot none (task 3865 ms: download 2509 ms overlapping gunzip 541 ms, parse 1591 ms, sort 0 ms, write 0 ms, index 634 ms: 3 candidates, 62739 repo-hours, 695 releases; waiting 749 ms; commit 0 ms)
2026-11-08T14:48:36Z [load_day 2025-12-18] 2025-12-18: repo_hour merged from 24 files to 1 (1849029 rows, 8567 ms)
2026-11-08T14:48:40Z [load_day 2025-12-18] 2025-12-18: index committed in 12479 ms (24 + 1 + 24 files)
2026-11-08T14:48:40Z [load_day 2025-12-18] 2025-12-18: 3547928 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:48:40Z [load_day 2025-12-18] attempt 1 succeeded