orcaLog in

Runs · run 4744

load_day 2025-12-22, attempt 1 succeeded

Host
73ccef5e07c2:420452
Started
2026-11-08T14:49:44Z
Ended
2026-11-08T14:50:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
695 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
77.7 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4744/load_day/2025-12-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:49:44Z [load_day 2025-12-22] attempt 1 started
2026-11-08T14:49:45Z [load_day 2025-12-22] 2025-12-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:49:50Z [load_day 2025-12-22] 2025-12-22 hour 0: 139389 events in 0 files, snapshot none (task 4005 ms: download 2272 ms overlapping gunzip 526 ms, parse 1600 ms, sort 0 ms, write 0 ms, index 748 ms: 7 candidates, 68700 repo-hours, 860 releases; waiting 827 ms; commit 0 ms)
2026-11-08T14:49:50Z [load_day 2025-12-22] 2025-12-22 hour 1: 149478 events in 0 files, snapshot none (task 4270 ms: download 2636 ms overlapping gunzip 476 ms, parse 1562 ms, sort 0 ms, write 0 ms, index 802 ms: 6 candidates, 88136 repo-hours, 654 releases; waiting 1125 ms; commit 0 ms)
2026-11-08T14:49:53Z [load_day 2025-12-22] 2025-12-22 hour 2: 145298 events in 0 files, snapshot none (task 3288 ms: download 2060 ms overlapping gunzip 406 ms, parse 1288 ms, sort 0 ms, write 0 ms, index 550 ms: 7 candidates, 74073 repo-hours, 659 releases; waiting 778 ms; commit 0 ms)
2026-11-08T14:49:53Z [load_day 2025-12-22] 2025-12-22 hour 3: 145187 events in 0 files, snapshot none (task 3089 ms: download 2058 ms overlapping gunzip 391 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 68078 repo-hours, 708 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:49:57Z [load_day 2025-12-22] 2025-12-22 hour 4: 145188 events in 0 files, snapshot none (task 3620 ms: download 2315 ms overlapping gunzip 467 ms, parse 1416 ms, sort 0 ms, write 0 ms, index 636 ms: 3 candidates, 69349 repo-hours, 1424 releases; waiting 774 ms; commit 0 ms)
2026-11-08T14:49:57Z [load_day 2025-12-22] 2025-12-22 hour 5: 141889 events in 0 files, snapshot none (task 3498 ms: download 2228 ms overlapping gunzip 486 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 541 ms: 8 candidates, 66973 repo-hours, 559 releases; waiting 747 ms; commit 0 ms)
2026-11-08T14:50:01Z [load_day 2025-12-22] 2025-12-22 hour 6: 148739 events in 0 files, snapshot none (task 3513 ms: download 2334 ms overlapping gunzip 432 ms, parse 1345 ms, sort 0 ms, write 0 ms, index 606 ms: 4 candidates, 75418 repo-hours, 618 releases; waiting 818 ms; commit 0 ms)
2026-11-08T14:50:01Z [load_day 2025-12-22] 2025-12-22 hour 7: 145982 events in 0 files, snapshot none (task 2975 ms: download 1628 ms overlapping gunzip 383 ms, parse 1181 ms, sort 0 ms, write 0 ms, index 639 ms: 8 candidates, 69848 repo-hours, 657 releases; waiting 268 ms; commit 0 ms)
2026-11-08T14:50:07Z [load_day 2025-12-22] 2025-12-22 hour 8: 142947 events in 0 files, snapshot none (task 5240 ms: download 3188 ms overlapping gunzip 668 ms, parse 1689 ms, sort 0 ms, write 0 ms, index 829 ms: 2 candidates, 72707 repo-hours, 655 releases; waiting 1675 ms; commit 0 ms)
2026-11-08T14:50:07Z [load_day 2025-12-22] 2025-12-22 hour 9: 151175 events in 0 files, snapshot none (task 5501 ms: download 3323 ms overlapping gunzip 704 ms, parse 2136 ms, sort 0 ms, write 0 ms, index 786 ms: 3 candidates, 76190 repo-hours, 721 releases; waiting 1560 ms; commit 0 ms)
2026-11-08T14:50:12Z [load_day 2025-12-22] 2025-12-22 hour 10: 153414 events in 0 files, snapshot none (task 4222 ms: download 2583 ms overlapping gunzip 570 ms, parse 1768 ms, sort 0 ms, write 0 ms, index 709 ms: 1 candidates, 78693 repo-hours, 714 releases; waiting 791 ms; commit 0 ms)
2026-11-08T14:50:12Z [load_day 2025-12-22] 2025-12-22 hour 11: 150594 events in 0 files, snapshot none (task 3921 ms: download 2264 ms overlapping gunzip 553 ms, parse 1676 ms, sort 0 ms, write 0 ms, index 741 ms: 2 candidates, 70618 repo-hours, 755 releases; waiting 565 ms; commit 0 ms)
2026-11-08T14:50:16Z [load_day 2025-12-22] 2025-12-22 hour 12: 155461 events in 0 files, snapshot none (task 3525 ms: download 1577 ms overlapping gunzip 489 ms, parse 1692 ms, sort 0 ms, write 0 ms, index 861 ms: 5 candidates, 94378 repo-hours, 528 releases; waiting 243 ms; commit 0 ms)
2026-11-08T14:50:16Z [load_day 2025-12-22] 2025-12-22 hour 13: 152275 events in 0 files, snapshot none (task 3870 ms: download 2163 ms overlapping gunzip 526 ms, parse 1770 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 88280 repo-hours, 503 releases; waiting 513 ms; commit 0 ms)
2026-11-08T14:50:21Z [load_day 2025-12-22] 2025-12-22 hour 14: 151536 events in 0 files, snapshot none (task 4348 ms: download 2608 ms overlapping gunzip 579 ms, parse 1722 ms, sort 0 ms, write 0 ms, index 642 ms: 9 candidates, 78442 repo-hours, 661 releases; waiting 1051 ms; commit 0 ms)
2026-11-08T14:50:21Z [load_day 2025-12-22] 2025-12-22 hour 15: 151038 events in 0 files, snapshot none (task 3842 ms: download 2334 ms overlapping gunzip 577 ms, parse 1786 ms, sort 0 ms, write 0 ms, index 626 ms: 6 candidates, 79392 repo-hours, 625 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:50:25Z [load_day 2025-12-22] 2025-12-22 hour 16: 151701 events in 0 files, snapshot none (task 3896 ms: download 2550 ms overlapping gunzip 571 ms, parse 1682 ms, sort 0 ms, write 0 ms, index 665 ms: 6 candidates, 76032 repo-hours, 789 releases; waiting 652 ms; commit 0 ms)
2026-11-08T14:50:25Z [load_day 2025-12-22] 2025-12-22 hour 17: 149134 events in 0 files, snapshot none (task 3952 ms: download 2409 ms overlapping gunzip 629 ms, parse 1824 ms, sort 0 ms, write 0 ms, index 668 ms: 3 candidates, 76753 repo-hours, 716 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:50:30Z [load_day 2025-12-22] 2025-12-22 hour 18: 148058 events in 0 files, snapshot none (task 4292 ms: download 2536 ms overlapping gunzip 574 ms, parse 1762 ms, sort 0 ms, write 0 ms, index 804 ms: 3 candidates, 79416 repo-hours, 740 releases; waiting 844 ms; commit 0 ms)
2026-11-08T14:50:30Z [load_day 2025-12-22] 2025-12-22 hour 19: 148512 events in 0 files, snapshot none (task 4432 ms: download 2996 ms overlapping gunzip 500 ms, parse 1534 ms, sort 0 ms, write 0 ms, index 632 ms: 6 candidates, 69719 repo-hours, 701 releases; waiting 1468 ms; commit 0 ms)
2026-11-08T14:50:35Z [load_day 2025-12-22] 2025-12-22 hour 20: 147060 events in 0 files, snapshot none (task 4181 ms: download 2743 ms overlapping gunzip 491 ms, parse 1522 ms, sort 0 ms, write 0 ms, index 586 ms: 4 candidates, 69710 repo-hours, 678 releases; waiting 1185 ms; commit 0 ms)
2026-11-08T14:50:35Z [load_day 2025-12-22] 2025-12-22 hour 21: 145427 events in 0 files, snapshot none (task 3640 ms: download 2459 ms overlapping gunzip 506 ms, parse 1668 ms, sort 0 ms, write 0 ms, index 510 ms: 2 candidates, 64535 repo-hours, 724 releases; waiting 673 ms; commit 0 ms)
2026-11-08T14:50:39Z [load_day 2025-12-22] 2025-12-22 hour 22: 144315 events in 0 files, snapshot none (task 3675 ms: download 2400 ms overlapping gunzip 577 ms, parse 1651 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 63714 repo-hours, 680 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:50:40Z [load_day 2025-12-22] 2025-12-22 hour 23: 143388 events in 0 files, snapshot none (task 5266 ms: download 4219 ms overlapping gunzip 626 ms, parse 2061 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 63030 repo-hours, 749 releases; waiting 1690 ms; commit 0 ms)
2026-11-08T14:50:48Z [load_day 2025-12-22] 2025-12-22: repo_hour merged from 24 files to 1 (1782184 rows, 8101 ms)
2026-11-08T14:50:51Z [load_day 2025-12-22] 2025-12-22: index committed in 10807 ms (24 + 1 + 24 files)
2026-11-08T14:50:51Z [load_day 2025-12-22] 2025-12-22: 3547185 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:50:51Z [load_day 2025-12-22] attempt 1 succeeded