orcaLog in

Runs · run 3623

load_day 2025-03-02, attempt 1 succeeded

Host
73ccef5e07c2:263955
Started
2026-11-08T10:37:18Z
Ended
2026-11-08T10:38:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
736 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
142.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3623/load_day/2025-03-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:37:18Z [load_day 2025-03-02] attempt 1 started
2026-11-08T10:37:18Z [load_day 2025-03-02] 2025-03-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:37:26Z [load_day 2025-03-02] 2025-03-02 hour 0: 177546 events in 0 files, snapshot none (task 6605 ms: download 3436 ms overlapping gunzip 930 ms, parse 4297 ms, sort 0 ms, write 0 ms, index 719 ms: 13 candidates, 83526 repo-hours, 1206 releases; waiting 292 ms; commit 0 ms)
2026-11-08T10:37:26Z [load_day 2025-03-02] 2025-03-02 hour 1: 204432 events in 0 files, snapshot none (task 6575 ms: download 3686 ms overlapping gunzip 915 ms, parse 4173 ms, sort 0 ms, write 0 ms, index 834 ms: 5 candidates, 114020 repo-hours, 961 releases; waiting 232 ms; commit 0 ms)
2026-11-08T10:37:32Z [load_day 2025-03-02] 2025-03-02 hour 2: 164674 events in 0 files, snapshot none (task 5988 ms: download 3290 ms overlapping gunzip 785 ms, parse 3700 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 70597 repo-hours, 724 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:37:32Z [load_day 2025-03-02] 2025-03-02 hour 3: 190187 events in 0 files, snapshot none (task 6100 ms: download 3122 ms overlapping gunzip 834 ms, parse 3784 ms, sort 0 ms, write 0 ms, index 638 ms: 6 candidates, 72966 repo-hours, 3904 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:37:39Z [load_day 2025-03-02] 2025-03-02 hour 4: 174933 events in 0 files, snapshot none (task 5971 ms: download 2490 ms overlapping gunzip 792 ms, parse 3601 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 62761 repo-hours, 668 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:37:39Z [load_day 2025-03-02] 2025-03-02 hour 5: 188801 events in 0 files, snapshot none (task 6465 ms: download 3532 ms overlapping gunzip 1033 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 65574 repo-hours, 748 releases; waiting 307 ms; commit 0 ms)
2026-11-08T10:37:46Z [load_day 2025-03-02] 2025-03-02 hour 6: 206947 events in 0 files, snapshot none (task 6777 ms: download 3221 ms overlapping gunzip 929 ms, parse 4075 ms, sort 0 ms, write 0 ms, index 942 ms: 4 candidates, 84063 repo-hours, 902 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:37:46Z [load_day 2025-03-02] 2025-03-02 hour 7: 187558 events in 0 files, snapshot none (task 6395 ms: download 2976 ms overlapping gunzip 878 ms, parse 3973 ms, sort 0 ms, write 0 ms, index 785 ms: 5 candidates, 68287 repo-hours, 722 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:37:52Z [load_day 2025-03-02] 2025-03-02 hour 8: 195428 events in 0 files, snapshot none (task 5482 ms: download 2813 ms overlapping gunzip 793 ms, parse 3568 ms, sort 0 ms, write 0 ms, index 560 ms: 5 candidates, 74520 repo-hours, 763 releases; waiting 300 ms; commit 0 ms)
2026-11-08T10:37:53Z [load_day 2025-03-02] 2025-03-02 hour 9: 209274 events in 0 files, snapshot none (task 6185 ms: download 3523 ms overlapping gunzip 892 ms, parse 4054 ms, sort 0 ms, write 0 ms, index 655 ms: 5 candidates, 81615 repo-hours, 1757 releases; waiting 323 ms; commit 0 ms)
2026-11-08T10:37:59Z [load_day 2025-03-02] 2025-03-02 hour 10: 206102 events in 0 files, snapshot none (task 6391 ms: download 3677 ms overlapping gunzip 877 ms, parse 4069 ms, sort 0 ms, write 0 ms, index 614 ms: 9 candidates, 79542 repo-hours, 927 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:37:59Z [load_day 2025-03-02] 2025-03-02 hour 11: 202673 events in 0 files, snapshot none (task 5474 ms: download 2909 ms overlapping gunzip 813 ms, parse 3524 ms, sort 0 ms, write 0 ms, index 583 ms: 18 candidates, 76077 repo-hours, 884 releases; waiting 222 ms; commit 0 ms)
2026-11-08T10:38:06Z [load_day 2025-03-02] 2025-03-02 hour 12: 256601 events in 0 files, snapshot none (task 7003 ms: download 3432 ms overlapping gunzip 837 ms, parse 3770 ms, sort 0 ms, write 0 ms, index 1460 ms: 9 candidates, 126151 repo-hours, 1119 releases; waiting 631 ms; commit 0 ms)
2026-11-08T10:38:06Z [load_day 2025-03-02] 2025-03-02 hour 13: 236695 events in 0 files, snapshot none (task 5581 ms: download 2929 ms overlapping gunzip 798 ms, parse 3527 ms, sort 0 ms, write 0 ms, index 777 ms: 8 candidates, 106120 repo-hours, 877 releases; waiting 201 ms; commit 0 ms)
2026-11-08T10:38:14Z [load_day 2025-03-02] 2025-03-02 hour 14: 233477 events in 0 files, snapshot none (task 7473 ms: download 4216 ms overlapping gunzip 993 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 1094 ms: 8 candidates, 89668 repo-hours, 963 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:38:15Z [load_day 2025-03-02] 2025-03-02 hour 15: 235416 events in 0 files, snapshot none (task 7830 ms: download 4423 ms overlapping gunzip 1040 ms, parse 4755 ms, sort 0 ms, write 0 ms, index 1242 ms: 5 candidates, 96672 repo-hours, 1263 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:38:23Z [load_day 2025-03-02] 2025-03-02 hour 16: 223249 events in 0 files, snapshot none (task 7367 ms: download 4298 ms overlapping gunzip 1039 ms, parse 4481 ms, sort 0 ms, write 0 ms, index 732 ms: 7 candidates, 88755 repo-hours, 988 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:38:23Z [load_day 2025-03-02] 2025-03-02 hour 17: 221563 events in 0 files, snapshot none (task 7238 ms: download 4591 ms overlapping gunzip 1032 ms, parse 4696 ms, sort 0 ms, write 0 ms, index 715 ms: 11 candidates, 84584 repo-hours, 884 releases; waiting 469 ms; commit 0 ms)
2026-11-08T10:38:31Z [load_day 2025-03-02] 2025-03-02 hour 18: 230760 events in 0 files, snapshot none (task 7673 ms: download 5048 ms overlapping gunzip 1170 ms, parse 5086 ms, sort 0 ms, write 0 ms, index 720 ms: 9 candidates, 100236 repo-hours, 1144 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:38:31Z [load_day 2025-03-02] 2025-03-02 hour 19: 203819 events in 0 files, snapshot none (task 6987 ms: download 3975 ms overlapping gunzip 1053 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 596 ms: 8 candidates, 74954 repo-hours, 954 releases; waiting 415 ms; commit 0 ms)
2026-11-08T10:38:39Z [load_day 2025-03-02] 2025-03-02 hour 20: 206079 events in 0 files, snapshot none (task 7336 ms: download 4230 ms overlapping gunzip 1104 ms, parse 4654 ms, sort 0 ms, write 0 ms, index 692 ms: 10 candidates, 76226 repo-hours, 1027 releases; waiting 469 ms; commit 0 ms)
2026-11-08T10:38:39Z [load_day 2025-03-02] 2025-03-02 hour 21: 205033 events in 0 files, snapshot none (task 7336 ms: download 4183 ms overlapping gunzip 1107 ms, parse 4689 ms, sort 0 ms, write 0 ms, index 828 ms: 9 candidates, 77348 repo-hours, 1083 releases; waiting 412 ms; commit 0 ms)
2026-11-08T10:38:46Z [load_day 2025-03-02] 2025-03-02 hour 22: 184842 events in 0 files, snapshot none (task 6598 ms: download 3554 ms overlapping gunzip 937 ms, parse 4106 ms, sort 0 ms, write 0 ms, index 694 ms: 10 candidates, 69183 repo-hours, 1086 releases; waiting 557 ms; commit 0 ms)
2026-11-08T10:38:46Z [load_day 2025-03-02] 2025-03-02 hour 23: 171545 events in 0 files, snapshot none (task 5812 ms: download 2452 ms overlapping gunzip 802 ms, parse 3746 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 63673 repo-hours, 957 releases; waiting 260 ms; commit 0 ms)
2026-11-08T10:38:55Z [load_day 2025-03-02] 2025-03-02: repo_hour merged from 24 files to 1 (1987118 rows, 9054 ms)
2026-11-08T10:38:58Z [load_day 2025-03-02] 2025-03-02: index committed in 12047 ms (24 + 1 + 24 files)
2026-11-08T10:38:58Z [load_day 2025-03-02] 2025-03-02: 4917634 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:38:58Z [load_day 2025-03-02] attempt 1 succeeded