orcaLog in

Runs · run 4747

load_day 2025-12-23, attempt 1 succeeded

Host
73ccef5e07c2:420722
Started
2026-11-08T14:50:02Z
Ended
2026-11-08T14:51:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
684 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.6 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4747/load_day/2025-12-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:50:02Z [load_day 2025-12-23] attempt 1 started
2026-11-08T14:50:03Z [load_day 2025-12-23] 2025-12-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:50:08Z [load_day 2025-12-23] 2025-12-23 hour 0: 143809 events in 0 files, snapshot none (task 3678 ms: download 2538 ms overlapping gunzip 493 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 73917 repo-hours, 977 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:50:08Z [load_day 2025-12-23] 2025-12-23 hour 1: 147683 events in 0 files, snapshot none (task 3645 ms: download 2247 ms overlapping gunzip 382 ms, parse 1290 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 89540 repo-hours, 683 releases; waiting 929 ms; commit 0 ms)
2026-11-08T14:50:12Z [load_day 2025-12-23] 2025-12-23 hour 2: 142971 events in 0 files, snapshot none (task 3830 ms: download 2563 ms overlapping gunzip 562 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 598 ms: 5 candidates, 77765 repo-hours, 666 releases; waiting 696 ms; commit 0 ms)
2026-11-08T14:50:12Z [load_day 2025-12-23] 2025-12-23 hour 3: 145407 events in 0 files, snapshot none (task 3534 ms: download 2304 ms overlapping gunzip 473 ms, parse 1565 ms, sort 0 ms, write 0 ms, index 545 ms: 10 candidates, 71636 repo-hours, 808 releases; waiting 614 ms; commit 0 ms)
2026-11-08T14:50:16Z [load_day 2025-12-23] 2025-12-23 hour 4: 143233 events in 0 files, snapshot none (task 3018 ms: download 1700 ms overlapping gunzip 421 ms, parse 1359 ms, sort 0 ms, write 0 ms, index 629 ms: 4 candidates, 70674 repo-hours, 1507 releases; waiting 28 ms; commit 0 ms)
2026-11-08T14:50:16Z [load_day 2025-12-23] 2025-12-23 hour 5: 140133 events in 0 files, snapshot none (task 3452 ms: download 2068 ms overlapping gunzip 537 ms, parse 1657 ms, sort 0 ms, write 0 ms, index 566 ms: 3 candidates, 66876 repo-hours, 695 releases; waiting 375 ms; commit 0 ms)
2026-11-08T14:50:21Z [load_day 2025-12-23] 2025-12-23 hour 6: 148013 events in 0 files, snapshot none (task 4195 ms: download 2691 ms overlapping gunzip 556 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 645 ms: 3 candidates, 77191 repo-hours, 824 releases; waiting 877 ms; commit 0 ms)
2026-11-08T14:50:21Z [load_day 2025-12-23] 2025-12-23 hour 7: 149483 events in 0 files, snapshot none (task 3673 ms: download 2055 ms overlapping gunzip 537 ms, parse 1668 ms, sort 0 ms, write 0 ms, index 619 ms: 5 candidates, 74249 repo-hours, 733 releases; waiting 564 ms; commit 0 ms)
2026-11-08T14:50:25Z [load_day 2025-12-23] 2025-12-23 hour 8: 149981 events in 0 files, snapshot none (task 4356 ms: download 2875 ms overlapping gunzip 624 ms, parse 1731 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 76858 repo-hours, 743 releases; waiting 1098 ms; commit 0 ms)
2026-11-08T14:50:25Z [load_day 2025-12-23] 2025-12-23 hour 9: 150107 events in 0 files, snapshot none (task 4120 ms: download 2585 ms overlapping gunzip 549 ms, parse 1532 ms, sort 0 ms, write 0 ms, index 809 ms: 7 candidates, 77528 repo-hours, 707 releases; waiting 900 ms; commit 0 ms)
2026-11-08T14:50:30Z [load_day 2025-12-23] 2025-12-23 hour 10: 146152 events in 0 files, snapshot none (task 4134 ms: download 3085 ms overlapping gunzip 645 ms, parse 1761 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 73714 repo-hours, 752 releases; waiting 795 ms; commit 0 ms)
2026-11-08T14:50:30Z [load_day 2025-12-23] 2025-12-23 hour 11: 148801 events in 0 files, snapshot none (task 4028 ms: download 2342 ms overlapping gunzip 514 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 835 ms: 6 candidates, 75356 repo-hours, 709 releases; waiting 889 ms; commit 0 ms)
2026-11-08T14:50:35Z [load_day 2025-12-23] 2025-12-23 hour 12: 156752 events in 0 files, snapshot none (task 4018 ms: download 2178 ms overlapping gunzip 514 ms, parse 1612 ms, sort 0 ms, write 0 ms, index 689 ms: 3 candidates, 96438 repo-hours, 599 releases; waiting 554 ms; commit 0 ms)
2026-11-08T14:50:35Z [load_day 2025-12-23] 2025-12-23 hour 13: 153809 events in 0 files, snapshot none (task 3830 ms: download 2477 ms overlapping gunzip 569 ms, parse 1621 ms, sort 0 ms, write 0 ms, index 722 ms: 6 candidates, 88588 repo-hours, 590 releases; waiting 621 ms; commit 0 ms)
2026-11-08T14:50:39Z [load_day 2025-12-23] 2025-12-23 hour 14: 148979 events in 0 files, snapshot none (task 3564 ms: download 2227 ms overlapping gunzip 571 ms, parse 1587 ms, sort 0 ms, write 0 ms, index 601 ms: 2 candidates, 76684 repo-hours, 736 releases; waiting 476 ms; commit 0 ms)
2026-11-08T14:50:39Z [load_day 2025-12-23] 2025-12-23 hour 15: 149816 events in 0 files, snapshot none (task 3847 ms: download 2164 ms overlapping gunzip 600 ms, parse 1751 ms, sort 0 ms, write 0 ms, index 552 ms: 4 candidates, 76033 repo-hours, 854 releases; waiting 343 ms; commit 0 ms)
2026-11-08T14:50:43Z [load_day 2025-12-23] 2025-12-23 hour 16: 147065 events in 0 files, snapshot none (task 3364 ms: download 2102 ms overlapping gunzip 407 ms, parse 1216 ms, sort 0 ms, write 0 ms, index 722 ms: 5 candidates, 76792 repo-hours, 781 releases; waiting 680 ms; commit 0 ms)
2026-11-08T14:50:43Z [load_day 2025-12-23] 2025-12-23 hour 17: 149301 events in 0 files, snapshot none (task 3398 ms: download 2085 ms overlapping gunzip 394 ms, parse 1213 ms, sort 0 ms, write 0 ms, index 628 ms: 7 candidates, 74332 repo-hours, 652 releases; waiting 861 ms; commit 0 ms)
2026-11-08T14:50:47Z [load_day 2025-12-23] 2025-12-23 hour 18: 147370 events in 0 files, snapshot none (task 3408 ms: download 2291 ms overlapping gunzip 398 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 77490 repo-hours, 783 releases; waiting 745 ms; commit 0 ms)
2026-11-08T14:50:47Z [load_day 2025-12-23] 2025-12-23 hour 19: 145084 events in 0 files, snapshot none (task 2686 ms: download 1469 ms overlapping gunzip 392 ms, parse 1171 ms, sort 0 ms, write 0 ms, index 647 ms: 4 candidates, 66533 repo-hours, 649 releases; waiting 246 ms; commit 0 ms)
2026-11-08T14:50:51Z [load_day 2025-12-23] 2025-12-23 hour 20: 146417 events in 0 files, snapshot none (task 3373 ms: download 2296 ms overlapping gunzip 425 ms, parse 1240 ms, sort 0 ms, write 0 ms, index 525 ms: 7 candidates, 67002 repo-hours, 751 releases; waiting 910 ms; commit 0 ms)
2026-11-08T14:50:51Z [load_day 2025-12-23] 2025-12-23 hour 21: 145857 events in 0 files, snapshot none (task 2931 ms: download 1886 ms overlapping gunzip 366 ms, parse 1116 ms, sort 0 ms, write 0 ms, index 580 ms: 3 candidates, 65697 repo-hours, 696 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:50:55Z [load_day 2025-12-23] 2025-12-23 hour 22: 144896 events in 0 files, snapshot none (task 3459 ms: download 2297 ms overlapping gunzip 403 ms, parse 1284 ms, sort 0 ms, write 0 ms, index 513 ms: 6 candidates, 64172 repo-hours, 820 releases; waiting 835 ms; commit 0 ms)
2026-11-08T14:50:55Z [load_day 2025-12-23] 2025-12-23 hour 23: 143651 events in 0 files, snapshot none (task 2792 ms: download 1832 ms overlapping gunzip 341 ms, parse 1132 ms, sort 0 ms, write 0 ms, index 483 ms: 3 candidates, 63762 repo-hours, 748 releases; waiting 555 ms; commit 0 ms)
2026-11-08T14:51:03Z [load_day 2025-12-23] 2025-12-23: repo_hour merged from 24 files to 1 (1798827 rows, 8191 ms)
2026-11-08T14:51:06Z [load_day 2025-12-23] 2025-12-23: index committed in 11325 ms (24 + 1 + 24 files)
2026-11-08T14:51:06Z [load_day 2025-12-23] 2025-12-23: 3534770 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:51:06Z [load_day 2025-12-23] attempt 1 succeeded