orcaLog in

Runs · run 4622

load_day 2025-11-16, attempt 1 succeeded

Host
73ccef5e07c2:405765
Started
2026-11-08T14:29:50Z
Ended
2026-11-08T14:30:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
637 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4622/load_day/2025-11-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:29:50Z [load_day 2025-11-16] attempt 1 started
2026-11-08T14:29:51Z [load_day 2025-11-16] 2025-11-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:29:55Z [load_day 2025-11-16] 2025-11-16 hour 0: 138767 events in 0 files, snapshot none (task 2816 ms: download 1671 ms overlapping gunzip 338 ms, parse 1070 ms, sort 0 ms, write 0 ms, index 519 ms: 6 candidates, 65784 repo-hours, 846 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:29:55Z [load_day 2025-11-16] 2025-11-16 hour 1: 145344 events in 0 files, snapshot none (task 2923 ms: download 1657 ms overlapping gunzip 303 ms, parse 1099 ms, sort 0 ms, write 0 ms, index 566 ms: 8 candidates, 83662 repo-hours, 592 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:30:01Z [load_day 2025-11-16] 2025-11-16 hour 2: 138878 events in 0 files, snapshot none (task 5487 ms: download 4228 ms overlapping gunzip 368 ms, parse 1209 ms, sort 0 ms, write 0 ms, index 516 ms: 5 candidates, 66733 repo-hours, 720 releases; waiting 3046 ms; commit 0 ms)
2026-11-08T14:30:01Z [load_day 2025-11-16] 2025-11-16 hour 3: 136485 events in 0 files, snapshot none (task 1861 ms: download 482 ms overlapping gunzip 287 ms, parse 912 ms, sort 0 ms, write 0 ms, index 425 ms: 2 candidates, 63548 repo-hours, 1683 releases; waiting 19 ms; commit 0 ms)
2026-11-08T14:30:04Z [load_day 2025-11-16] 2025-11-16 hour 4: 142376 events in 0 files, snapshot none (task 3388 ms: download 2396 ms overlapping gunzip 416 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 488 ms: 3 candidates, 61622 repo-hours, 543 releases; waiting 907 ms; commit 0 ms)
2026-11-08T14:30:04Z [load_day 2025-11-16] 2025-11-16 hour 5: 139824 events in 0 files, snapshot none (task 3139 ms: download 1854 ms overlapping gunzip 393 ms, parse 1301 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 58328 repo-hours, 511 releases; waiting 595 ms; commit 0 ms)
2026-11-08T14:30:08Z [load_day 2025-11-16] 2025-11-16 hour 6: 144523 events in 0 files, snapshot none (task 3207 ms: download 2038 ms overlapping gunzip 380 ms, parse 1156 ms, sort 0 ms, write 0 ms, index 645 ms: 4 candidates, 66261 repo-hours, 572 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:30:09Z [load_day 2025-11-16] 2025-11-16 hour 7: 142791 events in 0 files, snapshot none (task 3072 ms: download 1746 ms overlapping gunzip 373 ms, parse 1075 ms, sort 0 ms, write 0 ms, index 587 ms: 5 candidates, 61363 repo-hours, 395 releases; waiting 714 ms; commit 0 ms)
2026-11-08T14:30:12Z [load_day 2025-11-16] 2025-11-16 hour 8: 141435 events in 0 files, snapshot none (task 3431 ms: download 2127 ms overlapping gunzip 400 ms, parse 1303 ms, sort 0 ms, write 0 ms, index 560 ms: 2 candidates, 64689 repo-hours, 498 releases; waiting 856 ms; commit 0 ms)
2026-11-08T14:30:13Z [load_day 2025-11-16] 2025-11-16 hour 9: 143187 events in 0 files, snapshot none (task 3466 ms: download 2476 ms overlapping gunzip 387 ms, parse 1414 ms, sort 0 ms, write 0 ms, index 579 ms: 5 candidates, 63715 repo-hours, 635 releases; waiting 754 ms; commit 0 ms)
2026-11-08T14:30:17Z [load_day 2025-11-16] 2025-11-16 hour 10: 146203 events in 0 files, snapshot none (task 3661 ms: download 2211 ms overlapping gunzip 429 ms, parse 1477 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 64326 repo-hours, 534 releases; waiting 791 ms; commit 0 ms)
2026-11-08T14:30:17Z [load_day 2025-11-16] 2025-11-16 hour 11: 146981 events in 0 files, snapshot none (task 3566 ms: download 2083 ms overlapping gunzip 487 ms, parse 1586 ms, sort 0 ms, write 0 ms, index 479 ms: 6 candidates, 63845 repo-hours, 513 releases; waiting 696 ms; commit 0 ms)
2026-11-08T14:30:20Z [load_day 2025-11-16] 2025-11-16 hour 12: 159332 events in 0 files, snapshot none (task 3148 ms: download 1888 ms overlapping gunzip 335 ms, parse 1171 ms, sort 0 ms, write 0 ms, index 694 ms: 6 candidates, 92594 repo-hours, 532 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:30:21Z [load_day 2025-11-16] 2025-11-16 hour 13: 158809 events in 0 files, snapshot none (task 3144 ms: download 1873 ms overlapping gunzip 344 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 634 ms: 2 candidates, 84043 repo-hours, 424 releases; waiting 622 ms; commit 0 ms)
2026-11-08T14:30:24Z [load_day 2025-11-16] 2025-11-16 hour 14: 151988 events in 0 files, snapshot none (task 3449 ms: download 2202 ms overlapping gunzip 405 ms, parse 1261 ms, sort 0 ms, write 0 ms, index 600 ms: 4 candidates, 72603 repo-hours, 561 releases; waiting 874 ms; commit 0 ms)
2026-11-08T14:30:24Z [load_day 2025-11-16] 2025-11-16 hour 15: 152200 events in 0 files, snapshot none (task 3372 ms: download 2386 ms overlapping gunzip 378 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 563 ms: 6 candidates, 73008 repo-hours, 621 releases; waiting 873 ms; commit 0 ms)
2026-11-08T14:30:29Z [load_day 2025-11-16] 2025-11-16 hour 16: 149876 events in 0 files, snapshot none (task 4301 ms: download 2862 ms overlapping gunzip 491 ms, parse 1638 ms, sort 0 ms, write 0 ms, index 557 ms: 6 candidates, 72016 repo-hours, 588 releases; waiting 1318 ms; commit 0 ms)
2026-11-08T14:30:29Z [load_day 2025-11-16] 2025-11-16 hour 17: 150679 events in 0 files, snapshot none (task 3883 ms: download 2336 ms overlapping gunzip 493 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 575 ms: 4 candidates, 69642 repo-hours, 521 releases; waiting 769 ms; commit 0 ms)
2026-11-08T14:30:33Z [load_day 2025-11-16] 2025-11-16 hour 18: 150130 events in 0 files, snapshot none (task 3603 ms: download 2081 ms overlapping gunzip 481 ms, parse 1544 ms, sort 0 ms, write 0 ms, index 745 ms: 3 candidates, 74872 repo-hours, 579 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:30:34Z [load_day 2025-11-16] 2025-11-16 hour 19: 149925 events in 0 files, snapshot none (task 3909 ms: download 2810 ms overlapping gunzip 606 ms, parse 1872 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 64819 repo-hours, 562 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:30:38Z [load_day 2025-11-16] 2025-11-16 hour 20: 147675 events in 0 files, snapshot none (task 4130 ms: download 2624 ms overlapping gunzip 590 ms, parse 1917 ms, sort 0 ms, write 0 ms, index 518 ms: 3 candidates, 65925 repo-hours, 593 releases; waiting 639 ms; commit 0 ms)
2026-11-08T14:30:38Z [load_day 2025-11-16] 2025-11-16 hour 21: 145778 events in 0 files, snapshot none (task 4031 ms: download 2562 ms overlapping gunzip 616 ms, parse 1928 ms, sort 0 ms, write 0 ms, index 538 ms: 13 candidates, 63705 repo-hours, 619 releases; waiting 578 ms; commit 0 ms)
2026-11-08T14:30:43Z [load_day 2025-11-16] 2025-11-16 hour 22: 145031 events in 0 files, snapshot none (task 4114 ms: download 2676 ms overlapping gunzip 643 ms, parse 1946 ms, sort 0 ms, write 0 ms, index 508 ms: 5 candidates, 63903 repo-hours, 643 releases; waiting 748 ms; commit 0 ms)
2026-11-08T14:30:43Z [load_day 2025-11-16] 2025-11-16 hour 23: 143235 events in 0 files, snapshot none (task 3984 ms: download 2474 ms overlapping gunzip 547 ms, parse 1877 ms, sort 0 ms, write 0 ms, index 676 ms: 11 candidates, 62576 repo-hours, 546 releases; waiting 613 ms; commit 0 ms)
2026-11-08T14:30:51Z [load_day 2025-11-16] 2025-11-16: repo_hour merged from 24 files to 1 (1643582 rows, 7884 ms)
2026-11-08T14:30:53Z [load_day 2025-11-16] 2025-11-16: index committed in 10825 ms (24 + 1 + 24 files)
2026-11-08T14:30:53Z [load_day 2025-11-16] 2025-11-16: 3511452 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:30:53Z [load_day 2025-11-16] attempt 1 succeeded