orcaLog in

Runs · run 4636

load_day 2025-11-20, attempt 1 succeeded

Host
73ccef5e07c2:407055
Started
2026-11-08T14:31:59Z
Ended
2026-11-08T14:33:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
775 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.8 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4636/load_day/2025-11-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:31:59Z [load_day 2025-11-20] attempt 1 started
2026-11-08T14:32:00Z [load_day 2025-11-20] 2025-11-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:32:04Z [load_day 2025-11-20] 2025-11-20 hour 0: 154658 events in 0 files, snapshot none (task 2922 ms: download 1743 ms overlapping gunzip 429 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 545 ms: 4 candidates, 70751 repo-hours, 621 releases; waiting 420 ms; commit 0 ms)
2026-11-08T14:32:05Z [load_day 2025-11-20] 2025-11-20 hour 1: 165411 events in 0 files, snapshot none (task 3681 ms: download 1691 ms overlapping gunzip 349 ms, parse 1201 ms, sort 0 ms, write 0 ms, index 1140 ms: 10 candidates, 90393 repo-hours, 361 releases; waiting 703 ms; commit 0 ms)
2026-11-08T14:32:11Z [load_day 2025-11-20] 2025-11-20 hour 2: 153832 events in 0 files, snapshot none (task 3301 ms: download 2343 ms overlapping gunzip 403 ms, parse 1352 ms, sort 0 ms, write 0 ms, index 521 ms: 8 candidates, 72541 repo-hours, 540 releases; waiting 714 ms; commit 0 ms)
2026-11-08T14:32:11Z [load_day 2025-11-20] 2025-11-20 hour 3: 148203 events in 0 files, snapshot none (task 3336 ms: download 2224 ms overlapping gunzip 414 ms, parse 1348 ms, sort 0 ms, write 0 ms, index 526 ms: 6 candidates, 71219 repo-hours, 1616 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:32:15Z [load_day 2025-11-20] 2025-11-20 hour 4: 147003 events in 0 files, snapshot none (task 3723 ms: download 2293 ms overlapping gunzip 495 ms, parse 1615 ms, sort 0 ms, write 0 ms, index 692 ms: 2 candidates, 68961 repo-hours, 534 releases; waiting 636 ms; commit 0 ms)
2026-11-08T14:32:16Z [load_day 2025-11-20] 2025-11-20 hour 5: 144595 events in 0 files, snapshot none (task 4174 ms: download 2292 ms overlapping gunzip 535 ms, parse 1679 ms, sort 0 ms, write 0 ms, index 706 ms: 7 candidates, 69495 repo-hours, 554 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:32:19Z [load_day 2025-11-20] 2025-11-20 hour 6: 151610 events in 0 files, snapshot none (task 3840 ms: download 2417 ms overlapping gunzip 510 ms, parse 1706 ms, sort 0 ms, write 0 ms, index 650 ms: 2 candidates, 77266 repo-hours, 606 releases; waiting 609 ms; commit 0 ms)
2026-11-08T14:32:20Z [load_day 2025-11-20] 2025-11-20 hour 7: 147476 events in 0 files, snapshot none (task 3514 ms: download 1999 ms overlapping gunzip 581 ms, parse 1722 ms, sort 0 ms, write 0 ms, index 560 ms: 7 candidates, 73115 repo-hours, 585 releases; waiting 275 ms; commit 0 ms)
2026-11-08T14:32:24Z [load_day 2025-11-20] 2025-11-20 hour 8: 146029 events in 0 files, snapshot none (task 4504 ms: download 2873 ms overlapping gunzip 620 ms, parse 1845 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 76588 repo-hours, 573 releases; waiting 1070 ms; commit 0 ms)
2026-11-08T14:32:24Z [load_day 2025-11-20] 2025-11-20 hour 9: 147839 events in 0 files, snapshot none (task 3831 ms: download 2333 ms overlapping gunzip 548 ms, parse 1574 ms, sort 0 ms, write 0 ms, index 775 ms: 4 candidates, 78263 repo-hours, 605 releases; waiting 567 ms; commit 0 ms)
2026-11-08T14:32:29Z [load_day 2025-11-20] 2025-11-20 hour 10: 147590 events in 0 files, snapshot none (task 3466 ms: download 2255 ms overlapping gunzip 458 ms, parse 1425 ms, sort 0 ms, write 0 ms, index 619 ms: 4 candidates, 76772 repo-hours, 632 releases; waiting 543 ms; commit 0 ms)
2026-11-08T14:32:29Z [load_day 2025-11-20] 2025-11-20 hour 11: 149166 events in 0 files, snapshot none (task 3621 ms: download 2334 ms overlapping gunzip 458 ms, parse 1558 ms, sort 0 ms, write 0 ms, index 617 ms: 2 candidates, 70553 repo-hours, 528 releases; waiting 712 ms; commit 0 ms)
2026-11-08T14:32:33Z [load_day 2025-11-20] 2025-11-20 hour 12: 161714 events in 0 files, snapshot none (task 3636 ms: download 1935 ms overlapping gunzip 455 ms, parse 1491 ms, sort 0 ms, write 0 ms, index 809 ms: 5 candidates, 94994 repo-hours, 332 releases; waiting 569 ms; commit 0 ms)
2026-11-08T14:32:33Z [load_day 2025-11-20] 2025-11-20 hour 13: 162197 events in 0 files, snapshot none (task 3733 ms: download 2309 ms overlapping gunzip 491 ms, parse 1563 ms, sort 0 ms, write 0 ms, index 774 ms: 3 candidates, 90561 repo-hours, 309 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:32:37Z [load_day 2025-11-20] 2025-11-20 hour 14: 153312 events in 0 files, snapshot none (task 3713 ms: download 2128 ms overlapping gunzip 513 ms, parse 1672 ms, sort 0 ms, write 0 ms, index 634 ms: 7 candidates, 76373 repo-hours, 409 releases; waiting 583 ms; commit 0 ms)
2026-11-08T14:32:37Z [load_day 2025-11-20] 2025-11-20 hour 15: 154655 events in 0 files, snapshot none (task 3891 ms: download 1854 ms overlapping gunzip 551 ms, parse 1805 ms, sort 0 ms, write 0 ms, index 591 ms: 7 candidates, 79168 repo-hours, 458 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:32:42Z [load_day 2025-11-20] 2025-11-20 hour 16: 157959 events in 0 files, snapshot none (task 4032 ms: download 2890 ms overlapping gunzip 451 ms, parse 1378 ms, sort 0 ms, write 0 ms, index 706 ms: 12 candidates, 82970 repo-hours, 317 releases; waiting 1246 ms; commit 0 ms)
2026-11-08T14:32:42Z [load_day 2025-11-20] 2025-11-20 hour 17: 153917 events in 0 files, snapshot none (task 3125 ms: download 1822 ms overlapping gunzip 379 ms, parse 1297 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 81407 repo-hours, 339 releases; waiting 465 ms; commit 0 ms)
2026-11-08T14:32:46Z [load_day 2025-11-20] 2025-11-20 hour 18: 156962 events in 0 files, snapshot none (task 4155 ms: download 1849 ms overlapping gunzip 655 ms, parse 1959 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 85869 repo-hours, 456 releases; waiting 544 ms; commit 0 ms)
2026-11-08T14:32:46Z [load_day 2025-11-20] 2025-11-20 hour 19: 152988 events in 0 files, snapshot none (task 3988 ms: download 2115 ms overlapping gunzip 577 ms, parse 1759 ms, sort 0 ms, write 0 ms, index 707 ms: 9 candidates, 73324 repo-hours, 559 releases; waiting 296 ms; commit 0 ms)
2026-11-08T14:32:51Z [load_day 2025-11-20] 2025-11-20 hour 20: 152298 events in 0 files, snapshot none (task 3916 ms: download 2427 ms overlapping gunzip 582 ms, parse 1803 ms, sort 0 ms, write 0 ms, index 593 ms: 6 candidates, 73537 repo-hours, 639 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:32:51Z [load_day 2025-11-20] 2025-11-20 hour 21: 152452 events in 0 files, snapshot none (task 3699 ms: download 2548 ms overlapping gunzip 518 ms, parse 1699 ms, sort 0 ms, write 0 ms, index 595 ms: 10 candidates, 71247 repo-hours, 680 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:32:55Z [load_day 2025-11-20] 2025-11-20 hour 22: 146439 events in 0 files, snapshot none (task 3929 ms: download 2688 ms overlapping gunzip 522 ms, parse 1657 ms, sort 0 ms, write 0 ms, index 567 ms: 3 candidates, 67109 repo-hours, 775 releases; waiting 843 ms; commit 0 ms)
2026-11-08T14:32:55Z [load_day 2025-11-20] 2025-11-20 hour 23: 142571 events in 0 files, snapshot none (task 3699 ms: download 2556 ms overlapping gunzip 536 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 517 ms: 7 candidates, 65138 repo-hours, 699 releases; waiting 719 ms; commit 0 ms)
2026-11-08T14:33:03Z [load_day 2025-11-20] 2025-11-20: repo_hour merged from 24 files to 1 (1837614 rows, 8439 ms)
2026-11-08T14:33:06Z [load_day 2025-11-20] 2025-11-20: index committed in 11221 ms (24 + 1 + 24 files)
2026-11-08T14:33:06Z [load_day 2025-11-20] 2025-11-20: 3650876 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:33:06Z [load_day 2025-11-20] attempt 1 succeeded