orcaLog in

Runs · run 4801

load_day 2026-01-08, attempt 1 succeeded

Host
73ccef5e07c2:426790
Started
2026-11-08T14:58:25Z
Ended
2026-11-08T14:59:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
768 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.7 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4801/load_day/2026-01-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:58:25Z [load_day 2026-01-08] attempt 1 started
2026-11-08T14:58:26Z [load_day 2026-01-08] 2026-01-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:58:30Z [load_day 2026-01-08] 2026-01-08 hour 0: 147730 events in 0 files, snapshot none (task 3924 ms: download 2813 ms overlapping gunzip 584 ms, parse 1846 ms, sort 0 ms, write 0 ms, index 713 ms: 6 candidates, 76301 repo-hours, 1069 releases; waiting 517 ms; commit 0 ms)
2026-11-08T14:58:30Z [load_day 2026-01-08] 2026-01-08 hour 1: 148752 events in 0 files, snapshot none (task 3759 ms: download 2285 ms overlapping gunzip 559 ms, parse 1749 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 87160 repo-hours, 843 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:58:35Z [load_day 2026-01-08] 2026-01-08 hour 2: 147072 events in 0 files, snapshot none (task 3810 ms: download 2185 ms overlapping gunzip 503 ms, parse 1707 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 81755 repo-hours, 740 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:58:35Z [load_day 2026-01-08] 2026-01-08 hour 3: 144682 events in 0 files, snapshot none (task 3612 ms: download 2353 ms overlapping gunzip 586 ms, parse 1671 ms, sort 0 ms, write 0 ms, index 648 ms: 6 candidates, 69983 repo-hours, 788 releases; waiting 420 ms; commit 0 ms)
2026-11-08T14:58:39Z [load_day 2026-01-08] 2026-01-08 hour 4: 143986 events in 0 files, snapshot none (task 4089 ms: download 2662 ms overlapping gunzip 608 ms, parse 1817 ms, sort 0 ms, write 0 ms, index 720 ms: 7 candidates, 70971 repo-hours, 1496 releases; waiting 662 ms; commit 0 ms)
2026-11-08T14:58:39Z [load_day 2026-01-08] 2026-01-08 hour 5: 147370 events in 0 files, snapshot none (task 4113 ms: download 2482 ms overlapping gunzip 601 ms, parse 1811 ms, sort 0 ms, write 0 ms, index 665 ms: 3 candidates, 72530 repo-hours, 663 releases; waiting 648 ms; commit 0 ms)
2026-11-08T14:58:44Z [load_day 2026-01-08] 2026-01-08 hour 6: 144140 events in 0 files, snapshot none (task 4426 ms: download 2569 ms overlapping gunzip 696 ms, parse 2190 ms, sort 0 ms, write 0 ms, index 615 ms: 4 candidates, 73738 repo-hours, 588 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:58:44Z [load_day 2026-01-08] 2026-01-08 hour 7: 147509 events in 0 files, snapshot none (task 4125 ms: download 2084 ms overlapping gunzip 662 ms, parse 1908 ms, sort 0 ms, write 0 ms, index 715 ms: 7 candidates, 76489 repo-hours, 683 releases; waiting 513 ms; commit 0 ms)
2026-11-08T14:58:49Z [load_day 2026-01-08] 2026-01-08 hour 8: 142316 events in 0 files, snapshot none (task 4137 ms: download 2433 ms overlapping gunzip 626 ms, parse 1864 ms, sort 0 ms, write 0 ms, index 802 ms: 9 candidates, 76233 repo-hours, 754 releases; waiting 410 ms; commit 0 ms)
2026-11-08T14:58:49Z [load_day 2026-01-08] 2026-01-08 hour 9: 146935 events in 0 files, snapshot none (task 4481 ms: download 2358 ms overlapping gunzip 843 ms, parse 2225 ms, sort 0 ms, write 0 ms, index 736 ms: 6 candidates, 79350 repo-hours, 730 releases; waiting 400 ms; commit 0 ms)
2026-11-08T14:58:53Z [load_day 2026-01-08] 2026-01-08 hour 10: 150299 events in 0 files, snapshot none (task 4284 ms: download 2553 ms overlapping gunzip 653 ms, parse 1844 ms, sort 0 ms, write 0 ms, index 994 ms: 4 candidates, 80593 repo-hours, 725 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:58:54Z [load_day 2026-01-08] 2026-01-08 hour 11: 147505 events in 0 files, snapshot none (task 4315 ms: download 2511 ms overlapping gunzip 672 ms, parse 2189 ms, sort 0 ms, write 0 ms, index 739 ms: 5 candidates, 75429 repo-hours, 707 releases; waiting 378 ms; commit 0 ms)
2026-11-08T14:58:59Z [load_day 2026-01-08] 2026-01-08 hour 12: 157150 events in 0 files, snapshot none (task 4929 ms: download 1940 ms overlapping gunzip 676 ms, parse 2171 ms, sort 0 ms, write 0 ms, index 1332 ms: 5 candidates, 98854 repo-hours, 496 releases; waiting 420 ms; commit 0 ms)
2026-11-08T14:58:59Z [load_day 2026-01-08] 2026-01-08 hour 13: 155043 events in 0 files, snapshot none (task 4725 ms: download 2787 ms overlapping gunzip 641 ms, parse 2027 ms, sort 0 ms, write 0 ms, index 1203 ms: 9 candidates, 93823 repo-hours, 440 releases; waiting 504 ms; commit 0 ms)
2026-11-08T14:59:04Z [load_day 2026-01-08] 2026-01-08 hour 14: 146155 events in 0 files, snapshot none (task 4224 ms: download 1610 ms overlapping gunzip 717 ms, parse 2202 ms, sort 0 ms, write 0 ms, index 716 ms: 9 candidates, 81346 repo-hours, 652 releases; waiting 318 ms; commit 0 ms)
2026-11-08T14:59:04Z [load_day 2026-01-08] 2026-01-08 hour 15: 146971 events in 0 files, snapshot none (task 4291 ms: download 2535 ms overlapping gunzip 732 ms, parse 2090 ms, sort 0 ms, write 0 ms, index 613 ms: 4 candidates, 81847 repo-hours, 679 releases; waiting 507 ms; commit 0 ms)
2026-11-08T14:59:08Z [load_day 2026-01-08] 2026-01-08 hour 16: 147847 events in 0 files, snapshot none (task 3743 ms: download 2627 ms overlapping gunzip 445 ms, parse 1327 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 83498 repo-hours, 566 releases; waiting 938 ms; commit 0 ms)
2026-11-08T14:59:08Z [load_day 2026-01-08] 2026-01-08 hour 17: 148231 events in 0 files, snapshot none (task 3502 ms: download 2076 ms overlapping gunzip 517 ms, parse 1446 ms, sort 0 ms, write 0 ms, index 664 ms: 5 candidates, 79477 repo-hours, 640 releases; waiting 559 ms; commit 0 ms)
2026-11-08T14:59:12Z [load_day 2026-01-08] 2026-01-08 hour 18: 148843 events in 0 files, snapshot none (task 3670 ms: download 2517 ms overlapping gunzip 464 ms, parse 1330 ms, sort 0 ms, write 0 ms, index 707 ms: 1 candidates, 83872 repo-hours, 666 releases; waiting 885 ms; commit 0 ms)
2026-11-08T14:59:12Z [load_day 2026-01-08] 2026-01-08 hour 19: 145844 events in 0 files, snapshot none (task 3616 ms: download 2270 ms overlapping gunzip 460 ms, parse 1335 ms, sort 0 ms, write 0 ms, index 593 ms: 4 candidates, 72964 repo-hours, 722 releases; waiting 832 ms; commit 0 ms)
2026-11-08T14:59:17Z [load_day 2026-01-08] 2026-01-08 hour 20: 149651 events in 0 files, snapshot none (task 4431 ms: download 3022 ms overlapping gunzip 509 ms, parse 1402 ms, sort 0 ms, write 0 ms, index 607 ms: 10 candidates, 75463 repo-hours, 813 releases; waiting 1552 ms; commit 0 ms)
2026-11-08T14:59:17Z [load_day 2026-01-08] 2026-01-08 hour 21: 142824 events in 0 files, snapshot none (task 3474 ms: download 2272 ms overlapping gunzip 439 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 643 ms: 5 candidates, 70071 repo-hours, 931 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:59:21Z [load_day 2026-01-08] 2026-01-08 hour 22: 145446 events in 0 files, snapshot none (task 4209 ms: download 2083 ms overlapping gunzip 616 ms, parse 2040 ms, sort 0 ms, write 0 ms, index 658 ms: 6 candidates, 68027 repo-hours, 870 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:59:21Z [load_day 2026-01-08] 2026-01-08 hour 23: 148344 events in 0 files, snapshot none (task 4256 ms: download 2680 ms overlapping gunzip 584 ms, parse 1908 ms, sort 0 ms, write 0 ms, index 823 ms: 3 candidates, 67405 repo-hours, 900 releases; waiting 687 ms; commit 0 ms)
2026-11-08T14:59:30Z [load_day 2026-01-08] 2026-01-08: repo_hour merged from 24 files to 1 (1877179 rows, 8638 ms)
2026-11-08T14:59:33Z [load_day 2026-01-08] 2026-01-08: index committed in 11544 ms (24 + 1 + 24 files)
2026-11-08T14:59:33Z [load_day 2026-01-08] 2026-01-08: 3540645 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:59:33Z [load_day 2026-01-08] attempt 1 succeeded