orcaLog in

Runs · run 4831

load_day 2026-01-16, attempt 1 succeeded

Host
73ccef5e07c2:430397
Started
2026-11-08T15:02:56Z
Ended
2026-11-08T15:04:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
705 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.0 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4831/load_day/2026-01-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:02:56Z [load_day 2026-01-16] attempt 1 started
2026-11-08T15:02:58Z [load_day 2026-01-16] 2026-01-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:03:03Z [load_day 2026-01-16] 2026-01-16 hour 0: 144777 events in 0 files, snapshot none (task 4289 ms: download 2429 ms overlapping gunzip 679 ms, parse 2049 ms, sort 0 ms, write 0 ms, index 748 ms: 4 candidates, 74963 repo-hours, 842 releases; waiting 514 ms; commit 0 ms)
2026-11-08T15:03:03Z [load_day 2026-01-16] 2026-01-16 hour 1: 150573 events in 0 files, snapshot none (task 4693 ms: download 2697 ms overlapping gunzip 696 ms, parse 2172 ms, sort 0 ms, write 0 ms, index 877 ms: 7 candidates, 90905 repo-hours, 754 releases; waiting 541 ms; commit 0 ms)
2026-11-08T15:03:07Z [load_day 2026-01-16] 2026-01-16 hour 2: 146130 events in 0 files, snapshot none (task 3871 ms: download 2228 ms overlapping gunzip 594 ms, parse 1929 ms, sort 0 ms, write 0 ms, index 661 ms: 5 candidates, 78364 repo-hours, 695 releases; waiting 379 ms; commit 0 ms)
2026-11-08T15:03:07Z [load_day 2026-01-16] 2026-01-16 hour 3: 148130 events in 0 files, snapshot none (task 3618 ms: download 2030 ms overlapping gunzip 563 ms, parse 1587 ms, sort 0 ms, write 0 ms, index 774 ms: 6 candidates, 74054 repo-hours, 809 releases; waiting 368 ms; commit 0 ms)
2026-11-08T15:03:11Z [load_day 2026-01-16] 2026-01-16 hour 4: 142947 events in 0 files, snapshot none (task 3390 ms: download 2269 ms overlapping gunzip 397 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 617 ms: 3 candidates, 67596 repo-hours, 1546 releases; waiting 749 ms; commit 0 ms)
2026-11-08T15:03:11Z [load_day 2026-01-16] 2026-01-16 hour 5: 147159 events in 0 files, snapshot none (task 3592 ms: download 2315 ms overlapping gunzip 426 ms, parse 1284 ms, sort 0 ms, write 0 ms, index 695 ms: 5 candidates, 75118 repo-hours, 608 releases; waiting 883 ms; commit 0 ms)
2026-11-08T15:03:16Z [load_day 2026-01-16] 2026-01-16 hour 6: 147320 events in 0 files, snapshot none (task 4260 ms: download 3046 ms overlapping gunzip 536 ms, parse 1500 ms, sort 0 ms, write 0 ms, index 653 ms: 4 candidates, 80141 repo-hours, 732 releases; waiting 1251 ms; commit 0 ms)
2026-11-08T15:03:16Z [load_day 2026-01-16] 2026-01-16 hour 7: 149165 events in 0 files, snapshot none (task 4352 ms: download 2473 ms overlapping gunzip 633 ms, parse 1859 ms, sort 0 ms, write 0 ms, index 626 ms: 11 candidates, 77025 repo-hours, 720 releases; waiting 526 ms; commit 0 ms)
2026-11-08T15:03:20Z [load_day 2026-01-16] 2026-01-16 hour 8: 150103 events in 0 files, snapshot none (task 3843 ms: download 1943 ms overlapping gunzip 615 ms, parse 1867 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 80620 repo-hours, 794 releases; waiting 335 ms; commit 0 ms)
2026-11-08T15:03:21Z [load_day 2026-01-16] 2026-01-16 hour 9: 147357 events in 0 files, snapshot none (task 3595 ms: download 1847 ms overlapping gunzip 585 ms, parse 1716 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 77378 repo-hours, 820 releases; waiting 422 ms; commit 0 ms)
2026-11-08T15:03:25Z [load_day 2026-01-16] 2026-01-16 hour 10: 153750 events in 0 files, snapshot none (task 3686 ms: download 1873 ms overlapping gunzip 544 ms, parse 1648 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 81022 repo-hours, 668 releases; waiting 270 ms; commit 0 ms)
2026-11-08T15:03:25Z [load_day 2026-01-16] 2026-01-16 hour 11: 150379 events in 0 files, snapshot none (task 3568 ms: download 2128 ms overlapping gunzip 484 ms, parse 1470 ms, sort 0 ms, write 0 ms, index 604 ms: 10 candidates, 75209 repo-hours, 673 releases; waiting 545 ms; commit 0 ms)
2026-11-08T15:03:28Z [load_day 2026-01-16] 2026-01-16 hour 12: 158473 events in 0 files, snapshot none (task 3434 ms: download 2234 ms overlapping gunzip 341 ms, parse 1094 ms, sort 0 ms, write 0 ms, index 730 ms: 5 candidates, 95855 repo-hours, 446 releases; waiting 918 ms; commit 0 ms)
2026-11-08T15:03:28Z [load_day 2026-01-16] 2026-01-16 hour 13: 154813 events in 0 files, snapshot none (task 3193 ms: download 2157 ms overlapping gunzip 335 ms, parse 1057 ms, sort 0 ms, write 0 ms, index 727 ms: 6 candidates, 89847 repo-hours, 494 releases; waiting 824 ms; commit 0 ms)
2026-11-08T15:03:33Z [load_day 2026-01-16] 2026-01-16 hour 14: 152088 events in 0 files, snapshot none (task 3901 ms: download 2604 ms overlapping gunzip 416 ms, parse 1183 ms, sort 0 ms, write 0 ms, index 639 ms: 8 candidates, 82571 repo-hours, 626 releases; waiting 1327 ms; commit 0 ms)
2026-11-08T15:03:33Z [load_day 2026-01-16] 2026-01-16 hour 15: 151735 events in 0 files, snapshot none (task 3929 ms: download 2174 ms overlapping gunzip 376 ms, parse 1148 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 81951 repo-hours, 529 releases; waiting 1019 ms; commit 0 ms)
2026-11-08T15:03:37Z [load_day 2026-01-16] 2026-01-16 hour 16: 150198 events in 0 files, snapshot none (task 3362 ms: download 2008 ms overlapping gunzip 426 ms, parse 1209 ms, sort 0 ms, write 0 ms, index 615 ms: 4 candidates, 80539 repo-hours, 603 releases; waiting 806 ms; commit 0 ms)
2026-11-08T15:03:37Z [load_day 2026-01-16] 2026-01-16 hour 17: 149093 events in 0 files, snapshot none (task 3049 ms: download 1738 ms overlapping gunzip 381 ms, parse 1215 ms, sort 0 ms, write 0 ms, index 638 ms: 6 candidates, 77236 repo-hours, 728 releases; waiting 561 ms; commit 0 ms)
2026-11-08T15:03:41Z [load_day 2026-01-16] 2026-01-16 hour 18: 150820 events in 0 files, snapshot none (task 3150 ms: download 1863 ms overlapping gunzip 408 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 767 ms: 10 candidates, 83460 repo-hours, 770 releases; waiting 453 ms; commit 0 ms)
2026-11-08T15:03:42Z [load_day 2026-01-16] 2026-01-16 hour 19: 150462 events in 0 files, snapshot none (task 4777 ms: download 2941 ms overlapping gunzip 490 ms, parse 1463 ms, sort 0 ms, write 0 ms, index 672 ms: 10 candidates, 74332 repo-hours, 737 releases; waiting 1782 ms; commit 0 ms)
2026-11-08T15:03:44Z [load_day 2026-01-16] 2026-01-16 hour 20: 151244 events in 0 files, snapshot none (task 2652 ms: download 1415 ms overlapping gunzip 381 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 71434 repo-hours, 803 releases; waiting 243 ms; commit 0 ms)
2026-11-08T15:03:46Z [load_day 2026-01-16] 2026-01-16 hour 21: 146373 events in 0 files, snapshot none (task 3705 ms: download 2641 ms overlapping gunzip 526 ms, parse 1545 ms, sort 0 ms, write 0 ms, index 541 ms: 7 candidates, 69362 repo-hours, 798 releases; waiting 745 ms; commit 0 ms)
2026-11-08T15:03:50Z [load_day 2026-01-16] 2026-01-16 hour 22: 145536 events in 0 files, snapshot none (task 4862 ms: download 2504 ms overlapping gunzip 638 ms, parse 1859 ms, sort 0 ms, write 0 ms, index 726 ms: 6 candidates, 68225 repo-hours, 921 releases; waiting 1250 ms; commit 0 ms)
2026-11-08T15:03:52Z [load_day 2026-01-16] 2026-01-16 hour 23: 145233 events in 0 files, snapshot none (task 4922 ms: download 2433 ms overlapping gunzip 604 ms, parse 1845 ms, sort 0 ms, write 0 ms, index 1657 ms: 6 candidates, 66314 repo-hours, 840 releases; waiting 494 ms; commit 0 ms)
2026-11-08T15:04:06Z [load_day 2026-01-16] 2026-01-16: repo_hour merged from 24 files to 1 (1873521 rows, 13840 ms)
2026-11-08T15:04:09Z [load_day 2026-01-16] 2026-01-16: index committed in 17022 ms (24 + 1 + 24 files)
2026-11-08T15:04:09Z [load_day 2026-01-16] 2026-01-16: 3583858 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:04:09Z [load_day 2026-01-16] attempt 1 succeeded