orcaLog in

Runs · run 4875

load_day 2026-01-28, attempt 1 succeeded

Host
73ccef5e07c2:435825
Started
2026-11-08T15:09:33Z
Ended
2026-11-08T15:10:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
722 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.8 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4875/load_day/2026-01-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:09:33Z [load_day 2026-01-28] attempt 1 started
2026-11-08T15:09:34Z [load_day 2026-01-28] 2026-01-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:09:39Z [load_day 2026-01-28] 2026-01-28 hour 0: 146548 events in 0 files, snapshot none (task 3913 ms: download 2746 ms overlapping gunzip 547 ms, parse 1666 ms, sort 0 ms, write 0 ms, index 591 ms: 8 candidates, 76627 repo-hours, 885 releases; waiting 631 ms; commit 0 ms)
2026-11-08T15:09:39Z [load_day 2026-01-28] 2026-01-28 hour 1: 155690 events in 0 files, snapshot none (task 3594 ms: download 1960 ms overlapping gunzip 508 ms, parse 1588 ms, sort 0 ms, write 0 ms, index 652 ms: 14 candidates, 91825 repo-hours, 638 releases; waiting 533 ms; commit 0 ms)
2026-11-08T15:09:43Z [load_day 2026-01-28] 2026-01-28 hour 2: 146275 events in 0 files, snapshot none (task 3488 ms: download 1754 ms overlapping gunzip 510 ms, parse 1653 ms, sort 0 ms, write 0 ms, index 628 ms: 7 candidates, 79356 repo-hours, 703 releases; waiting 362 ms; commit 0 ms)
2026-11-08T15:09:43Z [load_day 2026-01-28] 2026-01-28 hour 3: 147374 events in 0 files, snapshot none (task 3590 ms: download 2383 ms overlapping gunzip 571 ms, parse 1581 ms, sort 0 ms, write 0 ms, index 544 ms: 15 candidates, 72092 repo-hours, 814 releases; waiting 560 ms; commit 0 ms)
2026-11-08T15:09:47Z [load_day 2026-01-28] 2026-01-28 hour 4: 149088 events in 0 files, snapshot none (task 3840 ms: download 2337 ms overlapping gunzip 467 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 620 ms: 9 candidates, 77058 repo-hours, 1407 releases; waiting 900 ms; commit 0 ms)
2026-11-08T15:09:47Z [load_day 2026-01-28] 2026-01-28 hour 5: 145552 events in 0 files, snapshot none (task 3420 ms: download 2068 ms overlapping gunzip 531 ms, parse 1569 ms, sort 0 ms, write 0 ms, index 551 ms: 10 candidates, 73852 repo-hours, 671 releases; waiting 513 ms; commit 0 ms)
2026-11-08T15:09:52Z [load_day 2026-01-28] 2026-01-28 hour 6: 147822 events in 0 files, snapshot none (task 3915 ms: download 2849 ms overlapping gunzip 671 ms, parse 1775 ms, sort 0 ms, write 0 ms, index 586 ms: 8 candidates, 77140 repo-hours, 738 releases; waiting 561 ms; commit 0 ms)
2026-11-08T15:09:52Z [load_day 2026-01-28] 2026-01-28 hour 7: 150478 events in 0 files, snapshot none (task 4010 ms: download 2391 ms overlapping gunzip 659 ms, parse 1826 ms, sort 0 ms, write 0 ms, index 597 ms: 17 candidates, 76746 repo-hours, 615 releases; waiting 535 ms; commit 0 ms)
2026-11-08T15:09:56Z [load_day 2026-01-28] 2026-01-28 hour 8: 143302 events in 0 files, snapshot none (task 4063 ms: download 2847 ms overlapping gunzip 524 ms, parse 1580 ms, sort 0 ms, write 0 ms, index 628 ms: 11 candidates, 77811 repo-hours, 626 releases; waiting 988 ms; commit 0 ms)
2026-11-08T15:09:56Z [load_day 2026-01-28] 2026-01-28 hour 9: 146331 events in 0 files, snapshot none (task 3860 ms: download 2261 ms overlapping gunzip 522 ms, parse 1622 ms, sort 0 ms, write 0 ms, index 829 ms: 8 candidates, 81720 repo-hours, 635 releases; waiting 544 ms; commit 0 ms)
2026-11-08T15:10:00Z [load_day 2026-01-28] 2026-01-28 hour 10: 144163 events in 0 files, snapshot none (task 3351 ms: download 1927 ms overlapping gunzip 417 ms, parse 1396 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 79223 repo-hours, 611 releases; waiting 590 ms; commit 0 ms)
2026-11-08T15:10:00Z [load_day 2026-01-28] 2026-01-28 hour 11: 146480 events in 0 files, snapshot none (task 3530 ms: download 2195 ms overlapping gunzip 454 ms, parse 1346 ms, sort 0 ms, write 0 ms, index 697 ms: 7 candidates, 78612 repo-hours, 630 releases; waiting 668 ms; commit 0 ms)
2026-11-08T15:10:05Z [load_day 2026-01-28] 2026-01-28 hour 12: 151169 events in 0 files, snapshot none (task 4607 ms: download 3217 ms overlapping gunzip 299 ms, parse 1015 ms, sort 0 ms, write 0 ms, index 804 ms: 5 candidates, 94511 repo-hours, 372 releases; waiting 2163 ms; commit 0 ms)
2026-11-08T15:10:05Z [load_day 2026-01-28] 2026-01-28 hour 13: 154247 events in 0 files, snapshot none (task 3686 ms: download 2051 ms overlapping gunzip 316 ms, parse 977 ms, sort 0 ms, write 0 ms, index 946 ms: 7 candidates, 96032 repo-hours, 340 releases; waiting 996 ms; commit 0 ms)
2026-11-08T15:10:09Z [load_day 2026-01-28] 2026-01-28 hour 14: 146423 events in 0 files, snapshot none (task 3263 ms: download 1986 ms overlapping gunzip 388 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 624 ms: 6 candidates, 82501 repo-hours, 498 releases; waiting 844 ms; commit 0 ms)
2026-11-08T15:10:09Z [load_day 2026-01-28] 2026-01-28 hour 15: 147646 events in 0 files, snapshot none (task 3527 ms: download 2250 ms overlapping gunzip 380 ms, parse 1125 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 83579 repo-hours, 411 releases; waiting 954 ms; commit 0 ms)
2026-11-08T15:10:14Z [load_day 2026-01-28] 2026-01-28 hour 16: 146269 events in 0 files, snapshot none (task 4076 ms: download 2598 ms overlapping gunzip 454 ms, parse 1379 ms, sort 0 ms, write 0 ms, index 718 ms: 8 candidates, 82893 repo-hours, 368 releases; waiting 1083 ms; commit 0 ms)
2026-11-08T15:10:14Z [load_day 2026-01-28] 2026-01-28 hour 17: 148405 events in 0 files, snapshot none (task 3687 ms: download 2208 ms overlapping gunzip 430 ms, parse 1276 ms, sort 0 ms, write 0 ms, index 730 ms: 13 candidates, 82731 repo-hours, 482 releases; waiting 945 ms; commit 0 ms)
2026-11-08T15:10:18Z [load_day 2026-01-28] 2026-01-28 hour 18: 148186 events in 0 files, snapshot none (task 3112 ms: download 1888 ms overlapping gunzip 353 ms, parse 1072 ms, sort 0 ms, write 0 ms, index 728 ms: 12 candidates, 83430 repo-hours, 535 releases; waiting 636 ms; commit 0 ms)
2026-11-08T15:10:35Z [load_day 2026-01-28] 2026-01-28 hour 19: 145568 events in 0 files, snapshot none (task 20861 ms: download 17886 ms overlapping gunzip 612 ms, parse 1883 ms, sort 0 ms, write 0 ms, index 578 ms: 8 candidates, 75723 repo-hours, 573 releases; waiting 15428 ms; commit 0 ms)
2026-11-08T15:10:35Z [load_day 2026-01-28] 2026-01-28 hour 20: 149083 events in 0 files, snapshot none (task 3445 ms: download 2019 ms overlapping gunzip 459 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 750 ms: 11 candidates, 76923 repo-hours, 714 releases; waiting 729 ms; commit 0 ms)
2026-11-08T15:10:40Z [load_day 2026-01-28] 2026-01-28 hour 21: 147617 events in 0 files, snapshot none (task 4177 ms: download 2431 ms overlapping gunzip 608 ms, parse 1634 ms, sort 0 ms, write 0 ms, index 1054 ms: 7 candidates, 74423 repo-hours, 772 releases; waiting 570 ms; commit 0 ms)
2026-11-08T15:10:41Z [load_day 2026-01-28] 2026-01-28 hour 22: 147561 events in 0 files, snapshot none (task 4675 ms: download 2256 ms overlapping gunzip 661 ms, parse 2030 ms, sort 0 ms, write 0 ms, index 1117 ms: 8 candidates, 71565 repo-hours, 879 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:10:46Z [load_day 2026-01-28] 2026-01-28 hour 23: 146091 events in 0 files, snapshot none (task 4204 ms: download 2740 ms overlapping gunzip 591 ms, parse 1780 ms, sort 0 ms, write 0 ms, index 619 ms: 8 candidates, 67630 repo-hours, 1022 releases; waiting 928 ms; commit 0 ms)
2026-11-08T15:10:55Z [load_day 2026-01-28] 2026-01-28: repo_hour merged from 24 files to 1 (1914003 rows, 9333 ms)
2026-11-08T15:10:58Z [load_day 2026-01-28] 2026-01-28: index committed in 12697 ms (24 + 1 + 24 files)
2026-11-08T15:10:58Z [load_day 2026-01-28] 2026-01-28: 3547368 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:10:58Z [load_day 2026-01-28] attempt 1 succeeded