orcaLog in

Runs · run 4083

load_day 2025-06-28, attempt 1 succeeded

Host
73ccef5e07c2:332819
Started
2026-11-08T12:41:44Z
Ended
2026-11-08T12:43:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
640 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
113.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4083/load_day/2025-06-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:41:44Z [load_day 2025-06-28] attempt 1 started
2026-11-08T12:41:45Z [load_day 2025-06-28] 2025-06-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:41:50Z [load_day 2025-06-28] 2025-06-28 hour 0: 133919 events in 0 files, snapshot none (task 4585 ms: download 2557 ms overlapping gunzip 639 ms, parse 2629 ms, sort 0 ms, write 0 ms, index 492 ms: 7 candidates, 64668 repo-hours, 1038 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:41:50Z [load_day 2025-06-28] 2025-06-28 hour 1: 146709 events in 0 files, snapshot none (task 4779 ms: download 3436 ms overlapping gunzip 591 ms, parse 2538 ms, sort 0 ms, write 0 ms, index 638 ms: 11 candidates, 84138 repo-hours, 839 releases; waiting 644 ms; commit 0 ms)
2026-11-08T12:41:56Z [load_day 2025-06-28] 2025-06-28 hour 2: 129910 events in 0 files, snapshot none (task 5292 ms: download 4202 ms overlapping gunzip 589 ms, parse 2437 ms, sort 0 ms, write 0 ms, index 406 ms: 9 candidates, 60136 repo-hours, 874 releases; waiting 1572 ms; commit 0 ms)
2026-11-08T12:41:56Z [load_day 2025-06-28] 2025-06-28 hour 3: 140155 events in 0 files, snapshot none (task 4624 ms: download 2744 ms overlapping gunzip 624 ms, parse 2642 ms, sort 0 ms, write 0 ms, index 514 ms: 2 candidates, 59364 repo-hours, 2026 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:42:01Z [load_day 2025-06-28] 2025-06-28 hour 4: 138763 events in 0 files, snapshot none (task 4542 ms: download 2497 ms overlapping gunzip 653 ms, parse 2647 ms, sort 0 ms, write 0 ms, index 424 ms: 7 candidates, 56178 repo-hours, 843 releases; waiting 548 ms; commit 0 ms)
2026-11-08T12:42:01Z [load_day 2025-06-28] 2025-06-28 hour 5: 136934 events in 0 files, snapshot none (task 4703 ms: download 2506 ms overlapping gunzip 664 ms, parse 2861 ms, sort 0 ms, write 0 ms, index 423 ms: 4 candidates, 54236 repo-hours, 664 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:42:08Z [load_day 2025-06-28] 2025-06-28 hour 6: 148167 events in 0 files, snapshot none (task 5704 ms: download 3010 ms overlapping gunzip 914 ms, parse 3679 ms, sort 0 ms, write 0 ms, index 492 ms: 13 candidates, 67555 repo-hours, 894 releases; waiting 251 ms; commit 0 ms)
2026-11-08T12:42:08Z [load_day 2025-06-28] 2025-06-28 hour 7: 146283 events in 0 files, snapshot none (task 5799 ms: download 3296 ms overlapping gunzip 880 ms, parse 3620 ms, sort 0 ms, write 0 ms, index 475 ms: 7 candidates, 60316 repo-hours, 839 releases; waiting 500 ms; commit 0 ms)
2026-11-08T12:42:14Z [load_day 2025-06-28] 2025-06-28 hour 8: 149477 events in 0 files, snapshot none (task 5540 ms: download 3194 ms overlapping gunzip 843 ms, parse 3442 ms, sort 0 ms, write 0 ms, index 527 ms: 9 candidates, 64005 repo-hours, 925 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:42:14Z [load_day 2025-06-28] 2025-06-28 hour 9: 146709 events in 0 files, snapshot none (task 5483 ms: download 3159 ms overlapping gunzip 798 ms, parse 3374 ms, sort 0 ms, write 0 ms, index 577 ms: 10 candidates, 67401 repo-hours, 800 releases; waiting 486 ms; commit 0 ms)
2026-11-08T12:42:20Z [load_day 2025-06-28] 2025-06-28 hour 10: 143437 events in 0 files, snapshot none (task 5281 ms: download 2725 ms overlapping gunzip 737 ms, parse 3075 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 64585 repo-hours, 704 releases; waiting 489 ms; commit 0 ms)
2026-11-08T12:42:20Z [load_day 2025-06-28] 2025-06-28 hour 11: 145313 events in 0 files, snapshot none (task 4440 ms: download 2335 ms overlapping gunzip 651 ms, parse 2741 ms, sort 0 ms, write 0 ms, index 407 ms: 6 candidates, 59015 repo-hours, 650 releases; waiting 306 ms; commit 0 ms)
2026-11-08T12:42:26Z [load_day 2025-06-28] 2025-06-28 hour 12: 159084 events in 0 files, snapshot none (task 5235 ms: download 2367 ms overlapping gunzip 661 ms, parse 2756 ms, sort 0 ms, write 0 ms, index 1018 ms: 5 candidates, 87846 repo-hours, 589 releases; waiting 496 ms; commit 0 ms)
2026-11-08T12:42:26Z [load_day 2025-06-28] 2025-06-28 hour 13: 160881 events in 0 files, snapshot none (task 5716 ms: download 2721 ms overlapping gunzip 791 ms, parse 3390 ms, sort 0 ms, write 0 ms, index 688 ms: 7 candidates, 79121 repo-hours, 664 releases; waiting 437 ms; commit 0 ms)
2026-11-08T12:42:31Z [load_day 2025-06-28] 2025-06-28 hour 14: 151137 events in 0 files, snapshot none (task 4915 ms: download 2149 ms overlapping gunzip 727 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 583 ms: 5 candidates, 66363 repo-hours, 764 releases; waiting 214 ms; commit 0 ms)
2026-11-08T12:42:32Z [load_day 2025-06-28] 2025-06-28 hour 15: 155394 events in 0 files, snapshot none (task 5449 ms: download 2807 ms overlapping gunzip 799 ms, parse 3201 ms, sort 0 ms, write 0 ms, index 637 ms: 3 candidates, 70706 repo-hours, 754 releases; waiting 542 ms; commit 0 ms)
2026-11-08T12:42:37Z [load_day 2025-06-28] 2025-06-28 hour 16: 149718 events in 0 files, snapshot none (task 4929 ms: download 2585 ms overlapping gunzip 668 ms, parse 2758 ms, sort 0 ms, write 0 ms, index 702 ms: 3 candidates, 68152 repo-hours, 651 releases; waiting 498 ms; commit 0 ms)
2026-11-08T12:42:38Z [load_day 2025-06-28] 2025-06-28 hour 17: 149013 events in 0 files, snapshot none (task 5059 ms: download 2855 ms overlapping gunzip 686 ms, parse 2889 ms, sort 0 ms, write 0 ms, index 651 ms: 2 candidates, 63780 repo-hours, 663 releases; waiting 538 ms; commit 0 ms)
2026-11-08T12:42:43Z [load_day 2025-06-28] 2025-06-28 hour 18: 152501 events in 0 files, snapshot none (task 5706 ms: download 3232 ms overlapping gunzip 716 ms, parse 2993 ms, sort 0 ms, write 0 ms, index 697 ms: 9 candidates, 72977 repo-hours, 773 releases; waiting 898 ms; commit 0 ms)
2026-11-08T12:42:44Z [load_day 2025-06-28] 2025-06-28 hour 19: 144170 events in 0 files, snapshot none (task 5375 ms: download 2749 ms overlapping gunzip 815 ms, parse 3336 ms, sort 0 ms, write 0 ms, index 445 ms: 9 candidates, 59505 repo-hours, 704 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:42:48Z [load_day 2025-06-28] 2025-06-28 hour 20: 142872 events in 0 files, snapshot none (task 4913 ms: download 2605 ms overlapping gunzip 681 ms, parse 2896 ms, sort 0 ms, write 0 ms, index 576 ms: 5 candidates, 57715 repo-hours, 676 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:42:49Z [load_day 2025-06-28] 2025-06-28 hour 21: 139003 events in 0 files, snapshot none (task 5015 ms: download 2803 ms overlapping gunzip 747 ms, parse 3140 ms, sort 0 ms, write 0 ms, index 505 ms: 9 candidates, 57244 repo-hours, 843 releases; waiting 319 ms; commit 0 ms)
2026-11-08T12:42:54Z [load_day 2025-06-28] 2025-06-28 hour 22: 132103 events in 0 files, snapshot none (task 4703 ms: download 2653 ms overlapping gunzip 646 ms, parse 2714 ms, sort 0 ms, write 0 ms, index 546 ms: 5 candidates, 51726 repo-hours, 971 releases; waiting 520 ms; commit 0 ms)
2026-11-08T12:42:55Z [load_day 2025-06-28] 2025-06-28 hour 23: 125619 events in 0 files, snapshot none (task 4521 ms: download 2369 ms overlapping gunzip 635 ms, parse 2728 ms, sort 0 ms, write 0 ms, index 383 ms: 3 candidates, 47086 repo-hours, 911 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:43:02Z [load_day 2025-06-28] 2025-06-28: repo_hour merged from 24 files to 1 (1543818 rows, 7717 ms)
2026-11-08T12:43:06Z [load_day 2025-06-28] 2025-06-28: index committed in 10930 ms (24 + 1 + 24 files)
2026-11-08T12:43:06Z [load_day 2025-06-28] 2025-06-28: 3467271 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:43:06Z [load_day 2025-06-28] attempt 1 succeeded