orcaLog in

Runs · run 4708

load_day 2025-12-12, attempt 1 succeeded

Host
73ccef5e07c2:416079
Started
2026-11-08T14:44:12Z
Ended
2026-11-08T14:45:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
700 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.4 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4708/load_day/2025-12-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:44:12Z [load_day 2025-12-12] attempt 1 started
2026-11-08T14:44:13Z [load_day 2025-12-12] 2025-12-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:44:17Z [load_day 2025-12-12] 2025-12-12 hour 0: 148262 events in 0 files, snapshot none (task 3545 ms: download 2412 ms overlapping gunzip 435 ms, parse 1405 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 75092 repo-hours, 1336 releases; waiting 753 ms; commit 0 ms)
2026-11-08T14:44:48Z [load_day 2025-12-12] 2025-12-12 hour 1: 153442 events in 0 files, snapshot none (task 34383 ms: download 1806 ms overlapping gunzip 394 ms, parse 1220 ms, sort 0 ms, write 0 ms, index 728 ms: 9 candidates, 91862 repo-hours, 1046 releases; waiting 771 ms; commit 0 ms)
2026-11-08T14:44:48Z [load_day 2025-12-12] 2025-12-12 hour 2: 146613 events in 0 files, snapshot none (task 3864 ms: download 2018 ms overlapping gunzip 419 ms, parse 1277 ms, sort 0 ms, write 0 ms, index 621 ms: 12 candidates, 77762 repo-hours, 1305 releases; waiting 1233 ms; commit 0 ms)
2026-11-08T14:44:52Z [load_day 2025-12-12] 2025-12-12 hour 3: 143693 events in 0 files, snapshot none (task 3666 ms: download 2037 ms overlapping gunzip 470 ms, parse 1422 ms, sort 0 ms, write 0 ms, index 912 ms: 7 candidates, 70348 repo-hours, 1298 releases; waiting 571 ms; commit 0 ms)
2026-11-08T14:44:52Z [load_day 2025-12-12] 2025-12-12 hour 4: 149165 events in 0 files, snapshot none (task 4094 ms: download 2529 ms overlapping gunzip 509 ms, parse 1580 ms, sort 0 ms, write 0 ms, index 903 ms: 10 candidates, 74373 repo-hours, 2060 releases; waiting 789 ms; commit 0 ms)
2026-11-08T14:44:57Z [load_day 2025-12-12] 2025-12-12 hour 5: 147353 events in 0 files, snapshot none (task 4086 ms: download 2197 ms overlapping gunzip 498 ms, parse 1632 ms, sort 0 ms, write 0 ms, index 995 ms: 3 candidates, 71620 repo-hours, 1181 releases; waiting 649 ms; commit 0 ms)
2026-11-08T14:44:57Z [load_day 2025-12-12] 2025-12-12 hour 6: 148839 events in 0 files, snapshot none (task 3823 ms: download 2488 ms overlapping gunzip 473 ms, parse 1460 ms, sort 0 ms, write 0 ms, index 984 ms: 10 candidates, 78763 repo-hours, 1103 releases; waiting 634 ms; commit 0 ms)
2026-11-08T14:45:02Z [load_day 2025-12-12] 2025-12-12 hour 7: 149796 events in 0 files, snapshot none (task 4594 ms: download 2949 ms overlapping gunzip 638 ms, parse 1979 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 74089 repo-hours, 1219 releases; waiting 984 ms; commit 0 ms)
2026-11-08T14:45:02Z [load_day 2025-12-12] 2025-12-12 hour 8: 145744 events in 0 files, snapshot none (task 4134 ms: download 2622 ms overlapping gunzip 627 ms, parse 1680 ms, sort 0 ms, write 0 ms, index 911 ms: 13 candidates, 75189 repo-hours, 1094 releases; waiting 638 ms; commit 0 ms)
2026-11-08T14:45:07Z [load_day 2025-12-12] 2025-12-12 hour 9: 146423 events in 0 files, snapshot none (task 4664 ms: download 3018 ms overlapping gunzip 566 ms, parse 1556 ms, sort 0 ms, write 0 ms, index 611 ms: 8 candidates, 77982 repo-hours, 1037 releases; waiting 1594 ms; commit 0 ms)
2026-11-08T14:45:08Z [load_day 2025-12-12] 2025-12-12 hour 10: 146796 events in 0 files, snapshot none (task 5340 ms: download 3658 ms overlapping gunzip 442 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 564 ms: 8 candidates, 77057 repo-hours, 689 releases; waiting 2528 ms; commit 0 ms)
2026-11-08T14:45:11Z [load_day 2025-12-12] 2025-12-12 hour 11: 148785 events in 0 files, snapshot none (task 3653 ms: download 2078 ms overlapping gunzip 537 ms, parse 1694 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 77226 repo-hours, 698 releases; waiting 458 ms; commit 0 ms)
2026-11-08T14:45:12Z [load_day 2025-12-12] 2025-12-12 hour 12: 153746 events in 0 files, snapshot none (task 3724 ms: download 2359 ms overlapping gunzip 478 ms, parse 1355 ms, sort 0 ms, write 0 ms, index 703 ms: 2 candidates, 94138 repo-hours, 485 releases; waiting 808 ms; commit 0 ms)
2026-11-08T14:45:15Z [load_day 2025-12-12] 2025-12-12 hour 13: 155044 events in 0 files, snapshot none (task 3549 ms: download 2150 ms overlapping gunzip 470 ms, parse 1571 ms, sort 0 ms, write 0 ms, index 671 ms: 5 candidates, 92400 repo-hours, 521 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:45:16Z [load_day 2025-12-12] 2025-12-12 hour 14: 150391 events in 0 files, snapshot none (task 3960 ms: download 2745 ms overlapping gunzip 524 ms, parse 1588 ms, sort 0 ms, write 0 ms, index 575 ms: 9 candidates, 80498 repo-hours, 605 releases; waiting 934 ms; commit 0 ms)
2026-11-08T14:45:19Z [load_day 2025-12-12] 2025-12-12 hour 15: 148498 events in 0 files, snapshot none (task 3524 ms: download 2411 ms overlapping gunzip 444 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 673 ms: 3 candidates, 80724 repo-hours, 691 releases; waiting 730 ms; commit 0 ms)
2026-11-08T14:45:20Z [load_day 2025-12-12] 2025-12-12 hour 16: 151787 events in 0 files, snapshot none (task 3397 ms: download 2416 ms overlapping gunzip 488 ms, parse 1365 ms, sort 0 ms, write 0 ms, index 562 ms: 4 candidates, 79720 repo-hours, 652 releases; waiting 765 ms; commit 0 ms)
2026-11-08T14:45:24Z [load_day 2025-12-12] 2025-12-12 hour 17: 147405 events in 0 files, snapshot none (task 3409 ms: download 2377 ms overlapping gunzip 431 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 581 ms: 4 candidates, 73029 repo-hours, 612 releases; waiting 752 ms; commit 0 ms)
2026-11-08T14:45:25Z [load_day 2025-12-12] 2025-12-12 hour 18: 150351 events in 0 files, snapshot none (task 3967 ms: download 2469 ms overlapping gunzip 414 ms, parse 1238 ms, sort 0 ms, write 0 ms, index 591 ms: 7 candidates, 80679 repo-hours, 686 releases; waiting 1457 ms; commit 0 ms)
2026-11-08T14:45:27Z [load_day 2025-12-12] 2025-12-12 hour 19: 147224 events in 0 files, snapshot none (task 3097 ms: download 1791 ms overlapping gunzip 395 ms, parse 1206 ms, sort 0 ms, write 0 ms, index 635 ms: 8 candidates, 70874 repo-hours, 658 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:45:29Z [load_day 2025-12-12] 2025-12-12 hour 20: 145274 events in 0 files, snapshot none (task 3947 ms: download 2773 ms overlapping gunzip 474 ms, parse 1380 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 69754 repo-hours, 631 releases; waiting 1166 ms; commit 0 ms)
2026-11-08T14:45:32Z [load_day 2025-12-12] 2025-12-12 hour 21: 147349 events in 0 files, snapshot none (task 3504 ms: download 2361 ms overlapping gunzip 399 ms, parse 1235 ms, sort 0 ms, write 0 ms, index 605 ms: 2 candidates, 70286 repo-hours, 763 releases; waiting 936 ms; commit 0 ms)
2026-11-08T14:45:33Z [load_day 2025-12-12] 2025-12-12 hour 22: 142794 events in 0 files, snapshot none (task 3026 ms: download 1758 ms overlapping gunzip 397 ms, parse 1234 ms, sort 0 ms, write 0 ms, index 560 ms: 3 candidates, 61953 repo-hours, 797 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:45:36Z [load_day 2025-12-12] 2025-12-12 hour 23: 143664 events in 0 files, snapshot none (task 3438 ms: download 2395 ms overlapping gunzip 394 ms, parse 1227 ms, sort 0 ms, write 0 ms, index 548 ms: 5 candidates, 64309 repo-hours, 751 releases; waiting 971 ms; commit 0 ms)
2026-11-08T14:45:44Z [load_day 2025-12-12] 2025-12-12: repo_hour merged from 24 files to 1 (1839727 rows, 8238 ms)
2026-11-08T14:45:47Z [load_day 2025-12-12] 2025-12-12: index committed in 10918 ms (24 + 1 + 24 files)
2026-11-08T14:45:47Z [load_day 2025-12-12] 2025-12-12: 3558438 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:45:47Z [load_day 2025-12-12] attempt 1 succeeded