orcaLog in

Runs · run 4512

load_day 2025-10-17, attempt 1 succeeded

Host
73ccef5e07c2:394006
Started
2026-11-08T14:14:12Z
Ended
2026-11-08T14:15:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
656 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.8 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4512/load_day/2025-10-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:14:12Z [load_day 2025-10-17] attempt 1 started
2026-11-08T14:14:13Z [load_day 2025-10-17] 2025-10-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:14:16Z [load_day 2025-10-17] 2025-10-17 hour 0: 145608 events in 0 files, snapshot none (task 2954 ms: download 1712 ms overlapping gunzip 344 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 606 ms: 5 candidates, 74169 repo-hours, 709 releases; waiting 548 ms; commit 0 ms)
2026-11-08T14:14:17Z [load_day 2025-10-17] 2025-10-17 hour 1: 149895 events in 0 files, snapshot none (task 3128 ms: download 1943 ms overlapping gunzip 351 ms, parse 1112 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 88457 repo-hours, 756 releases; waiting 664 ms; commit 0 ms)
2026-11-08T14:14:20Z [load_day 2025-10-17] 2025-10-17 hour 2: 142646 events in 0 files, snapshot none (task 3136 ms: download 2283 ms overlapping gunzip 364 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 530 ms: 9 candidates, 67349 repo-hours, 519 releases; waiting 778 ms; commit 0 ms)
2026-11-08T14:14:20Z [load_day 2025-10-17] 2025-10-17 hour 3: 145390 events in 0 files, snapshot none (task 3408 ms: download 2224 ms overlapping gunzip 395 ms, parse 1236 ms, sort 0 ms, write 0 ms, index 569 ms: 8 candidates, 67065 repo-hours, 1493 releases; waiting 874 ms; commit 0 ms)
2026-11-08T14:14:23Z [load_day 2025-10-17] 2025-10-17 hour 4: 142504 events in 0 files, snapshot none (task 2822 ms: download 1909 ms overlapping gunzip 359 ms, parse 1052 ms, sort 0 ms, write 0 ms, index 437 ms: 1 candidates, 61223 repo-hours, 439 releases; waiting 621 ms; commit 0 ms)
2026-11-08T14:14:24Z [load_day 2025-10-17] 2025-10-17 hour 5: 139494 events in 0 files, snapshot none (task 2861 ms: download 2025 ms overlapping gunzip 311 ms, parse 988 ms, sort 0 ms, write 0 ms, index 480 ms: 4 candidates, 61607 repo-hours, 465 releases; waiting 841 ms; commit 0 ms)
2026-11-08T14:14:27Z [load_day 2025-10-17] 2025-10-17 hour 6: 146604 events in 0 files, snapshot none (task 3283 ms: download 2071 ms overlapping gunzip 386 ms, parse 1210 ms, sort 0 ms, write 0 ms, index 628 ms: 4 candidates, 73493 repo-hours, 609 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:14:27Z [load_day 2025-10-17] 2025-10-17 hour 7: 148458 events in 0 files, snapshot none (task 2826 ms: download 1772 ms overlapping gunzip 355 ms, parse 1117 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 69838 repo-hours, 586 releases; waiting 439 ms; commit 0 ms)
2026-11-08T14:14:32Z [load_day 2025-10-17] 2025-10-17 hour 8: 142689 events in 0 files, snapshot none (task 4233 ms: download 2694 ms overlapping gunzip 644 ms, parse 2014 ms, sort 0 ms, write 0 ms, index 677 ms: 5 candidates, 70301 repo-hours, 660 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:14:32Z [load_day 2025-10-17] 2025-10-17 hour 9: 149477 events in 0 files, snapshot none (task 4423 ms: download 1997 ms overlapping gunzip 744 ms, parse 2144 ms, sort 0 ms, write 0 ms, index 637 ms: 5 candidates, 72599 repo-hours, 723 releases; waiting 483 ms; commit 0 ms)
2026-11-08T14:14:36Z [load_day 2025-10-17] 2025-10-17 hour 10: 145511 events in 0 files, snapshot none (task 3761 ms: download 1950 ms overlapping gunzip 658 ms, parse 1972 ms, sort 0 ms, write 0 ms, index 609 ms: 4 candidates, 71520 repo-hours, 691 releases; waiting 209 ms; commit 0 ms)
2026-11-08T14:14:37Z [load_day 2025-10-17] 2025-10-17 hour 11: 142096 events in 0 files, snapshot none (task 3740 ms: download 2203 ms overlapping gunzip 591 ms, parse 1687 ms, sort 0 ms, write 0 ms, index 523 ms: 3 candidates, 67636 repo-hours, 599 releases; waiting 544 ms; commit 0 ms)
2026-11-08T14:14:40Z [load_day 2025-10-17] 2025-10-17 hour 12: 149001 events in 0 files, snapshot none (task 3646 ms: download 2344 ms overlapping gunzip 487 ms, parse 1658 ms, sort 0 ms, write 0 ms, index 691 ms: 5 candidates, 89725 repo-hours, 538 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:14:41Z [load_day 2025-10-17] 2025-10-17 hour 13: 150905 events in 0 files, snapshot none (task 3463 ms: download 2148 ms overlapping gunzip 433 ms, parse 1434 ms, sort 0 ms, write 0 ms, index 615 ms: 4 candidates, 84612 repo-hours, 567 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:14:45Z [load_day 2025-10-17] 2025-10-17 hour 14: 144571 events in 0 files, snapshot none (task 3964 ms: download 2783 ms overlapping gunzip 479 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 74648 repo-hours, 624 releases; waiting 1060 ms; commit 0 ms)
2026-11-08T14:14:45Z [load_day 2025-10-17] 2025-10-17 hour 15: 146608 events in 0 files, snapshot none (task 3671 ms: download 2473 ms overlapping gunzip 480 ms, parse 1519 ms, sort 0 ms, write 0 ms, index 716 ms: 6 candidates, 75280 repo-hours, 705 releases; waiting 719 ms; commit 0 ms)
2026-11-08T14:14:49Z [load_day 2025-10-17] 2025-10-17 hour 16: 145882 events in 0 files, snapshot none (task 3511 ms: download 2327 ms overlapping gunzip 459 ms, parse 1393 ms, sort 0 ms, write 0 ms, index 560 ms: 3 candidates, 72051 repo-hours, 651 releases; waiting 738 ms; commit 0 ms)
2026-11-08T14:14:49Z [load_day 2025-10-17] 2025-10-17 hour 17: 144074 events in 0 files, snapshot none (task 3331 ms: download 2158 ms overlapping gunzip 485 ms, parse 1444 ms, sort 0 ms, write 0 ms, index 589 ms: 4 candidates, 68655 repo-hours, 587 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:14:53Z [load_day 2025-10-17] 2025-10-17 hour 18: 143335 events in 0 files, snapshot none (task 3851 ms: download 2543 ms overlapping gunzip 373 ms, parse 1152 ms, sort 0 ms, write 0 ms, index 865 ms: 2 candidates, 73573 repo-hours, 597 releases; waiting 1140 ms; commit 0 ms)
2026-11-08T14:14:56Z [load_day 2025-10-17] 2025-10-17 hour 19: 148361 events in 0 files, snapshot none (task 6236 ms: download 5264 ms overlapping gunzip 441 ms, parse 1427 ms, sort 0 ms, write 0 ms, index 670 ms: 4 candidates, 67034 repo-hours, 565 releases; waiting 3452 ms; commit 0 ms)
2026-11-08T14:14:57Z [load_day 2025-10-17] 2025-10-17 hour 20: 142199 events in 0 files, snapshot none (task 3074 ms: download 1770 ms overlapping gunzip 455 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 470 ms: 3 candidates, 63860 repo-hours, 582 releases; waiting 393 ms; commit 0 ms)
2026-11-08T14:15:02Z [load_day 2025-10-17] 2025-10-17 hour 21: 142833 events in 0 files, snapshot none (task 4942 ms: download 3869 ms overlapping gunzip 464 ms, parse 1415 ms, sort 0 ms, write 0 ms, index 537 ms: 4 candidates, 60344 repo-hours, 600 releases; waiting 2088 ms; commit 0 ms)
2026-11-08T14:15:02Z [load_day 2025-10-17] 2025-10-17 hour 22: 141501 events in 0 files, snapshot none (task 3025 ms: download 1758 ms overlapping gunzip 403 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 484 ms: 3 candidates, 57426 repo-hours, 600 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:15:05Z [load_day 2025-10-17] 2025-10-17 hour 23: 139607 events in 0 files, snapshot none (task 2851 ms: download 1700 ms overlapping gunzip 332 ms, parse 1149 ms, sort 0 ms, write 0 ms, index 465 ms: 1 candidates, 54197 repo-hours, 639 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:15:13Z [load_day 2025-10-17] 2025-10-17: repo_hour merged from 24 files to 1 (1686662 rows, 7702 ms)
2026-11-08T14:15:15Z [load_day 2025-10-17] 2025-10-17: index committed in 10408 ms (24 + 1 + 24 files)
2026-11-08T14:15:15Z [load_day 2025-10-17] 2025-10-17: 3479249 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:15:15Z [load_day 2025-10-17] attempt 1 succeeded