orcaLog in

Runs · run 4651

load_day 2025-11-25, attempt 1 succeeded

Host
73ccef5e07c2:408637
Started
2026-11-08T14:34:15Z
Ended
2026-11-08T14:35:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
79.3 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4651/load_day/2025-11-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:34:15Z [load_day 2025-11-25] attempt 1 started
2026-11-08T14:34:16Z [load_day 2025-11-25] 2025-11-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:34:20Z [load_day 2025-11-25] 2025-11-25 hour 0: 146943 events in 0 files, snapshot none (task 3283 ms: download 2038 ms overlapping gunzip 386 ms, parse 1157 ms, sort 0 ms, write 0 ms, index 741 ms: 10 candidates, 75294 repo-hours, 757 releases; waiting 671 ms; commit 0 ms)
2026-11-08T14:34:21Z [load_day 2025-11-25] 2025-11-25 hour 1: 152287 events in 0 files, snapshot none (task 4483 ms: download 3022 ms overlapping gunzip 482 ms, parse 1493 ms, sort 0 ms, write 0 ms, index 739 ms: 11 candidates, 91203 repo-hours, 584 releases; waiting 1431 ms; commit 0 ms)
2026-11-08T14:34:23Z [load_day 2025-11-25] 2025-11-25 hour 2: 141729 events in 0 files, snapshot none (task 2779 ms: download 1551 ms overlapping gunzip 371 ms, parse 1105 ms, sort 0 ms, write 0 ms, index 649 ms: 8 candidates, 73887 repo-hours, 578 releases; waiting 234 ms; commit 0 ms)
2026-11-08T14:34:26Z [load_day 2025-11-25] 2025-11-25 hour 3: 145363 events in 0 files, snapshot none (task 4129 ms: download 2500 ms overlapping gunzip 419 ms, parse 1402 ms, sort 0 ms, write 0 ms, index 715 ms: 7 candidates, 72716 repo-hours, 1481 releases; waiting 1286 ms; commit 0 ms)
2026-11-08T14:34:27Z [load_day 2025-11-25] 2025-11-25 hour 4: 146632 events in 0 files, snapshot none (task 3289 ms: download 2338 ms overlapping gunzip 424 ms, parse 1331 ms, sort 0 ms, write 0 ms, index 503 ms: 5 candidates, 68583 repo-hours, 512 releases; waiting 732 ms; commit 0 ms)
2026-11-08T14:34:31Z [load_day 2025-11-25] 2025-11-25 hour 5: 146448 events in 0 files, snapshot none (task 4071 ms: download 2534 ms overlapping gunzip 467 ms, parse 1520 ms, sort 0 ms, write 0 ms, index 767 ms: 8 candidates, 70562 repo-hours, 550 releases; waiting 1038 ms; commit 0 ms)
2026-11-08T14:34:31Z [load_day 2025-11-25] 2025-11-25 hour 6: 146929 events in 0 files, snapshot none (task 3738 ms: download 2337 ms overlapping gunzip 605 ms, parse 1801 ms, sort 0 ms, write 0 ms, index 563 ms: 10 candidates, 77300 repo-hours, 628 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:34:36Z [load_day 2025-11-25] 2025-11-25 hour 7: 147708 events in 0 files, snapshot none (task 4488 ms: download 3243 ms overlapping gunzip 462 ms, parse 1452 ms, sort 0 ms, write 0 ms, index 616 ms: 7 candidates, 73994 repo-hours, 585 releases; waiting 1640 ms; commit 0 ms)
2026-11-08T14:34:36Z [load_day 2025-11-25] 2025-11-25 hour 8: 149836 events in 0 files, snapshot none (task 3607 ms: download 2579 ms overlapping gunzip 500 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 665 ms: 11 candidates, 77645 repo-hours, 610 releases; waiting 631 ms; commit 0 ms)
2026-11-08T14:34:39Z [load_day 2025-11-25] 2025-11-25 hour 9: 147644 events in 0 files, snapshot none (task 3297 ms: download 1470 ms overlapping gunzip 497 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 747 ms: 7 candidates, 78072 repo-hours, 596 releases; waiting 282 ms; commit 0 ms)
2026-11-08T14:34:40Z [load_day 2025-11-25] 2025-11-25 hour 10: 147282 events in 0 files, snapshot none (task 3577 ms: download 2217 ms overlapping gunzip 533 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 568 ms: 4 candidates, 78769 repo-hours, 580 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:34:44Z [load_day 2025-11-25] 2025-11-25 hour 11: 148845 events in 0 files, snapshot none (task 3996 ms: download 2693 ms overlapping gunzip 579 ms, parse 1704 ms, sort 0 ms, write 0 ms, index 647 ms: 1 candidates, 75481 repo-hours, 559 releases; waiting 785 ms; commit 0 ms)
2026-11-08T14:34:44Z [load_day 2025-11-25] 2025-11-25 hour 12: 156089 events in 0 files, snapshot none (task 3726 ms: download 2222 ms overlapping gunzip 404 ms, parse 1315 ms, sort 0 ms, write 0 ms, index 846 ms: 4 candidates, 96419 repo-hours, 395 releases; waiting 761 ms; commit 0 ms)
2026-11-08T14:34:48Z [load_day 2025-11-25] 2025-11-25 hour 13: 155028 events in 0 files, snapshot none (task 3849 ms: download 2066 ms overlapping gunzip 489 ms, parse 1371 ms, sort 0 ms, write 0 ms, index 1077 ms: 9 candidates, 92686 repo-hours, 369 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:34:48Z [load_day 2025-11-25] 2025-11-25 hour 14: 148363 events in 0 files, snapshot none (task 3618 ms: download 2017 ms overlapping gunzip 569 ms, parse 1551 ms, sort 0 ms, write 0 ms, index 687 ms: 6 candidates, 83820 repo-hours, 528 releases; waiting 555 ms; commit 0 ms)
2026-11-08T14:34:53Z [load_day 2025-11-25] 2025-11-25 hour 15: 149510 events in 0 files, snapshot none (task 3827 ms: download 1940 ms overlapping gunzip 507 ms, parse 1529 ms, sort 0 ms, write 0 ms, index 719 ms: 9 candidates, 83551 repo-hours, 400 releases; waiting 689 ms; commit 0 ms)
2026-11-08T14:34:53Z [load_day 2025-11-25] 2025-11-25 hour 16: 148445 events in 0 files, snapshot none (task 3834 ms: download 2317 ms overlapping gunzip 528 ms, parse 1586 ms, sort 0 ms, write 0 ms, index 725 ms: 4 candidates, 81519 repo-hours, 550 releases; waiting 633 ms; commit 0 ms)
2026-11-08T14:34:57Z [load_day 2025-11-25] 2025-11-25 hour 17: 151287 events in 0 files, snapshot none (task 4181 ms: download 2587 ms overlapping gunzip 488 ms, parse 1643 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 82317 repo-hours, 384 releases; waiting 1145 ms; commit 0 ms)
2026-11-08T14:34:57Z [load_day 2025-11-25] 2025-11-25 hour 18: 156325 events in 0 files, snapshot none (task 3643 ms: download 1887 ms overlapping gunzip 448 ms, parse 1442 ms, sort 0 ms, write 0 ms, index 859 ms: 2 candidates, 88088 repo-hours, 460 releases; waiting 543 ms; commit 0 ms)
2026-11-08T14:35:02Z [load_day 2025-11-25] 2025-11-25 hour 19: 155501 events in 0 files, snapshot none (task 4190 ms: download 2690 ms overlapping gunzip 574 ms, parse 2019 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 82929 repo-hours, 425 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:35:02Z [load_day 2025-11-25] 2025-11-25 hour 20: 151026 events in 0 files, snapshot none (task 4186 ms: download 2394 ms overlapping gunzip 652 ms, parse 1935 ms, sort 0 ms, write 0 ms, index 708 ms: 11 candidates, 73432 repo-hours, 599 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:35:06Z [load_day 2025-11-25] 2025-11-25 hour 21: 147761 events in 0 files, snapshot none (task 3403 ms: download 2145 ms overlapping gunzip 365 ms, parse 1100 ms, sort 0 ms, write 0 ms, index 680 ms: 6 candidates, 69819 repo-hours, 686 releases; waiting 924 ms; commit 0 ms)
2026-11-08T14:35:07Z [load_day 2025-11-25] 2025-11-25 hour 22: 147027 events in 0 files, snapshot none (task 4652 ms: download 2786 ms overlapping gunzip 442 ms, parse 1434 ms, sort 0 ms, write 0 ms, index 567 ms: 4 candidates, 69974 repo-hours, 845 releases; waiting 1857 ms; commit 0 ms)
2026-11-08T14:35:10Z [load_day 2025-11-25] 2025-11-25 hour 23: 145441 events in 0 files, snapshot none (task 3328 ms: download 2344 ms overlapping gunzip 370 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 544 ms: 4 candidates, 67446 repo-hours, 646 releases; waiting 902 ms; commit 0 ms)
2026-11-08T14:35:18Z [load_day 2025-11-25] 2025-11-25: repo_hour merged from 24 files to 1 (1885506 rows, 7887 ms)
2026-11-08T14:35:29Z [load_day 2025-11-25] 2025-11-25: index committed in 18747 ms (24 + 1 + 24 files)
2026-11-08T14:35:29Z [load_day 2025-11-25] 2025-11-25: 3579449 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:35:29Z [load_day 2025-11-25] attempt 1 succeeded