orcaLog in

Runs · run 4595

load_day 2025-11-09, attempt 1 succeeded

Host
73ccef5e07c2:402568
Started
2026-11-08T14:25:59Z
Ended
2026-11-08T14:26:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
667 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
62.3 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4595/load_day/2025-11-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:25:59Z [load_day 2025-11-09] attempt 1 started
2026-11-08T14:26:00Z [load_day 2025-11-09] 2025-11-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:26:04Z [load_day 2025-11-09] 2025-11-09 hour 0: 137489 events in 0 files, snapshot none (task 3636 ms: download 2170 ms overlapping gunzip 507 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 581 ms: 8 candidates, 65425 repo-hours, 757 releases; waiting 715 ms; commit 0 ms)
2026-11-08T14:26:04Z [load_day 2025-11-09] 2025-11-09 hour 1: 149709 events in 0 files, snapshot none (task 3656 ms: download 1911 ms overlapping gunzip 499 ms, parse 1650 ms, sort 0 ms, write 0 ms, index 643 ms: 11 candidates, 88696 repo-hours, 669 releases; waiting 496 ms; commit 0 ms)
2026-11-08T14:26:09Z [load_day 2025-11-09] 2025-11-09 hour 2: 133192 events in 0 files, snapshot none (task 4061 ms: download 2235 ms overlapping gunzip 552 ms, parse 1929 ms, sort 0 ms, write 0 ms, index 630 ms: 14 candidates, 63351 repo-hours, 653 releases; waiting 630 ms; commit 0 ms)
2026-11-08T14:26:09Z [load_day 2025-11-09] 2025-11-09 hour 3: 137864 events in 0 files, snapshot none (task 3914 ms: download 1943 ms overlapping gunzip 525 ms, parse 1804 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 63268 repo-hours, 1637 releases; waiting 638 ms; commit 0 ms)
2026-11-08T14:26:13Z [load_day 2025-11-09] 2025-11-09 hour 4: 137465 events in 0 files, snapshot none (task 3499 ms: download 2269 ms overlapping gunzip 496 ms, parse 1546 ms, sort 0 ms, write 0 ms, index 614 ms: 9 candidates, 57038 repo-hours, 462 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:26:13Z [load_day 2025-11-09] 2025-11-09 hour 5: 137504 events in 0 files, snapshot none (task 3932 ms: download 1843 ms overlapping gunzip 664 ms, parse 1846 ms, sort 0 ms, write 0 ms, index 556 ms: 4 candidates, 57075 repo-hours, 479 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:26:18Z [load_day 2025-11-09] 2025-11-09 hour 6: 142457 events in 0 files, snapshot none (task 4199 ms: download 2048 ms overlapping gunzip 528 ms, parse 1669 ms, sort 0 ms, write 0 ms, index 483 ms: 8 candidates, 67602 repo-hours, 626 releases; waiting 1197 ms; commit 0 ms)
2026-11-08T14:26:18Z [load_day 2025-11-09] 2025-11-09 hour 7: 139101 events in 0 files, snapshot none (task 3605 ms: download 1983 ms overlapping gunzip 452 ms, parse 1536 ms, sort 0 ms, write 0 ms, index 531 ms: 6 candidates, 60449 repo-hours, 370 releases; waiting 811 ms; commit 0 ms)
2026-11-08T14:26:21Z [load_day 2025-11-09] 2025-11-09 hour 8: 144395 events in 0 files, snapshot none (task 3274 ms: download 1876 ms overlapping gunzip 443 ms, parse 1426 ms, sort 0 ms, write 0 ms, index 563 ms: 6 candidates, 65898 repo-hours, 521 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:26:21Z [load_day 2025-11-09] 2025-11-09 hour 9: 143727 events in 0 files, snapshot none (task 3372 ms: download 2152 ms overlapping gunzip 498 ms, parse 1516 ms, sort 0 ms, write 0 ms, index 480 ms: 5 candidates, 64115 repo-hours, 553 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:26:25Z [load_day 2025-11-09] 2025-11-09 hour 10: 145933 events in 0 files, snapshot none (task 3088 ms: download 1863 ms overlapping gunzip 366 ms, parse 1070 ms, sort 0 ms, write 0 ms, index 506 ms: 5 candidates, 65803 repo-hours, 490 releases; waiting 738 ms; commit 0 ms)
2026-11-08T14:26:25Z [load_day 2025-11-09] 2025-11-09 hour 11: 141647 events in 0 files, snapshot none (task 3236 ms: download 2379 ms overlapping gunzip 322 ms, parse 1000 ms, sort 0 ms, write 0 ms, index 485 ms: 5 candidates, 63150 repo-hours, 492 releases; waiting 1145 ms; commit 0 ms)
2026-11-08T14:26:28Z [load_day 2025-11-09] 2025-11-09 hour 12: 153691 events in 0 files, snapshot none (task 2934 ms: download 1690 ms overlapping gunzip 343 ms, parse 1104 ms, sort 0 ms, write 0 ms, index 693 ms: 3 candidates, 91595 repo-hours, 442 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:26:29Z [load_day 2025-11-09] 2025-11-09 hour 13: 152820 events in 0 files, snapshot none (task 3400 ms: download 2127 ms overlapping gunzip 396 ms, parse 1117 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 82887 repo-hours, 466 releases; waiting 833 ms; commit 0 ms)
2026-11-08T14:26:32Z [load_day 2025-11-09] 2025-11-09 hour 14: 147438 events in 0 files, snapshot none (task 3102 ms: download 1979 ms overlapping gunzip 353 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 534 ms: 12 candidates, 70910 repo-hours, 539 releases; waiting 770 ms; commit 0 ms)
2026-11-08T14:26:32Z [load_day 2025-11-09] 2025-11-09 hour 15: 149972 events in 0 files, snapshot none (task 2950 ms: download 1888 ms overlapping gunzip 332 ms, parse 1050 ms, sort 0 ms, write 0 ms, index 535 ms: 11 candidates, 72969 repo-hours, 662 releases; waiting 704 ms; commit 0 ms)
2026-11-08T14:26:36Z [load_day 2025-11-09] 2025-11-09 hour 16: 152324 events in 0 files, snapshot none (task 3263 ms: download 2156 ms overlapping gunzip 377 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 569 ms: 14 candidates, 73413 repo-hours, 647 releases; waiting 838 ms; commit 0 ms)
2026-11-08T14:26:36Z [load_day 2025-11-09] 2025-11-09 hour 17: 150351 events in 0 files, snapshot none (task 3153 ms: download 2129 ms overlapping gunzip 367 ms, parse 1130 ms, sort 0 ms, write 0 ms, index 571 ms: 10 candidates, 70444 repo-hours, 538 releases; waiting 749 ms; commit 0 ms)
2026-11-08T14:26:40Z [load_day 2025-11-09] 2025-11-09 hour 18: 151093 events in 0 files, snapshot none (task 3188 ms: download 1914 ms overlapping gunzip 373 ms, parse 1184 ms, sort 0 ms, write 0 ms, index 725 ms: 14 candidates, 76817 repo-hours, 587 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:26:40Z [load_day 2025-11-09] 2025-11-09 hour 19: 147696 events in 0 files, snapshot none (task 3302 ms: download 2213 ms overlapping gunzip 382 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 763 ms: 10 candidates, 65839 repo-hours, 571 releases; waiting 720 ms; commit 0 ms)
2026-11-08T14:26:43Z [load_day 2025-11-09] 2025-11-09 hour 20: 146663 events in 0 files, snapshot none (task 2991 ms: download 1843 ms overlapping gunzip 346 ms, parse 1102 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 66016 repo-hours, 542 releases; waiting 629 ms; commit 0 ms)
2026-11-08T14:26:44Z [load_day 2025-11-09] 2025-11-09 hour 21: 141727 events in 0 files, snapshot none (task 3541 ms: download 2409 ms overlapping gunzip 400 ms, parse 1181 ms, sort 0 ms, write 0 ms, index 599 ms: 6 candidates, 62534 repo-hours, 555 releases; waiting 927 ms; commit 0 ms)
2026-11-08T14:26:47Z [load_day 2025-11-09] 2025-11-09 hour 22: 144569 events in 0 files, snapshot none (task 3141 ms: download 2136 ms overlapping gunzip 383 ms, parse 1162 ms, sort 0 ms, write 0 ms, index 476 ms: 7 candidates, 62896 repo-hours, 654 releases; waiting 755 ms; commit 0 ms)
2026-11-08T14:26:47Z [load_day 2025-11-09] 2025-11-09 hour 23: 142357 events in 0 files, snapshot none (task 2868 ms: download 1812 ms overlapping gunzip 343 ms, parse 1115 ms, sort 0 ms, write 0 ms, index 500 ms: 8 candidates, 60358 repo-hours, 578 releases; waiting 464 ms; commit 0 ms)
2026-11-08T14:26:55Z [load_day 2025-11-09] 2025-11-09: repo_hour merged from 24 files to 1 (1638548 rows, 7228 ms)
2026-11-08T14:26:57Z [load_day 2025-11-09] 2025-11-09: index committed in 10088 ms (24 + 1 + 24 files)
2026-11-08T14:26:57Z [load_day 2025-11-09] 2025-11-09: 3471184 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:26:57Z [load_day 2025-11-09] attempt 1 succeeded