orcaLog in

Runs · run 4565

load_day 2025-11-01, attempt 1 succeeded

Host
73ccef5e07c2:399464
Started
2026-11-08T14:21:46Z
Ended
2026-11-08T14:22:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
680 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
64.4 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4565/load_day/2025-11-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:21:46Z [load_day 2025-11-01] attempt 1 started
2026-11-08T14:21:47Z [load_day 2025-11-01] 2025-11-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:21:52Z [load_day 2025-11-01] 2025-11-01 hour 0: 137911 events in 0 files, snapshot none (task 3511 ms: download 1966 ms overlapping gunzip 393 ms, parse 1169 ms, sort 0 ms, write 0 ms, index 839 ms: 3 candidates, 65904 repo-hours, 818 releases; waiting 787 ms; commit 0 ms)
2026-11-08T14:21:52Z [load_day 2025-11-01] 2025-11-01 hour 1: 146687 events in 0 files, snapshot none (task 3722 ms: download 2273 ms overlapping gunzip 341 ms, parse 1092 ms, sort 0 ms, write 0 ms, index 976 ms: 10 candidates, 85573 repo-hours, 683 releases; waiting 964 ms; commit 0 ms)
2026-11-08T14:21:55Z [load_day 2025-11-01] 2025-11-01 hour 2: 134949 events in 0 files, snapshot none (task 2863 ms: download 1772 ms overlapping gunzip 330 ms, parse 1044 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 62588 repo-hours, 657 releases; waiting 627 ms; commit 0 ms)
2026-11-08T14:21:56Z [load_day 2025-11-01] 2025-11-01 hour 3: 141774 events in 0 files, snapshot none (task 3517 ms: download 2214 ms overlapping gunzip 412 ms, parse 1272 ms, sort 0 ms, write 0 ms, index 468 ms: 3 candidates, 59473 repo-hours, 1705 releases; waiting 785 ms; commit 0 ms)
2026-11-08T14:21:58Z [load_day 2025-11-01] 2025-11-01 hour 4: 136688 events in 0 files, snapshot none (task 2586 ms: download 1826 ms overlapping gunzip 296 ms, parse 964 ms, sort 0 ms, write 0 ms, index 395 ms: 8 candidates, 53745 repo-hours, 493 releases; waiting 629 ms; commit 0 ms)
2026-11-08T14:21:59Z [load_day 2025-11-01] 2025-11-01 hour 5: 139679 events in 0 files, snapshot none (task 2919 ms: download 1940 ms overlapping gunzip 339 ms, parse 1113 ms, sort 0 ms, write 0 ms, index 473 ms: 5 candidates, 57155 repo-hours, 499 releases; waiting 707 ms; commit 0 ms)
2026-11-08T14:22:02Z [load_day 2025-11-01] 2025-11-01 hour 6: 144150 events in 0 files, snapshot none (task 3387 ms: download 2122 ms overlapping gunzip 358 ms, parse 1122 ms, sort 0 ms, write 0 ms, index 598 ms: 4 candidates, 66662 repo-hours, 599 releases; waiting 760 ms; commit 0 ms)
2026-11-08T14:22:02Z [load_day 2025-11-01] 2025-11-01 hour 7: 145430 events in 0 files, snapshot none (task 2842 ms: download 1638 ms overlapping gunzip 347 ms, parse 1098 ms, sort 0 ms, write 0 ms, index 472 ms: 3 candidates, 58915 repo-hours, 551 releases; waiting 481 ms; commit 0 ms)
2026-11-08T14:22:06Z [load_day 2025-11-01] 2025-11-01 hour 8: 142205 events in 0 files, snapshot none (task 3279 ms: download 2250 ms overlapping gunzip 361 ms, parse 1121 ms, sort 0 ms, write 0 ms, index 517 ms: 11 candidates, 60596 repo-hours, 524 releases; waiting 915 ms; commit 0 ms)
2026-11-08T14:22:06Z [load_day 2025-11-01] 2025-11-01 hour 9: 146594 events in 0 files, snapshot none (task 2989 ms: download 1887 ms overlapping gunzip 356 ms, parse 1119 ms, sort 0 ms, write 0 ms, index 461 ms: 8 candidates, 62566 repo-hours, 739 releases; waiting 597 ms; commit 0 ms)
2026-11-08T14:22:11Z [load_day 2025-11-01] 2025-11-01 hour 10: 145883 events in 0 files, snapshot none (task 4286 ms: download 3194 ms overlapping gunzip 427 ms, parse 1334 ms, sort 0 ms, write 0 ms, index 604 ms: 3 candidates, 64761 repo-hours, 625 releases; waiting 1634 ms; commit 0 ms)
2026-11-08T14:22:11Z [load_day 2025-11-01] 2025-11-01 hour 11: 148117 events in 0 files, snapshot none (task 2838 ms: download 1763 ms overlapping gunzip 360 ms, parse 1177 ms, sort 0 ms, write 0 ms, index 516 ms: 2 candidates, 62748 repo-hours, 500 releases; waiting 514 ms; commit 0 ms)
2026-11-08T14:22:15Z [load_day 2025-11-01] 2025-11-01 hour 12: 158132 events in 0 files, snapshot none (task 3114 ms: download 1590 ms overlapping gunzip 326 ms, parse 1117 ms, sort 0 ms, write 0 ms, index 893 ms: 5 candidates, 90251 repo-hours, 547 releases; waiting 537 ms; commit 0 ms)
2026-11-08T14:22:15Z [load_day 2025-11-01] 2025-11-01 hour 13: 153126 events in 0 files, snapshot none (task 3095 ms: download 1758 ms overlapping gunzip 389 ms, parse 1236 ms, sort 0 ms, write 0 ms, index 745 ms: 6 candidates, 77043 repo-hours, 491 releases; waiting 412 ms; commit 0 ms)
2026-11-08T14:22:18Z [load_day 2025-11-01] 2025-11-01 hour 14: 148980 events in 0 files, snapshot none (task 3048 ms: download 1560 ms overlapping gunzip 394 ms, parse 1205 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 67188 repo-hours, 564 releases; waiting 245 ms; commit 0 ms)
2026-11-08T14:22:18Z [load_day 2025-11-01] 2025-11-01 hour 15: 145888 events in 0 files, snapshot none (task 3249 ms: download 2128 ms overlapping gunzip 349 ms, parse 1154 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 67785 repo-hours, 611 releases; waiting 907 ms; commit 0 ms)
2026-11-08T14:22:22Z [load_day 2025-11-01] 2025-11-01 hour 16: 147444 events in 0 files, snapshot none (task 3460 ms: download 2116 ms overlapping gunzip 425 ms, parse 1500 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 68757 repo-hours, 745 releases; waiting 595 ms; commit 0 ms)
2026-11-08T14:22:23Z [load_day 2025-11-01] 2025-11-01 hour 17: 147623 events in 0 files, snapshot none (task 3434 ms: download 2003 ms overlapping gunzip 485 ms, parse 1561 ms, sort 0 ms, write 0 ms, index 501 ms: 5 candidates, 65172 repo-hours, 497 releases; waiting 607 ms; commit 0 ms)
2026-11-08T14:22:26Z [load_day 2025-11-01] 2025-11-01 hour 18: 152549 events in 0 files, snapshot none (task 3344 ms: download 2090 ms overlapping gunzip 439 ms, parse 1363 ms, sort 0 ms, write 0 ms, index 602 ms: 9 candidates, 72943 repo-hours, 585 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:22:26Z [load_day 2025-11-01] 2025-11-01 hour 19: 142593 events in 0 files, snapshot none (task 3090 ms: download 2093 ms overlapping gunzip 353 ms, parse 1248 ms, sort 0 ms, write 0 ms, index 519 ms: 6 candidates, 60132 repo-hours, 528 releases; waiting 706 ms; commit 0 ms)
2026-11-08T14:22:30Z [load_day 2025-11-01] 2025-11-01 hour 20: 145512 events in 0 files, snapshot none (task 2952 ms: download 1933 ms overlapping gunzip 342 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 494 ms: 5 candidates, 61999 repo-hours, 537 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:22:30Z [load_day 2025-11-01] 2025-11-01 hour 21: 144990 events in 0 files, snapshot none (task 3169 ms: download 2055 ms overlapping gunzip 369 ms, parse 1224 ms, sort 0 ms, write 0 ms, index 511 ms: 6 candidates, 60292 repo-hours, 607 releases; waiting 718 ms; commit 0 ms)
2026-11-08T14:22:34Z [load_day 2025-11-01] 2025-11-01 hour 22: 141025 events in 0 files, snapshot none (task 3639 ms: download 2380 ms overlapping gunzip 582 ms, parse 1793 ms, sort 0 ms, write 0 ms, index 459 ms: 4 candidates, 60452 repo-hours, 643 releases; waiting 511 ms; commit 0 ms)
2026-11-08T14:22:34Z [load_day 2025-11-01] 2025-11-01 hour 23: 136741 events in 0 files, snapshot none (task 3736 ms: download 2197 ms overlapping gunzip 540 ms, parse 1766 ms, sort 0 ms, write 0 ms, index 513 ms: 2 candidates, 52729 repo-hours, 634 releases; waiting 537 ms; commit 0 ms)
2026-11-08T14:22:44Z [load_day 2025-11-01] 2025-11-01: repo_hour merged from 24 files to 1 (1565429 rows, 9451 ms)
2026-11-08T14:22:47Z [load_day 2025-11-01] 2025-11-01: index committed in 12609 ms (24 + 1 + 24 files)
2026-11-08T14:22:47Z [load_day 2025-11-01] 2025-11-01: 3474670 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:22:47Z [load_day 2025-11-01] attempt 1 succeeded