orcaLog in

Runs · run 4592

load_day 2025-11-08, attempt 1 succeeded

Host
73ccef5e07c2:402369
Started
2026-11-08T14:25:35Z
Ended
2026-11-08T14:26:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
651 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
64.2 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4592/load_day/2025-11-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:25:35Z [load_day 2025-11-08] attempt 1 started
2026-11-08T14:25:37Z [load_day 2025-11-08] 2025-11-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:25:40Z [load_day 2025-11-08] 2025-11-08 hour 0: 142061 events in 0 files, snapshot none (task 3146 ms: download 2016 ms overlapping gunzip 415 ms, parse 1317 ms, sort 0 ms, write 0 ms, index 576 ms: 4 candidates, 73593 repo-hours, 761 releases; waiting 569 ms; commit 0 ms)
2026-11-08T14:25:40Z [load_day 2025-11-08] 2025-11-08 hour 1: 149162 events in 0 files, snapshot none (task 2971 ms: download 1771 ms overlapping gunzip 382 ms, parse 1194 ms, sort 0 ms, write 0 ms, index 615 ms: 6 candidates, 88999 repo-hours, 682 releases; waiting 497 ms; commit 0 ms)
2026-11-08T14:25:44Z [load_day 2025-11-08] 2025-11-08 hour 2: 140295 events in 0 files, snapshot none (task 2995 ms: download 1825 ms overlapping gunzip 399 ms, parse 1252 ms, sort 0 ms, write 0 ms, index 526 ms: 8 candidates, 61241 repo-hours, 567 releases; waiting 462 ms; commit 0 ms)
2026-11-08T14:25:44Z [load_day 2025-11-08] 2025-11-08 hour 3: 140385 events in 0 files, snapshot none (task 3101 ms: download 2070 ms overlapping gunzip 368 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 462 ms: 6 candidates, 61559 repo-hours, 1683 releases; waiting 780 ms; commit 0 ms)
2026-11-08T14:25:47Z [load_day 2025-11-08] 2025-11-08 hour 4: 141130 events in 0 files, snapshot none (task 3170 ms: download 2090 ms overlapping gunzip 323 ms, parse 992 ms, sort 0 ms, write 0 ms, index 483 ms: 10 candidates, 60125 repo-hours, 462 releases; waiting 997 ms; commit 0 ms)
2026-11-08T14:25:48Z [load_day 2025-11-08] 2025-11-08 hour 5: 141116 events in 0 files, snapshot none (task 3263 ms: download 2380 ms overlapping gunzip 314 ms, parse 1049 ms, sort 0 ms, write 0 ms, index 429 ms: 5 candidates, 60676 repo-hours, 532 releases; waiting 1099 ms; commit 0 ms)
2026-11-08T14:25:51Z [load_day 2025-11-08] 2025-11-08 hour 6: 142006 events in 0 files, snapshot none (task 3079 ms: download 1719 ms overlapping gunzip 284 ms, parse 917 ms, sort 0 ms, write 0 ms, index 616 ms: 4 candidates, 68371 repo-hours, 614 releases; waiting 734 ms; commit 0 ms)
2026-11-08T14:25:52Z [load_day 2025-11-08] 2025-11-08 hour 7: 144006 events in 0 files, snapshot none (task 3879 ms: download 2484 ms overlapping gunzip 316 ms, parse 977 ms, sort 0 ms, write 0 ms, index 514 ms: 3 candidates, 60043 repo-hours, 590 releases; waiting 1742 ms; commit 0 ms)
2026-11-08T14:25:54Z [load_day 2025-11-08] 2025-11-08 hour 8: 141370 events in 0 files, snapshot none (task 2447 ms: download 1508 ms overlapping gunzip 317 ms, parse 985 ms, sort 0 ms, write 0 ms, index 481 ms: 3 candidates, 62797 repo-hours, 586 releases; waiting 388 ms; commit 0 ms)
2026-11-08T14:25:55Z [load_day 2025-11-08] 2025-11-08 hour 9: 144116 events in 0 files, snapshot none (task 2726 ms: download 1854 ms overlapping gunzip 306 ms, parse 974 ms, sort 0 ms, write 0 ms, index 496 ms: 2 candidates, 62665 repo-hours, 649 releases; waiting 667 ms; commit 0 ms)
2026-11-08T14:25:57Z [load_day 2025-11-08] 2025-11-08 hour 10: 143468 events in 0 files, snapshot none (task 2901 ms: download 1888 ms overlapping gunzip 312 ms, parse 966 ms, sort 0 ms, write 0 ms, index 515 ms: 6 candidates, 66491 repo-hours, 557 releases; waiting 775 ms; commit 0 ms)
2026-11-08T14:25:59Z [load_day 2025-11-08] 2025-11-08 hour 11: 144963 events in 0 files, snapshot none (task 2938 ms: download 1794 ms overlapping gunzip 298 ms, parse 968 ms, sort 0 ms, write 0 ms, index 560 ms: 4 candidates, 65967 repo-hours, 474 releases; waiting 715 ms; commit 0 ms)
2026-11-08T14:26:00Z [load_day 2025-11-08] 2025-11-08 hour 12: 151282 events in 0 files, snapshot none (task 2851 ms: download 1703 ms overlapping gunzip 301 ms, parse 986 ms, sort 0 ms, write 0 ms, index 610 ms: 8 candidates, 89095 repo-hours, 504 releases; waiting 643 ms; commit 0 ms)
2026-11-08T14:26:03Z [load_day 2025-11-08] 2025-11-08 hour 13: 151090 events in 0 files, snapshot none (task 3388 ms: download 1977 ms overlapping gunzip 349 ms, parse 1112 ms, sort 0 ms, write 0 ms, index 906 ms: 4 candidates, 78550 repo-hours, 446 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:26:04Z [load_day 2025-11-08] 2025-11-08 hour 14: 147986 events in 0 files, snapshot none (task 3485 ms: download 1898 ms overlapping gunzip 495 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 566 ms: 6 candidates, 68355 repo-hours, 596 releases; waiting 567 ms; commit 0 ms)
2026-11-08T14:26:08Z [load_day 2025-11-08] 2025-11-08 hour 15: 151076 events in 0 files, snapshot none (task 4955 ms: download 3064 ms overlapping gunzip 559 ms, parse 1772 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 73699 repo-hours, 566 releases; waiting 1662 ms; commit 0 ms)
2026-11-08T14:26:09Z [load_day 2025-11-08] 2025-11-08 hour 16: 150098 events in 0 files, snapshot none (task 4408 ms: download 2440 ms overlapping gunzip 667 ms, parse 2093 ms, sort 0 ms, write 0 ms, index 607 ms: 9 candidates, 73880 repo-hours, 565 releases; waiting 701 ms; commit 0 ms)
2026-11-08T14:26:13Z [load_day 2025-11-08] 2025-11-08 hour 17: 148959 events in 0 files, snapshot none (task 4485 ms: download 2842 ms overlapping gunzip 664 ms, parse 2049 ms, sort 0 ms, write 0 ms, index 700 ms: 4 candidates, 69151 repo-hours, 556 releases; waiting 760 ms; commit 0 ms)
2026-11-08T14:26:13Z [load_day 2025-11-08] 2025-11-08 hour 18: 147136 events in 0 files, snapshot none (task 4121 ms: download 2259 ms overlapping gunzip 664 ms, parse 2056 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 72422 repo-hours, 614 releases; waiting 489 ms; commit 0 ms)
2026-11-08T14:26:17Z [load_day 2025-11-08] 2025-11-08 hour 19: 143457 events in 0 files, snapshot none (task 3524 ms: download 2581 ms overlapping gunzip 456 ms, parse 1471 ms, sort 0 ms, write 0 ms, index 515 ms: 9 candidates, 61647 repo-hours, 521 releases; waiting 860 ms; commit 0 ms)
2026-11-08T14:26:17Z [load_day 2025-11-08] 2025-11-08 hour 20: 147777 events in 0 files, snapshot none (task 3461 ms: download 2641 ms overlapping gunzip 548 ms, parse 1582 ms, sort 0 ms, write 0 ms, index 461 ms: 5 candidates, 64831 repo-hours, 554 releases; waiting 560 ms; commit 0 ms)
2026-11-08T14:26:21Z [load_day 2025-11-08] 2025-11-08 hour 21: 142021 events in 0 files, snapshot none (task 3527 ms: download 2192 ms overlapping gunzip 437 ms, parse 1443 ms, sort 0 ms, write 0 ms, index 733 ms: 5 candidates, 61648 repo-hours, 601 releases; waiting 601 ms; commit 0 ms)
2026-11-08T14:26:21Z [load_day 2025-11-08] 2025-11-08 hour 22: 142074 events in 0 files, snapshot none (task 3224 ms: download 1949 ms overlapping gunzip 497 ms, parse 1553 ms, sort 0 ms, write 0 ms, index 523 ms: 3 candidates, 60491 repo-hours, 564 releases; waiting 384 ms; commit 0 ms)
2026-11-08T14:26:25Z [load_day 2025-11-08] 2025-11-08 hour 23: 139715 events in 0 files, snapshot none (task 3747 ms: download 2762 ms overlapping gunzip 361 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 442 ms: 4 candidates, 55945 repo-hours, 719 releases; waiting 1447 ms; commit 0 ms)
2026-11-08T14:26:33Z [load_day 2025-11-08] 2025-11-08: repo_hour merged from 24 files to 1 (1622241 rows, 7615 ms)
2026-11-08T14:26:36Z [load_day 2025-11-08] 2025-11-08: index committed in 10962 ms (24 + 1 + 24 files)
2026-11-08T14:26:36Z [load_day 2025-11-08] 2025-11-08: 3476749 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:26:36Z [load_day 2025-11-08] attempt 1 succeeded