orcaLog in

Runs · run 4660

load_day 2025-11-28, attempt 1 succeeded

Host
73ccef5e07c2:410170
Started
2026-11-08T14:36:18Z
Ended
2026-11-08T14:37:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
684 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.0 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4660/load_day/2025-11-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:36:18Z [load_day 2025-11-28] attempt 1 started
2026-11-08T14:36:19Z [load_day 2025-11-28] 2025-11-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:36:22Z [load_day 2025-11-28] 2025-11-28 hour 0: 141809 events in 0 files, snapshot none (task 2639 ms: download 1585 ms overlapping gunzip 327 ms, parse 1074 ms, sort 0 ms, write 0 ms, index 563 ms: 7 candidates, 72515 repo-hours, 743 releases; waiting 331 ms; commit 0 ms)
2026-11-08T14:36:23Z [load_day 2025-11-28] 2025-11-28 hour 1: 154000 events in 0 files, snapshot none (task 3471 ms: download 2219 ms overlapping gunzip 339 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 681 ms: 10 candidates, 93044 repo-hours, 618 releases; waiting 915 ms; commit 0 ms)
2026-11-08T14:36:26Z [load_day 2025-11-28] 2025-11-28 hour 2: 145471 events in 0 files, snapshot none (task 3197 ms: download 1804 ms overlapping gunzip 356 ms, parse 1095 ms, sort 0 ms, write 0 ms, index 729 ms: 5 candidates, 71722 repo-hours, 573 releases; waiting 583 ms; commit 0 ms)
2026-11-08T14:36:27Z [load_day 2025-11-28] 2025-11-28 hour 3: 147727 events in 0 files, snapshot none (task 3218 ms: download 1854 ms overlapping gunzip 341 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 564 ms: 8 candidates, 73325 repo-hours, 1631 releases; waiting 852 ms; commit 0 ms)
2026-11-08T14:36:30Z [load_day 2025-11-28] 2025-11-28 hour 4: 142655 events in 0 files, snapshot none (task 3026 ms: download 2055 ms overlapping gunzip 315 ms, parse 1005 ms, sort 0 ms, write 0 ms, index 452 ms: 11 candidates, 65441 repo-hours, 478 releases; waiting 892 ms; commit 0 ms)
2026-11-08T14:36:30Z [load_day 2025-11-28] 2025-11-28 hour 5: 142655 events in 0 files, snapshot none (task 2934 ms: download 2094 ms overlapping gunzip 353 ms, parse 1076 ms, sort 0 ms, write 0 ms, index 491 ms: 3 candidates, 65365 repo-hours, 555 releases; waiting 727 ms; commit 0 ms)
2026-11-08T14:36:33Z [load_day 2025-11-28] 2025-11-28 hour 6: 146044 events in 0 files, snapshot none (task 3110 ms: download 2014 ms overlapping gunzip 348 ms, parse 1055 ms, sort 0 ms, write 0 ms, index 641 ms: 4 candidates, 76358 repo-hours, 619 releases; waiting 792 ms; commit 0 ms)
2026-11-08T14:36:34Z [load_day 2025-11-28] 2025-11-28 hour 7: 148930 events in 0 files, snapshot none (task 3222 ms: download 2288 ms overlapping gunzip 378 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 559 ms: 7 candidates, 73589 repo-hours, 656 releases; waiting 811 ms; commit 0 ms)
2026-11-08T14:36:38Z [load_day 2025-11-28] 2025-11-28 hour 8: 145358 events in 0 files, snapshot none (task 3717 ms: download 2167 ms overlapping gunzip 465 ms, parse 1304 ms, sort 0 ms, write 0 ms, index 833 ms: 3 candidates, 76414 repo-hours, 727 releases; waiting 748 ms; commit 0 ms)
2026-11-08T14:36:38Z [load_day 2025-11-28] 2025-11-28 hour 9: 143839 events in 0 files, snapshot none (task 3437 ms: download 2007 ms overlapping gunzip 402 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 916 ms: 2 candidates, 74433 repo-hours, 656 releases; waiting 663 ms; commit 0 ms)
2026-11-08T14:36:42Z [load_day 2025-11-28] 2025-11-28 hour 10: 145488 events in 0 files, snapshot none (task 3547 ms: download 1860 ms overlapping gunzip 485 ms, parse 1403 ms, sort 0 ms, write 0 ms, index 800 ms: 3 candidates, 75579 repo-hours, 690 releases; waiting 552 ms; commit 0 ms)
2026-11-08T14:36:42Z [load_day 2025-11-28] 2025-11-28 hour 11: 147838 events in 0 files, snapshot none (task 3633 ms: download 2025 ms overlapping gunzip 411 ms, parse 1250 ms, sort 0 ms, write 0 ms, index 929 ms: 2 candidates, 73758 repo-hours, 595 releases; waiting 741 ms; commit 0 ms)
2026-11-08T14:36:47Z [load_day 2025-11-28] 2025-11-28 hour 12: 158967 events in 0 files, snapshot none (task 4815 ms: download 2570 ms overlapping gunzip 452 ms, parse 1566 ms, sort 0 ms, write 0 ms, index 1268 ms: 7 candidates, 97586 repo-hours, 478 releases; waiting 1205 ms; commit 0 ms)
2026-11-08T14:36:47Z [load_day 2025-11-28] 2025-11-28 hour 13: 157481 events in 0 files, snapshot none (task 4312 ms: download 2418 ms overlapping gunzip 486 ms, parse 1568 ms, sort 0 ms, write 0 ms, index 1063 ms: 1 candidates, 91410 repo-hours, 462 releases; waiting 926 ms; commit 0 ms)
2026-11-08T14:36:51Z [load_day 2025-11-28] 2025-11-28 hour 14: 148202 events in 0 files, snapshot none (task 3894 ms: download 2704 ms overlapping gunzip 531 ms, parse 1508 ms, sort 0 ms, write 0 ms, index 645 ms: 6 candidates, 77206 repo-hours, 637 releases; waiting 894 ms; commit 0 ms)
2026-11-08T14:36:51Z [load_day 2025-11-28] 2025-11-28 hour 15: 150121 events in 0 files, snapshot none (task 3291 ms: download 1857 ms overlapping gunzip 407 ms, parse 1276 ms, sort 0 ms, write 0 ms, index 870 ms: 8 candidates, 78217 repo-hours, 696 releases; waiting 501 ms; commit 0 ms)
2026-11-08T14:36:56Z [load_day 2025-11-28] 2025-11-28 hour 16: 147357 events in 0 files, snapshot none (task 4037 ms: download 2323 ms overlapping gunzip 609 ms, parse 1752 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 77304 repo-hours, 662 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:36:56Z [load_day 2025-11-28] 2025-11-28 hour 17: 151831 events in 0 files, snapshot none (task 4158 ms: download 2534 ms overlapping gunzip 671 ms, parse 1916 ms, sort 0 ms, write 0 ms, index 671 ms: 7 candidates, 74623 repo-hours, 652 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:37:00Z [load_day 2025-11-28] 2025-11-28 hour 18: 150721 events in 0 files, snapshot none (task 3713 ms: download 2095 ms overlapping gunzip 564 ms, parse 1811 ms, sort 0 ms, write 0 ms, index 752 ms: 7 candidates, 79129 repo-hours, 630 releases; waiting 271 ms; commit 0 ms)
2026-11-08T14:37:00Z [load_day 2025-11-28] 2025-11-28 hour 19: 146195 events in 0 files, snapshot none (task 3294 ms: download 1857 ms overlapping gunzip 450 ms, parse 1422 ms, sort 0 ms, write 0 ms, index 543 ms: 5 candidates, 65649 repo-hours, 610 releases; waiting 521 ms; commit 0 ms)
2026-11-08T14:37:04Z [load_day 2025-11-28] 2025-11-28 hour 20: 144595 events in 0 files, snapshot none (task 3702 ms: download 2238 ms overlapping gunzip 556 ms, parse 1702 ms, sort 0 ms, write 0 ms, index 567 ms: 10 candidates, 66165 repo-hours, 554 releases; waiting 506 ms; commit 0 ms)
2026-11-08T14:37:05Z [load_day 2025-11-28] 2025-11-28 hour 21: 147077 events in 0 files, snapshot none (task 3783 ms: download 2079 ms overlapping gunzip 566 ms, parse 1794 ms, sort 0 ms, write 0 ms, index 567 ms: 9 candidates, 67345 repo-hours, 612 releases; waiting 506 ms; commit 0 ms)
2026-11-08T14:37:09Z [load_day 2025-11-28] 2025-11-28 hour 22: 143150 events in 0 files, snapshot none (task 3876 ms: download 2033 ms overlapping gunzip 558 ms, parse 1857 ms, sort 0 ms, write 0 ms, index 618 ms: 1 candidates, 64320 repo-hours, 822 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:37:09Z [load_day 2025-11-28] 2025-11-28 hour 23: 142451 events in 0 files, snapshot none (task 4056 ms: download 2579 ms overlapping gunzip 604 ms, parse 1914 ms, sort 0 ms, write 0 ms, index 445 ms: 7 candidates, 61722 repo-hours, 768 releases; waiting 807 ms; commit 0 ms)
2026-11-08T14:37:17Z [load_day 2025-11-28] 2025-11-28: repo_hour merged from 24 files to 1 (1792219 rows, 8032 ms)
2026-11-08T14:37:20Z [load_day 2025-11-28] 2025-11-28: index committed in 10934 ms (24 + 1 + 24 files)
2026-11-08T14:37:20Z [load_day 2025-11-28] 2025-11-28: 3539962 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:37:20Z [load_day 2025-11-28] attempt 1 succeeded