orcaLog in

Runs · run 4665

load_day 2025-11-29, attempt 1 succeeded

Host
73ccef5e07c2:410379
Started
2026-11-08T14:36:34Z
Ended
2026-11-08T14:37:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
653 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.1 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4665/load_day/2025-11-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:36:34Z [load_day 2025-11-29] attempt 1 started
2026-11-08T14:36:35Z [load_day 2025-11-29] 2025-11-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:36:39Z [load_day 2025-11-29] 2025-11-29 hour 0: 144802 events in 0 files, snapshot none (task 3402 ms: download 2260 ms overlapping gunzip 431 ms, parse 1341 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 71375 repo-hours, 889 releases; waiting 757 ms; commit 0 ms)
2026-11-08T14:36:39Z [load_day 2025-11-29] 2025-11-29 hour 1: 149352 events in 0 files, snapshot none (task 3339 ms: download 1867 ms overlapping gunzip 372 ms, parse 1193 ms, sort 0 ms, write 0 ms, index 732 ms: 5 candidates, 89617 repo-hours, 613 releases; waiting 689 ms; commit 0 ms)
2026-11-08T14:36:43Z [load_day 2025-11-29] 2025-11-29 hour 2: 138688 events in 0 files, snapshot none (task 3273 ms: download 2290 ms overlapping gunzip 410 ms, parse 1293 ms, sort 0 ms, write 0 ms, index 545 ms: 6 candidates, 65626 repo-hours, 624 releases; waiting 725 ms; commit 0 ms)
2026-11-08T14:36:43Z [load_day 2025-11-29] 2025-11-29 hour 3: 139643 events in 0 files, snapshot none (task 3007 ms: download 1939 ms overlapping gunzip 373 ms, parse 1200 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 65564 repo-hours, 1544 releases; waiting 576 ms; commit 0 ms)
2026-11-08T14:36:47Z [load_day 2025-11-29] 2025-11-29 hour 4: 142610 events in 0 files, snapshot none (task 3694 ms: download 2503 ms overlapping gunzip 550 ms, parse 1670 ms, sort 0 ms, write 0 ms, index 475 ms: 6 candidates, 62244 repo-hours, 496 releases; waiting 598 ms; commit 0 ms)
2026-11-08T14:36:47Z [load_day 2025-11-29] 2025-11-29 hour 5: 141924 events in 0 files, snapshot none (task 3377 ms: download 2039 ms overlapping gunzip 472 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 642 ms: 2 candidates, 61656 repo-hours, 517 releases; waiting 569 ms; commit 0 ms)
2026-11-08T14:36:52Z [load_day 2025-11-29] 2025-11-29 hour 6: 140672 events in 0 files, snapshot none (task 4093 ms: download 2597 ms overlapping gunzip 347 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 594 ms: 7 candidates, 68315 repo-hours, 628 releases; waiting 1635 ms; commit 0 ms)
2026-11-08T14:36:52Z [load_day 2025-11-29] 2025-11-29 hour 7: 144072 events in 0 files, snapshot none (task 3104 ms: download 1889 ms overlapping gunzip 359 ms, parse 1155 ms, sort 0 ms, write 0 ms, index 647 ms: 7 candidates, 63702 repo-hours, 544 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:36:56Z [load_day 2025-11-29] 2025-11-29 hour 8: 141506 events in 0 files, snapshot none (task 3591 ms: download 2040 ms overlapping gunzip 568 ms, parse 1779 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 67181 repo-hours, 601 releases; waiting 340 ms; commit 0 ms)
2026-11-08T14:36:56Z [load_day 2025-11-29] 2025-11-29 hour 9: 145055 events in 0 files, snapshot none (task 3451 ms: download 1730 ms overlapping gunzip 540 ms, parse 1716 ms, sort 0 ms, write 0 ms, index 550 ms: 6 candidates, 65507 repo-hours, 623 releases; waiting 345 ms; commit 0 ms)
2026-11-08T14:37:00Z [load_day 2025-11-29] 2025-11-29 hour 10: 147197 events in 0 files, snapshot none (task 3737 ms: download 1788 ms overlapping gunzip 515 ms, parse 1687 ms, sort 0 ms, write 0 ms, index 644 ms: 5 candidates, 67772 repo-hours, 580 releases; waiting 340 ms; commit 0 ms)
2026-11-08T14:37:00Z [load_day 2025-11-29] 2025-11-29 hour 11: 146436 events in 0 files, snapshot none (task 3763 ms: download 2457 ms overlapping gunzip 513 ms, parse 1527 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 65437 repo-hours, 465 releases; waiting 666 ms; commit 0 ms)
2026-11-08T14:37:04Z [load_day 2025-11-29] 2025-11-29 hour 12: 158619 events in 0 files, snapshot none (task 3375 ms: download 1610 ms overlapping gunzip 396 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 864 ms: 4 candidates, 93352 repo-hours, 494 releases; waiting 401 ms; commit 0 ms)
2026-11-08T14:37:04Z [load_day 2025-11-29] 2025-11-29 hour 13: 158398 events in 0 files, snapshot none (task 3703 ms: download 1969 ms overlapping gunzip 447 ms, parse 1429 ms, sort 0 ms, write 0 ms, index 889 ms: 6 candidates, 85342 repo-hours, 540 releases; waiting 618 ms; commit 0 ms)
2026-11-08T14:37:09Z [load_day 2025-11-29] 2025-11-29 hour 14: 148249 events in 0 files, snapshot none (task 4404 ms: download 2937 ms overlapping gunzip 445 ms, parse 1496 ms, sort 0 ms, write 0 ms, index 788 ms: 7 candidates, 70194 repo-hours, 548 releases; waiting 1340 ms; commit 0 ms)
2026-11-08T14:37:09Z [load_day 2025-11-29] 2025-11-29 hour 15: 151416 events in 0 files, snapshot none (task 3965 ms: download 2027 ms overlapping gunzip 563 ms, parse 1890 ms, sort 0 ms, write 0 ms, index 691 ms: 3 candidates, 71628 repo-hours, 607 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:37:13Z [load_day 2025-11-29] 2025-11-29 hour 16: 147844 events in 0 files, snapshot none (task 3653 ms: download 2349 ms overlapping gunzip 412 ms, parse 1398 ms, sort 0 ms, write 0 ms, index 633 ms: 4 candidates, 73764 repo-hours, 624 releases; waiting 830 ms; commit 0 ms)
2026-11-08T14:37:13Z [load_day 2025-11-29] 2025-11-29 hour 17: 147074 events in 0 files, snapshot none (task 2949 ms: download 1702 ms overlapping gunzip 369 ms, parse 1170 ms, sort 0 ms, write 0 ms, index 731 ms: 8 candidates, 70124 repo-hours, 681 releases; waiting 354 ms; commit 0 ms)
2026-11-08T14:37:17Z [load_day 2025-11-29] 2025-11-29 hour 18: 150280 events in 0 files, snapshot none (task 4351 ms: download 2826 ms overlapping gunzip 359 ms, parse 1093 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 76491 repo-hours, 660 releases; waiting 1927 ms; commit 0 ms)
2026-11-08T14:37:17Z [load_day 2025-11-29] 2025-11-29 hour 19: 147452 events in 0 files, snapshot none (task 2873 ms: download 1949 ms overlapping gunzip 395 ms, parse 1144 ms, sort 0 ms, write 0 ms, index 456 ms: 8 candidates, 65112 repo-hours, 495 releases; waiting 590 ms; commit 0 ms)
2026-11-08T14:37:22Z [load_day 2025-11-29] 2025-11-29 hour 20: 146376 events in 0 files, snapshot none (task 3829 ms: download 2852 ms overlapping gunzip 353 ms, parse 1102 ms, sort 0 ms, write 0 ms, index 515 ms: 7 candidates, 65139 repo-hours, 548 releases; waiting 1547 ms; commit 0 ms)
2026-11-08T14:37:22Z [load_day 2025-11-29] 2025-11-29 hour 21: 145873 events in 0 files, snapshot none (task 3193 ms: download 2168 ms overlapping gunzip 397 ms, parse 1093 ms, sort 0 ms, write 0 ms, index 456 ms: 10 candidates, 64706 repo-hours, 635 releases; waiting 810 ms; commit 0 ms)
2026-11-08T14:37:26Z [load_day 2025-11-29] 2025-11-29 hour 22: 141981 events in 0 files, snapshot none (task 3869 ms: download 2301 ms overlapping gunzip 480 ms, parse 1928 ms, sort 0 ms, write 0 ms, index 543 ms: 4 candidates, 63679 repo-hours, 709 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:37:27Z [load_day 2025-11-29] 2025-11-29 hour 23: 141387 events in 0 files, snapshot none (task 4112 ms: download 2601 ms overlapping gunzip 581 ms, parse 1979 ms, sort 0 ms, write 0 ms, index 577 ms: 4 candidates, 61261 repo-hours, 669 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:37:35Z [load_day 2025-11-29] 2025-11-29: repo_hour merged from 24 files to 1 (1674788 rows, 8023 ms)
2026-11-08T14:37:37Z [load_day 2025-11-29] 2025-11-29: index committed in 10839 ms (24 + 1 + 24 files)
2026-11-08T14:37:37Z [load_day 2025-11-29] 2025-11-29: 3506906 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:37:37Z [load_day 2025-11-29] attempt 1 succeeded