orcaLog in

Runs · run 4784

load_day 2026-01-03, attempt 1 succeeded

Host
73ccef5e07c2:424866
Started
2026-11-08T14:55:59Z
Ended
2026-11-08T14:57:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
669 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
67.4 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4784/load_day/2026-01-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:55:59Z [load_day 2026-01-03] attempt 1 started
2026-11-08T14:56:00Z [load_day 2026-01-03] 2026-01-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:56:04Z [load_day 2026-01-03] 2026-01-03 hour 0: 143769 events in 0 files, snapshot none (task 3617 ms: download 1981 ms overlapping gunzip 538 ms, parse 1678 ms, sort 0 ms, write 0 ms, index 596 ms: 5 candidates, 68666 repo-hours, 972 releases; waiting 428 ms; commit 0 ms)
2026-11-08T14:56:05Z [load_day 2026-01-03] 2026-01-03 hour 1: 150737 events in 0 files, snapshot none (task 3978 ms: download 2130 ms overlapping gunzip 522 ms, parse 1609 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 89873 repo-hours, 928 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:56:08Z [load_day 2026-01-03] 2026-01-03 hour 2: 143268 events in 0 files, snapshot none (task 3506 ms: download 2472 ms overlapping gunzip 337 ms, parse 1074 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 69851 repo-hours, 779 releases; waiting 1218 ms; commit 0 ms)
2026-11-08T14:56:10Z [load_day 2026-01-03] 2026-01-03 hour 3: 139476 events in 0 files, snapshot none (task 4380 ms: download 2812 ms overlapping gunzip 354 ms, parse 1058 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 66126 repo-hours, 1188 releases; waiting 2011 ms; commit 0 ms)
2026-11-08T14:56:12Z [load_day 2026-01-03] 2026-01-03 hour 4: 143007 events in 0 files, snapshot none (task 3146 ms: download 2178 ms overlapping gunzip 330 ms, parse 1038 ms, sort 0 ms, write 0 ms, index 501 ms: 7 candidates, 68414 repo-hours, 1317 releases; waiting 995 ms; commit 0 ms)
2026-11-08T14:56:14Z [load_day 2026-01-03] 2026-01-03 hour 5: 139252 events in 0 files, snapshot none (task 3629 ms: download 2390 ms overlapping gunzip 379 ms, parse 1056 ms, sort 0 ms, write 0 ms, index 569 ms: 10 candidates, 59453 repo-hours, 631 releases; waiting 1163 ms; commit 0 ms)
2026-11-08T14:56:16Z [load_day 2026-01-03] 2026-01-03 hour 6: 141991 events in 0 files, snapshot none (task 2958 ms: download 1848 ms overlapping gunzip 346 ms, parse 1060 ms, sort 0 ms, write 0 ms, index 541 ms: 4 candidates, 70956 repo-hours, 744 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:56:17Z [load_day 2026-01-03] 2026-01-03 hour 7: 143765 events in 0 files, snapshot none (task 2711 ms: download 1735 ms overlapping gunzip 320 ms, parse 978 ms, sort 0 ms, write 0 ms, index 498 ms: 7 candidates, 65592 repo-hours, 608 releases; waiting 629 ms; commit 0 ms)
2026-11-08T14:56:21Z [load_day 2026-01-03] 2026-01-03 hour 8: 146475 events in 0 files, snapshot none (task 4536 ms: download 3218 ms overlapping gunzip 575 ms, parse 1643 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 67819 repo-hours, 697 releases; waiting 1362 ms; commit 0 ms)
2026-11-08T14:56:21Z [load_day 2026-01-03] 2026-01-03 hour 9: 147973 events in 0 files, snapshot none (task 2970 ms: download 1759 ms overlapping gunzip 405 ms, parse 1225 ms, sort 0 ms, write 0 ms, index 560 ms: 4 candidates, 69362 repo-hours, 734 releases; waiting 491 ms; commit 0 ms)
2026-11-08T14:56:25Z [load_day 2026-01-03] 2026-01-03 hour 10: 145157 events in 0 files, snapshot none (task 3693 ms: download 1825 ms overlapping gunzip 533 ms, parse 1619 ms, sort 0 ms, write 0 ms, index 644 ms: 9 candidates, 67653 repo-hours, 675 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:56:25Z [load_day 2026-01-03] 2026-01-03 hour 11: 147268 events in 0 files, snapshot none (task 3300 ms: download 1908 ms overlapping gunzip 526 ms, parse 1621 ms, sort 0 ms, write 0 ms, index 623 ms: 1 candidates, 68517 repo-hours, 616 releases; waiting 252 ms; commit 0 ms)
2026-11-08T14:56:29Z [load_day 2026-01-03] 2026-01-03 hour 12: 157618 events in 0 files, snapshot none (task 3932 ms: download 2535 ms overlapping gunzip 458 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 746 ms: 6 candidates, 94729 repo-hours, 689 releases; waiting 881 ms; commit 0 ms)
2026-11-08T14:56:29Z [load_day 2026-01-03] 2026-01-03 hour 13: 150774 events in 0 files, snapshot none (task 3636 ms: download 1677 ms overlapping gunzip 526 ms, parse 1661 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 82852 repo-hours, 603 releases; waiting 406 ms; commit 0 ms)
2026-11-08T14:56:33Z [load_day 2026-01-03] 2026-01-03 hour 14: 153153 events in 0 files, snapshot none (task 3896 ms: download 2063 ms overlapping gunzip 574 ms, parse 1667 ms, sort 0 ms, write 0 ms, index 739 ms: 7 candidates, 74631 repo-hours, 767 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:56:33Z [load_day 2026-01-03] 2026-01-03 hour 15: 148051 events in 0 files, snapshot none (task 3651 ms: download 2254 ms overlapping gunzip 538 ms, parse 1595 ms, sort 0 ms, write 0 ms, index 591 ms: 3 candidates, 71126 repo-hours, 760 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:56:37Z [load_day 2026-01-03] 2026-01-03 hour 16: 146589 events in 0 files, snapshot none (task 3653 ms: download 2219 ms overlapping gunzip 574 ms, parse 1516 ms, sort 0 ms, write 0 ms, index 611 ms: 6 candidates, 74505 repo-hours, 847 releases; waiting 560 ms; commit 0 ms)
2026-11-08T14:56:38Z [load_day 2026-01-03] 2026-01-03 hour 17: 149909 events in 0 files, snapshot none (task 3836 ms: download 2253 ms overlapping gunzip 609 ms, parse 1849 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 70435 repo-hours, 806 releases; waiting 332 ms; commit 0 ms)
2026-11-08T14:56:42Z [load_day 2026-01-03] 2026-01-03 hour 18: 149176 events in 0 files, snapshot none (task 3736 ms: download 2704 ms overlapping gunzip 528 ms, parse 1674 ms, sort 0 ms, write 0 ms, index 624 ms: 4 candidates, 75952 repo-hours, 834 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:56:42Z [load_day 2026-01-03] 2026-01-03 hour 19: 145031 events in 0 files, snapshot none (task 3116 ms: download 1654 ms overlapping gunzip 467 ms, parse 1438 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 63703 repo-hours, 757 releases; waiting 342 ms; commit 0 ms)
2026-11-08T14:56:46Z [load_day 2026-01-03] 2026-01-03 hour 20: 144986 events in 0 files, snapshot none (task 3705 ms: download 1974 ms overlapping gunzip 519 ms, parse 1532 ms, sort 0 ms, write 0 ms, index 624 ms: 6 candidates, 67605 repo-hours, 801 releases; waiting 496 ms; commit 0 ms)
2026-11-08T14:56:46Z [load_day 2026-01-03] 2026-01-03 hour 21: 145700 events in 0 files, snapshot none (task 3284 ms: download 2064 ms overlapping gunzip 480 ms, parse 1312 ms, sort 0 ms, write 0 ms, index 643 ms: 12 candidates, 65284 repo-hours, 772 releases; waiting 621 ms; commit 0 ms)
2026-11-08T14:56:49Z [load_day 2026-01-03] 2026-01-03 hour 22: 142843 events in 0 files, snapshot none (task 3260 ms: download 1778 ms overlapping gunzip 453 ms, parse 1491 ms, sort 0 ms, write 0 ms, index 610 ms: 5 candidates, 63448 repo-hours, 779 releases; waiting 390 ms; commit 0 ms)
2026-11-08T14:56:50Z [load_day 2026-01-03] 2026-01-03 hour 23: 144053 events in 0 files, snapshot none (task 3482 ms: download 1913 ms overlapping gunzip 465 ms, parse 1470 ms, sort 0 ms, write 0 ms, index 506 ms: 5 candidates, 60821 repo-hours, 758 releases; waiting 501 ms; commit 0 ms)
2026-11-08T14:56:57Z [load_day 2026-01-03] 2026-01-03: repo_hour merged from 24 files to 1 (1697373 rows, 7670 ms)
2026-11-08T14:57:01Z [load_day 2026-01-03] 2026-01-03: index committed in 11063 ms (24 + 1 + 24 files)
2026-11-08T14:57:01Z [load_day 2026-01-03] 2026-01-03: 3510021 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:57:01Z [load_day 2026-01-03] attempt 1 succeeded