orcaLog in

Runs · run 4988

load_day 2026-03-01, attempt 1 succeeded

Host
73ccef5e07c2:449795
Started
2026-11-08T15:27:31Z
Ended
2026-11-08T15:28:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
762 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.0 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4988/load_day/2026-03-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:27:31Z [load_day 2026-03-01] attempt 1 started
2026-11-08T15:27:32Z [load_day 2026-03-01] 2026-03-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:27:37Z [load_day 2026-03-01] 2026-03-01 hour 0: 146222 events in 0 files, snapshot none (task 3577 ms: download 2664 ms overlapping gunzip 473 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 502 ms: 5 candidates, 65596 repo-hours, 1065 releases; waiting 923 ms; commit 0 ms)
2026-11-08T15:27:37Z [load_day 2026-03-01] 2026-03-01 hour 1: 152844 events in 0 files, snapshot none (task 3943 ms: download 2557 ms overlapping gunzip 505 ms, parse 1434 ms, sort 0 ms, write 0 ms, index 680 ms: 10 candidates, 81128 repo-hours, 838 releases; waiting 1073 ms; commit 0 ms)
2026-11-08T15:27:41Z [load_day 2026-03-01] 2026-03-01 hour 2: 150557 events in 0 files, snapshot none (task 3446 ms: download 1960 ms overlapping gunzip 382 ms, parse 1214 ms, sort 0 ms, write 0 ms, index 627 ms: 5 candidates, 84588 repo-hours, 779 releases; waiting 744 ms; commit 0 ms)
2026-11-08T15:27:41Z [load_day 2026-03-01] 2026-03-01 hour 3: 147123 events in 0 files, snapshot none (task 3243 ms: download 2164 ms overlapping gunzip 413 ms, parse 1253 ms, sort 0 ms, write 0 ms, index 580 ms: 6 candidates, 66837 repo-hours, 991 releases; waiting 665 ms; commit 0 ms)
2026-11-08T15:27:45Z [load_day 2026-03-01] 2026-03-01 hour 4: 148052 events in 0 files, snapshot none (task 3634 ms: download 2378 ms overlapping gunzip 455 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 632 ms: 5 candidates, 70109 repo-hours, 1010 releases; waiting 649 ms; commit 0 ms)
2026-11-08T15:27:45Z [load_day 2026-03-01] 2026-03-01 hour 5: 152808 events in 0 files, snapshot none (task 3328 ms: download 2239 ms overlapping gunzip 447 ms, parse 1376 ms, sort 0 ms, write 0 ms, index 555 ms: 4 candidates, 74164 repo-hours, 1805 releases; waiting 649 ms; commit 0 ms)
2026-11-08T15:27:49Z [load_day 2026-03-01] 2026-03-01 hour 6: 150592 events in 0 files, snapshot none (task 3347 ms: download 2151 ms overlapping gunzip 431 ms, parse 1321 ms, sort 0 ms, write 0 ms, index 520 ms: 6 candidates, 72505 repo-hours, 1086 releases; waiting 621 ms; commit 0 ms)
2026-11-08T15:27:50Z [load_day 2026-03-01] 2026-03-01 hour 7: 149675 events in 0 files, snapshot none (task 4305 ms: download 2715 ms overlapping gunzip 513 ms, parse 1552 ms, sort 0 ms, write 0 ms, index 558 ms: 5 candidates, 70885 repo-hours, 1056 releases; waiting 1155 ms; commit 0 ms)
2026-11-08T15:27:53Z [load_day 2026-03-01] 2026-03-01 hour 8: 150830 events in 0 files, snapshot none (task 3653 ms: download 2451 ms overlapping gunzip 538 ms, parse 1642 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 73169 repo-hours, 1091 releases; waiting 645 ms; commit 0 ms)
2026-11-08T15:27:54Z [load_day 2026-03-01] 2026-03-01 hour 9: 152927 events in 0 files, snapshot none (task 3496 ms: download 2154 ms overlapping gunzip 516 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 591 ms: 4 candidates, 75373 repo-hours, 1097 releases; waiting 556 ms; commit 0 ms)
2026-11-08T15:27:58Z [load_day 2026-03-01] 2026-03-01 hour 10: 151499 events in 0 files, snapshot none (task 3978 ms: download 2412 ms overlapping gunzip 630 ms, parse 1917 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 72909 repo-hours, 941 releases; waiting 547 ms; commit 0 ms)
2026-11-08T15:27:58Z [load_day 2026-03-01] 2026-03-01 hour 11: 149859 events in 0 files, snapshot none (task 3486 ms: download 2295 ms overlapping gunzip 561 ms, parse 1502 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 73317 repo-hours, 957 releases; waiting 521 ms; commit 0 ms)
2026-11-08T15:28:01Z [load_day 2026-03-01] 2026-03-01 hour 12: 160422 events in 0 files, snapshot none (task 3283 ms: download 1693 ms overlapping gunzip 431 ms, parse 1370 ms, sort 0 ms, write 0 ms, index 797 ms: 12 candidates, 95689 repo-hours, 633 releases; waiting 307 ms; commit 0 ms)
2026-11-08T15:28:02Z [load_day 2026-03-01] 2026-03-01 hour 13: 160988 events in 0 files, snapshot none (task 3546 ms: download 2038 ms overlapping gunzip 410 ms, parse 1344 ms, sort 0 ms, write 0 ms, index 730 ms: 8 candidates, 92143 repo-hours, 680 releases; waiting 517 ms; commit 0 ms)
2026-11-08T15:28:06Z [load_day 2026-03-01] 2026-03-01 hour 14: 160438 events in 0 files, snapshot none (task 4003 ms: download 2318 ms overlapping gunzip 597 ms, parse 1879 ms, sort 0 ms, write 0 ms, index 643 ms: 8 candidates, 82805 repo-hours, 757 releases; waiting 562 ms; commit 0 ms)
2026-11-08T15:28:06Z [load_day 2026-03-01] 2026-03-01 hour 15: 158075 events in 0 files, snapshot none (task 3688 ms: download 1990 ms overlapping gunzip 554 ms, parse 1752 ms, sort 0 ms, write 0 ms, index 651 ms: 11 candidates, 80106 repo-hours, 863 releases; waiting 395 ms; commit 0 ms)
2026-11-08T15:28:10Z [load_day 2026-03-01] 2026-03-01 hour 16: 155433 events in 0 files, snapshot none (task 3629 ms: download 2205 ms overlapping gunzip 560 ms, parse 1724 ms, sort 0 ms, write 0 ms, index 700 ms: 11 candidates, 78861 repo-hours, 743 releases; waiting 290 ms; commit 0 ms)
2026-11-08T15:28:10Z [load_day 2026-03-01] 2026-03-01 hour 17: 156008 events in 0 files, snapshot none (task 3833 ms: download 2259 ms overlapping gunzip 546 ms, parse 1757 ms, sort 0 ms, write 0 ms, index 663 ms: 8 candidates, 77590 repo-hours, 669 releases; waiting 560 ms; commit 0 ms)
2026-11-08T15:28:14Z [load_day 2026-03-01] 2026-03-01 hour 18: 157538 events in 0 files, snapshot none (task 4107 ms: download 2637 ms overlapping gunzip 605 ms, parse 1712 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 83631 repo-hours, 592 releases; waiting 680 ms; commit 0 ms)
2026-11-08T15:28:15Z [load_day 2026-03-01] 2026-03-01 hour 19: 153119 events in 0 files, snapshot none (task 4221 ms: download 2381 ms overlapping gunzip 653 ms, parse 2041 ms, sort 0 ms, write 0 ms, index 592 ms: 16 candidates, 74670 repo-hours, 755 releases; waiting 663 ms; commit 0 ms)
2026-11-08T15:28:19Z [load_day 2026-03-01] 2026-03-01 hour 20: 153333 events in 0 files, snapshot none (task 3859 ms: download 2476 ms overlapping gunzip 579 ms, parse 1745 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 77452 repo-hours, 795 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:28:19Z [load_day 2026-03-01] 2026-03-01 hour 21: 157155 events in 0 files, snapshot none (task 3907 ms: download 2195 ms overlapping gunzip 614 ms, parse 1945 ms, sort 0 ms, write 0 ms, index 593 ms: 7 candidates, 72524 repo-hours, 790 releases; waiting 399 ms; commit 0 ms)
2026-11-08T15:28:24Z [load_day 2026-03-01] 2026-03-01 hour 22: 153911 events in 0 files, snapshot none (task 4525 ms: download 2129 ms overlapping gunzip 726 ms, parse 2207 ms, sort 0 ms, write 0 ms, index 717 ms: 10 candidates, 74217 repo-hours, 876 releases; waiting 527 ms; commit 0 ms)
2026-11-08T15:28:24Z [load_day 2026-03-01] 2026-03-01 hour 23: 152675 events in 0 files, snapshot none (task 4476 ms: download 2695 ms overlapping gunzip 702 ms, parse 2149 ms, sort 0 ms, write 0 ms, index 637 ms: 8 candidates, 70807 repo-hours, 935 releases; waiting 664 ms; commit 0 ms)
2026-11-08T15:28:34Z [load_day 2026-03-01] 2026-03-01: repo_hour merged from 24 files to 1 (1841075 rows, 9935 ms)
2026-11-08T15:28:37Z [load_day 2026-03-01] 2026-03-01: index committed in 12906 ms (24 + 1 + 24 files)
2026-11-08T15:28:37Z [load_day 2026-03-01] 2026-03-01: 3682083 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:28:37Z [load_day 2026-03-01] attempt 1 succeeded