orcaLog in

Runs · run 5034

load_day 2026-03-14, attempt 1 succeeded

Host
73ccef5e07c2:455155
Started
2026-11-08T15:34:25Z
Ended
2026-11-08T15:35:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
733 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5034/load_day/2026-03-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:34:25Z [load_day 2026-03-14] attempt 1 started
2026-11-08T15:34:26Z [load_day 2026-03-14] 2026-03-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:34:31Z [load_day 2026-03-14] 2026-03-14 hour 0: 147847 events in 0 files, snapshot none (task 3940 ms: download 2349 ms overlapping gunzip 626 ms, parse 1812 ms, sort 0 ms, write 0 ms, index 648 ms: 10 candidates, 70485 repo-hours, 1070 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:34:31Z [load_day 2026-03-14] 2026-03-14 hour 1: 158321 events in 0 files, snapshot none (task 3844 ms: download 2321 ms overlapping gunzip 493 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 772 ms: 11 candidates, 91312 repo-hours, 633 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:34:35Z [load_day 2026-03-14] 2026-03-14 hour 2: 153733 events in 0 files, snapshot none (task 3658 ms: download 2321 ms overlapping gunzip 482 ms, parse 1597 ms, sort 0 ms, write 0 ms, index 656 ms: 7 candidates, 83376 repo-hours, 765 releases; waiting 609 ms; commit 0 ms)
2026-11-08T15:34:35Z [load_day 2026-03-14] 2026-03-14 hour 3: 149678 events in 0 files, snapshot none (task 3798 ms: download 2471 ms overlapping gunzip 558 ms, parse 1576 ms, sort 0 ms, write 0 ms, index 537 ms: 11 candidates, 70368 repo-hours, 952 releases; waiting 772 ms; commit 0 ms)
2026-11-08T15:34:39Z [load_day 2026-03-14] 2026-03-14 hour 4: 148429 events in 0 files, snapshot none (task 3727 ms: download 2486 ms overlapping gunzip 571 ms, parse 1516 ms, sort 0 ms, write 0 ms, index 645 ms: 7 candidates, 68074 repo-hours, 978 releases; waiting 662 ms; commit 0 ms)
2026-11-08T15:34:40Z [load_day 2026-03-14] 2026-03-14 hour 5: 149674 events in 0 files, snapshot none (task 4400 ms: download 2855 ms overlapping gunzip 524 ms, parse 1551 ms, sort 0 ms, write 0 ms, index 653 ms: 8 candidates, 74250 repo-hours, 829 releases; waiting 1353 ms; commit 0 ms)
2026-11-08T15:34:43Z [load_day 2026-03-14] 2026-03-14 hour 6: 149140 events in 0 files, snapshot none (task 3695 ms: download 2408 ms overlapping gunzip 474 ms, parse 1294 ms, sort 0 ms, write 0 ms, index 688 ms: 6 candidates, 77725 repo-hours, 904 releases; waiting 874 ms; commit 0 ms)
2026-11-08T15:34:44Z [load_day 2026-03-14] 2026-03-14 hour 7: 148271 events in 0 files, snapshot none (task 3216 ms: download 2036 ms overlapping gunzip 473 ms, parse 1378 ms, sort 0 ms, write 0 ms, index 585 ms: 9 candidates, 74831 repo-hours, 893 releases; waiting 507 ms; commit 0 ms)
2026-11-08T15:34:47Z [load_day 2026-03-14] 2026-03-14 hour 8: 151958 events in 0 files, snapshot none (task 3683 ms: download 2264 ms overlapping gunzip 507 ms, parse 1443 ms, sort 0 ms, write 0 ms, index 750 ms: 14 candidates, 77675 repo-hours, 847 releases; waiting 676 ms; commit 0 ms)
2026-11-08T15:34:47Z [load_day 2026-03-14] 2026-03-14 hour 9: 147021 events in 0 files, snapshot none (task 3531 ms: download 2168 ms overlapping gunzip 446 ms, parse 1326 ms, sort 0 ms, write 0 ms, index 776 ms: 5 candidates, 73110 repo-hours, 823 releases; waiting 674 ms; commit 0 ms)
2026-11-08T15:34:52Z [load_day 2026-03-14] 2026-03-14 hour 10: 160065 events in 0 files, snapshot none (task 3692 ms: download 2205 ms overlapping gunzip 453 ms, parse 1308 ms, sort 0 ms, write 0 ms, index 917 ms: 8 candidates, 80833 repo-hours, 839 releases; waiting 659 ms; commit 0 ms)
2026-11-08T15:34:52Z [load_day 2026-03-14] 2026-03-14 hour 11: 152253 events in 0 files, snapshot none (task 4032 ms: download 2266 ms overlapping gunzip 513 ms, parse 1546 ms, sort 0 ms, write 0 ms, index 684 ms: 8 candidates, 75707 repo-hours, 711 releases; waiting 875 ms; commit 0 ms)
2026-11-08T15:34:55Z [load_day 2026-03-14] 2026-03-14 hour 12: 159698 events in 0 files, snapshot none (task 2892 ms: download 1655 ms overlapping gunzip 308 ms, parse 973 ms, sort 0 ms, write 0 ms, index 703 ms: 6 candidates, 92686 repo-hours, 525 releases; waiting 583 ms; commit 0 ms)
2026-11-08T15:34:56Z [load_day 2026-03-14] 2026-03-14 hour 13: 161588 events in 0 files, snapshot none (task 3468 ms: download 2310 ms overlapping gunzip 341 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 685 ms: 6 candidates, 94441 repo-hours, 431 releases; waiting 1088 ms; commit 0 ms)
2026-11-08T15:34:59Z [load_day 2026-03-14] 2026-03-14 hour 14: 159872 events in 0 files, snapshot none (task 3578 ms: download 2262 ms overlapping gunzip 382 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 807 ms: 17 candidates, 82294 repo-hours, 615 releases; waiting 840 ms; commit 0 ms)
2026-11-08T15:35:00Z [load_day 2026-03-14] 2026-03-14 hour 15: 157157 events in 0 files, snapshot none (task 2980 ms: download 1873 ms overlapping gunzip 331 ms, parse 1067 ms, sort 0 ms, write 0 ms, index 590 ms: 9 candidates, 78526 repo-hours, 485 releases; waiting 693 ms; commit 0 ms)
2026-11-08T15:35:03Z [load_day 2026-03-14] 2026-03-14 hour 16: 160298 events in 0 files, snapshot none (task 3016 ms: download 1829 ms overlapping gunzip 300 ms, parse 975 ms, sort 0 ms, write 0 ms, index 693 ms: 18 candidates, 83211 repo-hours, 447 releases; waiting 751 ms; commit 0 ms)
2026-11-08T15:35:04Z [load_day 2026-03-14] 2026-03-14 hour 17: 161683 events in 0 files, snapshot none (task 3565 ms: download 2190 ms overlapping gunzip 388 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 82414 repo-hours, 599 releases; waiting 1064 ms; commit 0 ms)
2026-11-08T15:35:07Z [load_day 2026-03-14] 2026-03-14 hour 18: 160430 events in 0 files, snapshot none (task 3509 ms: download 2134 ms overlapping gunzip 319 ms, parse 987 ms, sort 0 ms, write 0 ms, index 749 ms: 10 candidates, 85241 repo-hours, 664 releases; waiting 1125 ms; commit 0 ms)
2026-11-08T15:35:08Z [load_day 2026-03-14] 2026-03-14 hour 19: 156106 events in 0 files, snapshot none (task 3277 ms: download 2120 ms overlapping gunzip 362 ms, parse 1138 ms, sort 0 ms, write 0 ms, index 635 ms: 9 candidates, 76416 repo-hours, 702 releases; waiting 837 ms; commit 0 ms)
2026-11-08T15:35:12Z [load_day 2026-03-14] 2026-03-14 hour 20: 155014 events in 0 files, snapshot none (task 4584 ms: download 2273 ms overlapping gunzip 702 ms, parse 2029 ms, sort 0 ms, write 0 ms, index 932 ms: 10 candidates, 72196 repo-hours, 844 releases; waiting 591 ms; commit 0 ms)
2026-11-08T15:35:13Z [load_day 2026-03-14] 2026-03-14 hour 21: 155442 events in 0 files, snapshot none (task 4449 ms: download 2632 ms overlapping gunzip 637 ms, parse 2077 ms, sort 0 ms, write 0 ms, index 607 ms: 7 candidates, 74286 repo-hours, 864 releases; waiting 830 ms; commit 0 ms)
2026-11-08T15:35:18Z [load_day 2026-03-14] 2026-03-14 hour 22: 151744 events in 0 files, snapshot none (task 4810 ms: download 2193 ms overlapping gunzip 690 ms, parse 2155 ms, sort 0 ms, write 0 ms, index 1086 ms: 4 candidates, 70557 repo-hours, 942 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:35:18Z [load_day 2026-03-14] 2026-03-14 hour 23: 151623 events in 0 files, snapshot none (task 4694 ms: download 2053 ms overlapping gunzip 672 ms, parse 2247 ms, sort 0 ms, write 0 ms, index 886 ms: 7 candidates, 69918 repo-hours, 1065 releases; waiting 277 ms; commit 0 ms)
2026-11-08T15:35:27Z [load_day 2026-03-14] 2026-03-14: repo_hour merged from 24 files to 1 (1879932 rows, 8844 ms)
2026-11-08T15:35:32Z [load_day 2026-03-14] 2026-03-14: index committed in 14040 ms (24 + 1 + 24 files)
2026-11-08T15:35:32Z [load_day 2026-03-14] 2026-03-14: 3707045 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:35:32Z [load_day 2026-03-14] attempt 1 succeeded