orcaLog in

Runs · run 2565

load_day 2024-06-09, attempt 1 succeeded

Host
73ccef5e07c2:133631
Started
2026-11-08T06:27:46Z
Ended
2026-11-08T06:28:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
628 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.8 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2565/load_day/2024-06-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:27:46Z [load_day 2024-06-09] attempt 1 started
2026-11-08T06:27:47Z [load_day 2024-06-09] 2024-06-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:27:52Z [load_day 2024-06-09] 2024-06-09 hour 0: 150064 events in 0 files, snapshot none (task 4838 ms: download 2131 ms overlapping gunzip 712 ms, parse 3226 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 73343 repo-hours, 1738 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:27:52Z [load_day 2024-06-09] 2024-06-09 hour 1: 157630 events in 0 files, snapshot none (task 4683 ms: download 1931 ms overlapping gunzip 694 ms, parse 3171 ms, sort 0 ms, write 0 ms, index 616 ms: 11 candidates, 87322 repo-hours, 1618 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:27:57Z [load_day 2024-06-09] 2024-06-09 hour 2: 130771 events in 0 files, snapshot none (task 4185 ms: download 996 ms overlapping gunzip 648 ms, parse 2765 ms, sort 0 ms, write 0 ms, index 554 ms: 6 candidates, 49660 repo-hours, 709 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:27:57Z [load_day 2024-06-09] 2024-06-09 hour 3: 145717 events in 0 files, snapshot none (task 4210 ms: download 1254 ms overlapping gunzip 625 ms, parse 2762 ms, sort 0 ms, write 0 ms, index 598 ms: 0 candidates, 63162 repo-hours, 4722 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:28:01Z [load_day 2024-06-09] 2024-06-09 hour 4: 124752 events in 0 files, snapshot none (task 3637 ms: download 1421 ms overlapping gunzip 542 ms, parse 2354 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 50295 repo-hours, 481 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:28:01Z [load_day 2024-06-09] 2024-06-09 hour 5: 133117 events in 0 files, snapshot none (task 3804 ms: download 1466 ms overlapping gunzip 567 ms, parse 2529 ms, sort 0 ms, write 0 ms, index 474 ms: 5 candidates, 52022 repo-hours, 662 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:28:06Z [load_day 2024-06-09] 2024-06-09 hour 6: 155820 events in 0 files, snapshot none (task 3945 ms: download 1343 ms overlapping gunzip 580 ms, parse 2513 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 66310 repo-hours, 655 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:28:06Z [load_day 2024-06-09] 2024-06-09 hour 7: 142847 events in 0 files, snapshot none (task 4337 ms: download 1512 ms overlapping gunzip 656 ms, parse 2781 ms, sort 0 ms, write 0 ms, index 681 ms: 8 candidates, 53705 repo-hours, 567 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:28:10Z [load_day 2024-06-09] 2024-06-09 hour 8: 154372 events in 0 files, snapshot none (task 3896 ms: download 1197 ms overlapping gunzip 605 ms, parse 2565 ms, sort 0 ms, write 0 ms, index 511 ms: 10 candidates, 59017 repo-hours, 655 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:28:11Z [load_day 2024-06-09] 2024-06-09 hour 9: 173939 events in 0 files, snapshot none (task 4258 ms: download 1766 ms overlapping gunzip 622 ms, parse 2788 ms, sort 0 ms, write 0 ms, index 635 ms: 6 candidates, 69385 repo-hours, 764 releases; waiting 2 ms; commit 0 ms)
2026-11-08T06:28:14Z [load_day 2024-06-09] 2024-06-09 hour 10: 159508 events in 0 files, snapshot none (task 3579 ms: download 1134 ms overlapping gunzip 539 ms, parse 2368 ms, sort 0 ms, write 0 ms, index 471 ms: 3 candidates, 65300 repo-hours, 677 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:28:15Z [load_day 2024-06-09] 2024-06-09 hour 11: 162396 events in 0 files, snapshot none (task 3689 ms: download 1429 ms overlapping gunzip 559 ms, parse 2494 ms, sort 0 ms, write 0 ms, index 430 ms: 5 candidates, 61110 repo-hours, 716 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:28:19Z [load_day 2024-06-09] 2024-06-09 hour 12: 245391 events in 0 files, snapshot none (task 4596 ms: download 1746 ms overlapping gunzip 628 ms, parse 3002 ms, sort 0 ms, write 0 ms, index 757 ms: 6 candidates, 120647 repo-hours, 868 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:28:20Z [load_day 2024-06-09] 2024-06-09 hour 13: 211322 events in 0 files, snapshot none (task 4059 ms: download 1516 ms overlapping gunzip 562 ms, parse 2570 ms, sort 0 ms, write 0 ms, index 716 ms: 6 candidates, 116102 repo-hours, 744 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:28:25Z [load_day 2024-06-09] 2024-06-09 hour 14: 197917 events in 0 files, snapshot none (task 5144 ms: download 2029 ms overlapping gunzip 788 ms, parse 3514 ms, sort 0 ms, write 0 ms, index 649 ms: 6 candidates, 89252 repo-hours, 791 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:28:26Z [load_day 2024-06-09] 2024-06-09 hour 15: 192186 events in 0 files, snapshot none (task 5314 ms: download 2596 ms overlapping gunzip 814 ms, parse 3654 ms, sort 0 ms, write 0 ms, index 641 ms: 3 candidates, 82044 repo-hours, 976 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:28:30Z [load_day 2024-06-09] 2024-06-09 hour 16: 180096 events in 0 files, snapshot none (task 4808 ms: download 1892 ms overlapping gunzip 728 ms, parse 3143 ms, sort 0 ms, write 0 ms, index 736 ms: 11 candidates, 71930 repo-hours, 849 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:28:31Z [load_day 2024-06-09] 2024-06-09 hour 17: 175233 events in 0 files, snapshot none (task 4648 ms: download 1629 ms overlapping gunzip 754 ms, parse 3143 ms, sort 0 ms, write 0 ms, index 530 ms: 5 candidates, 66147 repo-hours, 748 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:28:35Z [load_day 2024-06-09] 2024-06-09 hour 18: 186538 events in 0 files, snapshot none (task 4947 ms: download 1815 ms overlapping gunzip 639 ms, parse 2985 ms, sort 0 ms, write 0 ms, index 1115 ms: 6 candidates, 80449 repo-hours, 960 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:28:37Z [load_day 2024-06-09] 2024-06-09 hour 19: 162901 events in 0 files, snapshot none (task 5054 ms: download 2060 ms overlapping gunzip 773 ms, parse 3339 ms, sort 0 ms, write 0 ms, index 730 ms: 6 candidates, 59855 repo-hours, 782 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:28:40Z [load_day 2024-06-09] 2024-06-09 hour 20: 157690 events in 0 files, snapshot none (task 4761 ms: download 1492 ms overlapping gunzip 640 ms, parse 3105 ms, sort 0 ms, write 0 ms, index 803 ms: 9 candidates, 60676 repo-hours, 797 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:28:42Z [load_day 2024-06-09] 2024-06-09 hour 21: 156982 events in 0 files, snapshot none (task 4797 ms: download 1547 ms overlapping gunzip 704 ms, parse 3075 ms, sort 0 ms, write 0 ms, index 794 ms: 10 candidates, 62626 repo-hours, 822 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:28:46Z [load_day 2024-06-09] 2024-06-09 hour 22: 139042 events in 0 files, snapshot none (task 5037 ms: download 1939 ms overlapping gunzip 813 ms, parse 3287 ms, sort 0 ms, write 0 ms, index 485 ms: 7 candidates, 49879 repo-hours, 846 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:28:47Z [load_day 2024-06-09] 2024-06-09 hour 23: 133585 events in 0 files, snapshot none (task 3935 ms: download 1401 ms overlapping gunzip 628 ms, parse 2704 ms, sort 0 ms, write 0 ms, index 347 ms: 1 candidates, 49175 repo-hours, 736 releases; waiting 27 ms; commit 0 ms)
2026-11-08T06:28:54Z [load_day 2024-06-09] 2024-06-09: repo_hour merged from 24 files to 1 (1659413 rows, 7574 ms)
2026-11-08T06:28:57Z [load_day 2024-06-09] 2024-06-09: index committed in 10018 ms (23 + 1 + 24 files)
2026-11-08T06:28:57Z [load_day 2024-06-09] 2024-06-09: 3929816 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:28:57Z [load_day 2024-06-09] attempt 1 succeeded