orcaLog in

Runs · run 2911

load_day 2024-09-01, attempt 1 succeeded

Host
73ccef5e07c2:171888
Started
2026-11-08T07:42:41Z
Ended
2026-11-08T07:44:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
633 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
123.6 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2911/load_day/2024-09-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:42:41Z [load_day 2024-09-01] attempt 1 started
2026-11-08T07:42:41Z [load_day 2024-09-01] 2024-09-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:42:46Z [load_day 2024-09-01] 2024-09-01 hour 0: 142691 events in 0 files, snapshot none (task 4558 ms: download 2292 ms overlapping gunzip 663 ms, parse 2572 ms, sort 0 ms, write 0 ms, index 512 ms: 2 candidates, 67667 repo-hours, 1094 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:42:47Z [load_day 2024-09-01] 2024-09-01 hour 1: 168786 events in 0 files, snapshot none (task 4896 ms: download 2781 ms overlapping gunzip 679 ms, parse 2782 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 94114 repo-hours, 1003 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:42:52Z [load_day 2024-09-01] 2024-09-01 hour 2: 137520 events in 0 files, snapshot none (task 5097 ms: download 2353 ms overlapping gunzip 724 ms, parse 2809 ms, sort 0 ms, write 0 ms, index 779 ms: 3 candidates, 60273 repo-hours, 877 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:42:53Z [load_day 2024-09-01] 2024-09-01 hour 3: 158159 events in 0 files, snapshot none (task 6011 ms: download 3916 ms overlapping gunzip 806 ms, parse 3159 ms, sort 0 ms, write 0 ms, index 569 ms: 2 candidates, 60339 repo-hours, 4834 releases; waiting 1191 ms; commit 0 ms)
2026-11-08T07:42:58Z [load_day 2024-09-01] 2024-09-01 hour 4: 136625 events in 0 files, snapshot none (task 5166 ms: download 3936 ms overlapping gunzip 634 ms, parse 2576 ms, sort 0 ms, write 0 ms, index 368 ms: 2 candidates, 47977 repo-hours, 580 releases; waiting 1101 ms; commit 0 ms)
2026-11-08T07:42:58Z [load_day 2024-09-01] 2024-09-01 hour 5: 138981 events in 0 files, snapshot none (task 4148 ms: download 2272 ms overlapping gunzip 622 ms, parse 2258 ms, sort 0 ms, write 0 ms, index 371 ms: 1 candidates, 50468 repo-hours, 696 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:43:04Z [load_day 2024-09-01] 2024-09-01 hour 6: 164450 events in 0 files, snapshot none (task 5941 ms: download 3240 ms overlapping gunzip 856 ms, parse 3609 ms, sort 0 ms, write 0 ms, index 669 ms: 4 candidates, 70362 repo-hours, 718 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:43:04Z [load_day 2024-09-01] 2024-09-01 hour 7: 153930 events in 0 files, snapshot none (task 5870 ms: download 3480 ms overlapping gunzip 892 ms, parse 3726 ms, sort 0 ms, write 0 ms, index 471 ms: 2 candidates, 55404 repo-hours, 655 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:43:10Z [load_day 2024-09-01] 2024-09-01 hour 8: 158954 events in 0 files, snapshot none (task 5728 ms: download 3887 ms overlapping gunzip 909 ms, parse 3553 ms, sort 0 ms, write 0 ms, index 420 ms: 3 candidates, 59164 repo-hours, 776 releases; waiting 307 ms; commit 0 ms)
2026-11-08T07:43:11Z [load_day 2024-09-01] 2024-09-01 hour 9: 167434 events in 0 files, snapshot none (task 5807 ms: download 3301 ms overlapping gunzip 914 ms, parse 3622 ms, sort 0 ms, write 0 ms, index 484 ms: 4 candidates, 66485 repo-hours, 922 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:43:17Z [load_day 2024-09-01] 2024-09-01 hour 10: 166607 events in 0 files, snapshot none (task 5744 ms: download 2796 ms overlapping gunzip 854 ms, parse 3647 ms, sort 0 ms, write 0 ms, index 474 ms: 5 candidates, 61799 repo-hours, 751 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:43:18Z [load_day 2024-09-01] 2024-09-01 hour 11: 165959 events in 0 files, snapshot none (task 6480 ms: download 4370 ms overlapping gunzip 882 ms, parse 3553 ms, sort 0 ms, write 0 ms, index 469 ms: 3 candidates, 59102 repo-hours, 783 releases; waiting 1132 ms; commit 0 ms)
2026-11-08T07:43:24Z [load_day 2024-09-01] 2024-09-01 hour 12: 228352 events in 0 files, snapshot none (task 6508 ms: download 3592 ms overlapping gunzip 924 ms, parse 4012 ms, sort 0 ms, write 0 ms, index 760 ms: 7 candidates, 109846 repo-hours, 995 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:43:25Z [load_day 2024-09-01] 2024-09-01 hour 13: 204833 events in 0 files, snapshot none (task 7106 ms: download 4089 ms overlapping gunzip 1045 ms, parse 4255 ms, sort 0 ms, write 0 ms, index 936 ms: 7 candidates, 91956 repo-hours, 940 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:43:31Z [load_day 2024-09-01] 2024-09-01 hour 14: 186884 events in 0 files, snapshot none (task 6968 ms: download 3578 ms overlapping gunzip 1063 ms, parse 4100 ms, sort 0 ms, write 0 ms, index 1042 ms: 7 candidates, 72015 repo-hours, 939 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:43:32Z [load_day 2024-09-01] 2024-09-01 hour 15: 195607 events in 0 files, snapshot none (task 6608 ms: download 3573 ms overlapping gunzip 981 ms, parse 4053 ms, sort 0 ms, write 0 ms, index 620 ms: 5 candidates, 81091 repo-hours, 1039 releases; waiting 668 ms; commit 0 ms)
2026-11-08T07:43:37Z [load_day 2024-09-01] 2024-09-01 hour 16: 180229 events in 0 files, snapshot none (task 5728 ms: download 2658 ms overlapping gunzip 864 ms, parse 3537 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 70890 repo-hours, 931 releases; waiting 342 ms; commit 0 ms)
2026-11-08T07:43:39Z [load_day 2024-09-01] 2024-09-01 hour 17: 172488 events in 0 files, snapshot none (task 5804 ms: download 2953 ms overlapping gunzip 914 ms, parse 3636 ms, sort 0 ms, write 0 ms, index 499 ms: 6 candidates, 65467 repo-hours, 811 releases; waiting 465 ms; commit 0 ms)
2026-11-08T07:43:44Z [load_day 2024-09-01] 2024-09-01 hour 18: 189249 events in 0 files, snapshot none (task 5977 ms: download 2595 ms overlapping gunzip 927 ms, parse 3805 ms, sort 0 ms, write 0 ms, index 662 ms: 11 candidates, 83106 repo-hours, 989 releases; waiting 266 ms; commit 0 ms)
2026-11-08T07:43:45Z [load_day 2024-09-01] 2024-09-01 hour 19: 163821 events in 0 files, snapshot none (task 5926 ms: download 3159 ms overlapping gunzip 885 ms, parse 3634 ms, sort 0 ms, write 0 ms, index 618 ms: 1 candidates, 59088 repo-hours, 717 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:43:50Z [load_day 2024-09-01] 2024-09-01 hour 20: 157426 events in 0 files, snapshot none (task 5738 ms: download 3893 ms overlapping gunzip 863 ms, parse 3671 ms, sort 0 ms, write 0 ms, index 414 ms: 4 candidates, 58681 repo-hours, 802 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:43:51Z [load_day 2024-09-01] 2024-09-01 hour 21: 154720 events in 0 files, snapshot none (task 5435 ms: download 2987 ms overlapping gunzip 848 ms, parse 3331 ms, sort 0 ms, write 0 ms, index 394 ms: 6 candidates, 59352 repo-hours, 974 releases; waiting 568 ms; commit 0 ms)
2026-11-08T07:43:56Z [load_day 2024-09-01] 2024-09-01 hour 22: 136765 events in 0 files, snapshot none (task 5018 ms: download 2506 ms overlapping gunzip 731 ms, parse 2941 ms, sort 0 ms, write 0 ms, index 775 ms: 3 candidates, 47520 repo-hours, 897 releases; waiting 356 ms; commit 0 ms)
2026-11-08T07:43:56Z [load_day 2024-09-01] 2024-09-01 hour 23: 133793 events in 0 files, snapshot none (task 5058 ms: download 2257 ms overlapping gunzip 790 ms, parse 3387 ms, sort 0 ms, write 0 ms, index 368 ms: 1 candidates, 47856 repo-hours, 607 releases; waiting 175 ms; commit 0 ms)
2026-11-08T07:44:03Z [load_day 2024-09-01] 2024-09-01: repo_hour merged from 24 files to 1 (1600022 rows, 6872 ms)
2026-11-08T07:44:06Z [load_day 2024-09-01] 2024-09-01: index committed in 9308 ms (24 + 1 + 24 files)
2026-11-08T07:44:06Z [load_day 2024-09-01] 2024-09-01: 3964263 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:44:06Z [load_day 2024-09-01] attempt 1 succeeded