orcaLog in

Runs · run 3155

load_day 2024-11-02, attempt 1 succeeded

Host
73ccef5e07c2:201297
Started
2026-11-08T08:37:10Z
Ended
2026-11-08T08:38:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
641 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
125.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3155/load_day/2024-11-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:37:10Z [load_day 2024-11-02] attempt 1 started
2026-11-08T08:37:11Z [load_day 2024-11-02] 2024-11-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:37:18Z [load_day 2024-11-02] 2024-11-02 hour 0: 173855 events in 0 files, snapshot none (task 6642 ms: download 3079 ms overlapping gunzip 977 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 820 ms: 7 candidates, 87361 repo-hours, 1174 releases; waiting 592 ms; commit 0 ms)
2026-11-08T08:37:18Z [load_day 2024-11-02] 2024-11-02 hour 1: 176566 events in 0 files, snapshot none (task 6298 ms: download 2404 ms overlapping gunzip 871 ms, parse 3503 ms, sort 0 ms, write 0 ms, index 1134 ms: 3 candidates, 95226 repo-hours, 964 releases; waiting 482 ms; commit 0 ms)
2026-11-08T08:37:24Z [load_day 2024-11-02] 2024-11-02 hour 2: 144495 events in 0 files, snapshot none (task 5691 ms: download 2768 ms overlapping gunzip 772 ms, parse 3384 ms, sort 0 ms, write 0 ms, index 523 ms: 4 candidates, 60853 repo-hours, 930 releases; waiting 550 ms; commit 0 ms)
2026-11-08T08:37:24Z [load_day 2024-11-02] 2024-11-02 hour 3: 167288 events in 0 files, snapshot none (task 5870 ms: download 3513 ms overlapping gunzip 871 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 431 ms: 2 candidates, 60280 repo-hours, 3935 releases; waiting 568 ms; commit 0 ms)
2026-11-08T08:37:31Z [load_day 2024-11-02] 2024-11-02 hour 4: 144664 events in 0 files, snapshot none (task 6762 ms: download 2947 ms overlapping gunzip 1133 ms, parse 4283 ms, sort 0 ms, write 0 ms, index 550 ms: 7 candidates, 48741 repo-hours, 632 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:37:31Z [load_day 2024-11-02] 2024-11-02 hour 5: 148484 events in 0 files, snapshot none (task 6579 ms: download 3282 ms overlapping gunzip 1146 ms, parse 4387 ms, sort 0 ms, write 0 ms, index 484 ms: 2 candidates, 50013 repo-hours, 774 releases; waiting 314 ms; commit 0 ms)
2026-11-08T08:37:38Z [load_day 2024-11-02] 2024-11-02 hour 6: 164380 events in 0 files, snapshot none (task 6629 ms: download 3093 ms overlapping gunzip 943 ms, parse 4119 ms, sort 0 ms, write 0 ms, index 756 ms: 5 candidates, 66452 repo-hours, 1051 releases; waiting 502 ms; commit 0 ms)
2026-11-08T08:37:39Z [load_day 2024-11-02] 2024-11-02 hour 7: 155647 events in 0 files, snapshot none (task 6639 ms: download 3483 ms overlapping gunzip 1057 ms, parse 4161 ms, sort 0 ms, write 0 ms, index 552 ms: 4 candidates, 52543 repo-hours, 855 releases; waiting 425 ms; commit 0 ms)
2026-11-08T08:37:44Z [load_day 2024-11-02] 2024-11-02 hour 8: 163362 events in 0 files, snapshot none (task 4959 ms: download 2476 ms overlapping gunzip 680 ms, parse 2851 ms, sort 0 ms, write 0 ms, index 612 ms: 5 candidates, 58612 repo-hours, 881 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:37:44Z [load_day 2024-11-02] 2024-11-02 hour 9: 175571 events in 0 files, snapshot none (task 5326 ms: download 2895 ms overlapping gunzip 816 ms, parse 3182 ms, sort 0 ms, write 0 ms, index 519 ms: 12 candidates, 64490 repo-hours, 1064 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:37:50Z [load_day 2024-11-02] 2024-11-02 hour 10: 167268 events in 0 files, snapshot none (task 5139 ms: download 4034 ms overlapping gunzip 714 ms, parse 2736 ms, sort 0 ms, write 0 ms, index 514 ms: 5 candidates, 60857 repo-hours, 851 releases; waiting 951 ms; commit 0 ms)
2026-11-08T08:37:50Z [load_day 2024-11-02] 2024-11-02 hour 11: 175216 events in 0 files, snapshot none (task 4747 ms: download 2706 ms overlapping gunzip 694 ms, parse 2754 ms, sort 0 ms, write 0 ms, index 445 ms: 4 candidates, 59820 repo-hours, 773 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:37:56Z [load_day 2024-11-02] 2024-11-02 hour 12: 220880 events in 0 files, snapshot none (task 5679 ms: download 3359 ms overlapping gunzip 741 ms, parse 3265 ms, sort 0 ms, write 0 ms, index 770 ms: 11 candidates, 108227 repo-hours, 977 releases; waiting 615 ms; commit 0 ms)
2026-11-08T08:37:56Z [load_day 2024-11-02] 2024-11-02 hour 13: 206070 events in 0 files, snapshot none (task 5539 ms: download 3023 ms overlapping gunzip 858 ms, parse 3444 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 91302 repo-hours, 866 releases; waiting 266 ms; commit 0 ms)
2026-11-08T08:38:02Z [load_day 2024-11-02] 2024-11-02 hour 14: 192223 events in 0 files, snapshot none (task 5945 ms: download 3132 ms overlapping gunzip 796 ms, parse 3170 ms, sort 0 ms, write 0 ms, index 1091 ms: 7 candidates, 78254 repo-hours, 926 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:38:03Z [load_day 2024-11-02] 2024-11-02 hour 15: 192916 events in 0 files, snapshot none (task 6649 ms: download 3680 ms overlapping gunzip 913 ms, parse 3714 ms, sort 0 ms, write 0 ms, index 611 ms: 4 candidates, 78248 repo-hours, 1081 releases; waiting 1096 ms; commit 0 ms)
2026-11-08T08:38:09Z [load_day 2024-11-02] 2024-11-02 hour 16: 187757 events in 0 files, snapshot none (task 5930 ms: download 3004 ms overlapping gunzip 845 ms, parse 3485 ms, sort 0 ms, write 0 ms, index 755 ms: 10 candidates, 71408 repo-hours, 936 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:38:09Z [load_day 2024-11-02] 2024-11-02 hour 17: 187599 events in 0 files, snapshot none (task 5554 ms: download 3092 ms overlapping gunzip 819 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 542 ms: 3 candidates, 66556 repo-hours, 860 releases; waiting 459 ms; commit 0 ms)
2026-11-08T08:38:16Z [load_day 2024-11-02] 2024-11-02 hour 18: 205336 events in 0 files, snapshot none (task 7065 ms: download 4461 ms overlapping gunzip 986 ms, parse 4420 ms, sort 0 ms, write 0 ms, index 643 ms: 6 candidates, 92068 repo-hours, 955 releases; waiting 751 ms; commit 0 ms)
2026-11-08T08:38:16Z [load_day 2024-11-02] 2024-11-02 hour 19: 178325 events in 0 files, snapshot none (task 5730 ms: download 3024 ms overlapping gunzip 916 ms, parse 3750 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 62436 repo-hours, 893 releases; waiting 316 ms; commit 0 ms)
2026-11-08T08:38:23Z [load_day 2024-11-02] 2024-11-02 hour 20: 168648 events in 0 files, snapshot none (task 6062 ms: download 3583 ms overlapping gunzip 879 ms, parse 3911 ms, sort 0 ms, write 0 ms, index 483 ms: 3 candidates, 60139 repo-hours, 844 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:38:23Z [load_day 2024-11-02] 2024-11-02 hour 21: 168224 events in 0 files, snapshot none (task 6048 ms: download 3661 ms overlapping gunzip 918 ms, parse 3934 ms, sort 0 ms, write 0 ms, index 464 ms: 2 candidates, 60657 repo-hours, 1281 releases; waiting 484 ms; commit 0 ms)
2026-11-08T08:38:28Z [load_day 2024-11-02] 2024-11-02 hour 22: 149124 events in 0 files, snapshot none (task 5491 ms: download 3152 ms overlapping gunzip 883 ms, parse 3511 ms, sort 0 ms, write 0 ms, index 371 ms: 6 candidates, 51362 repo-hours, 997 releases; waiting 482 ms; commit 0 ms)
2026-11-08T08:38:29Z [load_day 2024-11-02] 2024-11-02 hour 23: 139985 events in 0 files, snapshot none (task 5543 ms: download 3101 ms overlapping gunzip 819 ms, parse 3569 ms, sort 0 ms, write 0 ms, index 409 ms: 6 candidates, 48989 repo-hours, 688 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:38:37Z [load_day 2024-11-02] 2024-11-02: repo_hour merged from 24 files to 1 (1634894 rows, 8032 ms)
2026-11-08T08:38:39Z [load_day 2024-11-02] 2024-11-02: index committed in 10959 ms (24 + 1 + 24 files)
2026-11-08T08:38:39Z [load_day 2024-11-02] 2024-11-02: 4153883 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:38:39Z [load_day 2024-11-02] attempt 1 succeeded