orcaLog in

Runs · run 3828

load_day 2025-04-26, attempt 1 succeeded

Host
73ccef5e07c2:294145
Started
2026-11-08T11:37:07Z
Ended
2026-11-08T11:38:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
141.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3828/load_day/2025-04-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:37:07Z [load_day 2025-04-26] attempt 1 started
2026-11-08T11:37:09Z [load_day 2025-04-26] 2025-04-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:37:18Z [load_day 2025-04-26] 2025-04-26 hour 0: 183519 events in 0 files, snapshot none (task 8348 ms: download 5305 ms overlapping gunzip 1214 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 839 ms: 8 candidates, 84935 repo-hours, 1144 releases; waiting 455 ms; commit 0 ms)
2026-11-08T11:37:18Z [load_day 2025-04-26] 2025-04-26 hour 1: 203880 events in 0 files, snapshot none (task 8060 ms: download 4333 ms overlapping gunzip 1157 ms, parse 5108 ms, sort 0 ms, write 0 ms, index 1035 ms: 10 candidates, 109494 repo-hours, 862 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:37:26Z [load_day 2025-04-26] 2025-04-26 hour 2: 163977 events in 0 files, snapshot none (task 7293 ms: download 3744 ms overlapping gunzip 1086 ms, parse 4709 ms, sort 0 ms, write 0 ms, index 672 ms: 11 candidates, 69971 repo-hours, 866 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:37:27Z [load_day 2025-04-26] 2025-04-26 hour 3: 181562 events in 0 files, snapshot none (task 8318 ms: download 4434 ms overlapping gunzip 1215 ms, parse 5572 ms, sort 0 ms, write 0 ms, index 619 ms: 6 candidates, 70143 repo-hours, 3036 releases; waiting 555 ms; commit 0 ms)
2026-11-08T11:37:32Z [load_day 2025-04-26] 2025-04-26 hour 4: 171487 events in 0 files, snapshot none (task 5782 ms: download 2692 ms overlapping gunzip 797 ms, parse 3416 ms, sort 0 ms, write 0 ms, index 820 ms: 7 candidates, 63009 repo-hours, 637 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:37:33Z [load_day 2025-04-26] 2025-04-26 hour 5: 175128 events in 0 files, snapshot none (task 6007 ms: download 2603 ms overlapping gunzip 809 ms, parse 3415 ms, sort 0 ms, write 0 ms, index 772 ms: 4 candidates, 65808 repo-hours, 789 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:37:39Z [load_day 2025-04-26] 2025-04-26 hour 6: 193356 events in 0 files, snapshot none (task 6624 ms: download 3755 ms overlapping gunzip 941 ms, parse 4198 ms, sort 0 ms, write 0 ms, index 666 ms: 6 candidates, 81168 repo-hours, 1070 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:37:40Z [load_day 2025-04-26] 2025-04-26 hour 7: 186233 events in 0 files, snapshot none (task 6400 ms: download 3591 ms overlapping gunzip 913 ms, parse 4051 ms, sort 0 ms, write 0 ms, index 544 ms: 9 candidates, 70981 repo-hours, 1018 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:37:47Z [load_day 2025-04-26] 2025-04-26 hour 8: 193088 events in 0 files, snapshot none (task 7111 ms: download 3755 ms overlapping gunzip 1054 ms, parse 4597 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 75648 repo-hours, 949 releases; waiting 369 ms; commit 0 ms)
2026-11-08T11:37:47Z [load_day 2025-04-26] 2025-04-26 hour 9: 199431 events in 0 files, snapshot none (task 6718 ms: download 3769 ms overlapping gunzip 985 ms, parse 4404 ms, sort 0 ms, write 0 ms, index 598 ms: 5 candidates, 77313 repo-hours, 1196 releases; waiting 443 ms; commit 0 ms)
2026-11-08T11:37:53Z [load_day 2025-04-26] 2025-04-26 hour 10: 200234 events in 0 files, snapshot none (task 6055 ms: download 3560 ms overlapping gunzip 827 ms, parse 3637 ms, sort 0 ms, write 0 ms, index 734 ms: 7 candidates, 78231 repo-hours, 916 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:37:54Z [load_day 2025-04-26] 2025-04-26 hour 11: 193264 events in 0 files, snapshot none (task 6033 ms: download 2667 ms overlapping gunzip 876 ms, parse 3757 ms, sort 0 ms, write 0 ms, index 740 ms: 2 candidates, 73746 repo-hours, 814 releases; waiting 440 ms; commit 0 ms)
2026-11-08T11:38:01Z [load_day 2025-04-26] 2025-04-26 hour 12: 247557 events in 0 files, snapshot none (task 6252 ms: download 3443 ms overlapping gunzip 792 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 861 ms: 8 candidates, 121845 repo-hours, 1201 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:38:01Z [load_day 2025-04-26] 2025-04-26 hour 13: 226561 events in 0 files, snapshot none (task 6240 ms: download 3616 ms overlapping gunzip 876 ms, parse 3935 ms, sort 0 ms, write 0 ms, index 737 ms: 5 candidates, 103964 repo-hours, 1245 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:38:06Z [load_day 2025-04-26] 2025-04-26 hour 14: 213031 events in 0 files, snapshot none (task 5426 ms: download 2879 ms overlapping gunzip 789 ms, parse 3399 ms, sort 0 ms, write 0 ms, index 631 ms: 13 candidates, 84765 repo-hours, 1095 releases; waiting 359 ms; commit 0 ms)
2026-11-08T11:38:08Z [load_day 2025-04-26] 2025-04-26 hour 15: 218432 events in 0 files, snapshot none (task 6567 ms: download 3943 ms overlapping gunzip 814 ms, parse 3631 ms, sort 0 ms, write 0 ms, index 669 ms: 8 candidates, 89027 repo-hours, 1114 releases; waiting 1129 ms; commit 0 ms)
2026-11-08T11:38:12Z [load_day 2025-04-26] 2025-04-26 hour 16: 213400 events in 0 files, snapshot none (task 5429 ms: download 2842 ms overlapping gunzip 757 ms, parse 3281 ms, sort 0 ms, write 0 ms, index 621 ms: 4 candidates, 85522 repo-hours, 1190 releases; waiting 556 ms; commit 0 ms)
2026-11-08T11:38:14Z [load_day 2025-04-26] 2025-04-26 hour 17: 207698 events in 0 files, snapshot none (task 5631 ms: download 3022 ms overlapping gunzip 759 ms, parse 3322 ms, sort 0 ms, write 0 ms, index 766 ms: 5 candidates, 79729 repo-hours, 866 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:38:20Z [load_day 2025-04-26] 2025-04-26 hour 18: 217161 events in 0 files, snapshot none (task 6857 ms: download 3984 ms overlapping gunzip 997 ms, parse 4400 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 92547 repo-hours, 954 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:38:21Z [load_day 2025-04-26] 2025-04-26 hour 19: 199196 events in 0 files, snapshot none (task 6214 ms: download 3532 ms overlapping gunzip 904 ms, parse 3928 ms, sort 0 ms, write 0 ms, index 605 ms: 15 candidates, 73251 repo-hours, 823 releases; waiting 439 ms; commit 0 ms)
2026-11-08T11:38:27Z [load_day 2025-04-26] 2025-04-26 hour 20: 190264 events in 0 files, snapshot none (task 6706 ms: download 3765 ms overlapping gunzip 973 ms, parse 4309 ms, sort 0 ms, write 0 ms, index 565 ms: 9 candidates, 71143 repo-hours, 907 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:38:27Z [load_day 2025-04-26] 2025-04-26 hour 21: 183518 events in 0 files, snapshot none (task 6253 ms: download 3673 ms overlapping gunzip 910 ms, parse 3957 ms, sort 0 ms, write 0 ms, index 545 ms: 13 candidates, 66624 repo-hours, 957 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:38:33Z [load_day 2025-04-26] 2025-04-26 hour 22: 160701 events in 0 files, snapshot none (task 5633 ms: download 3142 ms overlapping gunzip 838 ms, parse 3714 ms, sort 0 ms, write 0 ms, index 447 ms: 10 candidates, 56805 repo-hours, 991 releases; waiting 386 ms; commit 0 ms)
2026-11-08T11:38:34Z [load_day 2025-04-26] 2025-04-26 hour 23: 155006 events in 0 files, snapshot none (task 5628 ms: download 3131 ms overlapping gunzip 796 ms, parse 3683 ms, sort 0 ms, write 0 ms, index 394 ms: 8 candidates, 55656 repo-hours, 933 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:38:42Z [load_day 2025-04-26] 2025-04-26: repo_hour merged from 24 files to 1 (1901325 rows, 8610 ms)
2026-11-08T11:38:45Z [load_day 2025-04-26] 2025-04-26: index committed in 11423 ms (24 + 1 + 24 files)
2026-11-08T11:38:45Z [load_day 2025-04-26] 2025-04-26: 4677684 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:38:45Z [load_day 2025-04-26] attempt 1 succeeded