orcaLog in

Runs · run 3673

load_day 2025-03-16, attempt 1 succeeded

Host
73ccef5e07c2:271141
Started
2026-11-08T10:52:31Z
Ended
2026-11-08T10:54:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
793 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
139.9 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3673/load_day/2025-03-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:52:31Z [load_day 2025-03-16] attempt 1 started
2026-11-08T10:52:32Z [load_day 2025-03-16] 2025-03-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:52:38Z [load_day 2025-03-16] 2025-03-16 hour 0: 180270 events in 0 files, snapshot none (task 5819 ms: download 2886 ms overlapping gunzip 826 ms, parse 3564 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 78049 repo-hours, 1183 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:52:39Z [load_day 2025-03-16] 2025-03-16 hour 1: 213099 events in 0 files, snapshot none (task 6539 ms: download 3521 ms overlapping gunzip 883 ms, parse 3935 ms, sort 0 ms, write 0 ms, index 921 ms: 5 candidates, 109528 repo-hours, 948 releases; waiting 448 ms; commit 0 ms)
2026-11-08T10:52:44Z [load_day 2025-03-16] 2025-03-16 hour 2: 169692 events in 0 files, snapshot none (task 5393 ms: download 2859 ms overlapping gunzip 828 ms, parse 3401 ms, sort 0 ms, write 0 ms, index 486 ms: 5 candidates, 66100 repo-hours, 934 releases; waiting 385 ms; commit 0 ms)
2026-11-08T10:52:45Z [load_day 2025-03-16] 2025-03-16 hour 3: 184773 events in 0 files, snapshot none (task 5585 ms: download 2787 ms overlapping gunzip 746 ms, parse 3224 ms, sort 0 ms, write 0 ms, index 817 ms: 1 candidates, 69666 repo-hours, 3974 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:52:50Z [load_day 2025-03-16] 2025-03-16 hour 4: 173017 events in 0 files, snapshot none (task 5088 ms: download 2913 ms overlapping gunzip 740 ms, parse 2979 ms, sort 0 ms, write 0 ms, index 475 ms: 4 candidates, 58438 repo-hours, 717 releases; waiting 547 ms; commit 0 ms)
2026-11-08T10:52:51Z [load_day 2025-03-16] 2025-03-16 hour 5: 182291 events in 0 files, snapshot none (task 5227 ms: download 2681 ms overlapping gunzip 717 ms, parse 3193 ms, sort 0 ms, write 0 ms, index 446 ms: 4 candidates, 61114 repo-hours, 703 releases; waiting 510 ms; commit 0 ms)
2026-11-08T10:52:55Z [load_day 2025-03-16] 2025-03-16 hour 6: 201550 events in 0 files, snapshot none (task 4965 ms: download 2289 ms overlapping gunzip 705 ms, parse 3053 ms, sort 0 ms, write 0 ms, index 594 ms: 4 candidates, 78957 repo-hours, 938 releases; waiting 305 ms; commit 0 ms)
2026-11-08T10:52:56Z [load_day 2025-03-16] 2025-03-16 hour 7: 188985 events in 0 files, snapshot none (task 4865 ms: download 2696 ms overlapping gunzip 661 ms, parse 2926 ms, sort 0 ms, write 0 ms, index 490 ms: 3 candidates, 64531 repo-hours, 693 releases; waiting 524 ms; commit 0 ms)
2026-11-08T10:53:01Z [load_day 2025-03-16] 2025-03-16 hour 8: 193735 events in 0 files, snapshot none (task 4966 ms: download 2962 ms overlapping gunzip 654 ms, parse 2840 ms, sort 0 ms, write 0 ms, index 621 ms: 4 candidates, 69843 repo-hours, 821 releases; waiting 558 ms; commit 0 ms)
2026-11-08T10:53:02Z [load_day 2025-03-16] 2025-03-16 hour 9: 207571 events in 0 files, snapshot none (task 5324 ms: download 3722 ms overlapping gunzip 717 ms, parse 3187 ms, sort 0 ms, write 0 ms, index 613 ms: 4 candidates, 77717 repo-hours, 947 releases; waiting 523 ms; commit 0 ms)
2026-11-08T10:53:07Z [load_day 2025-03-16] 2025-03-16 hour 10: 204316 events in 0 files, snapshot none (task 5786 ms: download 2865 ms overlapping gunzip 749 ms, parse 3323 ms, sort 0 ms, write 0 ms, index 887 ms: 2 candidates, 76243 repo-hours, 967 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:53:09Z [load_day 2025-03-16] 2025-03-16 hour 11: 203286 events in 0 files, snapshot none (task 6378 ms: download 3093 ms overlapping gunzip 892 ms, parse 3848 ms, sort 0 ms, write 0 ms, index 805 ms: 6 candidates, 74376 repo-hours, 894 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:53:15Z [load_day 2025-03-16] 2025-03-16 hour 12: 258848 events in 0 files, snapshot none (task 7105 ms: download 3446 ms overlapping gunzip 839 ms, parse 4005 ms, sort 0 ms, write 0 ms, index 1487 ms: 9 candidates, 125098 repo-hours, 1099 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:53:16Z [load_day 2025-03-16] 2025-03-16 hour 13: 236504 events in 0 files, snapshot none (task 6359 ms: download 3412 ms overlapping gunzip 900 ms, parse 3824 ms, sort 0 ms, write 0 ms, index 834 ms: 6 candidates, 106137 repo-hours, 970 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:53:22Z [load_day 2025-03-16] 2025-03-16 hour 14: 230844 events in 0 files, snapshot none (task 6898 ms: download 4262 ms overlapping gunzip 978 ms, parse 4213 ms, sort 0 ms, write 0 ms, index 809 ms: 11 candidates, 90257 repo-hours, 1069 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:53:23Z [load_day 2025-03-16] 2025-03-16 hour 15: 236816 events in 0 files, snapshot none (task 6518 ms: download 3634 ms overlapping gunzip 930 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 875 ms: 4 candidates, 96496 repo-hours, 1124 releases; waiting 331 ms; commit 0 ms)
2026-11-08T10:53:30Z [load_day 2025-03-16] 2025-03-16 hour 16: 227862 events in 0 files, snapshot none (task 7526 ms: download 4466 ms overlapping gunzip 1108 ms, parse 4644 ms, sort 0 ms, write 0 ms, index 926 ms: 5 candidates, 88109 repo-hours, 1095 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:53:31Z [load_day 2025-03-16] 2025-03-16 hour 17: 228454 events in 0 files, snapshot none (task 7258 ms: download 4345 ms overlapping gunzip 1077 ms, parse 4636 ms, sort 0 ms, write 0 ms, index 752 ms: 6 candidates, 83590 repo-hours, 998 releases; waiting 536 ms; commit 0 ms)
2026-11-08T10:53:40Z [load_day 2025-03-16] 2025-03-16 hour 18: 232724 events in 0 files, snapshot none (task 9055 ms: download 5494 ms overlapping gunzip 1349 ms, parse 6028 ms, sort 0 ms, write 0 ms, index 859 ms: 10 candidates, 98017 repo-hours, 1051 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:53:40Z [load_day 2025-03-16] 2025-03-16 hour 19: 216114 events in 0 files, snapshot none (task 8213 ms: download 5001 ms overlapping gunzip 1265 ms, parse 5419 ms, sort 0 ms, write 0 ms, index 813 ms: 8 candidates, 74634 repo-hours, 950 releases; waiting 466 ms; commit 0 ms)
2026-11-08T10:53:48Z [load_day 2025-03-16] 2025-03-16 hour 20: 217813 events in 0 files, snapshot none (task 7711 ms: download 4079 ms overlapping gunzip 1159 ms, parse 5353 ms, sort 0 ms, write 0 ms, index 768 ms: 8 candidates, 75197 repo-hours, 1099 releases; waiting 181 ms; commit 0 ms)
2026-11-08T10:53:48Z [load_day 2025-03-16] 2025-03-16 hour 21: 206176 events in 0 files, snapshot none (task 8054 ms: download 4604 ms overlapping gunzip 1254 ms, parse 5100 ms, sort 0 ms, write 0 ms, index 728 ms: 11 candidates, 75709 repo-hours, 1158 releases; waiting 469 ms; commit 0 ms)
2026-11-08T10:53:54Z [load_day 2025-03-16] 2025-03-16 hour 22: 192078 events in 0 files, snapshot none (task 5979 ms: download 3173 ms overlapping gunzip 845 ms, parse 3670 ms, sort 0 ms, write 0 ms, index 707 ms: 8 candidates, 66487 repo-hours, 1233 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:53:55Z [load_day 2025-03-16] 2025-03-16 hour 23: 183716 events in 0 files, snapshot none (task 5532 ms: download 2981 ms overlapping gunzip 793 ms, parse 3609 ms, sort 0 ms, write 0 ms, index 527 ms: 5 candidates, 63448 repo-hours, 932 releases; waiting 315 ms; commit 0 ms)
2026-11-08T10:54:03Z [load_day 2025-03-16] 2025-03-16: repo_hour merged from 24 files to 1 (1927741 rows, 8843 ms)
2026-11-08T10:54:06Z [load_day 2025-03-16] 2025-03-16: index committed in 11753 ms (24 + 1 + 24 files)
2026-11-08T10:54:06Z [load_day 2025-03-16] 2025-03-16: 4970534 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:54:06Z [load_day 2025-03-16] attempt 1 succeeded