orcaLog in

Runs · run 3569

load_day 2025-02-16, attempt 1 succeeded

Host
73ccef5e07c2:256331
Started
2026-11-08T10:22:29Z
Ended
2026-11-08T10:24:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
756 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
138.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3569/load_day/2025-02-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:22:29Z [load_day 2025-02-16] attempt 1 started
2026-11-08T10:22:30Z [load_day 2025-02-16] 2025-02-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:22:37Z [load_day 2025-02-16] 2025-02-16 hour 0: 172071 events in 0 files, snapshot none (task 6499 ms: download 3450 ms overlapping gunzip 943 ms, parse 4149 ms, sort 0 ms, write 0 ms, index 664 ms: 10 candidates, 80099 repo-hours, 1250 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:22:37Z [load_day 2025-02-16] 2025-02-16 hour 1: 194836 events in 0 files, snapshot none (task 6626 ms: download 3527 ms overlapping gunzip 991 ms, parse 4129 ms, sort 0 ms, write 0 ms, index 788 ms: 7 candidates, 105710 repo-hours, 1024 releases; waiting 458 ms; commit 0 ms)
2026-11-08T10:22:44Z [load_day 2025-02-16] 2025-02-16 hour 2: 157725 events in 0 files, snapshot none (task 6103 ms: download 3146 ms overlapping gunzip 885 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 636 ms: 8 candidates, 67798 repo-hours, 844 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:22:44Z [load_day 2025-02-16] 2025-02-16 hour 3: 178509 events in 0 files, snapshot none (task 6019 ms: download 2951 ms overlapping gunzip 836 ms, parse 3939 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 68183 repo-hours, 3928 releases; waiting 305 ms; commit 0 ms)
2026-11-08T10:22:50Z [load_day 2025-02-16] 2025-02-16 hour 4: 163017 events in 0 files, snapshot none (task 5365 ms: download 2081 ms overlapping gunzip 739 ms, parse 3215 ms, sort 0 ms, write 0 ms, index 635 ms: 9 candidates, 58646 repo-hours, 735 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:22:50Z [load_day 2025-02-16] 2025-02-16 hour 5: 173178 events in 0 files, snapshot none (task 5802 ms: download 2580 ms overlapping gunzip 820 ms, parse 3614 ms, sort 0 ms, write 0 ms, index 557 ms: 4 candidates, 60869 repo-hours, 765 releases; waiting 553 ms; commit 0 ms)
2026-11-08T10:22:56Z [load_day 2025-02-16] 2025-02-16 hour 6: 185757 events in 0 files, snapshot none (task 6262 ms: download 3742 ms overlapping gunzip 835 ms, parse 3741 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 78081 repo-hours, 896 releases; waiting 737 ms; commit 0 ms)
2026-11-08T10:22:56Z [load_day 2025-02-16] 2025-02-16 hour 7: 174498 events in 0 files, snapshot none (task 5968 ms: download 3263 ms overlapping gunzip 878 ms, parse 3771 ms, sort 0 ms, write 0 ms, index 547 ms: 9 candidates, 63720 repo-hours, 837 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:23:02Z [load_day 2025-02-16] 2025-02-16 hour 8: 184648 events in 0 files, snapshot none (task 5093 ms: download 2597 ms overlapping gunzip 709 ms, parse 3033 ms, sort 0 ms, write 0 ms, index 562 ms: 14 candidates, 69630 repo-hours, 844 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:23:02Z [load_day 2025-02-16] 2025-02-16 hour 9: 196413 events in 0 files, snapshot none (task 5226 ms: download 2681 ms overlapping gunzip 694 ms, parse 3172 ms, sort 0 ms, write 0 ms, index 638 ms: 11 candidates, 76727 repo-hours, 809 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:23:08Z [load_day 2025-02-16] 2025-02-16 hour 10: 197159 events in 0 files, snapshot none (task 4946 ms: download 2795 ms overlapping gunzip 660 ms, parse 2912 ms, sort 0 ms, write 0 ms, index 582 ms: 12 candidates, 74648 repo-hours, 850 releases; waiting 556 ms; commit 0 ms)
2026-11-08T10:23:08Z [load_day 2025-02-16] 2025-02-16 hour 11: 184312 events in 0 files, snapshot none (task 5036 ms: download 2434 ms overlapping gunzip 668 ms, parse 3006 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 77976 repo-hours, 777 releases; waiting 515 ms; commit 0 ms)
2026-11-08T10:23:15Z [load_day 2025-02-16] 2025-02-16 hour 12: 254115 events in 0 files, snapshot none (task 6423 ms: download 2958 ms overlapping gunzip 781 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 1401 ms: 11 candidates, 124657 repo-hours, 900 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:23:15Z [load_day 2025-02-16] 2025-02-16 hour 13: 231849 events in 0 files, snapshot none (task 6202 ms: download 3284 ms overlapping gunzip 764 ms, parse 3482 ms, sort 0 ms, write 0 ms, index 1250 ms: 14 candidates, 101602 repo-hours, 844 releases; waiting 375 ms; commit 0 ms)
2026-11-08T10:23:21Z [load_day 2025-02-16] 2025-02-16 hour 14: 222503 events in 0 files, snapshot none (task 6218 ms: download 3648 ms overlapping gunzip 863 ms, parse 3901 ms, sort 0 ms, write 0 ms, index 646 ms: 8 candidates, 85400 repo-hours, 963 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:23:22Z [load_day 2025-02-16] 2025-02-16 hour 15: 232333 events in 0 files, snapshot none (task 6788 ms: download 4247 ms overlapping gunzip 987 ms, parse 4314 ms, sort 0 ms, write 0 ms, index 753 ms: 12 candidates, 95370 repo-hours, 1059 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:23:30Z [load_day 2025-02-16] 2025-02-16 hour 16: 222376 events in 0 files, snapshot none (task 7774 ms: download 4231 ms overlapping gunzip 1143 ms, parse 5166 ms, sort 0 ms, write 0 ms, index 859 ms: 16 candidates, 88721 repo-hours, 975 releases; waiting 322 ms; commit 0 ms)
2026-11-08T10:23:31Z [load_day 2025-02-16] 2025-02-16 hour 17: 220859 events in 0 files, snapshot none (task 8566 ms: download 5375 ms overlapping gunzip 1318 ms, parse 5633 ms, sort 0 ms, write 0 ms, index 652 ms: 4 candidates, 83957 repo-hours, 982 releases; waiting 548 ms; commit 0 ms)
2026-11-08T10:23:38Z [load_day 2025-02-16] 2025-02-16 hour 18: 230482 events in 0 files, snapshot none (task 7814 ms: download 4346 ms overlapping gunzip 1052 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 944 ms: 7 candidates, 100079 repo-hours, 1018 releases; waiting 494 ms; commit 0 ms)
2026-11-08T10:23:38Z [load_day 2025-02-16] 2025-02-16 hour 19: 202002 events in 0 files, snapshot none (task 7124 ms: download 3870 ms overlapping gunzip 983 ms, parse 4632 ms, sort 0 ms, write 0 ms, index 851 ms: 6 candidates, 74775 repo-hours, 939 releases; waiting 312 ms; commit 0 ms)
2026-11-08T10:23:46Z [load_day 2025-02-16] 2025-02-16 hour 20: 201447 events in 0 files, snapshot none (task 7415 ms: download 3727 ms overlapping gunzip 1121 ms, parse 4763 ms, sort 0 ms, write 0 ms, index 777 ms: 8 candidates, 75861 repo-hours, 1037 releases; waiting 371 ms; commit 0 ms)
2026-11-08T10:23:46Z [load_day 2025-02-16] 2025-02-16 hour 21: 196697 events in 0 files, snapshot none (task 6755 ms: download 3769 ms overlapping gunzip 966 ms, parse 3977 ms, sort 0 ms, write 0 ms, index 967 ms: 6 candidates, 76821 repo-hours, 1092 releases; waiting 529 ms; commit 0 ms)
2026-11-08T10:23:53Z [load_day 2025-02-16] 2025-02-16 hour 22: 185913 events in 0 files, snapshot none (task 5978 ms: download 3431 ms overlapping gunzip 834 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 608 ms: 5 candidates, 67937 repo-hours, 972 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:23:53Z [load_day 2025-02-16] 2025-02-16 hour 23: 172657 events in 0 files, snapshot none (task 5317 ms: download 3035 ms overlapping gunzip 747 ms, parse 3347 ms, sort 0 ms, write 0 ms, index 597 ms: 9 candidates, 62658 repo-hours, 827 releases; waiting 395 ms; commit 0 ms)
2026-11-08T10:24:02Z [load_day 2025-02-16] 2025-02-16: repo_hour merged from 24 files to 1 (1919925 rows, 8852 ms)
2026-11-08T10:24:05Z [load_day 2025-02-16] 2025-02-16: index committed in 11819 ms (24 + 1 + 24 files)
2026-11-08T10:24:05Z [load_day 2025-02-16] 2025-02-16: 4735356 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:24:05Z [load_day 2025-02-16] attempt 1 succeeded