orcaLog in

Runs · run 4174

load_day 2025-07-21, attempt 1 succeeded

Host
73ccef5e07c2:346297
Started
2026-11-08T13:01:20Z
Ended
2026-11-08T13:03:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
708 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
160.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4174/load_day/2025-07-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:01:20Z [load_day 2025-07-21] attempt 1 started
2026-11-08T13:01:21Z [load_day 2025-07-21] 2025-07-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:01:29Z [load_day 2025-07-21] 2025-07-21 hour 0: 140672 events in 0 files, snapshot none (task 6703 ms: download 4238 ms overlapping gunzip 1088 ms, parse 4248 ms, sort 0 ms, write 0 ms, index 505 ms: 3 candidates, 61937 repo-hours, 1120 releases; waiting 481 ms; commit 0 ms)
2026-11-08T13:01:29Z [load_day 2025-07-21] 2025-07-21 hour 1: 154601 events in 0 files, snapshot none (task 6250 ms: download 3579 ms overlapping gunzip 920 ms, parse 3835 ms, sort 0 ms, write 0 ms, index 672 ms: 3 candidates, 85124 repo-hours, 626 releases; waiting 464 ms; commit 0 ms)
2026-11-08T13:01:36Z [load_day 2025-07-21] 2025-07-21 hour 2: 151179 events in 0 files, snapshot none (task 6907 ms: download 3930 ms overlapping gunzip 1097 ms, parse 4361 ms, sort 0 ms, write 0 ms, index 708 ms: 10 candidates, 75027 repo-hours, 664 releases; waiting 475 ms; commit 0 ms)
2026-11-08T13:01:36Z [load_day 2025-07-21] 2025-07-21 hour 3: 144339 events in 0 files, snapshot none (task 6382 ms: download 3713 ms overlapping gunzip 1050 ms, parse 4178 ms, sort 0 ms, write 0 ms, index 712 ms: 5 candidates, 65084 repo-hours, 833 releases; waiting 203 ms; commit 0 ms)
2026-11-08T13:01:45Z [load_day 2025-07-21] 2025-07-21 hour 4: 149439 events in 0 files, snapshot none (task 7584 ms: download 3490 ms overlapping gunzip 1272 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 611 ms: 4 candidates, 66875 repo-hours, 1870 releases; waiting 500 ms; commit 0 ms)
2026-11-08T13:01:45Z [load_day 2025-07-21] 2025-07-21 hour 5: 152837 events in 0 files, snapshot none (task 7448 ms: download 3995 ms overlapping gunzip 1246 ms, parse 4775 ms, sort 0 ms, write 0 ms, index 679 ms: 2 candidates, 66197 repo-hours, 587 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:01:52Z [load_day 2025-07-21] 2025-07-21 hour 6: 153010 events in 0 files, snapshot none (task 7059 ms: download 4556 ms overlapping gunzip 1075 ms, parse 4523 ms, sort 0 ms, write 0 ms, index 593 ms: 3 candidates, 76321 repo-hours, 713 releases; waiting 573 ms; commit 0 ms)
2026-11-08T13:01:53Z [load_day 2025-07-21] 2025-07-21 hour 7: 144685 events in 0 files, snapshot none (task 7479 ms: download 5004 ms overlapping gunzip 1191 ms, parse 4845 ms, sort 0 ms, write 0 ms, index 586 ms: 8 candidates, 72198 repo-hours, 595 releases; waiting 513 ms; commit 0 ms)
2026-11-08T13:02:00Z [load_day 2025-07-21] 2025-07-21 hour 8: 154887 events in 0 files, snapshot none (task 6838 ms: download 4301 ms overlapping gunzip 1174 ms, parse 4185 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 78228 repo-hours, 787 releases; waiting 529 ms; commit 0 ms)
2026-11-08T13:02:01Z [load_day 2025-07-21] 2025-07-21 hour 9: 161688 events in 0 files, snapshot none (task 7379 ms: download 4715 ms overlapping gunzip 1146 ms, parse 4635 ms, sort 0 ms, write 0 ms, index 726 ms: 6 candidates, 81579 repo-hours, 900 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:02:07Z [load_day 2025-07-21] 2025-07-21 hour 10: 158105 events in 0 files, snapshot none (task 7190 ms: download 3373 ms overlapping gunzip 1019 ms, parse 3973 ms, sort 0 ms, write 0 ms, index 1430 ms: 5 candidates, 77722 repo-hours, 830 releases; waiting 149 ms; commit 0 ms)
2026-11-08T13:02:08Z [load_day 2025-07-21] 2025-07-21 hour 11: 162966 events in 0 files, snapshot none (task 6554 ms: download 3621 ms overlapping gunzip 969 ms, parse 3966 ms, sort 0 ms, write 0 ms, index 804 ms: 4 candidates, 76038 repo-hours, 775 releases; waiting 511 ms; commit 0 ms)
2026-11-08T13:02:16Z [load_day 2025-07-21] 2025-07-21 hour 12: 170978 events in 0 files, snapshot none (task 7577 ms: download 4412 ms overlapping gunzip 1120 ms, parse 4615 ms, sort 0 ms, write 0 ms, index 730 ms: 7 candidates, 99296 repo-hours, 802 releases; waiting 699 ms; commit 0 ms)
2026-11-08T13:02:16Z [load_day 2025-07-21] 2025-07-21 hour 13: 169572 events in 0 files, snapshot none (task 7873 ms: download 5200 ms overlapping gunzip 1228 ms, parse 4994 ms, sort 0 ms, write 0 ms, index 664 ms: 11 candidates, 93328 repo-hours, 815 releases; waiting 603 ms; commit 0 ms)
2026-11-08T13:02:23Z [load_day 2025-07-21] 2025-07-21 hour 14: 165550 events in 0 files, snapshot none (task 6857 ms: download 4287 ms overlapping gunzip 1051 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 647 ms: 10 candidates, 83858 repo-hours, 890 releases; waiting 689 ms; commit 0 ms)
2026-11-08T13:02:23Z [load_day 2025-07-21] 2025-07-21 hour 15: 165627 events in 0 files, snapshot none (task 6705 ms: download 4236 ms overlapping gunzip 1041 ms, parse 4163 ms, sort 0 ms, write 0 ms, index 662 ms: 4 candidates, 84809 repo-hours, 993 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:02:32Z [load_day 2025-07-21] 2025-07-21 hour 16: 160632 events in 0 files, snapshot none (task 8435 ms: download 4816 ms overlapping gunzip 1001 ms, parse 4147 ms, sort 0 ms, write 0 ms, index 1113 ms: 5 candidates, 80696 repo-hours, 832 releases; waiting 1817 ms; commit 0 ms)
2026-11-08T13:02:33Z [load_day 2025-07-21] 2025-07-21 hour 17: 161381 events in 0 files, snapshot none (task 9276 ms: download 5890 ms overlapping gunzip 1229 ms, parse 4975 ms, sort 0 ms, write 0 ms, index 648 ms: 10 candidates, 78226 repo-hours, 743 releases; waiting 2132 ms; commit 0 ms)
2026-11-08T13:02:39Z [load_day 2025-07-21] 2025-07-21 hour 18: 165355 events in 0 files, snapshot none (task 6797 ms: download 3592 ms overlapping gunzip 998 ms, parse 3949 ms, sort 0 ms, write 0 ms, index 931 ms: 7 candidates, 84089 repo-hours, 949 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:02:40Z [load_day 2025-07-21] 2025-07-21 hour 19: 161752 events in 0 files, snapshot none (task 6522 ms: download 3901 ms overlapping gunzip 989 ms, parse 4124 ms, sort 0 ms, write 0 ms, index 579 ms: 6 candidates, 72087 repo-hours, 744 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:02:48Z [load_day 2025-07-21] 2025-07-21 hour 20: 155645 events in 0 files, snapshot none (task 7868 ms: download 4950 ms overlapping gunzip 1250 ms, parse 5223 ms, sort 0 ms, write 0 ms, index 564 ms: 5 candidates, 70555 repo-hours, 924 releases; waiting 491 ms; commit 0 ms)
2026-11-08T13:02:48Z [load_day 2025-07-21] 2025-07-21 hour 21: 153296 events in 0 files, snapshot none (task 7240 ms: download 4486 ms overlapping gunzip 1190 ms, parse 4817 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 66978 repo-hours, 838 releases; waiting 295 ms; commit 0 ms)
2026-11-08T13:02:55Z [load_day 2025-07-21] 2025-07-21 hour 22: 142767 events in 0 files, snapshot none (task 6911 ms: download 4556 ms overlapping gunzip 1116 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 518 ms: 14 candidates, 60361 repo-hours, 881 releases; waiting 458 ms; commit 0 ms)
2026-11-08T13:02:58Z [load_day 2025-07-21] 2025-07-21 hour 23: 156916 events in 0 files, snapshot none (task 9626 ms: download 7175 ms overlapping gunzip 1719 ms, parse 6356 ms, sort 0 ms, write 0 ms, index 688 ms: 15 candidates, 82562 repo-hours, 766 releases; waiting 513 ms; commit 0 ms)
2026-11-08T13:03:07Z [load_day 2025-07-21] 2025-07-21: repo_hour merged from 24 files to 1 (1839175 rows, 8930 ms)
2026-11-08T13:03:10Z [load_day 2025-07-21] 2025-07-21: index committed in 12133 ms (24 + 1 + 24 files)
2026-11-08T13:03:10Z [load_day 2025-07-21] 2025-07-21: 3757879 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:03:10Z [load_day 2025-07-21] attempt 1 succeeded