orcaLog in

Runs · run 2492

load_day 2024-05-23, attempt 1 succeeded

Host
73ccef5e07c2:126154
Started
2026-11-08T06:13:14Z
Ended
2026-11-08T06:15:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
728 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2492/load_day/2024-05-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:13:14Z [load_day 2024-05-23] attempt 1 started
2026-11-08T06:13:16Z [load_day 2024-05-23] 2024-05-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:13:23Z [load_day 2024-05-23] 2024-05-23 hour 0: 197971 events in 0 files, snapshot none (task 7186 ms: download 4179 ms overlapping gunzip 1066 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 735 ms: 11 candidates, 100557 repo-hours, 1160 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:13:23Z [load_day 2024-05-23] 2024-05-23 hour 1: 198590 events in 0 files, snapshot none (task 6486 ms: download 3439 ms overlapping gunzip 984 ms, parse 4180 ms, sort 0 ms, write 0 ms, index 767 ms: 10 candidates, 106390 repo-hours, 891 releases; waiting 278 ms; commit 0 ms)
2026-11-08T06:13:30Z [load_day 2024-05-23] 2024-05-23 hour 2: 168603 events in 0 files, snapshot none (task 6185 ms: download 3648 ms overlapping gunzip 979 ms, parse 3964 ms, sort 0 ms, write 0 ms, index 501 ms: 8 candidates, 66388 repo-hours, 771 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:13:30Z [load_day 2024-05-23] 2024-05-23 hour 3: 177924 events in 0 files, snapshot none (task 6552 ms: download 3905 ms overlapping gunzip 1058 ms, parse 4440 ms, sort 0 ms, write 0 ms, index 611 ms: 9 candidates, 70640 repo-hours, 2895 releases; waiting 180 ms; commit 0 ms)
2026-11-08T06:13:38Z [load_day 2024-05-23] 2024-05-23 hour 4: 158445 events in 0 files, snapshot none (task 7043 ms: download 3593 ms overlapping gunzip 1093 ms, parse 4520 ms, sort 0 ms, write 0 ms, index 689 ms: 12 candidates, 60915 repo-hours, 645 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:13:38Z [load_day 2024-05-23] 2024-05-23 hour 5: 172241 events in 0 files, snapshot none (task 7148 ms: download 4387 ms overlapping gunzip 1139 ms, parse 4785 ms, sort 0 ms, write 0 ms, index 550 ms: 10 candidates, 67604 repo-hours, 816 releases; waiting 464 ms; commit 0 ms)
2026-11-08T06:13:46Z [load_day 2024-05-23] 2024-05-23 hour 6: 207075 events in 0 files, snapshot none (task 7989 ms: download 4822 ms overlapping gunzip 1211 ms, parse 5099 ms, sort 0 ms, write 0 ms, index 740 ms: 11 candidates, 92413 repo-hours, 1018 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:13:47Z [load_day 2024-05-23] 2024-05-23 hour 7: 217436 events in 0 files, snapshot none (task 8492 ms: download 5599 ms overlapping gunzip 1302 ms, parse 5414 ms, sort 0 ms, write 0 ms, index 603 ms: 14 candidates, 87596 repo-hours, 1086 releases; waiting 864 ms; commit 0 ms)
2026-11-08T06:13:55Z [load_day 2024-05-23] 2024-05-23 hour 8: 245382 events in 0 files, snapshot none (task 8499 ms: download 5663 ms overlapping gunzip 1387 ms, parse 5640 ms, sort 0 ms, write 0 ms, index 626 ms: 15 candidates, 91882 repo-hours, 1171 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:13:56Z [load_day 2024-05-23] 2024-05-23 hour 9: 241446 events in 0 files, snapshot none (task 8622 ms: download 6017 ms overlapping gunzip 1443 ms, parse 5977 ms, sort 0 ms, write 0 ms, index 669 ms: 18 candidates, 97256 repo-hours, 1261 releases; waiting 282 ms; commit 0 ms)
2026-11-08T06:14:03Z [load_day 2024-05-23] 2024-05-23 hour 10: 229391 events in 0 files, snapshot none (task 7424 ms: download 4793 ms overlapping gunzip 1113 ms, parse 4611 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 91118 repo-hours, 1102 releases; waiting 692 ms; commit 0 ms)
2026-11-08T06:14:04Z [load_day 2024-05-23] 2024-05-23 hour 11: 232045 events in 0 files, snapshot none (task 7120 ms: download 4694 ms overlapping gunzip 1090 ms, parse 4598 ms, sort 0 ms, write 0 ms, index 671 ms: 18 candidates, 88586 repo-hours, 1109 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:14:11Z [load_day 2024-05-23] 2024-05-23 hour 12: 289638 events in 0 files, snapshot none (task 7773 ms: download 5072 ms overlapping gunzip 1163 ms, parse 5054 ms, sort 0 ms, write 0 ms, index 837 ms: 14 candidates, 127827 repo-hours, 1333 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:14:12Z [load_day 2024-05-23] 2024-05-23 hour 13: 263334 events in 0 files, snapshot none (task 8097 ms: download 5381 ms overlapping gunzip 1194 ms, parse 5186 ms, sort 0 ms, write 0 ms, index 945 ms: 18 candidates, 118254 repo-hours, 1184 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:14:22Z [load_day 2024-05-23] 2024-05-23 hour 14: 255748 events in 0 files, snapshot none (task 10268 ms: download 6684 ms overlapping gunzip 1540 ms, parse 6850 ms, sort 0 ms, write 0 ms, index 1171 ms: 20 candidates, 106926 repo-hours, 1271 releases; waiting 397 ms; commit 0 ms)
2026-11-08T06:14:23Z [load_day 2024-05-23] 2024-05-23 hour 15: 253551 events in 0 files, snapshot none (task 10012 ms: download 6666 ms overlapping gunzip 1574 ms, parse 6752 ms, sort 0 ms, write 0 ms, index 877 ms: 14 candidates, 109079 repo-hours, 1439 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:14:31Z [load_day 2024-05-23] 2024-05-23 hour 16: 237758 events in 0 files, snapshot none (task 9087 ms: download 5963 ms overlapping gunzip 1493 ms, parse 6116 ms, sort 0 ms, write 0 ms, index 708 ms: 21 candidates, 97292 repo-hours, 1196 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:14:32Z [load_day 2024-05-23] 2024-05-23 hour 17: 226869 events in 0 files, snapshot none (task 8614 ms: download 5616 ms overlapping gunzip 1359 ms, parse 5747 ms, sort 0 ms, write 0 ms, index 704 ms: 10 candidates, 89225 repo-hours, 1134 releases; waiting 542 ms; commit 0 ms)
2026-11-08T06:14:41Z [load_day 2024-05-23] 2024-05-23 hour 18: 236617 events in 0 files, snapshot none (task 8712 ms: download 6034 ms overlapping gunzip 1301 ms, parse 5795 ms, sort 0 ms, write 0 ms, index 846 ms: 18 candidates, 98812 repo-hours, 1268 releases; waiting 486 ms; commit 0 ms)
2026-11-08T06:14:41Z [load_day 2024-05-23] 2024-05-23 hour 19: 204737 events in 0 files, snapshot none (task 8216 ms: download 5636 ms overlapping gunzip 1356 ms, parse 5528 ms, sort 0 ms, write 0 ms, index 670 ms: 21 candidates, 81256 repo-hours, 1125 releases; waiting 367 ms; commit 0 ms)
2026-11-08T06:14:49Z [load_day 2024-05-23] 2024-05-23 hour 20: 208089 events in 0 files, snapshot none (task 7950 ms: download 5537 ms overlapping gunzip 1306 ms, parse 5271 ms, sort 0 ms, write 0 ms, index 620 ms: 23 candidates, 79447 repo-hours, 1236 releases; waiting 482 ms; commit 0 ms)
2026-11-08T06:14:49Z [load_day 2024-05-23] 2024-05-23 hour 21: 190973 events in 0 files, snapshot none (task 7222 ms: download 4807 ms overlapping gunzip 1067 ms, parse 4780 ms, sort 0 ms, write 0 ms, index 596 ms: 19 candidates, 77110 repo-hours, 1186 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:14:56Z [load_day 2024-05-23] 2024-05-23 hour 22: 164932 events in 0 files, snapshot none (task 6197 ms: download 3823 ms overlapping gunzip 999 ms, parse 3939 ms, sort 0 ms, write 0 ms, index 434 ms: 8 candidates, 63200 repo-hours, 980 releases; waiting 553 ms; commit 0 ms)
2026-11-08T06:14:56Z [load_day 2024-05-23] 2024-05-23 hour 23: 153637 events in 0 files, snapshot none (task 5893 ms: download 3221 ms overlapping gunzip 937 ms, parse 4040 ms, sort 0 ms, write 0 ms, index 438 ms: 8 candidates, 58339 repo-hours, 899 releases; waiting 227 ms; commit 0 ms)
2026-11-08T06:15:05Z [load_day 2024-05-23] 2024-05-23: repo_hour merged from 24 files to 1 (2128112 rows, 9243 ms)
2026-11-08T06:15:07Z [load_day 2024-05-23] 2024-05-23: index committed in 11658 ms (24 + 1 + 24 files)
2026-11-08T06:15:07Z [load_day 2024-05-23] 2024-05-23: 5132432 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:15:07Z [load_day 2024-05-23] attempt 1 succeeded