How many t/s would you live with to run Fable/Carbon/Astra/etc locally? And what cliff?
retained text
I'll go first. Fifteen is my cutoff for the early buckets. Muse Spark currently crawling way down below 10 at \~300k context, but it's so token efficient it's still quicker than DSv41 in wall clock terms.
document fetched 2026-11-01 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1xkljk8/how_many_ts_would_you_live_with_to_run