Size of AI models. What we mean by "Large"?
retained text
What is 'Small', what is 'Large'? We're still over the place, years later we still can't reach consensus, causing endless confusion, so in infinite wisdom and generosity I took it upon myself to fix it. I've arbitrary decided from this day forth we shall all follow this table: Tiny - fits in 2GB (v)RAM Small - fits in 8GB (v)RAM Medium - fits in 32GB (v)RAM Large - fits in 128GB (v)RAM Huge - fits in 512GB (v)RAM Anything larger than 'Huge' is beyond my comprehension and beyond my financial means for at least the next 4 lifetimes, so I'll leave that for the future generations to fight over. You're welcome!
document fetched 2026-10-13 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1x4f80v/size_of_ai_models_what_we_mean_by_large