← sources

Size of AI models. What we mean by "Large"?

source: reddit (reddit:LocalLLaMA)published 2026-10-12 21:57ingested 2026-10-13 02:42

retained text

What is 'Small', what is 'Large'? We're still over the place, years later we still can't reach consensus, causing endless confusion, so in infinite wisdom and generosity I took it upon myself to fix it.  
I've arbitrary decided from this day forth we shall all follow this table:  
  
Tiny - fits in 2GB (v)RAM  
Small - fits in 8GB (v)RAM  
Medium - fits in 32GB (v)RAM  
Large - fits in 128GB (v)RAM  
Huge - fits in 512GB (v)RAM  
  
Anything larger than 'Huge' is beyond my comprehension and beyond my financial means for at least the next 4 lifetimes, so I'll leave that for the future generations to fight over.  
You're welcome!

document fetched 2026-10-13 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1x4f80v/size_of_ai_models_what_we_mean_by_large