← sources

List of tiny-to-medium models for web research/coding agents

source: reddit (reddit:LocalLLaMA)published 2026-11-02 06:08ingested 2026-11-03 02:42

retained text

I am compiling a list of models that I think are potentially worth considering for folks who want to run an LLM on a "normal computer",  specifically for an agent use case, but without having to buy a $$$$ graphics card to do it. 

In order of capability strongest to weakest, I have: 

  - Qwen 3.8 27B
  - Qwen 3.6 35B A3B
  - Jais 3 7B
  - Gemma 12B (included because it has vision)
  - XHToken/SparkX2.6 4B
  - FrogNano 4B
  - Gemma E4B (included because its small AND has vision)
  - Ling 3.0 Tiny 8B A1B 
  

Any other interesting small models (<10B) I might have missed or  that you think I should not ignore?

Any that you think should be banished, not even included ? 


document fetched 2026-11-03 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xlpkqv/list_of_tinytomedium_models_for_web