Best small LLMs that are good at writing specifically?
retained text
I am currently running Llamma 3.2 3B Q4, a recommendation from Gemini on Ollama. It is really fast. The reason I am using local AI is because I wish to expand this project in the near future to use RAG to retrieve data from sources that are very relevant to what I am writing. After that I wish to use OpenClaw on top of this setup that can be like a very useful assistant with research, making sure I am not spending way too much time playing games and giving me- basically a Jarvis that knows my work and prompts me to do that work. Now this local LLM part of the AI is pretty much new to me, and I am running on recommendations from AI or what I see other people have been talking about to know which model to use. Today even a new model, MiniCPM5, was released that seems to be really good, but my hardware is unfortunately limited, running 4 GB VRAM, 16 GB RAM, and an i7 12th gen 3050 Ti laptop. I wasn't able to find any benchmark for creative writing in particular, and I suspect the Llama 3.2 3B Q4 recommendation that I got is currently a bit outdated. Your input is highly appreciated.
document fetched 2026-09-15 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1wfzhdz/best_small_llms_that_are_good_at_writing