# Best small LLMs that are good at writing specifically? — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/ed92e3e211295d4d

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-09-14 10:19 ingested 2026-09-15 02:40

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1wfzhdz/best_small_llms_that_are_good_at_writing/)

## retained text



```
I am currently running Llamma 3.2 3B Q4, a recommendation from Gemini on Ollama. It is really fast. The reason I am using local AI is because I wish to expand this project in the near future to use RAG to retrieve data from sources that are very relevant to what I am writing. After that I wish to use OpenClaw on top of this setup that can be like a very useful assistant with research, making sure I am not spending way too much time playing games and giving me- basically a Jarvis that knows my work and prompts me to do that work. 

Now this local LLM part of the AI is pretty much new to me, and I am running on recommendations from AI or what I see other people have been talking about to know which model to use. Today even a new model, MiniCPM5, was released that seems to be really good, but my hardware is unfortunately limited, running 4 GB VRAM, 16 GB RAM, and an i7 12th gen 3050 Ti laptop. I wasn't able to find any benchmark for creative writing in particular, and I suspect the Llama 3.2 3B Q4 recommendation that I got is currently a bit outdated. Your input is highly appreciated. 
```



document fetched 2026-09-15 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1wfzhdz/best_small_llms_that_are_good_at_writing
