← sources

What can I realistically do with local AI on a Mac mini M5 Pro (48GB)?

source: reddit (reddit:ollama)published 2026-11-08 17:11ingested 2026-11-09 02:37

retained text

I just got a Mac mini with an M5 Pro (base CPU config) and 48GB of unified memory. I want to run as much AI locally as makes sense, but it's hard to separate what actually works day to day from benchmark hype.

What I'd like to do:

- Coding: autocomplete and agentic workflows with local models
- Image generation
- Anything else genuinely useful: transcription, RAG over my notes, etc.

Questions:

1. Which models and quantizations fit comfortably in 48GB and are actually usable, not just "it runs"?
2. Which runtime and tools: MLX, llama.cpp, Ollama, LM Studio, ComfyUI, something else?
3. What's your setup, and what did you give up on and go back to cloud APIs for?

Real tokens/sec numbers and "this was a waste of time" stories are especially welcome.

document fetched 2026-11-09 00:36 · canonical https://reddit.com/r/ollama/comments/1xr3fqq/what_can_i_realistically_do_with_local_ai_on_a