← sources

macOS 27 ships a free local LLM on Apple Silicon Macs. I made it easy to use from Node and Python

source: reddit (reddit:LocalLLaMA)published 2026-09-28 05:03ingested 2026-09-29 02:43

retained text

Apple Silicon Macs on macOS 26+ come with a small LLM built in. No download, no API key, and nothing leaves your Mac.

Why I built it

I was making a tool that writes API docs from code, and I didn't want users to install Ollama or paste an API key. Apple's model was already on their Mac, so I used it.

Getting it to work well was harder than expected. At temperature 0 it kept repeating itself, and a 2-second call took 20. Calls took 17 seconds instead of 1.5 until I kept one process running. So I turned all the fixes into a library: apple-llm.

**What it's good for**

\- Pulling structured data out of messy text, like emails into tickets or receipts into expenses. The JSON always matches your schema.

\- Tagging, summarising and rewriting

\- Private data you don't want to send anywhere

\- Tools you share with other Mac users, who don't need to download a model or get a key

**What it's bad at**

Coding and long reasoning. It's a small model.

There's also an optional cloud mode that uses Apple's bigger server model for harder questions. That one is not local: your prompt goes to Apple's servers, and it has a usage limit.

Node: **npm install apple-llm**

Python: **pip install apple-llm**

https://reddit.com/link/1ws5l5p/video/oarqcgm767sh1/player

GitHub: [https://github.com/jagdishpal02000/apple-llm](https://github.com/jagdishpal02000/apple-llm)

document fetched 2026-09-29 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1ws5l5p/macos_27_ships_a_free_local_llm_on_apple_silicon