← sources

How do you guys containerize local LLMs on Mac ?

source: reddit (reddit:LocalLLaMA)published 2026-11-13 18:59ingested 2026-11-14 02:42

retained text

Docker doesn’t support GPU on apple silicon, I simply create a docker to run llama.cpp there on Linux, I wonder if I am missing something on Mac. 

document fetched 2026-11-14 00:46 · canonical https://reddit.com/r/LocalLLaMA/comments/1xvggj6/how_do_you_guys_containerize_local_llms_on_mac