Expert expansion with llama.cpp
retained text
With the help of Glm 5.3 flash I built a custom branch of llama.cpp in order to support Expert expansion with MOE models, I've tested only on metal and It works better than my DS4 version , i need feedback from other platforms, and different models. [moex-expansion](https://github.com/vagrillo/llama.cpp/blob/moe-expansion/docs/moe-expansion.md)
document fetched 2026-09-07 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1w9404e/expert_expansion_with_llamacpp