← sources

Expert expansion with llama.cpp

source: reddit (reddit:LocalLLaMA)published 2026-09-06 18:27ingested 2026-09-07 07:20

retained text

With the help of Glm 5.3 flash I built a custom branch of llama.cpp in order to support Expert expansion with MOE models, I've tested only on metal and It works better than my DS4 version , i need feedback from other platforms, and different models.

[moex-expansion](https://github.com/vagrillo/llama.cpp/blob/moe-expansion/docs/moe-expansion.md)

document fetched 2026-09-07 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1w9404e/expert_expansion_with_llamacpp