# llama : add a GPU cache for MoE experts kept in host memory by am17an · Pull Request #29887 · ggml-org/llama.cpp — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/6136ed5f1a1df3c5

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-10-07 18:15 ingested 2026-10-08 02:41

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1x03xkc/llama_add_a_gpu_cache_for_moe_experts_kept_in/)

## retained text



```
Potentially big speedup for MoE models that don’t fully fit in VRAM.

Are you GPU Poor? Show your speedups ;)
```



document fetched 2026-10-08 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1x03xkc/llama_add_a_gpu_cache_for_moe_experts_kept_in
