← sources

llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq) by am17an · Pull Request #29510 · ggml-org/llama.cpp

source: reddit (reddit:LocalLLaMA)published 2026-11-02 16:41ingested 2026-11-03 02:42

retained text

Do you run multiple agents locally like I do? 

If so, this is a really nice speedup for the unified KV cache

document fetched 2026-11-03 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xm27fp/llama_cuda_flash_attn_ext_rows_fix_unified_kv_for