← sources

Qwen3.8 27B KV cache

source: reddit (reddit:LocalLLaMA)published 2026-09-03 18:26ingested 2026-09-04 02:42

retained text

Which KV cache do you use F16 or BF16 for Q6 quant? What is the difference between them?

document fetched 2026-09-04 00:49 · canonical https://reddit.com/r/LocalLLaMA/comments/1w6fnef/qwen38_27b_kv_cache