BeeLLama issues
retained text
<!-- SC_OFF --><div class="md"><p>Tried to use Beellama , and using the kvarn6 flag, i notice that its in llama-server --help but its not working. I must be doing something wrong. </p> <p><strong>trying to run the following:</strong><br /> llama-server.exe ^</p> <p>--model "C:\llamaROCM\models\Qwen3.6-35B-A3B-IQ4_XS-3.53bpw.gguf" ^</p> <p>--spec-type draft-mtp,ngram-mod ^</p> <p>--spec-draft-n-max 2 ^</p> <p>--spec-draft-type-k q8_0 ^</p> <p>--spec-draft-type-v q4_0 ^</p> <p>--port 8080 ^</p> <p>--ctx-size 40960 ^</p> <p>--fit on ^</p> <p>--gpu-layers auto ^</p> <p>--no-mmap ^</p> <p>--cache-type-k kvarn6 ^</p> <p>--cache-type-v kvarn6 ^</p> <p>--kv-tail-tokens 1024 ^</p> <p>--batch-size 2048 ^</p> <p>--ubatch-size 2048 ^</p> <p>--threads 12 ^</p> <p>-np 1 ^</p> <p>--flash-attn on ^</p> <p>--context-shift ^</p> <p>--sleep-idle-seconds 300 ^</p> <p>--temp 0.8 ^</p> <p>--top-k 50 ^</p> <p>--top-p 0.95 ^</p> <p>--min-p 0.1 ^</p> <p>--repeat-penalty 1.05 ^</p> <p>--no-ui ^</p> <p>--reasoning off ^</p> <p>--reasoning-budget 0</p> <p><strong>Getting the following Error:</strong></p> <p>[0merror while handling argument "--cache-type-k": Unsupported cache type: kvarn6<br /> usage:<br /> -ctk, --cache-type-k TYPE KV cache data type for K<br /> allowed values: f32, f16, bf16, q8_0, q4_0, q4_1, iq4_nl, q5_0, q5_1<br /> (default: f16)<br /> (env: LLAMA_ARG_CACHE_TYPE_K) </p> </div><!-- SC_ON -->   submitted by   <a href="https://www.reddit.com/user/uber-linny"> /u/uber-linny </a> <br /> <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1viku98/beellama_issues/">[link]</a></span>   <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1viku98/beellama_issues/">[comments]</a></span>
document fetched 2026-08-08 06:58 · canonical https://reddit.com/r/LocalLLaMA/comments/1viku98/beellama_issues