Döner Bench DeepSeek-V4-Flash IQ2_XS running on a single RTX 3090
retained text
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1ve6ds2/döner_bench_deepseekv4flash_iq2_xs_running_on_a/"> <img alt="Döner Bench DeepSeek-V4-Flash IQ2_XS running on a single RTX 3090" src="https://external-preview.redd.it/hXtKZS4giIlUq6sHS8k5C1yO4MC-RoNTQER3IqqEpo8.png?width=140&height=75&auto=webp&s=68cf4209118e6e8c0330d34b25ca91bb3e13b589" title="Döner Bench DeepSeek-V4-Flash IQ2_XS running on a single RTX 3090" /> </a> </td><td> <!-- SC_OFF --><div class="md"><p><a href="https://preview.redd.it/3zcvpbds14hh1.png?width=1911&format=png&auto=webp&s=a79aafb71eeca97638da93d2591902631e897fd5">https://preview.redd.it/3zcvpbds14hh1.png?width=1911&format=png&auto=webp&s=a79aafb71eeca97638da93d2591902631e897fd5</a></p> <p>I tried a test similar to the recent model-quant comparisons, but this time I focused only on:</p> <p><strong>DeepSeek-V4-Flash-0731-IQ2_XS-Experts-Q8_0</strong><br /> <strong>model link</strong> <a href="https://huggingface.co/bullerwins/DeepSeek-V4-Flash-0731-GGUF">bullerwins/DeepSeek-V4-Flash-0731-GGUF · Hugging Face</a></p> <h1>Hardware</h1> <ul> <li>RTX 3090 24 GB</li> <li>128 GB DDR4 RAM</li> <li>Windows</li> <li>llama.cpp / llama-server</li> </ul> <h1>Prompt</h1> <blockquote> <p>Write a single HTML file with a full-page canvas and no libraries. Simulate a realistic Döner-style kebab skewer rotating vertically in front of a gas-powered heating element.</p> </blockquote> <p>The resulting render is shown in the attached image.</p> <p>Considering that most of the model is quantized to <strong>IQ2_XS</strong>, I was impressed that it produced a complete and working result. It is obviously not perfect, and some of the finer details and realism are lost, but the overall scene, animation and requested concept are still present.</p> <p><a href="https://pastebin.com/h1VE5aj0">https://pastebin.com/h1VE5aj0</a></p> <h1>Command used</h1> <pre><code>"D:\cpp\llama-server.exe" ^ -m "E:\models\DeepSeek-V4-Flash-0731-IQ2_XS-Experts-Q8_0\DeepSeek-V4-Flash-0731-IQ2_XS-Experts-Q8_0.gguf" ^ --fit on ^ --fit-ctx 32768 ^ --fit-target 1024 ^ --jinja --metrics --perf ^ -np 1 ^ -ub 4096 -b 4096 ^ --no-kv-unified ^ --no-mmap ^ --flash-attn on ^ --cache-type-k q8_0 ^ --cache-type-v q8_0 ^ --temp 1.0 --top_k 40 --top_p 1.0 ^ --min-p 0.00 --repeat-penalty 1.0 --presence-penalty 0.0 ^ --threads 14 </code></pre> </div><!-- SC_ON -->   submitted by   <a href="https://www.reddit.com/user/nikhilprasanth"> /u/nikhilprasanth </a> <br /> <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1ve6ds2/döner_bench_deepseekv4flash_iq2_xs_running_on_a/">[link]</a></span>   <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1ve6ds2/döner_bench_deepseekv4flash_iq2_xs_running_on_a/">[comments]</a></span> </td></tr></table>
document fetched 2026-08-03 09:25 · canonical https://reddit.com/r/LocalLLaMA/comments/1ve6ds2/d%C3%B6ner_bench_deepseekv4flash_iq2_xs_running_on_a