← sources

Tesla V100 Qwen3.6 27B Performance

source: reddit (reddit:LocalLLaMA)published 2026-08-08 14:34ingested 2026-08-09 07:00

retained text

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vixl0f/tesla_v100_qwen36_27b_performance/"> <img alt="Tesla V100 Qwen3.6 27B Performance" src="https://preview.redd.it/bynog4baw5ih1.png?width=140&amp;height=71&amp;auto=webp&amp;s=1bf2313037350d989bee6dfdc621f25474e24a78" title="Tesla V100 Qwen3.6 27B Performance" /> </a> </td><td> <!-- SC_OFF --><div class="md"><p>Looking for V100 users to share your config and it's performance.</p> <p>GPU: Tesla V100 PCIE 32Gb</p> <p>Qwen3.6 27B Q4_K_M + Q8_0 MTP</p> <p>128K context length</p> <p>Pi coding agent </p> <p>llama.cpp model preset:</p> <pre><code>[*] spec-default = 1 ctx-size = 131072 mmap = 1 kv-unified = 1 n-gpu-layers = 999 threads = 18 prio = 3 seed = 3407 image-min-tokens = 1024 batch-size = 4096 ubatch-size = 2048 parallel = 1 flash-attn = true [Qwen3.6-27B] model = /models/Qwen3.6/Qwen3.6-27B-Q4_K_M.gguf mmproj = /models/mmproj/mmproj-Qwen3.6-27B-Q8_0.gguf spec-draft-model = /models/mtp/mtp-Qwen3.6-27B-Q8_0.gguf chat-template-file = /templates/froggeric_chat_template_v21-3.jinja spec-type = draft-mtp spec-draft-n-max = 1 temperature = 0.6 top-p = 0.95 top-k = 20 min-p = 0.05 presence-penalty = 0.0 repeat-penalty = 1.0 chat-template-kwargs = {&quot;preserve_thinking&quot;: true} </code></pre> <p>And the performance:</p> <p><a href="https://preview.redd.it/bynog4baw5ih1.png?width=1319&amp;format=png&amp;auto=webp&amp;s=97f8138f93f704c0aca3d9e7c638d6b57df3a832">https://preview.redd.it/bynog4baw5ih1.png?width=1319&amp;format=png&amp;auto=webp&amp;s=97f8138f93f704c0aca3d9e7c638d6b57df3a832</a></p> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://www.reddit.com/user/Traditional_Bell8153"> /u/Traditional_Bell8153 </a> <br /> <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vixl0f/tesla_v100_qwen36_27b_performance/">[link]</a></span> &#32; <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vixl0f/tesla_v100_qwen36_27b_performance/">[comments]</a></span> </td></tr></table>

document fetched 2026-08-09 07:00 · canonical https://reddit.com/r/LocalLLaMA/comments/1vixl0f/tesla_v100_qwen36_27b_performance