← sources

Updated my benchmark with a new vLLM based recipe for Qwen 3.8 Flash Next : now up to 98/100 (instead of 91 previously)

source: reddit (reddit:LocalLLaMA)published 2026-09-04 18:12ingested 2026-09-05 02:42

retained text

I was using:

* weights [https://huggingface.co/RadixArk/Qwen3.8-Flash-Next-NVFP4](https://huggingface.co/RadixArk/Qwen3.8-Flash-Next-NVFP4) 
* with the optimized SGLANG (patched) from  [https://old.reddit.com/r/BlackwellPerformance/comments/1w04xb7/qwen38\_flashnext\_on\_1x\_rtx\_pro\_6000\_171\_ts\_c1\_428/](https://old.reddit.com/r/BlackwellPerformance/comments/1w04xb7/qwen38_flashnext_on_1x_rtx_pro_6000_171_ts_c1_428/)

Now I'm using: 

* weights (AWQ W4A16) from: [https://huggingface.co/wtdcode/Qwen3.8-Flash-Next-AWQ-W4A16](https://huggingface.co/wtdcode/Qwen3.8-Flash-Next-AWQ-W4A16)
* PLE (INT4) from: [https://huggingface.co/primitive-ai/Qwen3.8-Flash-Next-PLE-quant](https://huggingface.co/primitive-ai/Qwen3.8-Flash-Next-PLE-quant)
* with vLLM patched with the patch from the same repo cf [https://huggingface.co/primitive-ai/Qwen3.8-Flash-Next-PLE-quant#serve](https://huggingface.co/primitive-ai/Qwen3.8-Flash-Next-PLE-quant#serve)
* the goal was to load both the weights and the n-gram PLE quantized in 4bits either on my sm89 or sm120 devices

It's way slower (for my low concurrency usecase) but also **a lot better**. I was surprised to see such a delta.

I reached 98/100 (instead of 91) both with medium and xhigh reasoning (still not useful for this bench). And now it really feels like a huge setup up from the other models. It's the best score AND the most efficient...

I'll try to dig deeper to understand if the difference comes from the engine (and its patches) or the quants themselves. And try to optimize further the vLLM receipt for my setup

as always, the graphs and the data : 

* [here](https://wonderrico.github.io/local_llm_benchmark/benchmark-main.html)
* and [here](https://wonderrico.github.io/local_llm_benchmark/benchmark-detail.html)

document fetched 2026-09-05 00:42 · canonical https://reddit.com/r/LocalLLaMA/comments/1w7c4ej/updated_my_benchmark_with_a_new_vllm_based_recipe