← sources

Unsloth v3.1 QFN IQ4_XS fails tool calls very frequently

source: reddit (reddit:LocalLLaMA)published 2026-11-06 23:22ingested 2026-11-07 02:41

retained text

My sample size is not very big but it feels like since updating Qwen Flash Next to v3.1 and Strata to 0.2.11, IQ4\_XS quant seems to fail tool calls even more often than the previous version did in both Hermes and Oh my Pi harnesses with int8 KV cache in Strata. Weird thing is, after failed tool calls, it just straight up stop generating altogether, I have to send a continue for it to finish.  
Tried addressing this on unsloth's subreddit and the post got nuked.  
Honestly could just be a Strata issue and not Unsloth's, I have yet to perform an investigation.  
Anyone else had this experience with new updated quants?

upd: it's not new Unsloth quants, I see the same issue with ISTA quants, it seems to be specific to latest Strata. Possibly new dflash2? Need to investigate further.

document fetched 2026-11-07 00:40 · canonical https://reddit.com/r/LocalLLaMA/comments/1xprc6o/unsloth_v31_qfn_iq4_xs_fails_tool_calls_very