# Qwen 3.8 27b with tools and directed search on a non-coding professional suite — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/6d835c3b35365fa0

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-08-25 00:13 ingested 2026-08-25 06:58

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1vxk763/qwen_38_27b_with_tools_and_directed_search_on_a/)

## retained text



```
<!-- SC_OFF --><div class="md"><p>Some data showing the value of tools on the professional intelligence of Qwen 3.8 27b. My workload with Qwen focuses on real estate, private equity, and adjacent finance stuff. It's not the typical coding domain, so these results might not apply to everyone.</p> <p>I'm running Qwen 3.8 27b nvp4 &quot;RadixArk kVarN&quot; on a 5090. This is on vLLM 0.27.1 with a handful of TurboQuant and scheduler fixes to stop it from hanging all the time:</p> <pre><code>vllm serve RadixArk/Qwen3.8-27B-NVFP4 \ --quantization modelopt \ --kv-cache-dtype turboquant_4bit_nc \ --speculative-config '{&quot;method&quot;:&quot;mtp&quot;,&quot;num_speculative_tokens&quot;:3}' \ --max-model-len 180224 \ --max-num-seqs 2 \ --max-num-batched-tokens 1024 \ --enable-prefix-caching \ --enable-auto-tool-choice \ --tool-call-parser qwen3_coder \ --reasoning-parser qwen3 </code></pre> <p>My use case supports background processes and also realtime human interactions so I made some compromises in size and speed. </p> <ul> <li>Max input: 180,224 tokens</li> <li>2x concurrent &quot;medium&quot;-reasoning agent requests</li> <li>Artificial cap of 8,192 tokens to halt runaway thinking</li> <li>~108 generated tok/s per concurrent agent (around 200 for the pair)</li> <li>~1.28 seconds mean model TTFT</li> </ul> <p>I ran the model out of the box against a custom suite of 600 tests derived from professional certifications. These tests cover esoteric stuff like underwriting, valuation, credit, REIT accounting, 1031 exchange tax law, etc. They also include a set of fictional business scenarios the model must troubleshoot. </p> <p>Without any help or internet connection, Qwen achieved a blended 95.25% score on these tests, already very good.</p> <p>I then connected a tools/MCP layer with some basic functions like:</p> <ul> <li>Deterministic finance calculator (free)</li> <li>Web research with ranked providers and capped API spending ($10 cap)</li> <li>Basic date and time functions (free)</li> </ul> <p>For the same model with the same test inputs, tools lifted blended score to 98.05%</p> <p>Then I explicitly hinted it with a set of professional-relevant search tools. For example, when to search SEC Edgar rather than just asking Google. Hinting these sources further nudged blended score to 98.44%</p> <p>Scores breakdown:</p> <table><thead> <tr> <th align="left">Measure</th> <th align="left">No tools</th> <th align="left">Tools enabled</th> <th align="left">Search hints</th> </tr> </thead><tbody> <tr> <td align="left">Tests</td> <td align="left">600</td> <td align="left">600</td> <td align="left">600</td> </tr> <tr> <td align="left">Perfect answers</td> <td align="left">543</td> <td align="left">551</td> <td align="left">563</td> </tr> <tr> <td align="left">Core Professional Quantitative (100 cases)</td> <td align="left">98.95%</td> <td align="left">100.00%</td> <td align="left">98.40%</td> </tr> <tr> <td align="left">Jr. Analyst Professional Quantitative (100 cases)</td> <td align="left">100.00%</td> <td align="left">99.30%</td> <td align="left">100.00%</td> </tr> <tr> <td align="left">Synthetic Case Studies (100 cases)</td> <td align="left">98.60%</td> <td align="left">97.53%</td> <td align="left">98.12%</td> </tr> <tr> <td align="left">Basic Knowledge, Ethics, Escalation (100 cases)</td> <td align="left">91.08%</td> <td align="left">96.45%</td> <td align="left">97.56%</td> </tr> <tr> <td align="left">Medium Knowledge, Ethics, Escalation (100 cases)</td> <td align="left">90.80%</td> <td align="left">97.58%</td> <td align="left">98.05%</td> </tr> <tr> <td align="left">Hard Knowledge, Ethics, Escalation (100 cases)</td> <td align="left">92.08%</td> <td align="left">97.45%</td> <td align="left">97.17%</td> </tr> <tr> <td align="left"><strong>Combined weighted score</strong></td> <td align="left"><strong>95.25%</strong></td> <td align="left"><strong>98.05%</strong></td> <td align="left"><strong>98.44%</strong></td> </tr> </tbody></table> <p>Bottom line at least for me: Qwen is already solid out of the box, but tools and guided search support make it very competent.</p> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://www.reddit.com/user/offgridai"> /u/offgridai </a> <br /> <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vxk763/qwen_38_27b_with_tools_and_directed_search_on_a/">[link]</a></span> &#32; <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vxk763/qwen_38_27b_with_tools_and_directed_search_on_a/">[comments]</a></span>
```



document fetched 2026-08-25 06:58 · canonical https://reddit.com/r/LocalLLaMA/comments/1vxk763/qwen_38_27b_with_tools_and_directed_search_on_a
