# [2608.16157] FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/59f0411e67b4040a

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-08-24 23:38 ingested 2026-08-25 06:58

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1vxjcsw/260816157_freetoken_efficient_edgenative_moe/)

## retained text



```
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vxjcsw/260816157_freetoken_efficient_edgenative_moe/"> <img alt="[2608.16157] FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution" src="https://external-preview.redd.it/q3evP6JeDpAC2MdSQHWYxnCYTqbJkElIQsLFqVSdkss.png?width=640&amp;crop=smart&amp;auto=webp&amp;s=de730fbf7ecace6df0036b21470c16a2d4feacfb" title="[2608.16157] FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution" /> </a> </td><td> <!-- SC_OFF --><div class="md"><p>Source of Claims: <a href="https://x.com/Andy_ShuoYang/status/2090856976880472439">https://x.com/Andy_ShuoYang/status/2090856976880472439</a></p> <blockquote> <p>Your gaming PC can now serve frontier models at interactive speed using official checkpoints without extreme quantization!</p> <p>Qwen3.6 35B → 8GB RTX 4060 laptop @ 39 tok/s</p> <p>DeepSeek-V4-Flash 284B → RTX 5090 desktop @ 22-25 tok/s</p> <p>GLM-5.2 753B → RTX PRO 6000 workstation @ 15 tok/s</p> <p>Run your claude code or codex now with frontier model for $0</p> <p>FreeToken is fast. Comparing to Ollama, we have 3–4× faster decode, and 6–30× faster prefill</p> <p>How? We introduce bandwidth-adaptive CPU–GPU execution + semantic-aware caching across agent turns.</p> </blockquote> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://www.reddit.com/user/SteppenAxolotl"> /u/SteppenAxolotl </a> <br /> <span><a href="https://arxiv.org/abs/2608.16157">[link]</a></span> &#32; <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1vxjcsw/260816157_freetoken_efficient_edgenative_moe/">[comments]</a></span> </td></tr></table>
```



document fetched 2026-08-25 06:58 · canonical https://reddit.com/r/LocalLLaMA/comments/1vxjcsw/260816157_freetoken_efficient_edgenative_moe
