← sources

OMG! If you have a Mac with 64GB, try Qwen3.8-Flash-Next-oQ4e-mtp with oMLX!

source: reddit (reddit:LocalLLaMA)published 2026-10-11 00:00ingested 2026-10-11 02:41

retained text

I'm genuinely shocked! I was able to run Qwen3.8-Flash-Next-oQ4e-mtp on M3Max 64GB with oMLX!

Even a couple of weeks ago, I wasn't able to get it to run. I just tried the latest commit for fun, and it worked! It feels like some kind of sorcery to be able to run a 100GB model with 58GB allocated to GPU!

I can even run up to 130k context window!

Here are stats after running a short session with PI.

* Requests: 13
* Total Prefill Tokens: 321,309
* Cached Tokens: 292,209
* Cache Efficiency: 90.9%
* Prompt Processing (excl. cached): 140.0 tok/s
* Token Generation: 15.8 tok/s

Here are the  settings I used on oMLX:

* Memory guard: Aggressive
* Hot Cache Limit (In-Memory Cache): 2GB
* Lightning MTP: on
* MoE Expert Offload: on
* RESIDENT EXPERTS: 50%

document fetched 2026-10-11 00:38 · canonical https://reddit.com/r/LocalLLaMA/comments/1x2tstj/omg_if_you_have_a_mac_with_64gb_try