Hy4-flash quants are down from 70 to 49 GB, run on a 64Gb vRAM
retained text
Tencent's 220B Hy4-flash with 49 GB of weights in memory: the experts at \~2.3 bits, everything else at Q8\_0, the Engram n-gram table in a file of its own that stays on the SSD. [Hy4-flash](https://huggingface.co/tencent/Hy4-flash) is Tencent's Mixture-of-Experts model with 220B parameters: 155.5B in the network itself (512 routed experts, 16 active per token, 11.3B active parameters in all) and 63.5B in Engram, a table of learned bigram and trigram embeddings looked up by hash. It reads text and images and has a 1M-token context. The Engram table is read row by row, a few kilobytes per token, so it can stay on disk. What has to fit in memory is the rest. Tencent's own GGUF builds ([AngelSlim/Hy4-flash-GGUF](https://huggingface.co/AngelSlim/Hy4-flash-GGUF)) keep 72–105 GB of it in memory and are the better choice on 96 GB and 128 GB machines. This repo has one file built for 64 GB: 49.1 GB of weights, the table in a second file. quants are made by [Atomic.Chat](http://Atomic.Chat) local ai app.
document fetched 2026-11-19 00:42 · canonical https://reddit.com/r/LocalLLaMA/comments/1xzopsy/hy4flash_quants_are_down_from_70_to_49_gb_run_on