# Hy4-flash quants are down from 70 to 49 GB, run on a 64Gb vRAM — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/e6b261bff73af710

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-11-18 19:42 ingested 2026-11-19 02:39

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1xzopsy/hy4flash_quants_are_down_from_70_to_49_gb_run_on/)

## retained text



```
Tencent's 220B Hy4-flash with 49 GB of weights in memory: the experts at \~2.3 bits, everything else at Q8\_0, the Engram n-gram table in a file of its own that stays on the SSD.

[Hy4-flash](https://huggingface.co/tencent/Hy4-flash) is Tencent's Mixture-of-Experts model with 220B parameters: 155.5B in the network itself (512 routed experts, 16 active per token, 11.3B active parameters in all) and 63.5B in Engram, a table of learned bigram and trigram embeddings looked up by hash. It reads text and images and has a 1M-token context.

The Engram table is read row by row, a few kilobytes per token, so it can stay on disk. What has to fit in memory is the rest. Tencent's own GGUF builds ([AngelSlim/Hy4-flash-GGUF](https://huggingface.co/AngelSlim/Hy4-flash-GGUF)) keep 72–105 GB of it in memory and are the better choice on 96 GB and 128 GB machines. This repo has one file built for 64 GB: 49.1 GB of weights, the table in a second file. quants are made by [Atomic.Chat](http://Atomic.Chat) local ai app.
```



document fetched 2026-11-19 00:42 · canonical https://reddit.com/r/LocalLLaMA/comments/1xzopsy/hy4flash_quants_are_down_from_70_to_49_gb_run_on
