← sources

Nanbeige4.3-33B Quantised GGUF

source: reddit (reddit:LocalLLaMA)published 2026-10-25 21:33ingested 2026-10-26 02:40

retained text

Quant ladder of Nanbeige's new 33B model from 35.2GB down to 13.7GB

For 32GB hardware the sweet spot is 20.3GB AD-IQ4\_XS with a top-1% of 92.0% compared to BF16

document fetched 2026-10-26 00:38 · canonical https://reddit.com/r/LocalLLaMA/comments/1xfeho8/nanbeige4333b_quantised_gguf