Nanbeige4.3-33B Quantised GGUF
retained text
Quant ladder of Nanbeige's new 33B model from 35.2GB down to 13.7GB For 32GB hardware the sweet spot is 20.3GB AD-IQ4\_XS with a top-1% of 92.0% compared to BF16
document fetched 2026-10-26 00:38 · canonical https://reddit.com/r/LocalLLaMA/comments/1xfeho8/nanbeige4333b_quantised_gguf