← sources

Qwen3.8 FLASH Next iq4 VRAM usage

source: reddit (reddit:LocalLLaMA)published 2026-09-25 12:34ingested 2026-09-26 02:38

retained text

Guys with a lot of VRAM, how much VRAM needed for iq4 to load all layers and with full context for one user? Is 72GB enough or 80GB is the minimum? Is it possible to use only 6x3060 or 3x3090? Or do I need at least 5x5060Ti 16GB?

document fetched 2026-09-26 00:41 · canonical https://reddit.com/r/LocalLLaMA/comments/1wpv63n/qwen38_flash_next_iq4_vram_usage