Hy4-flash > QFN early impressions
retained text
I work in a legal role with many pdf documents, so far in my limited testing, hy4 flash outperforms QFN by a substantial margin (my hardware is 26gb vram and 128gb ddr4). For legal work, the accuracy when working with these pdf documents is paramount, and I’ve found that the hy4 model is better at accurately citing the law. So far for me hy4 flash is the best model for local legal workflows. Interested to see if anyone is getting the same result. My speed is ass though (10 tps v QFN 15 tps). I’m using QFN 5 bit and hy4-flash 4 bit for these tests
document fetched 2026-11-20 00:42 · canonical https://reddit.com/r/LocalLLaMA/comments/1y0dffj/hy4flash_qfn_early_impressions