← sources

Do we have any benchmarks on quality degradation between Basalt, Infernix, Strata(-nvfp4)? Not "engine go more brr" benchmarks, exploring wrong avenues fast is worthless.

source: reddit (reddit:LocalLLaMA)published 2026-11-02 19:13ingested 2026-11-03 02:42

retained text

While fast inference is very welcome, I would like to know if it's worth increasing the speed over strata-nvfp4 or am I paying some unacceptable penalties.

One thing I've noticed with Basalt is that it doesn't have dynamic rope scaling, so it goes off with the yarn scaling statically (2 for 524K context) from the get-go. Basalt also lacks a censorship switch, but the machinery exists so it's trivial to write it in.

document fetched 2026-11-03 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xm6hjx/do_we_have_any_benchmarks_on_quality_degradation