← sources

Proposal: A community revolution for private quality benchmarks (and why endless chasing tok/s is rotting our brains

source: reddit (reddit:LocalLLaMA)published 2026-11-02 11:33ingested 2026-11-03 02:42

retained text

Proposal: A community revolution for private quality benchmarks (and why endless chasing tok/s is rotting our brains

honestly we in r/LocalLLaMA  need a revolution of people making their own private benchmarks(not tok/s) i mean benchmarking the quality(especially across quantisation). keep yours private and share the chart results to each other. i feel this is what this sub was made for it seems nowaday every few hours someone is posting about tok/s and also Benchmaxxing is getting out of hand in the huggingface openweight LLM space.

document fetched 2026-11-03 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xlusil/proposal_a_community_revolution_for_private