Finally found a model my hardware can run at full precision: me
retained text
Was getting bored trying to squeeze every last t/s out of my local model on my hardware, so I made a tps counter for my fingers instead (with real tokenizers, of course). My best is around 2 t/s. According to the page, that beats a 70B on a laptop CPU and is roughly 76x slower than an 8B on a 4090. So yeah. If you want something to do while waiting for your LLM to answer, give it a try! [https://homoagens.github.io/human-tps/](https://homoagens.github.io/human-tps/) PS: you can also share your result.. who knows, maybe I'll get famous :)
document fetched 2026-09-29 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1wsiepp/finally_found_a_model_my_hardware_can_run_at_full