Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B
retained text
We're launching [Precision Numerics](https://precisionnumerics.ai/) by releasing Boole-1.7B, a 1-bit version of Qwen3-1.7B. * 247 MB packed weights: 13.9× smaller than BF16. * 85.9% of the BF16 model’s average score across our 10-task evaluation - outperforms 1-bit Bonsai-1.7B and nearly matches 1.58-bit Bonsai-1.7B. Try it locally in your browser (it's for low-latency tasks using English and non-thinking mode), or use it with vLLM or llama.cpp. We'll ship more capable models for the open-source community. Let us know what you what models/capabilities you want to see next. * Blog: [precisionnumerics.ai/blog/boole-1p7b](http://precisionnumerics.ai/blog/boole-1p7b) * Weights: [huggingface.co/precision-numerics/Boole-1.7B](http://huggingface.co/precision-numerics/Boole-1.7B) * Demo code (for vLLM, llama.cpp): [github.com/PrecisionNumerics/boole-demo](http://github.com/PrecisionNumerics/boole-demo) * Local chat in browser: [precisionnumerics.ai/chat/](http://precisionnumerics.ai/chat/)
document fetched 2026-10-13 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1x452zj/boole17b_a_1bit_qwen317b_model_that_outperforms