OVHaiLLM/Olala-v1.0-mini-7A1B
retained text
Gguf's: [https://huggingface.co/OVHaiLLM/Olala-v1.0-mini-7A1B-GGUF](https://huggingface.co/OVHaiLLM/Olala-v1.0-mini-7A1B-GGUF) Free playground: [https://olala.ovh.com/](https://olala.ovh.com/) "Olala-v1.0-mini-7A1B is a **small reasoning model for chat, instruction following and tool use**, built on our hybrid Mamba-3 / attention mixture-of-experts architecture. * **Made in Europe, open by design:** designed in France by OVHai LLM (OVHcloud group), trained on three European supercomputers (JUPITER, Jean Zay and MeluXina) on 12.8T tokens of public datasets and our own synthetic data, and released with open weights under Apache 2.0. * **Efficient:** about 1B active parameters per token, and only 7 of its 36 layers keep a KV cache. It runs on a laptop. * **Reasoning and agentic:** it thinks before it answers, with four reasoning-effort levels, and was trained with reinforcement learning to call tools and to search over many turns." " |Property|Specification| |:-|:-| |**Checkpoint**|Post-trained (SFT + reinforcement learning), text-only language model| |**Parameters**|6.8B total, about 1B active per token| |**Architecture**|36 layers: 29 Mamba-3 and 7 attention layers (one in five), each followed by a mixture-of-experts block with 256 routed experts (6 active) and 1 shared expert| |**Context length**|32K tokens (input + output) A 128K-context version is coming soon.| |**Vocabulary**|151,936 tokens| |**Training data**|12.8T tokens: public datasets and our own synthetic data| |**Languages**|Pre-trained on English and 36 other languages (38 in annealing), mostly European, plus Arabic, Chinese, Japanese and Korean (full list in the [technical report](https://huggingface.co/OVHaiLLM/Olala-v1.0-mini-7A1B/blob/main/Olala-v1.0-mini.pdf)). Multilingual post-training evaluation covers 11 languages (MGSM) and 8 languages (Multi-IF).| |**License**|Apache 2.0"|
document fetched 2026-11-20 00:42 · canonical https://reddit.com/r/LocalLLaMA/comments/1y06p4p/ovhaillmolalav10mini7a1b