← sources

Xiaomi’s MiMo-V3 to adopt new architecture as HySparse2 cuts long-context costs

source: china-news (china-news:technode)published 2026-09-24 05:57ingested 2026-09-25 02:56

retained text

Xiaomi MiMo lead Fuli Luo said MiMo-V3 will adopt a new architecture. Its core technology, HySparse2, is designed to reduce the cost of long-context inference and improve retrieval for agentic workloads.

At a context length of 1 million tokens, HySparse2 reduces prefill computation by 5.02 times and cuts the KV cache by 4.5 times. Xiaomi also reported higher MRCRv2 and RULER-v2 scores, along with lower AgentPPL and LongPPL results. [arXiv]

document fetched 2026-09-27 02:52 · canonical https://technode.com/2026/09/24/xiaomis-mimo-v3-to-adopt-new-architecture-as-hysparse2-cuts-long-context-costs