← sources

sensenova/SenseNova-Loop-9B-GGUF · Hugging Face

source: reddit (reddit:LocalLLaMA)published 2026-11-18 11:08ingested 2026-11-19 02:39

retained text

probably this fork is required: [https://github.com/OpenSenseNova/llama.cpp](https://github.com/OpenSenseNova/llama.cpp)

  
Model Highlights

* **Shared looped block:** 24 decoder layers are executed twice in sequence, producing 56 layer computations from 32 distinct layers per forward pass.
* **Two-stream mHC:** learned mappings route and combine information between two residual streams within the looped block.
* **Hybrid attention:** the decoder interleaves linear and full attention in a repeating four-layer pattern.
* **Long-context multimodal training:** the training recipe includes text, images, code, and tool-use trajectories, with the context length extended to 512K tokens.
* **Low-memory deployment:** With 4-bit weights and an 8-bit KV cache, multimodal inference at a 256K context length requires approximately 15 GiB of GPU memory.
* **Official quantized release:** An official AWQ 4-bit version is available on launch day for easier deployment.

document fetched 2026-11-19 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xzckfi/sensenovasensenovaloop9bgguf_hugging_face