sensenova/SenseNova-Loop-9B-GGUF · Hugging Face
retained text
probably this fork is required: [https://github.com/OpenSenseNova/llama.cpp](https://github.com/OpenSenseNova/llama.cpp) Model Highlights * **Shared looped block:** 24 decoder layers are executed twice in sequence, producing 56 layer computations from 32 distinct layers per forward pass. * **Two-stream mHC:** learned mappings route and combine information between two residual streams within the looped block. * **Hybrid attention:** the decoder interleaves linear and full attention in a repeating four-layer pattern. * **Long-context multimodal training:** the training recipe includes text, images, code, and tool-use trajectories, with the context length extended to 512K tokens. * **Low-memory deployment:** With 4-bit weights and an 8-bit KV cache, multimodal inference at a 256K context length requires approximately 15 GiB of GPU memory. * **Official quantized release:** An official AWQ 4-bit version is available on launch day for easier deployment.
document fetched 2026-11-19 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xzckfi/sensenovasensenovaloop9bgguf_hugging_face