inclusionAI/Realtime-Venus · Hugging Face
retained text
do you want some omni? here is omni for you [](https://huggingface.co/inclusionAI/Realtime-Venus#1-🧭-overview)1. 🧭 Overview This repository hosts two checkpoints of the [Realtime-Venus](https://realtime-venus.github.io/) system: * **Realtime-Venus-Omni** (`Realtime-Venus-Omni/`): the 9B audio-visual interaction model. It continuously watches and listens, decides whether and when to respond, and generates text and speech on a shared causal timeline. Adapted from MiniCPM-o 4.5, it supports proactive interaction, semantic interruption handling, and training-free long-video memory. * **Realtime-Venus-Audio** (`Realtime-Venus-Audio/`): the audio-focused checkpoint on the same streaming backbone, for audio understanding and audio-driven conversation with text or speech output. Both directories contain model weights and custom Hugging Face Transformers code. The asynchronous Realtime-Venus-Harness and its external tool integrations live in the [GitHub repository](https://github.com/inclusionAI/Realtime-Venus). # [](https://huggingface.co/inclusionAI/Realtime-Venus#2-✨-highlights)2. ✨ Highlights * **Native full-duplex conversation:** keeps perceiving while speaking and distinguishes backchannels, interruptions, corrections, and redirections. * **Omni-Proactive interaction:** continuously processes temporally aligned video and audio, and initiates a response when an event warrants it — without waiting for a user prompt. * **Delegation:** emits in-stream `<delegate>` requests on the shared causal timeline and consumes asynchronous backend results the same way, so external tasks never block the ongoing conversation. (Executing requests requires the Realtime-Venus-Harness runtime, available in the [GitHub repository](https://github.com/inclusionAI/Realtime-Venus).) * **Training-free long-video Memory:** archives visually informative moments, retrieves query-relevant and non-redundant evidence, and reassembles the corresponding audio-visual context — no additional training required. * **Text and speech output:** generates response text together with native speech through the bundled Token2wav resources and a reference voice.
document fetched 2026-09-19 00:40 · canonical https://reddit.com/r/LocalLLaMA/comments/1wjtav9/inclusionairealtimevenus_hugging_face