← Back to feed

Every current AI voice interface works the same way: user speaks, model waits for the end of turn, model replies. OpenBMB’s MiniCPM-o 4.5 ships the first genuinely open alternative at production-ready scale.

The model runs on OpenBMB’s Omni-Flow framework, which treats interaction as a continuous stream on a single shared temporal axis. Video tokens, audio tokens, LLM hidden states, speech tokens, and waveform generation are all time-aligned — the model perceives input and generates output simultaneously rather than sequentially. There is no walkie-talkie round-trip.

Key Numbers

• Parameters: 9B total
• RAM requirement: Under 12GB — fits on a single consumer GPU
• Architecture: Full-duplex omnimodal via Omni-Flow shared temporal axis
• Benchmark: Outperforms Qwen3-Omni-30B-A3B on omni-modal capabilities and speech generation quality
• Deployment: Edge-capable; MLX-compatible for Apple Silicon
• Licence: Open, with weights, code, and technical report

The model is 3x smaller than the Qwen model it outperforms on speech quality. The efficiency gap comes from architecture, not compression: Omni-Flow avoids the serialisation overhead of traditional turn-based pipelines by eliminating the buffering step between perception and generation.

The Architecture Difference

Most “omnimodal” models process modalities independently and stitch outputs together at the end of a turn. MiniCPM-o 4.5 processes all modalities in locked time steps. The model can interrupt, back-channel, and update its own output mid-stream as new sensory input arrives — the same constraint structure that makes human conversation feel natural.

Thinking Machines Lab previewed a similar concept from a research angle earlier this month with TML-Interaction-Small, but that model remains proprietary. OpenBMB has shipped the equivalent as an open-weight release with full reproducibility.

Context

MiniCPM-o 4.5 lands as voice AI benchmarks are beginning to formalise. The Full-Duplex Bench v3 (FDB-v3) published earlier this year showed Gemini Live 3.1 going silent 22% of the time — a symptom of the turn-based ceiling. MiniCPM-o 4.5 is the first open model explicitly designed to break that ceiling.

For developers building on-device voice agents, the sub-12GB footprint changes the target hardware. An iPhone 17 Pro already demonstrated 40 tokens/sec with Gemma 4 E2B under MLX; MiniCPM-o 4.5 extends that calculus to real-time multimodal interaction.

The weights, code, and Omni-Flow framework technical report are available via OpenBMB’s GitHub.