社区开发者基于 VoxCPM2 推出本地视频配音工具 VoxaDub
社区开发者 @kadirrbrtt 基于面壁智能 VoxCPM2 声音克隆构建了本地优先的视频配音工具 VoxaDub,工作流覆盖转录对齐(可选说话人分离)、本地 Hy-MT2 上下文翻译、VoxCPM2 语音合成、时长适配以及与原始背景音合成,唇形同步为可选独立步骤。
OpenBMB· @OpenBMB · X·2026-11-17 21:30· 45 分钟前AI 评分53
AI 导读
面壁智能 OpenBMB 转发社区开发者 @kadirrbrtt 基于 VoxCPM2 声音克隆构建的本地优先视频配音工具 VoxaDub,工作流覆盖转录对齐(可选说话人分离)、本地 Hy-MT2 上下文翻译、VoxCPM2 语音合成、时长适配和与原背景音合成,唇形同步为可选独立步骤。
正文 · 原文
🎬 A new language. A familiar voice.
Community developer @kadirrbrtt built VoxaDub, a local-first video dubbing tool that brings VoxCPM2 voice cloning into a multilingual workflow. 🌍
From source video to dubbed output:
📝 Transcribe & align: Transcribe dialogue and align timestamps, with optional speaker diarization to distinguish who speaks when.
🧠 Translate: Local Hy-MT2 translation uses surrounding context and optional terminology.
🎙️ Generate voices: Selected clean audio clips from each speaker guide VoxCPM2 synthesis, helping preserve distinct voice characteristics in the translated dialogue.
⏱️ Fit the timing: Duration-aware translation refinement and bounded audio adjustments help fit speech into the original scene.
🎞️ Rebuild the video: Combine dubbed speech with the original background audio. Optional lip-sync is available as a separate step.
🔒 Offline dubbing can run fully locally after model setup, with optional cloud compute choices.
⚡ VoxaDub also explores live broadcast dubbing, currently experimental. Timing safeguards help improve alignment without promising perfect synchronization.
We love seeing our community turn VoxCPM2’s expressive speech generation into tools that help stories reach new audiences. 💙
🛠️ Explore VoxaDub and its multilingual demos:
github.com/kadirb4rut/voxadub
🚀 VoxCPM GitHub:
github.com/OpenBMB/VoxCPM
🤗 VoxCPM2 on Hugging Face:
huggingface.co/openbmb/VoxCPM2
#VoxCPM2 #OpenBMB #AIDubbing #OpenSource
来源:OpenBMB · x.com
来源:RadarAI · aihot.news
