Blog.
Notes on how OpenDub dubs a video: the models it uses, what runs on your device, and what goes to the voice model you choose.
-
How OpenDub dubs a video in the speaker's own voice
OpenDub takes a video in one language and gives it back in another, in a clone of the speaker's voice, with every line timed to their lips and subtitles burned in. This is what happens in between: eight steps, which of them run on your device, what is sent to the voice model you choose, and how the browser tab, the app on your computer and the command line differ.