A video translator that speaks in your own voice

OpenDub is a video translator that dubs. It translates what is said in a video into one of 17 languages and speaks it back in a clone of the speaker's own voice, with subtitles in the new language. It is open source, needs no account, and the video stays on your device.

What this video translator does

Many tools sold as a video translator only write subtitles. OpenDub writes them too, and it also replaces the speech. It separates the speech from the music and effects, transcribes it, translates each whole sentence to fit the moment it was said, and speaks it back in a clone of the original voice. Each dubbed line is timed to last as long as the speaker took to say it, and is read in the tone it was said in.

You do not record a voice sample or train anything: the voice is cloned from a few seconds of clear sentences in the video you are translating. Only clone voices you have the rights to use.

How to use the video translator

  1. Choose the video. MP4, MOV or WebM, from your own device. The language of the original video is detected automatically.
  2. Choose the language to dub into. One of the 17 listed below.
  3. Choose a voice model. Higgs Audio or ElevenLabs with your own API key, or the free OmniVoice in the app on your computer.
  4. Choose what happens to the original sound. Replace the voice keeps the music and effects and swaps only the speech; Voice-over leaves the original faintly underneath. Subtitles in the new language can be burned in.
  5. Start the dub and download it. In the app on your computer you can then change any line's translation, tone or timing and re-dub just that line.

What the video translator gives you

  • The dubbed MP4.
  • The dub audio as WAV.
  • Subtitles in both languages as SRT.
  • The clip the voice was cloned from.

17 languages

The video translator dubs into 17 languages: English, 简体中文, 繁體中文, 日本語, 한국어, Español, Français, Deutsch, Português, Italiano, Русский, हिन्दी, Bahasa Indonesia, Bahasa Melayu, Tiếng Việt, ไทย, العربية. That includes English, so it also works when you want to translate video to English.

Where the video translator runs, and what it costs

  • In the browser, with your own key. With a Higgs Audio or ElevenLabs API key the dub runs in the card at the top of opendub.app, with nothing to install, for videos up to five minutes. You pay Boson AI or ElevenLabs directly.
  • On your computer, for free. OmniVoice is the free voice. It needs the OpenDub app on your computer: there are downloads for Mac (Apple Silicon) and Windows, and a one-line install for macOS and Linux. It runs at about 15–35 seconds a line on a laptop CPU, and its model weights are licensed for non-commercial use only. The app has no length limit.

OpenDub itself is open source under AGPL-3.0, free to use, and needs no account.

So it is a free video translator when you use OmniVoice in the app on your computer, for non-commercial use. In the browser it is free software with a paid voice model, billed by that provider.

What it does not do

  • It does not change the lips in the picture. It replaces the voice and leaves the picture as it is.
  • It does not take a link to a video online. It works on a video file on your own device.
  • The free voice is for non-commercial use, and the browser route stops at five minutes.

Is the video uploaded?

No. This video translator keeps the video on your device. Only speech clips and text go to the voice model you choose. An API key is kept in memory for that one dub, sent only to that provider, and never stored. The privacy page has the details.

For the choices along the way and the files you get, read How to translate a video into another language. For where the cloned voice comes from, read Voice cloning for multilingual video dubbing.

Questions

Is this AI video translator free?

The software is free and open source. The OmniVoice voice is free and runs in the OpenDub app on your computer, for non-commercial use. With Higgs Audio or ElevenLabs you use your own API key and pay that provider directly.

Does the video translator keep the background music?

Yes. Replace the voice keeps the music and effects and swaps only the speech. Voice-over leaves the original faintly underneath.

How long a video can I translate?

Up to five minutes in the browser. The OpenDub app on your computer has no length limit.

Do I need an account?

No. OpenDub needs no account.

Does the video translator change the lips in the picture?

No. OpenDub replaces the voice and leaves the picture as it is. Each dubbed line is timed to last as long as the speaker took to say it.

Dub a video on opendub.app · Blog