AI Dubbing
Live AI dubbing in Line 21: speech-to-speech translation with Gemini Live Translate, how to set it up, and how dubbed audio reaches players and streams.
AI Dubbing turns the speaker's voice into spoken audio in another language, live. Your audience can listen in their own language instead of reading captions.
AI Dubbing is in beta and is switched on per organisation. Contact us to enable it. In the dashboard it appears as Interpretation, under AI Agents in your project settings.
How it works
AI Dubbing uses a speech-to-speech model: the original audio goes in, translated speech comes out, with no captions in between.
We currently use one model: Google Gemini Live Translate. It works on a continuous stream, translating while the speaker is talking rather than waiting for them to finish a sentence.
- Language changes: the model follows a live stream that switches language, without restarting.
- Voice matching: the dubbed voice follows the original speaker, including their gender.
- In sync: every dubbed track stays aligned with the original video.
Supported languages
AI Dubbing is available in 75 languages, listed below and on the Languages page. The source must be a single-language input: inputs that combine several languages can't be dubbed yet.
| Code | Language |
|---|---|
| AF | Afrikaans |
| SQ | Albanian |
| AM | Amharic |
| AR | Arabic |
| HY | Armenian |
| AZ | Azerbaijani |
| EU | Basque |
| BE | Belarusian |
| BN | Bengali |
| BG | Bulgarian |
| CA | Catalan |
| ZH | Chinese (Simplified) |
| HR | Croatian |
| CS | Czech |
| DA | Danish |
| NL | Dutch |
| EN | English |
| ET | Estonian |
| FI | Finnish |
| FR | French |
| GL | Galician |
| KA | Georgian |
| DE | German |
| EL | Greek |
| GU | Gujarati |
| HA | Hausa |
| HE | Hebrew |
| HI | Hindi |
| HU | Hungarian |
| IS | Icelandic |
| ID | Indonesian |
| IT | Italian |
| JA | Japanese |
| JV | Javanese |
| KN | Kannada |
| KK | Kazakh |
| KM | Khmer |
| RW | Kinyarwanda |
| KO | Korean |
| LO | Lao |
| LV | Latvian |
| LT | Lithuanian |
| MK | Macedonian |
| MS | Malay |
| ML | Malayalam |
| MR | Marathi |
| MN | Mongolian |
| MY | Myanmar (Burmese) |
| NE | Nepali |
| NO | Norwegian |
| FA | Persian |
| PL | Polish |
| PT | Portuguese |
| PA | Punjabi |
| RO | Romanian |
| RU | Russian |
| SR | Serbian |
| SD | Sindhi |
| SI | Sinhala (Sinhalese) |
| SK | Slovak |
| SL | Slovenian |
| ES | Spanish |
| SU | Sundanese |
| SW | Swahili |
| SV | Swedish |
| TL | Tagalog (Filipino) |
| TA | Tamil |
| TE | Telugu |
| TH | Thai |
| TR | Turkish |
| UK | Ukrainian |
| UR | Urdu |
| UZ | Uzbek |
| VI | Vietnamese |
| ZU | Zulu |
Adding AI Dubbing
- Open your project's Settings and find Interpretation under AI Agents.
- Click + to add an interpretation.
- Choose the Model (Gemini Live Translate).
- Choose the Input source: the language input whose speech you want to dub.
- Choose the language to dub into, then click Add Interpretation.
The interpretation shows as Idle until audio is flowing, and you can add one for each language your audience needs.
Where the dubbed audio goes
| Destination | How the dubbing is delivered |
|---|---|
| HLS streaming | Each dubbed language is published as an alternative audio track that viewers pick in the player. |
| RTMP streaming | The original audio is replaced with one dubbed track. Turn off Use original audio and pick the Audio track. |
| SRT | Dubbed audio from existing interpretations can be muxed into the SRT output. |
| Captions page | Coming soon: listen to the dubbed audio on the same page as the captions. |
Things to know
The model's voice replication is good but not perfect. As Google notes, a voice can occasionally shift after a long pause, start with the wrong gender, or settle on one voice when several people talk in quick succession. Language detection can also struggle with heavy accents or very similar languages, although the translation itself should still be accurate.
For a high-stakes session, test with a recording of your speakers first, and keep captions available alongside the dubbed audio.
Dubbed audio is processed by the same pipeline as the rest of your content: see Data handling & retention.
AI Translations
Live machine translation of captions in Line 21: the translation engines, supported languages, switching engines per language, and custom dictionaries.
AI Context
Give AI services your event's scripts, names and terminology with the AI Context Builder, to make the AI Proofreader and speech recognition more accurate.