DeepL Aure preserves intonation, emotion and speaking pace in real-time translation
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Cross-language conversations now preserve not only a person's voice but also their changing manner of speech, so less meaning and emotion are lost.
Aure continuously analyzes the source audio and translated text, so the translated voice changes with the speaker: it preserves emphasis, pauses, pace and sarcasm rather than fixing intonation from an opening sample. During training, DeepL separates voice identity, melody and speech content so they can be transferred into another language independently; reinforcement learning is used to preserve accuracy and reduce accent. The model is automatically enabled in DeepL Voice for online meetings, in-person conversations and the API. At launch it supports English, German, Spanish, French, Italian, Japanese, Portuguese and Korean. DeepL says meeting recordings and translations are not stored permanently and are deleted from memory when the session ends.
Sources 2