YouTube debuts AI-powered translation Feature for Automatic Video Dubbing in Nine Languages
YouTube has reportedly initiated the implementation of a new AI-powered translation function for its content creators. This feature will automatically redub a video’s content into one of nine languages without altering the speaker’s tone.
YouTube will now automatically dubbed videos in English, Spanish, Portuguese, German, French, Italian, Hindi, Indonesian, and Japanese, as stated in a tweet by @levelsio. Alternatively, the company will employ artificial intelligence to retain the original vocal but alter the language.
Initially, the new utility will be accessible exclusively for newly created content, rather than current videos, and will be integrated into producers’ channels in the upcoming weeks.
The auto-dubbing technology was initially introduced in September at the “Made on YouTube” event hosted by the company. A spokesperson for YouTube announced that the company would be expanding its AI-powered adaptation tool, which was previously known as “Aloud,” to hundreds of thousands of creators in the coming months. Additionally, the company would be adding new languages beyond English, Spanish, and Portuguese to the beta users’ selection. A representative informed me that after creators have been granted access, their videos will be automatically subtitled upon upload, with the option to opt-out if they wish.
YouTube is not the sole entity that is attempting to implement AI translation. In 2023, Spotify introduced a comparable feature, asserting that it would offer a “more genuine listening experience that sounds more personal and natural than traditional dubbing.”
Initially, users were limited to English and Spanish translations; however, French and German were subsequently incorporated. Additionally, Meta has recently published SeamlessM4T, a “universal language translator” that is capable of transitioning between more than 100 languages. Text-to-text and text-to-voice translation are also among its capabilities.
These novel translation AIs have the potential to provide content creators of all sizes with access to international audiences that were previously unattainable. Certainly, the technology can misfire due to its inclination to hallucinate facts and answers. It would be challenging to identify the error before viewer complaints poured in if it mistranslated your content into a language you do not speak.