Typically, videos uploaded on YouTube, Google’s video platform, are only accessible in one language. To cater to non-speakers of that language, Google incorporated a subtitle feature for YouTube many years back.
Today, automatic caption generation is possible on YouTube. While this automated process is not perfect, it serves its purpose by making the content available to users who would otherwise struggle to understand it.
YouTube users may soon have the ability to hear videos in languages they understand, even if the video’s original language is different. Through the Aloud project by Google’s Area 120, videos could soon be automatically dubbed on YouTube using AI.
Introduced in 2022, Aloud was initially a part of the Area 120 project. Its primary focus at that time was to equip video creators with tools for multilingual subtitling and dubbing. Dubbing is a technique used in video production to change its language by replacing audio while ensuring the new audio matches lip movements closely.
Aloud handles most of the heavy lifting for video creators. It kickstarts by transcribing the video, allowing producers to review and adjust the transcription. Once satisfied, Aloud translates the text into chosen languages and creates the dubbing.
Last year, Aloud released a brief demo video showcasing its operations:
The technology is currently in early access, limiting both the access and supported languages. At present, only a few languages like English, Spanish, and Portuguese are supported.
As per Amjad Hanif, Vice President of Creator Products at YouTube, the platform seems to be piloting the tool with select creators.
Users and content creators interested can watch a specific YouTube video. While it’s originally in English, Aloud has provided a Spanish version.
To switch to Spanish, go to Settings > Audio Track > select Spanish (Latin America) dubbed.
Aloud is expected to undergo significant upgrades. Beyond expanding language support, it aims to mimic creators’ voices in the target language, enhance lip syncing, and introduce more expressions.
Parting Thoughts
This technology holds vast potential. YouTube creators can leverage it to engage with audiences previously out of their reach. The effectiveness of transcription and foreign language audio creation, alongside the efforts required by producers for quality transcription, remains to be observed.
Your Turn: Subtitles or dubs – what’s your preference?
Thank you for reading Ghacks. The article You May Soon Listen to YouTube Videos in Any Language Thanks to AI was first published on gHacks Technology News.
