Home Artificial Intelligence YouTube integrates AI-powered dubbing tool

YouTube integrates AI-powered dubbing tool

0
YouTube integrates AI-powered dubbing tool

YouTube is currently testing a recent tool that may help creators mechanically dub their videos into other languages using AI, the corporate announced Thursday at VidCon. YouTube teamed up with AI-powered dubbing service Aloud, which is an element of Google’s in-house incubator Area 120.

Earlier this 12 months, YouTube introduced support for multi-language audio tracks, which allows creators so as to add dubbing to their recent and existing videos, letting them reach a wider international audience. As of June 2023, creators have dubbed greater than 10,000 videos in over 70 languages, the corporate told TechCrunch.

Previously, creators needed to partner directly with third-party dubbing providers to create their audio tracks, which is usually a time-consuming and expensive process. Aloud lets them dub videos at no additional cost.

Google first introduced Aloud in 2022. The AI-powered dubbing product transcribes a video for the creator, then translates and produces a dubbed version. Creators can review and edit the transcription before Aloud generates the dub.

YouTube is testing the tool with lots of of creators, YouTube’s VP of Creator Products, Amjad Hanif, said to the group yesterday. Soon the corporate will open the tool to all creators. Aloud is currently available in English, Spanish and Portuguese. Nonetheless, there will probably be more languages offered in the long run, reminiscent of Hindi and Bahasa Indonesian, amongst others.

Hanif added that YouTube is “working to make translated audio tracks sound just like the creator’s voice, with more expression and lip sync.” YouTube confirmed to TechCrunch that, in the long run, generative AI would allow Aloud to launch features like voice preservation, higher emotion transfer and lip reanimation.

LEAVE A REPLY

Please enter your comment!
Please enter your name here