Amazon’s Prime Video is promising to make English-language dubs look more natural by using AI to sync up the way the actors’ mouths move on screen. The feature will be available first on “Maxton Hall,” the German-language romance that is Prime Video’s most-watched international original series to date. Lip-sync dubs are available starting Wednesday on “Maxton Hall” Seasons 1 and 2 globally in English and will also be included when the third and final season of the show releases on Prime Video on Dec. 9.
The upcoming Season 3 is based on the 2018 novel “Save Me” by Mona Kasten. The Prime Video team worked with a combination of AI and VFX technologies to develop the feature, but the company is not sharing specifics on what AI tools it used. Amazon said it Prime Video plans to expand the technology to additional titles in the future.
Prime Video’s AI dub-syncing feature synchronizes actors’ lip movements with human-dubbed audio, which creates “a seamless viewing experience that allows audiences to remain fully immersed in the story,” according to Amazon. And for creators, we’re making it easier for their stories to reach an even broader and global audience, all done under creative oversight to ensure the integrity of their artistic vision is preserved.” Amazon said that Prime Video “continues to explore practical and useful applications of AI that help enhance the viewing experience, always with the customer at the center and creators in the driver’s seat.”
Extract — continue reading at the source.
