MARZ redefining video localization for professional content producers in entertainment, advertising, marketing, social media, and online education

Emmy-nominated visual effects (VFX) studio and AI technology startup Monsters Aliens Robots Zombies (MARZ) today announced that its LipDub AI™ software is now in private beta for professional content producers and creators in entertainment, advertising, marketing, social media, and online education. Developed to expand the reach of content to global audiences, LipDub AI™ is a video localization platform that both automatically dubs and lip-syncs videos at Hollywood standards in minutes to deliver the most expressive, high-fidelity, and photoreal lip-sync results in the market.

Scalable and cost-effective, LipDub AI™ is ideal for creative teams at Hollywood studios, advertising agencies, marketing teams, online education businesses, and macro social media influencers that prioritize the production value of their localized content, need a professional grade solution that will consistently work without breaking and producing artifacts, and want the benefit of increased engagement and viewership of their content on a global scale.

“LipDub AI will revolutionize content globalization by enabling professional creators to produce video in any number of languages in minutes, not months,” said Jonathan Bronfman, co-founder and CEO of MARZ. “Localized video is far more engaging when voices and facial movements are in unison. This professional tool opens doors to new markets and diverse demographics by creating more immersive and relatable viewing experiences with content that feels native to audiences around the world.”

Requiring no human intervention nor support from visual effects (VFX) artists, LipDub AI™ is the only automated platform available in the market today that consistently delivers high quality video localization. Using the LipDub AI™ fully automated workflow, professional creators can effortlessly dub and lip-sync their videos to any language at Hollywood standards in minutes.

LipDub AI™ stands out in the localization landscape through several differentiators, including the following key areas where the software sets itself apart from consumer-grade applications:

• As a professional software platform, LipDub AI™ can localize footage with multi-character interactions, movement, pose changes, lighting changes, extreme poses, and speaker occlusion.
• LipDub AI™ allows users to localize videos of unlimited length all at once, avoiding the frustration of uploading clips one at a time.
• LipDub AI™ generates high fidelity textures and no AI artifacting.
• LipDub AI™ is the only solution that gives users the flexibility of using voice actor files or AI generated audio.
• LipDub AI™ is a scalable localization platform that transforms one minute of content into a new language in one minute of compute time.

Marketing Technology News: MarTech Interview with Karen Ng, SVP of Product and Partnerships at HubSpot

LipDub AI™ is built for teams who care about quality and require efficiency

“LipDub AI will impact every industry that uses video to engage, educate, and grow their global audience,” said Matt Panousis, Co-founder and COO of MARZ, “Between captions and bad dubs, audiences around the world have had no choice but to put up with a second-class viewing experience. With natural AI dubs and perfect lip-sync that feels native, content creators from ad agencies and digital marketing teams to Hollywood studios are going to dramatically improve the viewing experience for their international audiences and drive increased engagement and watch time in the process.”

This groundbreaking approach to dubbing content was developed by a team of machine learning researchers and VFX professionals at MARZ who understand the challenges associated with quality localization of content from years of manual VFX work for Hollywood productions.

The team is led by MARZ Chief Scientist and world-renowned professor at the Department of Computer Science at Tel-Aviv University, Daniel Cohen-Or, an ACM fellow and The Isaias Nizri Chair in Visual Computing, alongside his longtime collaborator Ali Mahdavi-Amiri, Assistant Professor at Simon Fraser University.

“With LipDub AI, we have succeeded in leveraging advanced generative AI to create photorealistic, lip-synced videos that are dynamic and temporally consistent,” said Cohen-Or. “It will enable creatives to create globally appealing content that transcends borders.”

Beta testing is initially limited to select customers and partners. Those interested in LipDub AI™ can sign up for the beta waitlist at lipdub.ai and can access the software by purchasing credits that then get consumed on the platform as they generate video into new languages.

Marketing Technology News: Hot Take: Why Your Bad Website Is Driving Consumers Away