Deepdub GO lets creators use their own voice for dubbing in 65 languages and first-of-its-kind emotion-prompting AI allows control over vocal emotional expression

Deepdub, the leading AI-based audiovisual dubbing and language localization company, announced the launch of Deepdub GO, a new AI-powered audio-video localization and creation platform for businesses, advertising agencies, online learning platforms, and content creators. Deepdub initially developed its proprietary AI technology for the entertainment industry and has collaborated with Hollywood studios on dozens of film and television projects, including shows that are currently streaming on Hulu and Amazon Prime. With the launch of Deepdub GO, the company is now bringing high-quality and scalable video localization to a wide range of industries for the first time.

Localization of video content by dubbing creates an engaging and immersive viewer experience and can make content accessible to a wider audience. However due to long turnaround times, the complexity of the process and the high costs associated with dubbing, the practice has been mostly limited to the entertainment industry.

“The vast majority of content today can only be viewed by a tiny sliver of the world’s population,” said Ofir Krakowski, CEO and co-founder of Deepdub. “There’s tremendous value that can be unlocked by bringing educational, business and human interest content to a global audience. While auto-generated subtitles help, they aren’t engaging, aren’t accessible to many, and are entirely unsuited for many forms of content like, for example, fitness videos.”

Marketing Technology News: Prasanna Prasad Appointed Chief Technical Officer of Verve Group

The new Deepdub Go platform delivers unparalleled voice quality and emotional resonance. It’s equipped with human-like sound, first-of-its-kind emotion-prompting and voice-guiding technology, and a robust composer for high-quality voice cloning. The professional platform’s capabilities extend to editing voice characteristics, languages, and translations, in addition to other powerful editing features such as controlling duration and word count for lip-sync adjustment. In addition to cloning the original voice, users can choose from thousands of platform voices across 65 languages to match any style.

Deepdub GO gives content creators fine-grained control over the emotional expressivity of the generated audio through “emotion prompting” — a novel approach that utilizes a custom large language model (LLM), allowing users to steer the performance via textual prompts. Additionally, the platform enables control through “voice guiding” — a technique developed by Deepdub to achieve theatrical-grade results for Hollywood movies. Users can provide a voice recording to act as a guide for the desired emotional expressivity of the AI-generated audio.

“For the first time ever, professional-level dubbing is available for any type of content, whether it’s a corporate training video, a university course, or an influencer’s video,” said Ofir Krakowski. “Deepdub GO is an enabler of global storytelling, allowing content creators to resonate with their audiences in a deeper, more personal way. With our studio platform, creators can amplify the potential reach of every piece of content beyond traditional geographical and linguistic boundaries.”

Users simply upload their videos to the Deepdub GO platform, choose the video style and desired languages, and the video is available for download shortly. The end-to-end process includes automatic transcription, translation, voice generation, and audio mixing. Users have full control over every step in the process, and can make edits and adjustments according to their needs. Deepdub GO is also available as an API, enabling integration into existing tools and automated workflows.

Marketing Technology News: MarTech Interview with Carol Howley, CMO at Exclaimer