Synthesia, the end-to-end AI video creation platform for businesses, now boasts one million users generating videos in 130 languages. To keep up with demand, the company is launching what it calls “the world’s first video localization solution.”
The multi-part upgrade aims to address challenges in quickly, efficiently, and affordably translating enterprise video content using AI. Synthesia users can start by translating a video they’ve created in the platform instantly with one click. Using AI-enhanced dubbing, Synthesia adjusts lip-sync to “a natural-sounding voice” from one of its many AI avatar hosts.
Also: IBM will train you in AI fundamentals for free, and give you a skill credential – in 10 hours
In a blog post announcing the new features, Synthesia noted that despite the wide availability of video and translated captions globally, potential reach is still limited by difficulties translating audio once a video is produced and finished. Voiceover, subtitling, and dubbing can be expensive and time-consuming, issues the company hopes to address with this upgrade.
To fine-tune translation, users can then invite a collaborator, like a third-party translation service, onto the platform to easily verify accuracy and relevance. They can directly comment and edit within Synthesia, and all language versions are connected back to the original video for seamless updating and comparison.
“According to CSA Research, 87% of consumers won’t buy from an English-only website,” the release states. “This means you could miss out on important business opportunities by not localizing your content.”
The Multilingual Video Player lets viewers click to play automatically translated versions of the original video in their desired language. Using AI-enhanced dubbing, Synthesia adjusts lip-sync to “a natural-sounding voice” from one of its many AI avatar hosts.
Synthesia says it goes a step further to “localize” audio and video for an audience. “A literal translation for videos can miss cultural cues, resulting in content that not only does not appeal to audiences but can be awkward, inappropriate or offensive,” the company explains in the release.
“For example, the American ad ‘Make us your top draft pick’ might not be understood outside the US, where the draft is not a common concept.”
Also: The best AI image generators of 2024: Tested and reviewed
By localizing a video during translation, Synthesia aims to capture the details and nuances of a culture so that content “feels as native as possible and resonates with the audience.”
Users can select a Personal Avatar from their company’s local office to address an audience in that country, for example, and replace visual elements in the background of the video to make it feel more familiar. The features are available starting today in Synthesia 2.0.
