Fresh off the heels of their impressive $80 million Series B funding news, ElevenLabs has announced Dubbing Studio to gives users more control over localizing videos. The new tool offers unprecedented control over video translation, including transcript editing, translation customization, and precise timing adjustments, marking a significant enhancement from their AI Dubbing tool launched last October.
ElevenLab's AI Dubbing tool already facilitated video translation across 29 languages. The Dubbing Studio builds on this by offering meticulous control over various aspects of the dubbing process. This includes generating and editing transcripts, tweaking translations for naturalness, and re-generating translated audio segments to match the desired delivery style.
The user experience begins with a straightforward project setup, encompassing language selection and file uploading. What follows is a suite of robust features:
- Transcript and Translation Editing: Users can now effortlessly adjust translations for contextual appropriateness. For example, if a translation seems awkward or repetitive, as in the case of translating "In a land where the sun scorches the Earth." to “En una tierra donde el sol quema la tierra,” users can modify it to sound more natural.
- Voice Customization: The Dubbing Studio isolates each speaker’s voice, cloning it to ensure consistent voice quality across languages. Users can also adjust voice settings like stability, similarity, and style.
- Synchronization and Timing: Aligning dialogue with on-screen action is crucial for a seamless viewing experience. The Dubbing Studio allows users to adjust timecodes and inject audio clips, ensuring perfect synchronization.
- Flexibility in Editing: The interface includes speaker cards showing both the original and translated text, a timeline with individual voice tracks, and settings for detailed adjustments. This comprehensive setup ensures that users can modify every aspect of their dub.
- Manual Import Option: For those seeking even more control, the manual dubbing option allows users to upload separate audio files, background tracks, and a detailed CSV file outlining the dialogue specifics.
The launch of Dubbing Studio ultimately empowers creators and businesses to reach a broader audience by making their content accessible and culturally relevant across different languages. It offers the level of control demanded by many professional creators seeking higher production value in their multilingual video content.