Breaking linguistic barriers, increasing audience engagement, and expanding market reach can be greatly facilitated by video dubbing, or content localization, which replaces the original spoken language in a video with another language while synchronizing the audio and video. However, traditional methods of video dubbing are costly and time-consuming, with rates of roughly $20 per minute and human involvement being typically required. This creates challenges for companies in the Media & Entertainment industry. As such, a more economical and efficient alternative is video auto-dubbing, which utilizes the power of generative artificial intelligence (AI).
A cost-effective solution for video auto-dubbing involves the use of Amazon Translate for video caption translation, and Amazon Bedrock for post-editing to enhance translation quality. Amazon Translate is a neural machine translation service that offers speedy, high-quality, and affordable language translation. Meanwhile, Amazon Bedrock is a service that offers a choice of high-performing foundation models from leading AI companies and helps create security, privacy, and responsible AI, generative AI apps.
Such a solution can benefit organizations like MagellanTV, a leading streaming platform for documentaries that is aiming to expand its global presence through content internationalization. Mission Cloud, an AWS Premier Tier Partner, assists MagellanTV by offering a novel dubbing solution marked by idiomatic detection and automatic replacement, seamless automatic time scaling, and batch processing capabilities.
An example workflow of this solution would begin when the user specifies the original video and caption file, target language, and settings for idiom detection and formality tone. This information is uploaded to an Amazon Simple Storage Service bucket, which starts the pipeline. The final outputs are a dubbed video file and a translated caption file. The pipeline gets high translation accuracy and tailored translations thanks to Amazon Translate and its support for custom glossaries and setting formality tone. Amazon Bedrock further improves video dubbing quality and uses sentence shortening for automatic time scaling.
In conclusion, the use of generative AI, solutions for idiom detection and replacement, sentence length shortening, and customization of terminology and tone, as provided by the unique localization pipeline developed by Mission Cloud, allows for market expansion of content without substantial costs. A pipeline that is constantly developing is useful for MagellanTV in addressing its growing needs and ambitions. The team is keen on sharing more about their innovation and welcomes contact through the AWS Marketplace.
