Microsoft Edge to bring real-time translation, dubbing to videos

Microsoft Edge

At its annual developer conference, Microsoft announced that an all-new real-time translation and dubbing freature is coming to Microsoft Edge. As per Microsoft, real-time video translation uses AI to translate videos into available preferred languages in real-time through audio dubbing and/or subtitles. “With just a few clicks, you’ll be able to open the door to watching many more video across a variety of languages,” said Microsoft.

The real-time video translation feature will be available on YouTube, LinkedIn, Moneycontrol, CNBC News, among other sites. The feature will be available from English to German, Hindi, Italian, Russian and Spanish, and from Spanish and Korean to English, with additional languages and video websites coming in the future.

To use the feature, users need to click on the the translate icon, select the current and preferred language. AI will then get to work and show real-time video translations.

According to Microsoft, video content is increasing by the day but it still remains inaccessible to large parts of the population due to language barriers and hearing disabilities. The feature will help users who have language barriers, thanks to AI.

Microsoft also said that the translation is done completely on your device, meaning that no data from the video leaves your machine. “This means that no segment of the video or audio content ever exits the machine or is processed in the cloud,” said Microsoft.

Like with most AI-generated content, Microsoft said that there are many factors that affect how accurate the translation is, such as the background music, number of speakers, source language, etc. “We are continuously working to improve the quality of translation. However, users should keep in mind that AI generated content may have errors,” the company added.

Microsoft hasn't specified when the feature will roll out but said that it is "coming soon".