D-ID, the Tel Aviv-based synthetic intelligence (AI) startup, launched an AI-powered video translation device in beta on Wednesday. Dubbed Video Translate, the device can generate translated movies that mimic the voice of the unique speaker and sync the lip motion to match the phrases. The function is presently accessible to the subscribers of the platform, and the corporate mentioned will probably be obtainable without cost for a restricted interval. The device will compete with comparable platforms similar to ElevenLabs, Speechify, and extra.
The AI startup introduced the launch of the video translation function in a put up on X (previously often known as Twitter). The brand new device joins the platform’s current choices similar to avatar-based AI video era, AI agent creation, and AI-powered video marketing campaign creation. The Video Translate device is presently obtainable in beta on the internet. Whereas D-ID does have iOS and Android apps, they don’t help this function in the mean time.
With the brand new AI device, customers can both add a video file from their system or drag it from a cloud server. Presently, the utmost supported file dimension is 2GB and the supported file codecs embrace MP4, MOV, and MPEG. Devices 360 employees members had been capable of check the platform and located it to be working as described, though the lip-syncing and AI voice seem barely unnatural and robotic, and figuring out these movies as AI-generated will likely be fairly simple.
Nonetheless, there are a number of limitations when producing a video as properly. The video translation will solely work when there’s a single particular person within the body of the video, and the particular person is front-facing with their face seen always. Additional, background noise or music can distort the standard of era. Moreover, the platform doesn’t translate movies if the speaker is a well-known or recognisable particular person who seems in them.
The D-ID Video Translate device can translate movies into 30 completely different languages. A few of them embrace Arabic, Chinese language, English, French, German, Hindi, Italian, Japanese, Korean, Russian, Tamil, and Turkish.
Presently, the function is out there to all subscribers of the platform. Customers can subscribe to D-ID by registering an electronic mail ID without cost. The free tier will get 20 credit, which isn’t replenished as soon as exhausted. The paid subscription begins at $56 (roughly Rs. 4,700) per yr and gives 40 credit per 30 days. The most costly plan will price $2,263 (roughly Rs. 1,90,000) per yr and gives 700 credit a month. The startup additionally gives enterprise-focused plans as properly.
