Adobe Firefly gets major AI update, can generate and translate videos, audio and more

Adobe Firefly

Adobe has added several new generative AI features to Firefly making it more capable than ever and helping users easily leverage these tools within applications like Photoshop, Premiere Pro, etc. The centre stage of the announcement is the new Firefly Video Model which offers tools like generating video content, translating videos, creating videos from text or photos and more.

The Firefly Video Model powers the Generate Video feature, enabling users to create video clips from text prompts or images. It supports 1080p resolution, with plans for a 4K model. Users can control camera angles, create atmospheric elements, and develop custom motion designs. The feature is designed for high-speed iteration and professional production, with early adopters including brands like PepsiCo/Gatorade and Stagwell.

Scene to Image allows users to create high-resolution images from 3D sketches and reference shapes. A lightweight 3D sketching tool helps transform artwork into professional-quality images. Users can adjust 3D angles and perspectives, making it suitable for graphic design workflows. This feature integrates with Text to Image, providing precise visual guides for creators.

The Translate Audio and Video feature enables the translation of spoken dialogue into over 20 languages while maintaining voice authenticity. It reduces the time and cost associated with dubbing and audio mixing, making it easier to reach global audiences. The tool matches voice, tone, and cadence, ensuring natural-looking content.

Adobe has introduced two new subscription plans: Firefly Standard and Firefly Pro. The Standard plan offers 2,000 video/audio credits monthly, allowing up to 20 five-second 1080p video generations, priced at Rs 797. The Pro plan provides 7,000 credits, enabling up to 70 five-second 1080p video generations, priced at Rs 2,394.  Both plans include unlimited imaging and vector features and 100GB of cloud storage. Note that this is an early access pricing and will end May 15.

The new Firefly application and its features are available globally, with early access pricing for the new plans. Adobe continues to focus on integrating generative AI tools into its Creative Cloud ecosystem, supporting creative professionals in ideation and production.