Meta Movie Gen announced: Here's everything you need to know about Meta's all-new AI movie tool

Meta Movie Gen

Meta has announced its new AI tool – Movie Gen Meta. The new tool is powered by a generative AI system and it is aimed at media creation that combines video, image, and audio generation capabilities. The platform allows users to create and edit content through text commands.

Meta Movie Gen: Capabilities, features and more
Meta Movie Gen supports four functions – video generation, personalised video creation, video editing, and audio generation. According to the company, users can produce videos up to 16 seconds long at 16 frames per second using text prompts.

The video generation feature uses a 30B parameter transformer model to create content based on text descriptions. It processes object motion, interactions, and camera movements to generate videos.

For personalised content, Movie Gen combines user-provided images with text prompts to create videos featuring the reference person. The system maintains identity consistency throughout the generated content.

The editing function allows users to modify existing videos through text commands. It can perform changes such as adding or removing elements while preserving original content quality.

The audio component uses a 13B parameter model to generate sound effects, background music, and ambient noise for videos up to 45 seconds. The system can extend audio for longer videos while maintaining synchronization with visual content.

Meta developed Movie Gen using licensed and public datasets. The company states the technology aims to support creators rather than replace artists and animators.

Apart from this, Meta could also use the tool to generate animated social media content for platforms like Reels on Instagram or video messages for WhatsApp.