The meta appeared in advance new AI tools on Friday called Movie Gen that can create videos, automatically edit them and overlay AI-generated sound for a cohesive video clip.
Movie Gen works with written text requests, an image or an existing video as input. There is also an option to add a personal photo so users can see themselves in the video.
Related: Meta is putting AI images on your Facebook and Instagram feeds, with custom photos
After the AI works its magic and generates a video, a user can type a text message to create a custom soundtrack to play with the video.
A look at a Meta Movie Gen video created from an image. Credit: Meta
As Meta says Movie Gen high definition videos are “the first of their kind in the industry,” when creating long videos in different aspect ratios, that doesn't mean AI is perfect. At the moment, the AI can only generate videos that are up to 16 seconds long – and it doesn't always do the job right.
In one demonstration per the New York Times, Meta's AI tool made a mistake. Although it was able to create a video of a dog in a park talking on a phone, the AI messed up by placing a human hand around the phone instead of a dog's paw.
? Today we're introducing Meta Movie Gen: the most advanced media foundation models to date.
Developed by the AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We are excited about the potential of this line of research to bring to… pic.twitter.com/NDONyKOOyq
— AI at Meta (@AIatMeta) October 4, 2024
Chris Cox, chief product officer at Meta, stated in a post on Threads that Movie Gen is “the industry leader” in video quality, but that Meta is not prepared to release the tools because they are too expensive and videos currently take too long to generate.
Meta is sharing what it has now because the results are “getting pretty impressive,” Cox has written.
Meta isn't the first to showcase a text-to-video AI generation tool – ChatGPT creator OpenAI did so in February with Sora text-to-video template.
In July, OpenAI published many videos on YouTube in partnership with artists and entrepreneurs showing how Sora could create fantastic short films.
Related: Mark Zuckerberg does a better job than his rivals at explaining AI