Meta takes on OpenAI with its AI video generator "Movie Gen"

Meta today announced a new AI-powered video generator tool called Movie Gen capable of producing high-definition videos. Movie Gen uses text prompts to produce realistic-looking video clips with AI-generated audio. Currently, Movie Gen can create AI videos of up to 16 seconds long at 16 frames per second.

Meta announced its AI video generator tool “Movie Gen” which can create some amazing footage

The company also showcased the capability of Movie Gen by sharing multiple AI video clips including a baby hippo swimming around in a river. Besides, we saw a surfing koala and a woman DJ spinning a record alongside a Cheetah. Not to forget, all these AI videos can be generated in different aspect ratios.

It is worth mentioning that Movie Gen can also create personalized videos from photos. Meta showcases this ability of Movie Gen using an image of a woman, and the tool later generated a video depicting her sitting in a pumpkin patch enjoying some kind of drink. You can check out some screenshots captured from the AI videos below.

Meta mentioned that these models are trained on publicly available and licensed video data, though it didn’t reveal the source. Not to forget, it has been a trend of licensing copyrighted content for a big sum these days and Movie Gen is probably the result of that too. Runway AI did something similar last month, just in case you didn’t know.

Editing existing video and AI-generated audio is also possible

Let’s not forget that Movie Gen can also edit existing videos. It can smoothly add transitions, styles, and other things that never existed previously on that specific video. Besides video generation capabilities, Movie Gen can also generate high-quality and high-fidelity audio of up to 45 seconds.

Interestingly, the generated audio features ambient sound, sound effects, and instrumental background music which is all synced to the video, giving a complete video output at the end. Well, it all does that using a video and optional text prompts entered by a user.

The company further adds that it has worked on this AI video generator with a belief that everyone should have access to such tools to enhance their creativity. If you are looking for technicalities behind Movie Gen, head over to the 92-page research paper shared by Meta. Moreover, Movie Gen is still in the testing phase and isn’t available for public use just like OpenAI’s Sora. So, we don’t know if or when Meta will make it available to the general public.