Meta Reveals Advanced AI Video Generator, Movie Gen
In the ever-evolving landscape of artificial intelligence, Meta – the parent company of social media giants Facebook and Instagram – has unveiled a significant advancement in AI video generation technology. The new model, known as Movie Gen, represents a marked improvement over its predecessor, Make-A-Video, which was announced in October 2022 but never saw a public release.
Movie Gen is designed to create cohesive video content that closely follows text prompts. In addition to video generation, it can also produce audio, aligning music and sound effects with the visual narrative. The model is capable of editing existing videos and can take still images as references, providing a versatile tool for content creation.
Meta has provided a glimpse into the capabilities of Movie Gen through a recently published research paper. The AI model can generate videos up to 16 seconds in length and audio lasting up to 45 seconds. It offers flexibility in aspect ratios, making it useful for various media formats. The initial findings suggest that Movie Gen's output can favourably compare to other leading AI video generators such as Runway, OpenAI's Sora, and Kling. The video outputs showcase commendable human and animal representations, as well as detailed depictions of clothing and other objects, although some images exhibit a slightly cartoonish quality. Lighting and shadow rendering appear particularly sophisticated.
Despite the promising capabilities of Movie Gen, Meta has announced that there are no immediate plans for its public release. Chris Cox, Meta's Chief Product Officer, mentioned that the model remains expensive and time-consuming to operate. He noted, however, that the company wanted to share the impressive progress achieved so far.
This technological development comes amidst competition from other AI video creators. OpenAI had originally planned to release Sora publicly within the year, although there have been no updates on this timeline. Runway, another prominent AI video generator, has entered a partnership with entertainment producer Lionsgate to develop a tailored model. Furthermore, Adobe is poised to introduce its AI video tool, Firefly Video, which promises seamless integration with Adobe’s established software products like Photoshop and Premiere Pro.
The training techniques behind these AI models have been a point of discussion. Meta has claimed that Movie Gen was trained using a combination of licensed and publicly available datasets, though no specific datasets were disclosed. This contrasts with speculations around Runway's training data, which some allege involved content scraped from YouTube, potentially violating YouTube’s terms of service.
As AI continues to push the boundaries of creative capabilities, Meta's latest foray into AI video generation signifies a notable step forward, with potential implications for various sectors, including entertainment, marketing, and media production. Nevertheless, the tech giant appears to be taking a cautious approach before releasing Movie Gen to a broader audience.
Source: Noah Wire Services