In a remarkable technical milestone for the film industry, TriStar Pictures on Friday released "Here," a film directed by the acclaimed Robert Zemeckis. With a production budget of $50 million, the film pioneers the use of real-time generative AI facial transformation techniques to portray actors Tom Hanks and Robin Wright over a span of 60 years. This novel use of AI marks one of Hollywood's first forays into full-length features built around AI-powered visual effects.
"Here" is an adaptation of a 2014 graphic novel, set mainly within a New Jersey living room, navigating multiple time periods. Instead of employing different actors for the various ages of the characters, the production opted for advanced AI technology to alter the appearances of Hanks and Wright across different decades.
The breakthrough de-aging technology comes from the visual effects company Metaphysic, known for developing real-time facial transformations. For each scene, the film crew monitored two screens: one displaying the actors in their actual state and the other showing them transformed to match the age required by the story at that point.
Metaphysic's facial modification system was achieved by training custom machine-learning models on extensive footage from the actors' earlier films. This comprehensive dataset included a range of facial expressions, skin textures, and lighting conditions. As a result, the models facilitate immediate face alterations without the extensive post-production efforts typically required by traditional CGI techniques.
This technology differs starkly from traditional aging effects that depend on laborious frame-by-frame adjustments. By contrast, Metaphysic’s AI generates these transformations instantly by analysing key facial landmarks and applying pre-trained age variations.
Robert Zemeckis highlighted the novelty of this approach, remarking to The New York Times that such a film could not have been made just three years ago. Conventionally, the visual effects needed to achieve this level of face modification would demand a vast team of artists and budgets akin to those of large-scale Marvel productions.
While not the initial use of AI for de-aging in cinema—having seen prior implementation in the 2023 film "Indiana Jones and the Dial of Destiny" for Harrison Ford—Metaphysic's model stands out for its ability to process transformations autonomously during production, without necessitating additional hardware.
The release of "Here" comes amid a broader industry exploration of AI's potential applications beyond visual effects. Companies such as Runway are experimenting with text-to-video generation tools, while others are devising systems like Callaia for script analysis and production planning. Nonetheless, recent guild contracts have reinforced stringent limitations on AI in creative fields such as scriptwriting.
The ongoing debate over AI’s role in filmmaking has stirred considerable discussion among major studios and unions, most notably during a SAG-AFTRA union strike last year. While some AI use restrictions have been secured by the Screen Actors Guild and the Writers Guild, many in the industry anticipate that the technology's integration is inevitable. Susan Sprung, the CEO of the Producers Guild of America, expressed this uncertainty succinctly when she noted, "Everyone's nervous, and yet no one's quite sure what to be nervous about."
However, Metaphysic's technology has already been adopted for other upcoming film projects. It has been employed in "Furiosa: A Mad Max Saga" to recreate the character of the late Richard Carter, and in "Alien: Romulus" to resurrect Ian Holm's android role from the 1979 original. Both usages required estate approval, aligning with California's new legislation concerning AI recreations known as deepfakes.
Despite its potential, AI's role in the film industry remains controversial. Notably, Robert Downey Jr. recently made headlines by declaring that he would legally challenge any attempt to digitally resurrect him for future film roles posthumously. Nonetheless, the allure of AI-driven visual innovations persists within Hollywood, particularly when substantial financial incentives are at play.
Source: Noah Wire Services