TriStar Pictures has made a significant leap into the future of filmmaking with the release of the Robert Zemeckis-directed film, "Here". Unveiled on Friday, this groundbreaking movie, with a budget of $50 million, harnesses real-time generative AI face transformation technology to present actors Tom Hanks and Robin Wright over a span of 60 years. This production marks a pioneering moment in Hollywood as one of the first full-length features centred around AI-powered visual effects.
"Here" is an adaptation of a graphic novel published in 2014, predominantly set in a single New Jersey living room but spanning diverse epochs. The innovative aspect of the film lies in the utilisation of AI to alter the appearances of its lead stars, Hanks and Wright, rather than deploying different actors to portray them at multiple ages. This novel approach was made possible by the visual effects company Metaphysic, known for its real-time face swapping and age progression technologies.
During the film’s production, the crew utilised a dual-monitor setup: one displayed the actors as they were, while the other revealed their AI-transformed variations according to the scene’s timeframe. This seamless integration of technology into the filmmaking process is a testament to the strides made in AI-driven visual effects.
Metaphysic crafted a bespoke facial modification system by training machine-learning models on a comprehensive collection of frames from previous films starring both Hanks and Wright. These datasets encompassed a wide range of facial movements, skin textures, and visual presentations under different lighting and camera perspectives. The final models can produce instantaneous face transformations, thereby eliminating the extensive manual labour traditionally associated with CGI post-production work.
Director Robert Zemeckis, speaking to The New York Times, highlighted the innovation's timing, stating, "You couldn't have made this movie three years ago." The traditional visual effects method for attaining such sophisticated face modifications would typically involve a much larger team of artists and budgets akin to those of high-scale productions like Marvel films.
This venture is not without precedent as other films have also dabbled in AI-driven de-aging techniques. For example, ILM employed a method for de-aging Harrison Ford in the 2023 film "Indiana Jones and the Dial of Destiny". Their technique, called Flux, utilised infrared cameras to capture Ford's facial data in combination with historical images to achieve the de-aging effect in post-production. Metaphysic’s AI approach, by contrast, processes transformations in real-time without the need for additional hardware, offering immediacy in visual effects that can be viewed during the filming process.
As "Here" takes its place in the annals of cinema, it not only showcases a compelling narrative set across time but also underscores a remarkable technological achievement that may shape the future landscape of film production.
Source: Noah Wire Services