Photo: Everett Collection.
A de-aged version of actors Tom Hanks and Robin Wright, created by artificial intelligence for the 2024 film Here.
We are well into the age of AI, and I certainly hope that doesn’t mean we’re going to realize the dire warnings of one of its pioneers but just use it in relatively harmless ways.
Today’s story is about using AI to “de-age” actors in a movie covering 60 years.
Benj Edwards writes at Wired, “Here, a $50 million Robert Zemeckis–directed film [used] real-time generative AI face transformation techniques to portray actors Tom Hanks and Robin Wright across a 60-year span, marking one of Hollywood’s first full-length features built around AI-powered visual effects.
“The film adapts a 2014 graphic novel set primarily in a New Jersey living room across multiple time periods. Rather than cast different actors for various ages, the production used AI to modify Hanks’s and Wright’s appearances throughout.
“The de-aging technology comes from Metaphysic, a visual effects company that creates real time face swapping and aging effects. During filming, the crew watched two monitors simultaneously: one showing the actors’ actual appearances and another displaying them at whatever age the scene required.
“Metaphysic developed the facial modification system by training custom machine-learning models on frames of Hanks’ and Wright’s previous films. This included a large dataset of facial movements, skin textures, and appearances under varied lighting conditions and camera angles. …
“Unlike previous aging effects that relied on frame-by-frame manipulation, Metaphysic’s approach generates transformations instantly by analyzing facial landmarks and mapping them to trained age variations. … Traditional visual effects for this level of face modification would reportedly require hundreds of artists and a substantially larger budget closer to standard Marvel movie costs.
“This isn’t the first film that has used AI techniques to de-age actors. ILM’s approach to de-aging Harrison Ford in 2023’s Indiana Jones and the Dial of Destiny used a proprietary system called Flux with infrared cameras to capture facial data during filming, then old images of Ford to de-age him in postproduction. By contrast, Metaphysic’s AI models process transformations without additional hardware and show results during filming. …
“Meanwhile, as we saw with the SAG-AFTRA union strike [in 2023], Hollywood studios and unions continue to hotly debate AI’s role in filmmaking. While the Screen Actors Guild and Writers Guild secured some AI limitations in recent contracts, many industry veterans see the technology as inevitable. …
“Even so, the New York Times says that Metaphysic’s technology has already found use in two other 2024 releases. Furiosa: A Mad Max Saga employed it to re-create deceased actor Richard Carter’s character, while Alien: Romulus brought back Ian Holm’s android character from the 1979 original. Both implementations required estate approval under new California legislation governing AI recreations of performers, often called deepfakes. …
“Robert Downey Jr. recently said in an interview that he would instruct his estate to sue anyone attempting to digitally bring him back from the dead for another film appearance. But even with controversies, Hollywood still seems to find a way to make death-defying (and age-defying) visual feats take place onscreen — especially if there is enough money involved.”
What could go wrong?
The first thing I think of is fewer job opportunities for actors who play younger versions of stars. Still, I’d love to see an AI child version of the actress who plays Astrid in the French crime show of the same name, because I think it would look more natural than the mimicking girl they’ve got. (Awesome tv, by the way. Check it out on PBS Passport.)
More at Wired, here. This story originally appeared on Ars Technica.
Suzanne's Mom's Blog 