arts

Rembrandt's 'Night Watch' on display with missing figures restored by AI

Published 24th June 2021
TOPSHOT - The remounted 1642 'Night Watch' is put in place at the Rijksmuseum Museum during 'Operation Night Watch',  the largest ever investigation into the painting by Dutch master Rembrandt in Amsterdam on June 22, 2021. - Using advanced technology the museum is able to determines how best to preserve the masterpiece for future generations.  - RESTRICTED TO EDITORIAL USE - MANDATORY MENTION OF THE ARTIST UPON PUBLICATION - TO ILLUSTRATE THE EVENT AS SPECIFIED IN THE CAPTION (Photo by Remko de Waal / ANP / AFP) / RESTRICTED TO EDITORIAL USE - MANDATORY MENTION OF THE ARTIST UPON PUBLICATION - TO ILLUSTRATE THE EVENT AS SPECIFIED IN THE CAPTION / RESTRICTED TO EDITORIAL USE - MANDATORY MENTION OF THE ARTIST UPON PUBLICATION - TO ILLUSTRATE THE EVENT AS SPECIFIED IN THE CAPTION (Photo by REMKO DE WAAL/ANP/AFP via Getty Images)
Credit: Remko de Waal/AFP/Getty Images
Rembrandt's 'Night Watch' on display with missing figures restored by AI
Written by ReutersAmsterdam, Netherlands
For the first time in 300 years, Rembrandt's famed "The Night Watch" is back on display in what researchers say is its original size, with missing parts temporarily restored in an exhibition aided by artificial intelligence.
Rembrandt finished the large canvas, which portrays the captain of an Amsterdam city militia ordering his men into action, in 1642.
Although it is now considered one of the greatest masterpieces of the Dutch Golden Age, strips were cut from all four sides of it during a move in 1715.
Though those strips have not been found, another artist of the time had made a copy, and restorers and computer scientists have used that, blended with Rembrandt's style, to recreate the missing parts.
"It's never the real thing, but I think it gives you different insight into the composition," Rijksmuseum director Taco Dibbits said.
A close up of the frame added to Rembrandt's "Night Watch" using AI.
A close up of the frame added to Rembrandt's "Night Watch" using AI. Credit: Remko de Waal/AFP/Getty Images
The effect is a little like seeing a photo cropped as the photographer would have wanted.
The central figure in the painting, Captain Frans Bannink Cocq, now appears more off-center, as he was in Rembrandt's original version, making the work more dynamic.
Some of the figure of a drummer entering the frame on the far right has been restored, as he marches onto the scene, prompting a dog to bark.
Three restored figures that had been missing on the left, not highly detailed, are onlookers, not members of the militia. That was an effect Rembrandt intended, Dibbits said, to draw the viewer into the painting.
Rijksmuseum Senior Scientist Robert Erdmann explained some of the steps in crafting the missing parts, which are hung to overlap the original work without touching it.
First both "The Night Watch" and the much smaller copy, which is attributed to Gerrit Lundens and dated to around 1655, had to be carefully photographed.
"The Night Watch" in 2020, prior to its restoration.
"The Night Watch" in 2020, prior to its restoration. Credit: Patrick van Katwijk/BSR Agency/Getty Images
Then researchers scaled the images to the same size, and warped the Lundens work to fit better with the Rembrandt where there were minor differences in placement of figures and objects.
The artificial intelligence software learned by trying millions of times to approximate Rembrandt's style and colors more closely. Humans judged the success.
Erdemann said the result was good enough that the AI had "hallucinated" cracks in the paint in some spots as it translated Lundens work into Rembrandt.
But asked whether this is the best possible restoration of "The Night Watch," he said no.
"I think technique will always be able to improve."