Early bird prices are coming to an end soon... ⏰ Grab your tickets before January 17

This article was published on December 20, 2021

This AI app enhances your crappy photos — or turns them into monstrosities

An uncanny valley of restorations


This AI app enhances your crappy photos — or turns them into monstrosities

AI is having a big impact on photo editing, but the results are proving divisive.

The proponents say that AI unleashes new artistic ideas and cuts the time creators spent on monotonous work. Critics, however, argue that the techniques distort reality and propagate an artificial homogeneity.

A new entry to the debate is GFP-GAN. The system gives low-quality images a high-resolution revamp — and the results can be impressive.

Comparisons with state-of-the-art face restoration methods: HiFaceGAN [67], DFDNet [44], Wan et al. [61] and PULSE [52
GFP-GAN’s outputs (far-right) look impressive compared to other state-of-the-art techniques.
The system, which was created by researchers at the Tencent ARC Lab in China, uses a generative adversarial network (GAN) architecture to enhance faces in old, damaged, and unclear photos.The features are then restored and refined to generate an upscaled image.

“While previous methods struggle to restore faithful facial details or retain face identity, our proposed GFP-GAN achieves a good balance of realness and fidelity with much fewer artifacts,” the study authors wrote in their paper. “In addition, the powerful generative facial prior allows us to perform restoration and color enhancement jointly.”

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!

The research team has also kindly created a demo for their system — which gave us a chance to put their claims to the test.

AI Xi Jinping
The CCP has not, as far as we know, banned this tool or photo.

In our brief and highly unscientific trial, GFP-GAN was most adept with images that had only minor blemishes. Unlike many AI photo tools, it also generated a similar accuracy across a diverse range of subjects. The problem was, this accuracy was highly inconsistent.

AI Justin Bieber face
Meet Dustin Deceiver.

Unsurprisingly, this issue was most pronounced when the tool was used on extremely blurry images. However, even high-resolution inputs led GFP-GAN down some horrifying uncanny valleys.

Mark Zuckerberg Facebook AI face photo
In fairness, GFP-GAN is only designed for human faces.

Our experiment left me on the fence in the debate over AI photo editing. I can certainly see the creative potential, but I certainly wouldn’t trust it to reflect reality.

Perhaps that isn’t such a bad thing. As privacy professionals have warned, cameras equipped with AI image enhancers could be used to track entire populations.

Get the TNW newsletter

Get the most important tech news in your inbox each week.

Also tagged with


Published
Back to top