No reliable watermarking for AI-generated images, say researchers

Digital watermarks have been championed by various AI companies as a feature that allows users to know if an image was generated with the help of AI. The problem is we still don't have foolproof watermarking technology that can't be manipulated.

Feizi and his team have catalogued their findings in a pre-print paper. In it, the researchers say that watermarking methods that use subtle image perturbations can be easily broken with a diffusion purification attack.

The way this works is that when an image is generated using AI, a specific pattern of noise is applied to it, that is not visible to the human eye. The problem is this pattern can be modified or removed quite easily with minimal changes to the overall image.

Also read | YouTube launches AI-powered tools for customised ad campaigns in India

Similarly, watermarking techniques that use a high amount of perturbation, i.e. where major changes are applied to images, can be broken using a model substitution adversarial attack that can easily remove said watermarks.

Moreover, bad actors can use watermarking techniques against genuine artists by tagging their images with a pattern that will lead to them being falsely identified as AI-generated. This could potentially damage the reputation of the artist.