Microsoft outlines plan to remove abusive deepfake content from Bing

Microsoft

Microsoft has partnered with StopNCII to detect and remove AI-generated deepfake content and intimate images in its Bing search engine. StopNCII is a global platform for adults that works to protect their intimate photos from being shared online without their consent.

In an official blog post, Microsoft said that it will “pilot a victim-centered approach to detection” in Bing.

With help from StopNCII, victims of online imagery abuse can "create a “hash” or digital fingerprint of their images, without those images ever leaving their device (including synthetic imagery)”. Those digital fingerprints will help Microsoft’s industry partners “to detect that imagery on their services and take action in line with their policies”.

Microsoft says that anyone can put in a request to remove their “nude or sexually explicit image or video” that has been shared without their consent through Microsoft’s centralized reporting portal.

For users 18 years and above, Microsoft has also outlined a three-step procedure to report non-consensual intimate imagery.

"Step 1: Use the webform at aka.ms/reportci to report NCII, confirming the images were shared without consent.

Step 2: Submit the form with the URL of the webpage and the image.

Step 3: Receive an email confirmation; Microsoft will assess and take appropriate action."

Those under 18 years of age should report the imagery "as child sexual exploitation and abuse imagery,” adds Microsoft.

Microsoft says that when it confirms that the reported content violates its NCII policy, it will “remove reported links to photos and videos from search results in Bing globally and/or remove access to the content itself if it has been shared on one of Microsoft’s hosted consumer services. This approach applies to both real and synthetic imagery.”