As China tracked Muslims, Alibaba showed customers how they could, too

It could not be determined whether or how Alibaba’s clients had used the minority detection tool. But the potential for troubling use is high. A social media platform, for instance, could automatically flag videos for additional scrutiny or even alert authorities if the videos contain faces that the software predicts are Uighur.

After the Times asked Alibaba about the tool this week, the company edited its website to remove the references to Uighur and minority faces.

“The ethnicity mention refers to a feature/function that was used within a testing environment during an exploration of our technical capability,” an Alibaba Cloud representative said in a written statement. “It was never used outside the testing environment.”

The company declined to say more about its testing or explain why information about the feature had been included in the official documentation of its software. It also declined to comment on why it had been testing tools for detecting ethnic minority faces.

Alibaba is a Chinese corporate giant with worldwide reach. It is perhaps Amazon’s sole global peer, a behemoth of digital commerce that has sprawled into logistics, groceries, brick-and-mortar retail and cloud services. Alibaba’s shares trade on the New York Stock Exchange and are owned by major international investors. Global brands like Nike, Starbucks and Ralph Lauren use its platforms to sell to Chinese shoppers. Alibaba is the official cloud services partner for the Olympic Games.

But the Trump administration has viewed Chinese technology companies with growing suspicion, particularly those that are seen as participating in human rights abuses in Xinjiang, the western Chinese region that is home to many Uighurs.

The administration last year added 28 Chinese entities, including manufacturers of surveillance gear and artificial intelligence startups, to a trade blacklist over concerns about their role in the crackdown. Last month, the White House barred Americans from investing in a list of companies with ties to the Chinese military, a step toward severing Chinese businesses’ access to US capital markets.

Chinese officials have defended the campaign in Xinjiang as a nonlethal way of fighting extremism. They have pointed to racial tensions in the United States to deflect US officials' criticisms.

Surveillance technology has been crucial to China’s efforts. The vast majority of the country’s population is of the Han ethnicity. But members of other ethnic groups can look distinct enough from Han Chinese to make it easier for software to single them out.

The Washington Post reported last week that Huawei, another Chinese tech giant, had tested software that could automatically alert police when its surveillance cameras detected Uighur faces. The Post’s reporting, which cited a document that had been found on Huawei’s website, led a French soccer star, Antoine Griezmann, to cut ties with the company. He had been a brand ambassador for Huawei’s smartphones.

A Huawei spokesperson told the Post that the tool had been “simply a test.”

Facial recognition technology has posed ethical challenges in many places. In the United States, the potential for inaccuracy and bias has led some local governments to block the technology’s use for law enforcement purposes. Amazon this year stopped allowing police departments to use its facial recognition service for a year to allow lawmakers to consider stronger regulations.

The ways in which the technology has been deployed in China have raised starker questions.

Before this week, Alibaba’s website had said that tools for detecting the faces of Uighurs and other minorities were part of its “content security” service. The service helps Alibaba’s cloud clients flag potentially risky material within the images, videos, texts and documents that are uploaded to their digital platforms.

“As government regulation gets stricter by the day, these are tasks that all websites and platforms must urgently handle and manage seriously,” Alibaba’s website explains. The company is China’s leading provider of cloud services and a partner to international companies that have online operations in China.

The content security service can perform “facial recognition of sensitive people” using still pictures and videos, according to Alibaba’s website. When given an image of a face, the software can look for attributes including whether the person is wearing glasses or smiling, the website’s descriptions say.

Before Alibaba edited those descriptions this week, they had said that the software could evaluate two other attributes as well: whether a person is of “Asian” descent and whether he or she is a “minority” — which, as a description on another page added in parentheses, referred to Uighurs.

The company’s online documentation in English for the same software contained no mention of detecting ethnic minorities, a possible indication that the feature was intended principally for Chinese clients’ use.

Alibaba had not been alone in China in touting tools for automated racial profiling.

Another Chinese cloud provider, Kingsoft Cloud, had described on its website technology that could use an image of a face to predict “race,” among other attributes. According to a page and a document on Kingsoft Cloud’s website that were discovered by IPVM and shared with the Times, the company’s software could evaluate whether a person’s race was “Uighur” or “non-Uighur.”

After the Times asked Kingsoft Cloud about the software, the company purged those pages from its website. In a written statement, it said that the tool in question had never been sold to customers and that it had not been able to distinguish Uighur faces.

The statement said that the software had slipped past the company’s internal review processes and that the company was evaluating those mechanisms to ensure proper oversight.

“The labeling on the basis of any race is inappropriate and inconsistent with Kingsoft Cloud’s policies and values,” the statement said. “Our products will never include any attempt to identify and label specific ethnic groups.”

Kingsoft Cloud is listed on the Nasdaq stock exchange.

c.2020 The New York Times Company