HomeNewsTrendsJapan supermarket chain uses AI to assess staff smiles, sparking harassment concerns

Japan supermarket chain uses AI to assess staff smiles, sparking harassment concerns

The AI system, known as “Mr Smile,” was developed by Japanese technology firm InstaVR. It evaluates over 450 factors, including facial expressions, voice volume, and the tone of greetings, to rate a shop assistant’s service attitude.

July 24, 2024 / 13:37 IST
Story continues below Advertisement
japan supermarket
The implementation of Mr Smile has raised concerns about exacerbating workplace harassment, particularly from customers.

Japanese supermarket chain AEON has become the world's first company to implement an artificial intelligence (AI) system to assess and standardise employees' smiles, sparking renewed debate about workplace harassment. The initiative, launched on July 1, is in place across AEON’s 240 stores nationwide.

The AI system, known as “Mr Smile,” was developed by Japanese technology firm InstaVR. It evaluates over 450 factors, including facial expressions, voice volume, and the tone of greetings, to rate a shop assistant’s service attitude. The system incorporates gamification elements, encouraging staff to improve their attitude by challenging their scores.

Story continues below Advertisement

A trial involving approximately 3,400 staff across eight stores reportedly showed a 1.6-fold improvement in service attitude over three months. AEON's objective is to “standardise staff members’ smiles and satisfy customers to the maximum.”

However, the implementation of Mr Smile has raised concerns about exacerbating workplace harassment, particularly from customers—a significant issue in Japan known as “kasu-hara.” Customer harassment manifests as abusive language and repetitive complaints. According to a survey conducted by Japan’s largest union, UA Zensen, nearly half of the 30,000 service industry workers polled reported experiencing customer harassment.