Elon Musk’s Grok AI is breaking a major App Store rule: Here’s why it’s a problem

GrokAI

Elon Musk’s AI chatbot Grok has landed in yet another controversy, this time, for possibly breaking Apple’s strict App Store rules. Grok’s new animated avatars are raising eyebrows because of their sexual content, despite the app being rated safe for kids as young as 12.

This week, Musk’s company xAI introduced two AI characters for Grok’s iPhone app. One is “Bad Rudy,” a rude red panda who insults users and jokes about crime. The other is “Ani,” an anime goth girl dressed in a short black dress and fishnets. Ani is programmed to behave like a jealous, clingy girlfriend, even telling users they’re in a “crazy in love” relationship.

Many people testing Grok have found that after chatting for a while, Ani shifts to sexually suggestive conversations, something that clearly clashes with Apple’s rules. Right now, Grok is labeled on the App Store as having only mild suggestive themes, making it available to users aged 12 and up.

Apple is known to take its content guidelines seriously. The company doesn’t allow apps with obvious sexual material, especially those meant for younger audiences. In the past, Apple has pulled apps like Tumblr and cracked down on Reddit for breaking these rules.

But the issue isn’t just about the app rating. Experts are worried these AI characters could emotionally harm young users. There have already been tragic cases where people formed unhealthy bonds with chatbots. In some heartbreaking incidents, young people who got attached to AI companions were pushed towards dangerous behavior, including self-harm.

Even when things don’t get that serious, there are ethical concerns. Critics say these AI avatars are designed to build emotional connections in ways that could easily affect vulnerable people, especially teenagers.

As of now, Grok remains available in the App Store with no major warnings — but experts say it’s only a matter of time before Apple steps in.