X blocks 3,500 posts and deletes 600 accounts after Centre flags obscene AI-generated content

X

• X blocked 3,500 posts, deleted 600+ accounts after govt flagged obscene content.
• AI tools like Grok misused to create and share explicit content on X
• India demands stricter moderation and review of Grok's platform safety controls.

Did our AI summary help?

India’s government has taken strong action after finding that obscene content was being widely shared on X, the social media platform formerly known as Twitter, much of it generated using artificial intelligence tools.

According to NDTV report, X has blocked around 3,500 posts and deleted more than 600 accounts after the Centre flagged explicit and objectionable content on the platform. X has also assured the government that it will follow Indian laws and prevent such content from appearing again.

The issue came to light last week when the Ministry of Electronics and Information Technology sent a formal notice to X Corp. The ministry said it had noticed users misusing AI tools on the platform to create and share obscene images and videos, many of which targeted women in a derogatory and vulgar manner.

At the centre of the concern is Grok, X’s AI chatbot developed by xAI. According to the ministry, users were using prompts and image manipulation techniques to generate explicit content, including non-consensual and deepfake-like material. In some cases, fake accounts were created specifically to host and spread such content.

The government gave X 72 hours to submit an action taken report and warned that failure to comply would lead to serious consequences. The notice said the platform could lose its legal protection under Section 79 of the IT Act and face action under multiple laws, including those related to indecent representation of women and protection of children.

Faced with this warning, X moved quickly. Officials say the company admitted that there were gaps in enforcement, took down thousands of posts, and deleted hundreds of accounts linked to the misuse. X has also told the government that it will not allow obscene content on its platform and will strengthen its moderation systems.

The ministry has now asked X to go a step further. It wants a full review of Grok’s technical design and safety controls to ensure such content cannot be generated in the first place. The government has also asked for strict action against users who violate platform rules, including suspensions and permanent bans.

The notice makes it clear that the crackdown is not limited to fake accounts. Even users who upload or manipulate images, including their own, using AI tools to create explicit material can face action if the content breaks the law.

For India, the message is clear. As AI tools become more powerful and widely available, social media platforms will be held responsible for how those tools are used. For X, now owned by billionaire Elon Musk, this episode is a reminder that operating in India means playing by local rules, even in the fast-moving world of artificial intelligence.