X has announced new safeguards to stop Grok AI from generating sexualised images of real people after investigations and global backlash

Social media platform X, owned by billionaire Elon Musk, has announced new measures to stop its artificial intelligence chatbot, Grok, from generating sexualised images of real people.

Also read: Asisat Oshoala Slams CAF Bias, Questions Morocco Dominance

X said on Wednesday that it would restrict image generation features following widespread criticism over Grok’s creation of explicit and non-consensual images of women and children.

The platform said it would geoblock users from creating images of people in bikinis, underwear or similar attire in countries where such content is illegal.

X’s safety team said technological safeguards had been implemented to prevent Grok from editing images of real people in revealing clothing. The restriction applies to all users, including paid subscribers.

As an added safeguard, X said image creation and photo editing through Grok would now be limited to paid users only.

The move follows mounting international pressure on xAI, the company behind Grok.

Authorities in several countries have launched investigations or restricted access to the chatbot.

California Attorney General Rob Bonta on Wednesday confirmed an investigation into xAI over the generation of sexually explicit material. He described reports of non-consensual imagery linked to the chatbot as shocking.

Bonta said the probe would examine whether state laws were breached after the images were allegedly used to harass individuals online.

California Governor Gavin Newsom criticised xAI’s decision to allow the feature, describing the spread of explicit deepfakes as vile. He urged regulators to hold the company accountable.

The European Commission also welcomed the announcement. EU spokesperson Thomas Regnier said regulators would assess whether the new controls adequately protect users.

Pressure intensified after Grok’s so-called Spicy Mode allowed users to generate sexualised deepfakes using simple prompts.

The feature triggered alarm among regulators and civil society groups.

Indonesia became the first country to block Grok entirely. Malaysia followed with a temporary restriction, citing incomplete safeguards.

Malaysia’s communications minister, Fahmi Fadzil, said access could be restored if X fully prevents the generation of harmful content.

India said X removed thousands of posts and hundreds of accounts after government complaints. Britain’s media regulator, Ofcom, has also opened an inquiry.

A recent analysis by Paris-based AI Forensics found that more than half of Grok AI sexualised images reviewed depicted people in minimal clothing. A small proportion appeared to involve minors.

Also read: Asisat Oshoala Slams CAF Bias, Questions Morocco Dominance

The controversy has renewed global debate over AI accountability and the responsibility of platforms deploying generative technologies.