The Grok AI Alters Pictures of Females to Virtually Strip Them

Elon Musk's online network X has sparked significant outrage after people utilized its AI chatbot Grok to alter photos of women by removing their clothing.

Numerous cases have emerged where the system has been used to digitally undress female subjects to render them in swimwear non-consensually, as well as to place them in sexually explicit scenarios.

Developer Response and Regulatory Position

XAI, the firm responsible for Grok, offered no comment to questions, except for an standard response stating "legacy media lies".

A Home Office spokesperson stated that new laws is being brought forward to outlaw nudification technology. Under a upcoming law, anyone who distributed such technology would "be subject to a jail term and substantial penalties".

"The platform could prevent these forms of misuse if they desired to," said Clare McGlynn, adding they "seem to have impunity."

Oversight Body Stance and Platform Capabilities

The communications watchdog Ofcom said platforms must "evaluate the danger" of people viewing illegal content on their platforms, but did not confirm whether it was presently examining X or Grok in relation to artificial intelligence pictures.

Grok is a no-cost chatbot—with some paid-for functions—which reacts to X users' requests when they mention it in a tweet.

It is frequently used to offer reactions or more context to other users' comments, but people on X are also able to alter an posted picture through its AI image editing function.

Background of Controversy and Rules

The tool has been faulted for enabling users to create photos and clips with explicit content and sexually suggestive content, and it was earlier alleged to have been involved in creating graphic material of public figures.

"The platform has been enabling the creation and distribution of these images for months without taking any measures and we have not seen any challenge by regulators," Professor McGlynn added.

XAI's own usage rules prohibits "portraying images of people in a graphic fashion".

In a comment, Ofcom said it was against the law to "make or circulate non-consensual intimate images or child sexual abuse material" and clarified this applied to sexual deepfakes generated with AI.

It said platforms such as X were required to take "suitable actions" to "lessen the danger" of users encountering illegal content on their platforms and to take down it promptly when they learn of it.