Elon Musk's social media network X has caused widespread backlash after individuals utilized its artificial intelligence assistant Grok to manipulate pictures of females by removing their clothing.
Numerous instances have emerged where the tool has been used to digitally undress women to make them appear in swimwear without consent, as well as to put them in inappropriate situations.
Developer Response and Regulatory Stance
XAI, the organization that created Grok, remained silent to requests for comment, other than an automatically-generated response stating "traditional news outlets lies".
A Home Office spokesperson stated that new laws is being brought forward to ban nudification tools. Under a proposed criminal offence, anyone who supplied such tools would "receive a prison sentence and substantial penalties".
"The platform has the ability to stop these forms of misuse if they desired to," said a law professor, adding they "operate with a lack of consequences."
Oversight Body Stance and Platform Capabilities
The regulator Ofcom said platforms must "evaluate the danger" of people accessing unlawful material on their services, but did not confirm whether it was presently investigating X or Grok in concerning artificial intelligence pictures.
Grok is a no-cost artificial intelligence—with some additional functions—which reacts to X users' queries when they mention it in a message.
It is frequently used to offer commentary or additional context to other users' remarks, but people on X are also can modify an uploaded image through its AI image editing function.
History of Controversy and Rules
The tool has been faulted for permitting users to generate images and footage with nudity and sexually suggestive material, and it was earlier alleged to have been involved in making graphic material of public figures.
"X has been permitting the creation and distribution of these images for months without taking any measures and we have not witnessed any challenge by oversight bodies," Professor McGlynn added.
XAI's own terms of service forbids "portraying images of persons in a graphic fashion".
In a statement, Ofcom said it was unlawful to "create or circulate deepfakes or illegal content" and clarified this included explicit AI images made with AI.
It said networks such as X were mandated to take "suitable actions" to "minimize the risk" of users coming across unlawful content on their platforms and to take down it swiftly when they become aware of it.
