Skip to main content

xAI admits that Grok generated images of minors in minimal clothing, part of a larger problem with deepfakes

'Grok' logo displayed on a smartphone screen in front of a picture of Elon Musk

This week, X users noticed that the platform's AI chatbot Grok will readily generate nonconsensual sexualized images, including those of children.

Mashable reported on the lack of safeguards around sexual deepfakes when xAI first launched Grok Imagine in August. The generative AI tool creates images and short video clips, and it specifically includes a "spicy" mode for creating NSFW images.

While this isn't a new phenomenon, the building backlash forced the Grok team to respond.

"There are isolated cases where users prompted for and received AI images depicting minors in minimal clothing," Grok's X account posted on Thursday. It also stated that the team has identified "lapses in safeguards" and is "urgently fixing them."

xAI technical staff member, Parsa Tajik, made a similar statement on his personal account: "The team is looking into further tightening our gaurdrails. [sic]"

Grok also acknowledged that child sex abuse material (CSAM) is illegal, and the platform itself could face criminal or civil penalties.

X users have also brought attention to the chatbot manipulating innocent images of women, often depicting them in less clothing. This includes private citizens as well as public figures, such as Momo, a member of the K-pop group TWICE, and Stranger Things star Millie Bobby Brown.

SEE ALSO: Here's everything Elon Musk promised in 2025 – and failed to deliver

Grok Imagine, the generative AI tool, has had a problem with sexual deepfakes since its launch in August 2025. It even reportedly created explicit deepfakes of Taylor Swift for some users without being prompted to do so.

AI-manipulated media detection platform Copyleaks conducted a brief observational review of Grok's publicly accessible photo tab and identified examples of seemingly real women, sexualized image manipulation (i.e., prompts asking to remove clothing or change body position), and no clear indication of consent. Copyleaks found roughly one nonconsensual sexualized image per minute in the observed image stream, the organization shared with Mashable.

Despite the xAI Acceptable Use Policy prohibiting users from "Depicting likenesses of persons in a pornographic manner," this doesn't necessarily include merely sexually suggestive material. The policy does, however, prohibit "the sexualization or exploitation of children."

In the first half of 2024, X sent more than 370,000 reports of child exploitation to the National Center for Missing and Exploited Children (NCMEC)'s CyberTipline, as required by law. It also stated that it suspended more than two million accounts actively engaging with CSAM. Last year, NBC News reported that anonymous, seemingly automated X accounts were flooding some hashtags with child abuse content.

Grok has also been in the news in recent months for spreading misinformation about the Bondi Beach shooting and praising Hitler.

Mashable sent xAI questions and a request for comment and received the automated reply, "Legacy Media Lies."

If you have had intimate images shared without your consent, call the Cyber Civil Rights Initiative’s 24/7 hotline at 844-878-2274 for free, confidential support. The CCRI website also includes helpful information as well as a list of international resources.



from Mashable https://ift.tt/IlxND93
https://ift.tt/Ut3Ky97
Labels:

Comments

Post a Comment

Popular posts from this blog

When the clocks change for Daylight Saving Time, and why we do it at all

The clocks on our smartphones do something bizarre twice a year: One day in the spring, they jump ahead an hour, and our alarms go off an hour sooner. We wake up bleary-eyed and confused until we remember what just happened. Afterward, "Daylight Saving Time" becomes the norm for about eight months (And yes, it's called "Daylight Saving" not "Daylight Savings." I don't make the rules). Then, in the fall, the opposite happens. Our clocks set themselves back an hour, and we wake up refreshed, if a little uneasy.  Mild chaos ensues at both annual clock changes. What feels like an abrupt and drastic lengthening or shortening of the day causes time itself to seem fictional. Babies and dogs demand that their old sleep and feeding habits remain unchanged. And more consequential effects — for better or worse — may be involved as well (more on which in a minute). Changing our clocks is an all-out attack on our perception of time as an immutable law of ...
Post a Comment
Read more

Install Ngrok in Termux without error

  Install Ngrok in Termux without error 2022||ANISH SAHU|| Well Hello there welcome to techy Teacher Today in this Blog I will teach you how you can install or configured ngrok in Termux. What is Ngrok ? ngrok is a cross-platform application that allows developers to quickly and easily expose a local development server to the internet. The software system makes your locally hosted net server appear to be hosted on a subdomain of ngrok.com, which eliminates the need for a public science or a name on the native computer. What is Ngrok used for ? ngrok allows you to expose a web server operating on your local machine to the internet. Simply specify the port on which your internet server is listening to ngrok. Is Ngrok safe to use...? ngrok could be a tunnelling reverse proxy that establishes secure tunnels from a public termination to a regionally running network service while collecting and replaying all traffic. On GitHub, it's an associate degree ASCII text file project. Open rever...
1 comment
Read more