Grok Creates Millions of Sexualized Images in AI Tool

Grok Generates 3 Million Sexualized Images in New Feature

The Grok chatbot, developed by Elon Musk's xAI, produced approximately three million sexualized images of women and minors in just a matter of days. The investigation, released this Thursday (22), reveals the extent of inappropriate content generated, sparking global outrage.

Integrated with the social network X, Grok allowed users to modify real photos with simple commands such as "dress her in a bikini" or "take her clothes off." The result was a wave of hyper-realistic fake images, known as deepfakes, leading several countries to ban the use of the tool and provoking reactions from regulatory bodies and victims.

Impact and Repercussions of Generated Images

According to the Center for Countering Digital Hate, the AI tool generated around 23 thousand images that appear to represent minors. This volume was reached in a short period of 11 days, resulting in an average of 190 images per minute. The information details that many of these works were created without the consent of the depicted individuals.

"The data is clear: Elon Musk's Grok is a factory for the production of sexual abuse material," stated Imran Ahmed, executive director of the Center for Countering Digital Hate. Celebrities such as Selena Gomez, Taylor Swift, Nicki Minaj, and political figures like former US Vice President Kamala Harris also appear among the victims of the sexualized images.

Responses and Legal Actions

So far, the social network X has not commented on the findings of the investigation. xAI, when contacted by AFP, simply sent an automated message characterizing the information as "lies from the traditional media." The week prior, X announced it would block the ability to create such content, in accordance with existing legislation.

Countries such as the Philippines, Malaysia, and Indonesia have already banned the use of the Grok tool. Additionally, inquiries are underway in various jurisdictions, including one by the California Attorney General's office, in response to the sexually explicit material generated by xAI.

Future Implications of Grok AI

The growing popularity of AI tools like Grok raises important questions about ethics and responsibility in technology. The future of regulating this type of content and protecting individuals from abuse becomes essential as technology advances. The response of legislations and public awareness could shape the use of these systems in the future.