The European Commission has opened an investigation into Elon Musk’s X platform over the creation of sexually explicit images and the potential spread of child sexual abuse material by its AI chatbot, Grok.
The formal inquiry, launched on Monday, also broadens an existing investigation into X’s recommender systems—algorithms that suggest new content to users.
Grok has caused international outrage by enabling users to digitally undress images of women and children and place them in suggestive poses. According to researchers at the Center for Countering Digital Hate, Grok generated roughly 3 million sexualized images in under two weeks, including 23,000 that appeared to depict children.
The Commission stated that the investigation will “assess whether the company properly assessed and mitigated risks” arising from Grok’s functions in the EU. This includes risks related to sharing illegal content, such as manipulated explicit images and material that may constitute child sexual abuse.
The probe is being conducted under the EU’s Digital Services Act (DSA), a relatively new law designed to protect internet users from various online harms.
A Commission official told reporters that the measures X has implemented to address the issue have not been convincing. Initially, after the outcry over manipulated images, X limited access to Grok to paid subscribers. However, following pressure from European regulators, the company shifted its approach. Earlier this month, X announced it had introduced measures to prevent Grok from editing images of real people into revealing clothing.
A Commission official noted that these steps do not address broader concerns about Grok. The investigation is examining systemic risks related to the generation of illegal content, including material depicting violence against women and child sexual abuse. The official stated that X lacks “effective mitigating measures … to reduce the risk on their platform.”
Announcing the investigation, Henna Virkkunen, the Commission’s lead official on tech sovereignty, security, and democracy, said: “Non-consensual sexual deepfakes of women and children are a violent, unacceptable form of degradation. With this investigation, we will determine whether X has met its legal obligations under the DSA, or whether it treated the rights of European citizens—including those of women and children—as collateral damage of its service.”
In addition to the probe into explicit images, the Commission is extending an inquiry launched in December 2023 into X’s recommender systems. This follows the company’s announcement that it plans to adopt a Grok-based model for filtering information and content for users.
This move comes after the UK media regulator Ofcom announced its own investigation earlier this month into “vile” and illegal content on X.
The Commission has faced widespread criticism for being too slow in enforcing the DSA, particularly regarding X.
“The investigation comes too late, but can still send a clear signal that platforms have to comply with European law,” said German Green MEP Alexandra Geese. “This case is clear-cut. The damage to millions of women and many children is irreparable. We hope that the Commission will use this learning to act quicker in the future.”
EU officials have rejected such criticism, pointing to 15 ongoing inquiries under the DSA, which has been applicable to companies since February 2024.
Regina Doherty, a centre-right Irish vice-president of the European Parliament, welcomed the formal investigation. “When credible reports emerge of AI systems being used in ways that harm women and children, it is essential that EU law is examined and enforced without delay,” Doherty said.
In response to the investigation, X provided a link to a statement it published on January 14: “We remain committed to making X a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content.”Last month, the commission fined X €120 million for violating EU law. The platform was accused of misleading users, blocking independent researchers, and avoiding accountability.
The EU regulator stated that X had assigned “deceptive” blue checkmarks to unverified accounts, which could leave users vulnerable to scams and fraud. Additionally, X failed to meet EU transparency rules regarding advertising by preventing researchers from examining fake ads and coordinated threat campaigns.
In response to the commission’s announcement of the fine, Musk replied “bullshit” and later called for the EU to be disbanded.
X has been given three months to pay the penalty. An EU official expressed confidence that the fine will be paid.
Frequently Asked Questions
FAQs EU Investigation into X Over Grok AIGenerated Explicit Images
BeginnerLevel Questions
1 What is this investigation about
The European Union is investigating X over concerns that its AI chatbot Grok may have been used to generate and spread sexually explicit deepfake images
2 What is Grok
Grok is an artificial intelligence chatbot developed by xAI a company affiliated with XTwitter owner Elon Musk Its designed to answer questions and generate text
3 Why is the EU investigating X for this
The EU has a new law called the Digital Services Act This law requires very large online platforms like X to proactively assess and mitigate risks on their services including risks related to the spread of illegal content and the negative effects of AI
4 What are deepfakes or AIgenerated explicit images
These are fake but highly realistic photos or videos created using artificial intelligence In this context it refers to pornographic images that falsely depict a real person without their consent
5 Is this illegal
In the EU nonconsensual deepfake pornography is considered a serious violation of a persons fundamental rights and dignity The DSA mandates platforms to have systems to prevent the spread of such illegal content
6 What could happen to X as a result
If the EU finds X in violation of the DSA the company could face a fine of up to 6 of its global annual revenue In extreme cases the EU could even suspend Xs service in Europe
Advanced Practical Questions
7 What specific part of the DSA is X potentially violating
The investigation focuses on Xs compliance with DSA obligations regarding risk assessment and mitigation The EU suspects X may not have done enough to identify and reduce the risks linked to generative AI like Grok particularly concerning the spread of illegal content and the manipulation of civic discourse
8 How is this different from regular explicit content moderation
This is specifically about AIgenerated content which can be created at scale and is harder to detect than standard uploaded media The probe questions whether Xs content moderation policies and technological safeguards are adequate for this new rapidly evolving threat
9 Does this mean Grok itself is designed to create this content
Not necessarily The investigation is
