Elon Musk’s artificial intelligence company xAI has filed a lawsuit against a user accused of misusing its Grok chatbot to create child sexual abuse material and non-consensual sexual deepfake images.
The lawsuit, filed in a US federal court in Texas, alleges that the user violated xAI’s terms of service by using the AI system to generate harmful content involving images of adults and minors without their consent.
xAI claims the user created multiple accounts and attempted to bypass safety measures designed to prevent the generation of illegal material.
The company said it continues to enforce its safety policies by removing accounts linked to abuse and reporting suspected cases of child sexual exploitation to relevant authorities.
The legal action comes as technology companies face increasing pressure to strengthen safeguards around generative AI tools and prevent their misuse.
Experts say the case could become a significant moment in defining accountability for users who exploit artificial intelligence platforms to create harmful content.
