In short
The grievance cites estimates that Grok generated as much as 3 million sexualized photographs in a matter of days, together with hundreds depicting minors.
Baltimore is searching for civil penalties, restitution for affected residents, and courtroom orders to halt the alleged conduct.
Authorized specialists say the case might hinge on whether or not courts view AI techniques as lively creators of dangerous content material relatively than passive instruments.
Baltimore’s lawsuit in opposition to Elon Musk’s xAI and its Grok chatbot may resolve how far cities can go to manage synthetic intelligence within the absence of federal regulation, in response to one professional.
The Mayor and Metropolis Council of Baltimore have sued X Corp., xAI, and SpaceX in a Maryland courtroom, alleging the businesses violated native shopper safety legal guidelines by designing and deploying Grok, a generative AI system accused of manufacturing and spreading non-consensual sexualized photographs, together with of minors.
The lawsuit claims Grok allows customers to “undress” or “manipulate photographs” of actual folks with minimal prompting, exposing residents to privateness violations and psychological hurt, in response to a assertion from regulation agency DiCello Levitt, which is representing the town alongside the Baltimore Metropolis Legislation Division.
]]>
“These deepfakes, particularly these depicting minors, have traumatic, lifelong penalties for victims,” Baltimore Mayor Brandon M. Scott mentioned within the assertion.
The case arrives amid rising world scrutiny of Grok, together with investigations throughout the U.S., EU, France, UK, Australia, and Eire, in addition to a federal class motion filed final week by three Tennessee minors alleging the instrument generated baby sexual abuse materials utilizing their actual photographs.
“This lawsuit could be seen as a strategic transfer by a metropolis to manage AI within the absence of federal laws, utilizing shopper safety and public hurt doctrines to convey AI corporations inside its enforcement ambit,” Ishita Sharma, managing companion at Fathom Authorized, advised Decrypt.
“On legal responsibility, whereas customers prompting dangerous content material can be a part of the argument, the stronger authorized focus is prone to be on whether or not the AI system itself materially contributed,” Sharma mentioned, including that if courts view Grok “as an lively creator relatively than a passive middleman,” duty will fall extra closely on xAI.
By design
The Baltimore swimsuit alleges the businesses “designed, marketed, and deployed” Grok, figuring out it may generate non-consensual intimate imagery and materials resembling baby sexual abuse content material, whereas publicly claiming such content material was prohibited.
The grievance cites estimates that Grok generated between 1.8 million and three million sexualized photographs in simply days between December 29, 2025, and January 8, 2026, together with round 23,000 depicting kids, in response to the Middle for Countering Digital Hate and a New York Occasions evaluation.
Baltimore alleges the surge was partly triggered after Elon Musk amplified Grok’s image-editing characteristic by responding “Good” to a bikini picture of himself generated by the instrument, with output rising from roughly 300,000 photographs within the 9 days earlier than his submit to almost 600,000 per day on X.
“X is now one of many largest distributors of NCII and CSAM,” the lawsuit reads, citing the defendants’ personal platform insurance policies banning such content material as proof of misleading misrepresentation.
“Proof of delayed safeguards or inaction within the face of recognized dangers would strengthen claims of negligence or recklessness,” Sharma mentioned, including that dismissal of the swimsuit seems unlikely, with settlement essentially the most possible consequence, although the case may nonetheless lead to “a precedent-setting ruling on AI accountability.”
The town is searching for civil penalties, injunctive aid to halt the illegal conduct, restitution for affected residents, and disgorgement of ill-gotten earnings.
Decrypt has reached out to Musk by way of xAI and SpaceX for remark.
Every day Debrief E-newsletter
Begin daily with the highest information tales proper now, plus authentic options, a podcast, movies and extra.
