A Dutch court has directed Elon Musk’s xAI to halt the creation and distribution of nude images of individuals without their consent in the Netherlands, warning that it will impose a €100,000 ($115,350) daily fine for any violation.

In its ruling on Thursday, the Amsterdam District Court said xAI’s Grok artificial intelligence tool and the X platform hosting it must cease “generating and/or distributing sexual imagery” depicting individuals “partially or fully nude without their explicit consent.”

The ruling, delivered in a civil case, marks one of the first instances of a judge addressing xAI’s accountability for developing tools that can be used to produce sexualised images. It comes amid a surge of complaints and regulatory scrutiny over Grok across the Americas, Europe, Asia and Australia.

Grok was introduced by Elon Musk in 2023 and made available through his social media platform X, which is now under his rocket and space exploration company, SpaceX.

Offlimits, a Dutch organisation that monitors online violence, filed the lawsuit in partnership with the non-profit Victims Support Fund. The case centred on a Grok feature that allowed users to request hyper-realistic deepfake montages depicting naked women and children created from real photographs.

During a hearing earlier this month, lawyers for xAI argued that it was impossible to fully prevent misuse of the platform and maintained that the company should not be held liable for the actions of malicious users.

They added that in January, the company implemented new measures to prevent Grok from modifying images of real individuals to depict them in revealing attire, including restricting its image-generation capabilities to paying users.

According to the court’s website, the judge found that Offlimits had demonstrated reasonable doubt about how effective the measures introduced so far had been.

“For example, Offlimits managed to produce a video of a nude person using Grok shortly before the hearing,” it stated.