法國與馬來西亞當局調查 Grok 生成色情深度偽造內容

Topics

Latest

AI

Amazon

Apps

Biotech & Health

Climate

Cloud Computing

Commerce

Crypto

Enterprise

EVs

Fintech

Fundraising

Gadgets

Gaming

Google

Government & Policy

Hardware

Instagram

Layoffs

Media & Entertainment

Meta

Microsoft

Privacy

Robotics

Security

Social

Space

Startups

TikTok

Transportation

Venture

More from TechCrunch

Staff

Events

Startup Battlefield

StrictlyVC

Newsletters

Podcasts

Videos

Partner Content

TechCrunch Brand Studio

Crunchboard

Contact Us

French and Malaysian authorities are investigating Grok for generating sexualized deepfakes

Over the past few days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured on his social media platform X, posted an apology to its account earlier this week, writing, “I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt.”

The statement continued, “This violated ethical standards and potentially US laws on [child sexual abuse material]. It was a failure in safeguards, and I’m sorry for any harm caused. xAI is reviewing to prevent future issues.”

It’s not clear who is actually apologizing or accepting responsibility in the statement above. Defector’s Albert Burnko noted that Grok is “not in any real sense anything like an ‘I’,” which in his view makes the apology “utterly without substance” as “Grok cannot be held accountable in any meaningful way for having turned Twitter into an on-demand CSAM factory.”

Futurism found that in addition to generating nonconsensual pornographic images, Grok has also been used to generate images of women being assaulted and sexually abused.

“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk posted on Saturday.

Some governments have taken notice, with India’s IT ministry issuing an order on Friday saying that X must take action to restrict Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.” The order said that X must respond within 72 hours or risk losing the “safe harbor” protections that shield it from legal liability for user-generated content.

French authorities also said they are taking action, with the Paris prosecutor’s office telling Politico that it will investigate the proliferation of sexually explicit deepfakes on X. The French digital affairs office said three government ministers have reported “manifestly illegal content” to the prosecutor’s office and to a government online surveillance platform “to obtain its immediate removal.”

The Malaysian Communications and Multimedia Commission also posted a statement saying that it has “taken note with serious concern of public complaints about the misuse of artificial intelligence (AI) tools on the X platform, specifically the digital manipulation of images of women and minors to produce indecent, grossly offensive, and otherwise harmful content.”

The commission added that it is “presently investigating the online harms in X.”

Topics

Anthony Ha is TechCrunch’s weekend editor. Previously, he worked as a tech reporter at Adweek, a senior editor at VentureBeat, a local government reporter at the Hollister Free Lance, and vice president of content at a VC firm. He lives in New York City.

You can contact or verify outreach from Anthony by emailing [email protected].

Plan ahead for the 2026 StrictlyVC events. Hear straight-from-the-source candid insights in on-stage fireside sessions and meet the builders and backers shaping the industry. Join the waitlist to get first access to the lowest-priced tickets and important updates.