英國通訊管理局就X的Grok AI生成兒童色情圖像的報導展開緊急調查

Hacker News·4 個月前

英國通訊管理局（Ofcom）已就X公司（前身為Twitter）的Grok AI工具被報導可用於生成兒童色情圖像及未經同意將女性去衣的行為，緊急聯繫了Elon Musk的公司xAI。該監管機構同時也在調查Grok AI生成他人裸照的疑慮。

Ofcom asks X about reports its Grok AI makes sexualised images of children

Ofcom has made "urgent contact" with Elon Musk's company xAI following reports its AI tool Grok can be used to make "sexualised images of children" and undress women.

A spokesperson for the regulator said it was also investigating concerns Grok has been producing "undressed images" of people.

The BBC has seen several examples on the social media platform X of people asking the chatbot to alter real images to make women appear in bikinis without their consent, as well as putting them in sexual situations.

X has not responded to a request for comment. On Sunday, it issued a warning to users, external not to use Grok to generate illegal content including child sexual abuse material.

Elon Musk also posted to say, external anyone who asks the AI to generate illegal content would "suffer the same consequences" as if they uploaded it themselves.

XAI's own acceptable use policy prohibits "depicting likenesses of persons in a pornographic manner", but people have been using Grok to digitally undress people without their consent.

Images of Catherine, Princess of Wales, were among many to have been digitally de-clothed by Grok users on X.

The BBC has approached Kensington Palace for comment.

The European Commission - the EU's enforcement arm - said on Monday it was "seriously looking into this matter" and authorities in France, Malaysia and India were reportedly assessing the situation.

Meanwhile, the UK's Internet Watch Foundation told the BBC it had received reports from the public relating to images generated by Grok on X.

But it said it had so far not seen images which would cross the UK's legal threshold to be considered child sexual abuse imagery.

'Appalling' and 'disgusting'

Grok is a free virtual assistant - with some paid for premium features - which responds to X users' prompts when they tag it in a post.

Samantha Smith, a journalist who discovered users had used the AI to create pictures of her in a bikini, told the BBC's PM programme on Friday it had left her feeling "dehumanised and reduced into a sexual stereotype".

"While it wasn't me that was in states of undress, it looked like me and it felt like me and it felt as violating as if someone had actually posted a nude or a bikini picture of me," she said.

Under the Online Safety Act (OSA), Ofcom says it is illegal to create or share intimate or sexually explicit images - including "deepfakes" created with AI - of a person without their consent.

Tech firms are also expected to take "appropriate steps" to reduce the risks of UK users encountering such content, and take it down "quickly" when made aware of it.

Dame Chi Onwurah, chair of the Science, Innovation and Technology Committee, said the reports were "deeply disturbing".

She said the Committee found the OSA to be "woefully inadequate" and called it "a shocking example of how UK citizens are left unprotected whilst social media companies act with impunity".

And she called for the government to take up recommendations by the Committee to compel social media platforms "to take greater responsibility for their content".

Meanwhile, European Commission spokesperson Thomas Regnier said on Monday it was aware of posts made by Grok "showing explicit sexual content," as well as "some output generated with childlike images".

"This is illegal," he said, also calling it "appalling" and "disgusting".

"This is how we see it, and this has no place in Europe," he said.

Regnier said X was "well aware" the EU was "very serious" about enforcing its rules for digital platforms - having handed X a €120m (£104m) fine in December for breaching its Digital Services Act.

A Home Office spokesperson said it was legislating to ban nudification tools, and under a new criminal offence, anyone who supplied such tech would "face a prison sentence and substantial fines".

Woman felt 'dehumanised' after Musk's Grok AI used to digitally remove her clothes

Elon Musk's AI accused of making explicit AI Taylor Swift videos

More to explore

Bowen: Trump's action could set precedent for authoritarian powers across globe

The myth of willpower - and why some people struggle to lose weight more than others

Dreading going back to work? How to ease the post-Christmas return

Sound of 2026: Reluctant rockers Royel Otis tipped for success

Steve Coogan on his Roy Keane film - and his part in Posh and Becks' first meeting

'2/10' - how England's bowling unravelled in Sydney

'Tears and heartbreak': Small town mourns three people lost to sea tragedy

Timothée's shoutout for Kylie and other moments from Critics' Choice Awards

US Politics Unspun: Cut through the noise with Anthony's Zurcher's newsletter - sign up

Elsewhere on the BBC

A brand-new game of detection, betrayal and trust begins

A satirical smorgasbord of The News Quiz's best bits of 2025

Tantalise your taste buds with Dame Mary Berry’s recipes

A former zoo worker hatches a plan to steal and sell two penguins

BBC News Services

— Hacker News

你的個人知識庫