xAI sues a man for using Grok to generate CSAM ‘deepfakes’

xAI sues a man for using Grok to generate CSAM ‘deepfakes’

xAI 起诉一名利用 Grok 生成儿童性虐待材料(CSAM)“深度伪造”内容的男子

Elon Musk’s xAI claims Terry Harwood bypassed Grok’s safeguards to generate CSAM. The company is asking for reputational and legal damages. 埃隆·马斯克旗下的 xAI 声称,特里·哈伍德(Terry Harwood)绕过了 Grok 的安全防护机制以生成儿童性虐待材料(CSAM)。该公司正寻求就名誉和法律损失进行索赔。

The Elon Musk-owned xAI is suing a South Carolina man who allegedly used the company’s Grok AI chatbot to generate child sexual abuse material (CSAM). In a lawsuit reported earlier by Reuters, xAI claims Terry Wayne Harwood “knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM,” breaching the company’s policies. 埃隆·马斯克旗下的 xAI 正在起诉一名南卡罗来纳州男子,该男子涉嫌利用公司的 Grok AI 聊天机器人生成儿童性虐待材料(CSAM)。据路透社早前报道,xAI 在诉讼中称,特里·韦恩·哈伍德(Terry Wayne Harwood)“明知且蓄意地利用 Grok 规避安全防护、篡改未经同意的图像,并生成和传播 CSAM”,违反了公司的相关政策。

Harwood was arrested in February for allegedly possessing and distributing CSAM and is facing eight felony charges. The lawsuit claims “at least some” of the images related to Harwood’s criminal charges “were generated or altered” with Grok, and that Harwood bypassed Grok’s safeguards and “abused the tool to convert non-sexual photographs into sexually explicit images” without the subjects’ consent. 哈伍德因涉嫌持有和传播 CSAM 于二月被捕,目前面临八项重罪指控。诉讼称,与哈伍德刑事指控相关的图像中“至少有一部分”是使用 Grok“生成或篡改的”,且哈伍德绕过了 Grok 的安全防护,“滥用该工具将非色情照片转换为露骨的性图像”,且未获得当事人的同意。

After rolling out a “spicy” mode for Grok last year, xAI added the ability to edit images with the chatbot, leading to a flood of sexualized AI deepfakes, including ones with minors. A group of teens sued xAI in March over claims Grok generated sexualized images of themselves as minors. Musk responded by saying, “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” though this appears to be the first time xAI has sued anyone over AI deepfakes created with Grok. 在去年为 Grok 推出“火辣(spicy)”模式后,xAI 增加了使用聊天机器人编辑图像的功能,导致大量色情 AI 深度伪造内容涌现,其中包括涉及未成年人的内容。今年三月,一群青少年起诉了 xAI,声称 Grok 生成了他们作为未成年人时的色情图像。马斯克对此回应称:“任何利用 Grok 制作非法内容的人,都将承担与上传非法内容相同的后果。”不过,这似乎是 xAI 首次因 Grok 生成的 AI 深度伪造内容而起诉他人。

xAI claims Harwood’s alleged actions exposed the company to “significant legal risk and reputational damage.” It has asked the court to order Harwood to pay xAI for any damages, as well as “reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant’s conduct.” xAI also wants the judge to block Harwood from creating an xAI account or using Grok. xAI 声称,哈伍德的涉嫌行为使公司面临“重大的法律风险和名誉损失”。该公司已请求法院责令哈伍德赔偿 xAI 的所有损失,以及“因被告行为受害者提起的任何法律诉讼中,公司为自我辩护而产生的合理费用”。xAI 还希望法官禁止哈伍德创建 xAI 账户或使用 Grok。