Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery
Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery
Meta 投放的广告中包含 AI 生成的儿童性虐待图像
Editor’s note: This article contains descriptions of imagery depicting child sexual abuse. Reader discretion is strongly advised. 编者注:本文包含对描绘儿童性虐待图像的描述。强烈建议读者谨慎阅读。
Over the last nine months, Mark Zuckerberg’s Meta has run dozens of paid ads that include explicit AI-generated child sexual abuse material (CSAM) and images of minors alongside sexually suggestive statements, according to details of the ads shared with WIRED. The ads, which in some cases reached several thousand accounts, were targeted at people living in the United States, United Kingdom, and more than a dozen European countries. 根据与《连线》(WIRED)分享的广告详情,在过去九个月里,马克·扎克伯格旗下的 Meta 公司投放了数十条付费广告,其中包含露骨的 AI 生成儿童性虐待材料(CSAM),以及未成年人图像和带有性暗示的声明。这些广告在某些情况下触达了数千个账户,目标受众涵盖美国、英国以及十多个欧洲国家的居民。
More than 50 image and video ads containing abusive content were recently discovered in Meta’s ad library by researchers at the Tech Transparency Project (TTP), with the listings showing that some ads linked out to so-called nudify or undressing apps. Meta’s ad library—a transparency tool that catalogues ads displayed on the company’s platforms—shows the ads running across Facebook, Instagram, Messenger, and/or Threads. The findings are the second time in recent weeks that paid ads linked to child sexual abuse material have been found on Meta’s platforms. “科技透明项目”(TTP)的研究人员最近在 Meta 的广告资料库中发现了 50 多条包含虐待内容的图片和视频广告,列表显示其中一些广告链接到了所谓的“一键脱衣”(nudify)应用程序。Meta 的广告资料库是一个用于编目公司平台所展示广告的透明度工具,显示这些广告在 Facebook、Instagram、Messenger 和/或 Threads 上运行。这是近几周内第二次在 Meta 平台上发现与儿童性虐待材料相关的付费广告。
“These ads made no effort to mask the images or hide what they were promoting,” Katie Paul, the director of the TTP, an independent watchdog group, tells WIRED. “It’s important to point out that this isn’t content posted by third parties on Facebook or Instagram, these are ads that were reviewed, approved, and allowed to run by Meta, never encountering interference while the company collected the ad dollars.” 独立监督组织 TTP 的主任凯蒂·保罗(Katie Paul)告诉《连线》:“这些广告根本没有试图掩盖图像或隐藏其推广的内容。必须指出的是,这并非第三方在 Facebook 或 Instagram 上发布的内容,而是经过 Meta 审核、批准并允许投放的广告。在公司收取广告费的同时,这些广告从未受到任何干预。”
The ads discovered by the researchers—which have now been removed by Meta for violating its policies on child sexual abuse and exploitation material, and adult sexual solicitation and nudity—were all published between November last year and the start of August. The ads, according to data in Meta’s ad transparency library, often ran over a period of several days and some only targeted men. 研究人员发现的这些广告均发布于去年 11 月至今年 8 月初之间,目前已被 Meta 以违反其关于儿童性虐待和剥削材料以及成人性招揽和裸露的政策为由删除。根据 Meta 广告透明度资料库的数据,这些广告通常持续投放数天,且部分广告仅针对男性用户。
One video ad, the TTP researchers say, used a thumbnail image of a child sitting on the floor with text appearing on top of it saying: “Realizing Deep Fantasies with Generation AI [sic]. There is so much more than what is shown, use your imagination.” The researchers say that when the ad was clicked, it played video clips of adults involved in sexual acts and then added the child’s face from the thumbnail to a sex act. TTP 研究人员称,其中一条视频广告使用了一张儿童坐在地板上的缩略图,上方文字写着:“用生成式 AI 实现深层幻想。这里展示的远不止这些,发挥你的想象力吧。”研究人员表示,当点击该广告时,它会播放成年人进行性行为的视频片段,随后将缩略图中的儿童面部合成到性行为画面中。
Another ad the researchers say had been repeatedly posted showed an image of a young girl laying back with her legs spread in a sexual position with text above it saying: “I can show you more.” 研究人员称,另一条被反复发布的广告展示了一名年轻女孩仰卧、双腿张开的性暗示姿势,上方文字写着:“我可以给你看更多。”
Most of the ads were not actively being shown to users when researchers found them, but they continued to be available, apparently undetected, in Meta’s ad library for months. Although many of the ads, according to Meta’s data, only “reached” a handful of accounts, at least one reached 2,563 accounts in Europe—including in France, Germany, Ireland, Italy, the Netherlands, Spain, Sweden, and the United Kingdom. Meta’s ad library database does not include details about ad performance in the US or all countries, so the overall reach may be higher. 当研究人员发现这些广告时,大多数广告并未主动向用户展示,但它们显然未被察觉,在 Meta 的广告资料库中存在了数月之久。尽管根据 Meta 的数据,许多广告仅“触达”了少数账户,但至少有一条广告在欧洲触达了 2,563 个账户,涉及法国、德国、爱尔兰、意大利、荷兰、西班牙、瑞典和英国。Meta 的广告资料库数据库并未包含美国或其他所有国家的广告表现详情,因此其总体触达范围可能更高。
Paul says TTP first discovered the ads last week as its researchers continued to investigate nudify app ads on Meta, after publishing a report about a Chinese advertising partner posting them. Paul says the organization immediately reported the findings to National Center for Missing and Exploited Children’s CyberTipline, which allows people to report online child sexual abuse material. A NCMEC spokesperson says it does not comment on reports it receives. 保罗表示,TTP 在发布了一份关于某中国广告合作伙伴发布此类广告的报告后,研究人员继续调查 Meta 上的“一键脱衣”应用广告,并于上周首次发现了这些广告。保罗称,该组织立即向美国国家失踪与受虐儿童中心(NCMEC)的 CyberTipline 举报了这些发现,该平台允许人们举报在线儿童性虐待材料。NCMEC 发言人表示,不对其收到的举报发表评论。
After WIRED reached out to Meta, the company removed the ads from its advertising library. “Sexual exploitation is horrific, and we work aggressively to keep it off our platform,” a Meta spokesperson says. “The majority of these ads had minimal reach and many were disabled before WIRED shared them. Many of these ads also predate new AI technology we launched recently to better detect and block violating ads at upload—and we’re constantly improving these systems. From removing over 36 million pieces of child sexual exploitation content last year to taking legal action against nudify app developers, we will continue to relentlessly fight this abuse.” 在《连线》联系 Meta 后,该公司从其广告资料库中删除了这些广告。Meta 发言人表示:“性剥削是可怕的,我们正积极努力将其从我们的平台上清除。这些广告中的大多数触达范围极小,且许多在《连线》分享之前就已经被禁用。其中许多广告发布于我们近期推出的新 AI 技术之前,该技术旨在更好地在上传时检测并拦截违规广告——我们正在不断改进这些系统。从去年删除超过 3,600 万条儿童性剥削内容,到对‘一键脱衣’应用开发者采取法律行动,我们将继续不懈地打击这种虐待行为。”
As the company implies, some of the offending ads got past Meta’s new AI technology. Initially, the TTP researchers found around two dozen ads displaying the abusive content. However, hours ahead of publication, the researchers discovered around 30 more. Many of these ads had been published after WIRED first asked Meta about the content, with multiple ads being live and shown to accounts at the time researchers discovered them. 正如该公司所暗示的那样,一些违规广告绕过了 Meta 的新 AI 技术。最初,TTP 研究人员发现了约两打显示虐待内容的广告。然而,在文章发布前几小时,研究人员又发现了约 30 条。其中许多广告是在《连线》首次向 Meta 询问相关内容后发布的,且在研究人员发现时,多条广告仍处于在线状态并向账户展示。
Paul says the tranche included some of the worst instances the researchers had seen. One of the video ads, the researchers say, showed a thumbnail of a girl appearing to put on lip gloss, and when it started playing, the video morphed into the child performing a sex act. 保罗表示,这批广告中包含研究人员所见过的最恶劣的案例。研究人员称,其中一条视频广告的缩略图显示一个女孩似乎在涂唇彩,而当视频开始播放时,画面随即转变为该儿童进行性行为的影像。
Meta’s policies say that all ads are reviewed before they are published, with the system “primarily” using “automated tools” to check them against its policies. The company’s advertising standards stipulate that child sexual and exploitation materials are not permitted, and say that when the company becomes aware of it, it makes reports to NCMEC. Beyond this, Meta’s advertising policies say that ads are not allowed to include any “imagery depicting nudity, sexual activity, depictions of people in explicit or sexually suggestive positions, or activities that are sexually suggestive.” Meta 的政策规定,所有广告在发布前都会经过审核,系统“主要”使用“自动化工具”对照其政策进行检查。该公司的广告标准规定,不允许出现儿童性虐待和剥削材料,并表示一旦公司知晓此类内容,会向 NCMEC 报告。此外,Meta 的广告政策还规定,广告不得包含任何“描绘裸露、性活动、处于露骨或性暗示姿势的人员,或具有性暗示的活动”的图像。
Meta’s ad library now shows that the ads found by the TTP researchers were removed for violating the company’s policies, displaying messages saying they violated rules on “child sexual exploitation, abuse and nudity” and “adult nudity and sexual activity.” Meta 的广告资料库现在显示,TTP 研究人员发现的广告因违反公司政策已被删除,并显示了它们违反了关于“儿童性剥削、虐待和裸露”以及“成人裸露和性活动”规则的提示信息。
In early July, a BBC investigation found that Instagram had been running ads that promoted the sale of what appeared to be child sexual abuse material in India. According to the reporting, the ads used terminology s 7 月初,英国广播公司(BBC)的一项调查发现,Instagram 在印度投放了推广疑似儿童性虐待材料销售的广告。据报道,这些广告使用了相关术语……