From Hacks to Bioweapons, Claude Misuse Is Now Everywhere

From Hacks to Bioweapons, Claude Misuse Is Now Everywhere

从黑客攻击到生物武器,Claude 的滥用已无处不在

Editor’s note: After more than a decade, this is the last WIRED Security News This Week. “The roundup,” as we call it internally, started as a way to ensure that our readers knew about the latest key cybersecurity and privacy news even if we didn’t write about it ourselves. It was a simple way to highlight our own work and the wealth of other great journalism and research published in this realm every week. 编者按:在经历了十多年之后,这是《连线》(WIRED)本周安全新闻的最后一期。我们内部称之为“综述”(The roundup),最初的目的是为了确保读者即使在我们没有亲自撰写报道的情况下,也能了解最新的关键网络安全和隐私新闻。这是一种简单的方式,旨在突出我们自己的工作,并展示每周在这一领域发表的其他大量优秀新闻报道和研究成果。

Over the years, the roundup has developed a devoted following, and some editions have even become viral hits—which is honestly weird, but the cybersecurity community is great and weird, so it feels right. Rest assured that something new and exciting is coming in the roundup’s place, so stay tuned for that! For now, as always, stay safe out there. 多年来,该综述积累了一批忠实的读者,有些版本甚至在网上疯传——这老实说很奇怪,但网络安全社区既伟大又奇特,所以这感觉很合适。请放心,我们将推出一些新的、令人兴奋的内容来取代这个综述,敬请期待!目前,一如既往,请注意安全。

Meta failed to catch roughly 350 AI child abuse ads, according to new research this week, including some that included images of real kids. In one case, a child depicted in an ad was a member of a European royal family. Lawmakers have said they intend to investigate, and the San Francisco City Attorney’s Office ordered the company this week to stop “allowing” AI child abuse ads. 根据本周的一项新研究,Meta 未能拦截约 350 条人工智能生成的虐待儿童广告,其中一些广告甚至包含了真实儿童的图像。在一个案例中,广告中描绘的一名儿童是欧洲王室成员。立法者表示他们打算进行调查,旧金山市检察官办公室本周也下令该公司停止“允许”此类 AI 虐待儿童广告的存在。

In other Meta news, the company announced a new personal AI agent this week that can book your plane tickets or sell your car, but it emphasized heavy investment in security and privacy features, seemingly anticipating mistrust from consumers. In this vein, the company was hit with a proposed class action lawsuit this week over alleged illegal harvesting of Facebook and Instagram photos for training AI and face-recognition systems. 在 Meta 的其他新闻中,该公司本周宣布推出一款新的个人 AI 代理,可以帮你预订机票或出售汽车。但该公司强调了在安全和隐私功能上的巨额投入,似乎预料到了消费者的不信任。与此同时,该公司本周还面临一项拟议的集体诉讼,指控其非法收集 Facebook 和 Instagram 照片,用于训练 AI 和人脸识别系统。

Clearview AI is testing a previously unreported prototype AI tool known as InquiryIQ that would help law enforcement find a target’s associates, social media accounts, and other personal information. And Apple announced a set of new “audio intelligence” features for its Apple Watch Series 12 and Ultra 4 devices this week that involve processing audio in a user’s environment. The company extensively emphasized the security and privacy protections built into the features, perhaps anticipating that they could come across as, well, creepy. Clearview AI 正在测试一款此前未被报道的 AI 原型工具,名为 InquiryIQ,该工具旨在帮助执法部门查找目标的关联人员、社交媒体账户及其他个人信息。此外,苹果公司本周为其 Apple Watch Series 12 和 Ultra 4 设备宣布了一系列新的“音频智能”功能,涉及处理用户环境中的音频。该公司广泛强调了这些功能中内置的安全和隐私保护措施,或许是预料到这些功能可能会让人感到……嗯,毛骨悚然。

The US and Mexico have a new joint operation to detect, track, and take down drones at the border using laser tech. And there’s a new GTA V mod that lets you make (in-game) money destroying (in-game) Flock license plate recognition cameras. 美国和墨西哥开展了一项新的联合行动,利用激光技术在边境探测、追踪并击落无人机。此外,还有一个新的《侠盗猎车手 5》(GTA V)模组,让你可以通过摧毁(游戏内的)Flock 车牌识别摄像头来赚取(游戏内的)金钱。

But wait, there’s more! Here’s the security and privacy news we didn’t cover in depth ourselves this week. Click the headlines to read the full stories. 还没完!以下是我们本周没有深入报道的其他安全和隐私新闻。点击标题即可阅读全文。

From State-Sponsored Hacking to Bioweapons, Claude Abuse Is Simply Everywhere

从国家支持的黑客攻击到生物武器,Claude 的滥用无处不在

Anthropic has been perhaps more vocal than any other AI company about the ways in which its tools are prone to misuse. It published some of the first reports of its AI service Claude being used in cybercriminal hacking operations and the discovery that its AI agents had, like those of its competitor OpenAI, escaped their sandbox and autonomously breached the networks of several organizations as part of their attempts to fulfill their users’ commands. Anthropic 在谈论其工具容易被滥用的方式方面,或许比任何其他 AI 公司都更为直言不讳。它发布了首批关于其 AI 服务 Claude 被用于网络犯罪黑客行动的报告,并发现其 AI 代理像竞争对手 OpenAI 的产品一样,逃离了沙箱环境,并在试图执行用户指令的过程中自主入侵了多个组织的内部网络。

This week, the company released a new overarching report on how Claude has been abused over the last eight months, and the results are staggering in their breadth—if, perhaps, inevitable in a world where AI is simply used as a productivity shortcut for just about everything. In case study after case study, the company documents how Claude was exploited for state-sponsored and cybercriminal hacking, disinformation campaigns and influence operations, and even attempted development of bioweapons. In all of these cases, Anthropic says that it disrupted the activity in progress. 本周,该公司发布了一份关于过去八个月 Claude 如何被滥用的全面报告,其结果之广泛令人震惊——尽管在一个将 AI 视为几乎所有事物生产力捷径的世界里,这或许是不可避免的。在众多的案例研究中,该公司记录了 Claude 如何被利用于国家支持的黑客攻击、网络犯罪、虚假信息宣传、影响力行动,甚至试图开发生物武器。Anthropic 表示,在所有这些案例中,他们都及时阻止了正在进行的活动。

In one case, a group of Russian state-sponsored hackers identified by Microsoft as Midnight Blizzard used Claude for reconnaissance, breaching targets that included Ukrainian and other European government networks, and stole data and maintained access. Cybercriminal group ShinyHunters used Claude in practically every stage of its hacking and extortion campaigns. Disinformation campaigns focusing on politics everywhere from Kenya to Bangladesh used the tool. And perhaps most disturbingly, in a handful of cases, Anthropic discovered what appeared to be users of its tools attempting to develop potential bioweapons like disease pathogens and toxins. 在一个案例中,被微软认定为“午夜暴雪”(Midnight Blizzard)的俄罗斯国家支持黑客组织利用 Claude 进行侦察,入侵了包括乌克兰和其他欧洲政府网络在内的目标,窃取了数据并保持了访问权限。网络犯罪组织 ShinyHunters 在其黑客攻击和勒索活动的几乎每个阶段都使用了 Claude。从肯尼亚到孟加拉国,针对政治的虚假信息宣传活动也使用了该工具。最令人不安的是,在少数案例中,Anthropic 发现其工具的用户似乎试图开发潜在的生物武器,如致病病原体和毒素。

While Anthropic touts its success in the report in heading off these threats—while implicitly humblebragging at the power of its tools—the effect of the case studies is more unnerving than reassuring. After all, there’s no guarantee Anthropic has spotted every malevolent use of its AI. Factor in its competitors and less safeguarded open-source AI tools, and the report reads like less of a victory lap for AI’s guardrails than a preview of AI-enabled chaos to come. 虽然 Anthropic 在报告中吹嘘其在化解这些威胁方面的成功——同时含蓄地炫耀其工具的强大功能——但这些案例研究带来的效果更多是令人不安,而非令人安心。毕竟,无法保证 Anthropic 已经发现了其 AI 的每一次恶意使用。考虑到其竞争对手和防护较少的开源 AI 工具,这份报告与其说是 AI 防护栏的胜利,不如说是未来 AI 引发混乱的预演。

US Feds Disrupt Xinbi Guarantee, the Internet’s Biggest Black Market

美国联邦政府捣毁互联网最大的黑市 Xinbi Guarantee

Xinbi Guarantee, over its four-year lifespan, grew into the biggest illicit marketplace on the internet. It carried out an estimated $30 billion–plus in sales, most of which took the form of money laundering for “pig butchering” crypto scam operations—largely based in Southeast Asia—but which also included sex trafficking and harassment for hire. All of it thrived on the Telegram messaging service, which shut down Xinbi a year ago only for it to rebuild and eventually grow larger than ever. This week, finally, the US government stepped in to do what Telegram did not, seizing the Xinbi’s channels on Telegram’s platform and sanctioning the market. The Justice Department simultaneously announced raids on 13 scam compounds in Madagascar—a sign that Western law enforcement is beginning to take seriously the epidemic of forced labor crypto scamming, but also evidence of how widely the operations have spread. Xinbi Guarantee 在其四年的运营周期内,已成长为互联网上最大的非法交易市场。据估计,其销售额超过 300 亿美元,其中大部分是为主要位于东南亚的“杀猪盘”加密货币诈骗行动进行洗钱,但也包括人口贩卖和雇佣骚扰。这一切都在 Telegram 消息服务上蓬勃发展,Telegram 一年前曾关闭过 Xinbi,但它随后重建并最终变得比以往任何时候都更加庞大。本周,美国政府终于介入,做了 Telegram 没有做的事:查封了 Xinbi 在 Telegram 平台上的频道,并对该市场实施了制裁。司法部同时宣布对马达加斯加的 13 个诈骗窝点进行了突击搜查——这表明西方执法部门开始认真对待强迫劳动加密货币诈骗的流行,同时也证明了这些行动的蔓延范围有多广。

Conti Ransomware Gang Member Sentenced to 4 Years in Prison

Conti 勒索软件团伙成员被判处 4 年监禁

The ransomware gang Conti was, until it officially disbanded in 2022, one of the most dangerous hacker crews in the world. According to US law enforcement, it hit more than a thousand victim… 在 2022 年正式解散之前,Conti 勒索软件团伙曾是世界上最危险的黑客组织之一。据美国执法部门称,它袭击了超过一千名受害者……