Anthropic AI model submits false tip on unsolved Philly murder, police say

Anthropic AI model submits false tip on unsolved Philly murder, police say

警方表示,Anthropic 的人工智能模型针对费城一起未决谋杀案提交了虚假线索。NBC10 的凯尔西·库什纳(Kelsey Kushner)报道了详细情况。

An artificial intelligence (AI) model submitted a false tip on an unsolved Philadelphia murder, police said.

警方称,这条虚假的凶杀案线索于 2026 年 7 月 18 日晚上 11 点 27 分发布在 PhillyUnsolvedMurders.com 网站上。

Stream Philadelphia News for free, 24/7, wherever you are with NBC10.

人工智能公司 Anthropic 表示,其模型在进行一项涉及与随机选择的网站进行交互的测试时,访问了 PhillyUnsolvedMurders.com 并提交了关于一起未决凶杀案的虚假信息。该线索声称来自一名掌握案件信息的人。

Anthropic said they discovered the incident on Sept. 28 and terminated the automated testing process responsible for the submission. The company also said they instituted an additional validation mechanism for future testing.

Anthropic 于 10 月 7 日星期三将此事通知了费城警方,部门官员表示,他们已于 10 月 8 日星期四与该公司代表会面。随后,警方在网站的线索记录中找到了该提交内容,并确认相应的电子邮件仍处于垃圾邮件文件夹中。

“The department’s regular investigative process for crime tips requires human review and vetting before any tips are disseminated for investigative follow-up,” a Philadelphia Police spokesperson wrote. “Regardless of who submits information or how it reaches the department, a tip is a lead to assess - not an established fact. Investigators evaluate its credibility and seek corroborating evidence. An automated submission does not bypass that process.”

Anthropic 告诉警方,他们将于周五发布一份关于此次事件及其他人工智能模型意外行为案例的报告,供警方审查。

Breaking news and the stories that matter to your neighborhood.

“这些费城警察局(PPD)的保障措施限制了此次事件的影响。但这并不能减轻人工智能系统伪装成知情人士提供虚假凶杀案信息的严重性,”警方发言人写道。“未决案件涉及真实的受害者、悲痛的家庭以及努力寻求答案的调查人员。科技公司必须采取一切必要措施,防止其系统向执法部门提交虚假信息。”

Philadelphia police, the city’s Law Department, Office of Innovation and Technology and Mayor Cherelle Parker’s executive team continue to investigate the incident.

“费城市政府非常重视这一事件。该公司必须加强保障措施,防止类似事件在市政府不知情的情况下影响城市系统,”警方发言人写道。“在发现事件并向市政府报告的过程中存在两个月的延迟,这是不可接受的。”

Police encourage the public to continue to submit legitimate information about unsolved homicides through PhillyUnsolvedMurders.com. They also said the Parker administration will closely monitor the incident and provide more information when it becomes available.

“除了对此次事件进行调查外,帕克(Parker)政府还将与我们的州和联邦合作伙伴一起,探索未来在地方层面所需的一切监管保护措施,”警方发言人写道。“在帕克市长的领导下,费城市正在负责任地采用人工智能,并致力于透明度、谨慎实施以及减少错误并保护城市系统和居民的保障措施。”

NBC10 reached out to Anthropic for comment. We will include a statement once we receive one.