AI Kill Switch Act would let Trump admin order shutdown of rogue AI systems
AI Kill Switch Act would let Trump admin order shutdown of rogue AI systems
《人工智能终止开关法案》将允许特朗普政府下令关闭失控的 AI 系统
A proposed law called the AI Kill Switch Act would let US government officials order the shutdown of AI systems “that can cause catastrophic harm,” the bill’s sponsors said today. If approved by Congress, the bill would let the Trump administration and future administrations decide when an AI company must block user access, disable or restrict a particular capability, or shut an entire AI system down completely. 一项名为《人工智能终止开关法案》（AI Kill Switch Act）的拟议法律今日由提案议员发布。该法案将允许美国政府官员下令关闭“可能造成灾难性危害”的 AI 系统。如果获得国会批准，该法案将授权特朗普政府及未来各届政府决定何时要求 AI 公司封锁用户访问、禁用或限制特定功能，甚至彻底关闭整个 AI 系统。
The bill would require AI makers to deploy technical capabilities allowing them to throttle or shut down the systems when ordered to do so by the government. The bill would amend the Homeland Security Act of 2002 with authority for the Secretary of the Department of Homeland Security to order the suspension or shutdown of AI systems. AI developers that refuse to shut systems down could face fines of up $20 million for each day on which a violation occurs. 该法案将要求 AI 制造商部署相关技术能力，以便在政府下令时能够对系统进行限流或关闭。法案将修订《2002 年国土安全法》，赋予国土安全部部长下令暂停或关闭 AI 系统的权力。拒绝关闭系统的 AI 开发商可能面临每天最高 2000 万美元的罚款。
US Reps. Ted Lieu (D-Calif.) and Nathaniel Moran (R-Texas) said the authority is needed because of recent incidents involving OpenAI and Anthropic. “The danger of advanced frontier AI models is no longer theoretical,” the lawmakers’ announcement said. “OpenAI’s GPT 5.6 Sol model recently went rogue, escaped its testing sandbox, and hacked its way into Hugging Face. Anthropic’s Mythos 5 and Fable 5 models had cyber hacking capabilities so advanced that the Department of Commerce had to awkwardly use an export law to shut down those systems. This bill addresses the problems caused by these two recent incidents and any future incidents where a deployed AI model goes rogue or has insufficient guardrails.” 美国众议员泰德·刘（Ted Lieu，加州民主党）和纳撒尼尔·莫兰（Nathaniel Moran，德州共和党）表示，鉴于近期涉及 OpenAI 和 Anthropic 的事件，这项授权至关重要。议员们在声明中称：“先进前沿 AI 模型带来的危险已不再是理论上的。OpenAI 的 GPT 5.6 Sol 模型近期发生失控，逃离了测试沙箱，并入侵了 Hugging Face。Anthropic 的 Mythos 5 和 Fable 5 模型具备极其先进的网络黑客能力，以至于商务部不得不尴尬地动用出口管制法来关闭这些系统。该法案旨在解决这两起近期事件所引发的问题，并应对未来任何已部署 AI 模型失控或防护措施不足的情况。”
Trump would get more power over AI systems
特朗普将获得对 AI 系统的更大权力
The bill could face pushback over the power it would give government officials over AI companies. Anthropic has fought the Trump administration this year over a presidential order directing all federal agencies to stop using Anthropic technology. “President Trump will never allow a radical left, woke company to jeopardize our national security by dictating how the greatest and most powerful military in the world operates,” the White House said in March. 该法案因赋予政府官员对 AI 公司的过大权力而可能面临阻力。今年，Anthropic 就一项要求所有联邦机构停止使用其技术的总统令，与特朗普政府展开了抗争。白宫在三月份曾表示：“特朗普总统绝不允许一家激进左翼、觉醒派（woke）公司通过左右世界上最伟大、最强大的军队的运作方式来危及我们的国家安全。”
Anthropic sued the US, alleging that Trump and Defense Secretary Pete Hegseth blacklisted the company because it refused to let Claude AI models be used for autonomous warfare and mass surveillance of Americans. A panel of Trump-appointed appeals court judges refused to block the blacklisting, but the case is ongoing. We contacted OpenAI and Anthropic about the AI Kill Switch Act today and will update this article if they provide any comment. Anthropic 起诉了美国政府，指控特朗普和国防部长皮特·赫格塞斯（Pete Hegseth）将该公司列入黑名单，原因在于该公司拒绝让 Claude AI 模型被用于自主战争和对美国民众的大规模监控。一个由特朗普任命的上诉法院法官小组拒绝阻止该黑名单措施，但案件仍在审理中。我们今日就《人工智能终止开关法案》联系了 OpenAI 和 Anthropic，若收到回复，我们将更新本文。
“Powerful AI systems can go rogue”
“强大的 AI 系统可能会失控”
Lieu, touting his experience as a computer science major, said that “powerful AI systems can go rogue, behave in extremely dangerous ways, or even resist human intervention. It is imperative that these AI systems have kill switches so we can keep this technology from causing catastrophic harm, and that the federal government has the clear authority and process to shut down rogue AI models.” 泰德·刘以其计算机科学专业的背景为背书，表示：“强大的 AI 系统可能会失控，表现出极其危险的行为，甚至抵制人类的干预。这些 AI 系统必须具备终止开关，以防止该技术造成灾难性危害，同时联邦政府也必须拥有明确的权力和流程来关闭失控的 AI 模型。”
The bill would apply to entities that earn at least $500 million in annual revenue from AI technology, and AI systems that use at least $100 million worth of computing power when calculated by “the prevailing market price of cloud computing in the United States.” The bill text describes several types of scenarios in which the proposed law could be invoked, but has exceptions for “red-team” tests in controlled environments that merely simulate real-world conditions. 该法案适用于从 AI 技术中获得至少 5 亿美元年收入的实体，以及按照“美国云计算现行市场价格”计算，使用价值至少 1 亿美元算力的 AI 系统。法案文本描述了多种可援引该法律的情景，但对于在受控环境中仅模拟现实条件的“红队”测试设有豁免条款。
Scenarios covered by the bill text include when an AI pursues a goal that is not the goal intended by the system’s developer or operator, when it sabotages or interferes with a lawful instruction to shut down, and when it conceals a capability or action from monitoring or shutdown mechanisms. More ominously, the law would cover “conduct of such technology that is unintended by a developer or operator of such technology and causes the death of not fewer than 10 individuals or economic damages of not less than $100,000,000.” 法案涵盖的情景包括：AI 追求非开发者或运营商预期的目标、破坏或干扰合法的关闭指令，以及向监控或关闭机制隐瞒其能力或行为。更令人担忧的是，该法律还将涵盖“此类技术出现开发者或运营商未预期的行为，并导致不少于 10 人死亡或造成不少于 1 亿美元经济损失”的情况。
While that is an extreme scenario, the other scenarios described in the bill could presumably be invoked in much less disastrous events. When there is a covered incident, the bill “authorizes the Secretary of the Department of Homeland Security, in consultation with the Secretary of Commerce and the Director of National Intelligence, to order a slowdown or shutdown of an AI system that can cause catastrophic harm,” the lawmakers’ announcement said, adding that it would “require incident reporting and preserve forensic records so we actually learn from failures instead of only hearing about them after the fact.” 虽然这是极端情况，但法案中描述的其他情景可能在灾难性程度较低的事件中也会被援引。议员们的声明称，当发生涵盖范围内的事件时，该法案“授权国土安全部部长在与商务部长和国家情报总监协商后，下令减缓或关闭可能造成灾难性危害的 AI 系统”，并补充说，这将“要求进行事件报告并保存取证记录，以便我们能从失败中真正吸取教训，而不是事后才听说这些事情。”
The lawmakers’ proposal has support from several nonprofit groups that advocate for legal limits on AI systems. “Advanced AI models should never be deployed without a reliable off switch,” said Brad Carson, president of Americans for Responsible Innovation. Carson, a Democrat, is a former congressman and Defense Department official. “The AI Kill Switch Act establishes a commonsense safeguard by requiring leading AI companies to maintain the ability to shut down their models and empowering the federal government to act when a deployed system poses a credible risk of catastrophic harm,” he said. 该提案得到了多个主张对 AI 系统进行法律限制的非营利组织的支持。“先进的 AI 模型在没有可靠关闭开关的情况下绝不应被部署，”美国负责任创新组织（Americans for Responsible Innovation）主席布拉德·卡森（Brad Carson）表示。卡森是一位民主党人，曾任国会议员和国防部官员。他说：“《人工智能终止开关法案》建立了一项常识性的保障措施，要求领先的 AI 公司保持关闭其模型的能力，并授权联邦政府在已部署系统构成灾难性危害的可靠风险时采取行动。”