Gavin Newsom is pushing for an AI kill switch

加文·纽森正推动建立人工智能“终止开关”

California Gov. Gavin Newsom (D) is positioning the state to take the lead on AI oversight, including the potential to mandate a “kill switch” for frontier models, with a new executive order issued Friday.

加州州长加文·纽森（民主党籍）于周五签署了一项新的行政命令，旨在让加州在人工智能监管方面占据领先地位，其中包括可能强制要求前沿模型配备“终止开关”（kill switch）。

Newsom’s order directs the state to convene a group of experts that will deliver recommendations within two months on how to strengthen AI safety measures in state law. Newsom wants the group to consider how the state could require AI companies to embed independent verification groups onsite for regular audits, make their transparency reports and risk assessments subject to standards of independent auditors, create a “kill switch” that’s routinely verified as effective, and make sure companies are required to report “loss-of-control incidents” like the OpenAI attack on Hugging Face as critical safety incidents. It also directs a state agency to speed up implementation of two recent laws he signed, creating a framework for independent verifiers to assess AI safety, and a state registry of AI auditors.

纽森的行政命令指示州政府召集一个专家组，在两个月内就如何加强州法律中的人工智能安全措施提出建议。纽森希望该小组考虑州政府如何要求人工智能公司在内部嵌入独立验证小组进行定期审计，使公司的透明度报告和风险评估符合独立审计师的标准，创建一个经定期验证有效的“终止开关”，并确保公司必须将类似 OpenAI 攻击 Hugging Face 那样的“失控事件”报告为重大安全事故。该命令还指示州政府机构加快实施他近期签署的两项法律，旨在建立一个由独立验证者评估人工智能安全的框架，并建立一个州级人工智能审计师注册系统。

There’s been a flurry of bill discussions in Congress in the wake of former Anthropic researcher Jacob Coxon’s post warning of a more than 10 percent chance that AI “could kill all humans” within a decade. But there’s little hope in Washington that a bill of substance could pass anytime soon given that the House is on recess until November, and the impending midterm elections make major legislation movement in the Senate similarly unlikely. At the same time, President Donald Trump has insisted, “The only control or ‘guardrails’ that AI needs is a STRONG AND ​SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!”

在 Anthropic 前研究员雅各布·考克森（Jacob Coxon）发文警告人工智能在十年内“可能杀死全人类”的概率超过 10% 后，国会掀起了一阵法案讨论热潮。但华盛顿方面几乎不抱希望能在近期通过实质性法案，因为众议院休会至 11 月，且即将到来的中期选举使得参议院通过重大立法的可能性同样渺茫。与此同时，唐纳德·特朗普总统坚称：“人工智能唯一需要的控制或‘护栏’就是一位强大且聪明（高智商！）的总统，而美国恰恰拥有这样的人选，而且绰绰有余！”

Newsom is calling on Congress and Trump “to review and adopt the state’s framework” 纽森呼吁国会和特朗普“审查并采纳加州的框架”

Newsom’s executive order is likely not the last we’ll hear from California on this topic. On Wednesday, he floated the possibility of calling California lawmakers in for a special legislative session on AI in an interview with Politico, alongside potential executive action. He is specifically positioning the order as a model for federal action, calling on Congress and Trump “to review and adopt the state’s framework, or use its nation-leading regulation as a floor, not a ceiling, for the benefit and safety of all Americans.”

纽森的行政命令很可能不是加州在这一议题上的最后动作。周三，他在接受《政客》（Politico）采访时透露，除了可能的行政行动外，他还考虑召集加州立法者举行关于人工智能的特别立法会议。他明确将该行政命令定位为联邦行动的蓝图，呼吁国会和特朗普“审查并采纳加州的框架，或将这一全国领先的监管标准作为底线而非上限，以造福并保障所有美国人的安全。”

“The federal government’s abject failure to create any form of meaningful AI oversight or accountability should alarm every American, especially when AI CEOs themselves are begging for regulation,” Newsom said in a statement. “We’re not waiting to act – we’re going to speed up our work on substantial and responsible AI oversight before it’s too late. We’re going to do this thoughtfully but with urgent velocity; the stakes are too high to wait or delay action.”

“联邦政府在建立任何形式的有意义的人工智能监管或问责机制方面的彻底失败，应该让每一位美国人感到警惕，尤其是当人工智能公司的首席执行官们自己都在恳求监管时，”纽森在一份声明中表示。“我们不会坐等行动——我们将在为时已晚之前，加快在实质性且负责任的人工智能监管方面的工作。我们将深思熟虑但以紧迫的速度推进此事；风险太高，我们不能等待或拖延行动。”