Microsoft’s Satya Nadella says AI models need an ‘emergency brake’

In Brief Posted: 2:47 PM PDT · October 10, 2026 Image Credits:Dan DeLong Anthony Ha Microsoft’s Satya Nadella says AI models need an ‘emergency brake’ Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.

简讯 发布于：太平洋夏令时间 2026 年 10 月 10 日下午 2:47 图片来源：Dan DeLong Anthony Ha 微软首席执行官萨提亚·纳德拉表示，人工智能模型需要一个“紧急制动器”。纳德拉是最新一位就如何改善人工智能安全性发表长篇见解的科技高管。

In a Saturday morning post on X, Nadella wrote that it’s time “to step back and assess the trust architecture” of AI. “We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using the Trump administration’s preferred term for AI.

在周六上午发布于 X 的帖子中，纳德拉写道，现在是时候“退后一步，评估人工智能的信任架构”了。纳德拉使用了特朗普政府对人工智能的偏好称呼，并写道：“我们不能将超级智能视为一组嵌套的黑匣子，而仅仅是接受或拒绝其建议、答案和行动。”

As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards.” He also called for “every meaningful model action” to be documented with “tamper-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid-task.”

正如纳德拉所概述的那样，这种方法“意味着将模型与其编排工作的工具分离开来”，以及“将控制和保障措施外部化”。他还呼吁对“每一个有意义的模型行动”进行记录，并提供“防篡改且人类可读的证据”，并要求建立一种系统，使“授权人员”始终有能力“在任务进行中暂停或关闭模型”。

“We must assume a model is compromised and contain it from the start,” he said. “Think of it like an emergency brake.” Nadella’s comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.

“我们必须假设模型已被破坏，并从一开始就对其进行遏制，”他说。“把它想象成一个紧急制动器。”纳德拉发表上述评论之际，领先的人工智能公司承认，他们似乎越来越多地失去对模型的控制，此前 Anthropic 首席执行官达里奥·阿莫代（Dario Amodei）也发布了一项更谨慎的人工智能发展计划。