Satya Nadella says we should assume all AI models are ‘compromised’

萨提亚·纳德拉称我们应假设所有人工智能模型都已“被入侵”

Microsoft’s CEO calls for putting an ‘emergency brake’ on AI. 微软首席执行官呼吁为人工智能安装“紧急制动器”。

In a lengthy post on X, Microsoft’s CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a “set of nested black boxes” whose advice and actions we simply accept or reject. He calls for building a more transparent system where models can be contained, observed, and leaves behind “tamper-proof human readable evidence.” 在一篇发布于 X 的长文中，微软首席执行官阐述了他对高度先进的人工智能模型所带来的危险的看法，以及如何应对这些风险。纳德拉表示，我们不能再接受一个将人工智能视为“一系列嵌套黑箱”的世界，对于这些黑箱的建议和行为，我们只能简单地接受或拒绝。他呼吁建立一个更透明的系统，使模型能够被控制、观察，并留下“防篡改且人类可读的证据”。

Many of his recommendations align with what we’ve heard from others in the industry: timely incident disclosure, independent audits, verifiable data, and containment. It’s on that last point that he appears to go slightly farther than some others in the field, saying: 他的许多建议与我们从业内其他人那里听到的观点一致：及时的事件披露、独立审计、可验证的数据以及控制措施。在最后一点上，他似乎比该领域的其他人走得更远，他说道：

We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on. 我们必须假设模型已被入侵，并从一开始就对其进行控制。可以把它想象成一个紧急制动器。授权人员应始终能够在模型执行任务的过程中将其暂停或关闭。更先进的模型将需要更先进的控制技术，我们需要对此进行标准化。

Unfortunately, Nadella also refers to AI as “super intelligence” throughout the post. 遗憾的是，纳德拉在整篇文章中也将人工智能称为“超级智能”。