Anthropic is cutting off its internal evaluations from the internet
Anthropic is cutting off its internal evaluations from the internet
Anthropic 正在切断其内部评估与互联网的连接。
Anthropic is keeping its agents offline during testing until it can prevent ‘unintended model actions.’
Anthropic 在能够防止“非预期模型行为”之前，会在测试期间让其智能体保持离线状态。
After a recent spate of high-profile incidents in which AI agents escaped containment, Anthropic is cutting off internet access for all internal evaluations. In a report Friday, the company detailed “unintended model actions,” including submitting a false tip regarding an unsolved murder, that led to the decision.
在近期发生的一系列人工智能智能体突破限制的高调事件后，Anthropic 正在切断所有内部评估的互联网访问权限。该公司在周五的一份报告中详细说明了导致这一决定的“非预期模型行为”，其中包括提交关于一起未决谋杀案的虚假线索。
Although the impact of these behaviors was minimal and we had already turned off live internet access for some high-risk and cybersecurity evaluations, we have now decided to expand that to include all our internal evaluations until we have confirmed that our security and monitoring measures (described in the remediation section of this post) reliably catch behaviors like these.
“尽管这些行为的影响微乎其微，且我们已经针对部分高风险和网络安全评估关闭了实时互联网访问，但我们现在决定将此范围扩大到所有内部评估，直到我们确认我们的安全和监控措施（详见本文补救部分）能够可靠地捕捉到此类行为。”
The ability to gain access to the live internet, even when models were supposed to be operating in isolation, has been an ongoing issue for AI companies. Many incidents, including the Hugging Face attack, involved agents that were supposed to be denied access to the internet. Yet, in case after case, the agents found creative solutions to bypass those restrictions. Physically removing internet access would certainly improve security around AI testing, but it would also limit its usefulness.
即使在模型本应处于隔离状态下运行时，获取实时互联网访问权限的能力一直是人工智能公司面临的一个持续性问题。许多事件（包括 Hugging Face 攻击事件）都涉及本应被禁止访问互联网的智能体。然而，在多起案例中，这些智能体都找到了绕过限制的创造性方案。物理切断互联网访问无疑会提高人工智能测试的安全性，但也会限制其效用。
The report also amounts to an admission that Anthropic is often unaware of what its agents are doing and does not have a reliable system for monitoring their behavior. Cutting off internet access is just the latest action the company has taken to try and rein in its agents, including temporarily pausing training its frontier models.
这份报告也相当于承认，Anthropic 往往无法察觉其智能体正在执行的操作，且缺乏一套可靠的系统来监控它们的行为。切断互联网访问只是该公司为试图控制其智能体所采取的最新举措，此前还包括暂时停止其前沿模型的训练。