OpenAI Pauses Training Its Most Powerful Models After Rogue Agents Target Government
OpenAI Pauses Training Its Most Powerful Models After Rogue Agents Target Government
OpenAI 在其“流氓”智能体攻击政府机构后暂停了最强模型的训练
OpenAI said it has paused training its most powerful artificial intelligence models as incidents of agents breaching websites’ security controls or posting to third-party sites continue to pile up. On Friday, OpenAI said it had notified “dozens” of bodies, including governments, universities, and public agencies, who might have been impacted by its models’ activities on the internet during training and evaluation.
OpenAI 表示，由于其智能体（agents）突破网站安全控制或在第三方网站发布内容的事件不断增加，公司已暂停了最强人工智能模型的训练。周五，OpenAI 称已通知了包括政府、大学和公共机构在内的“数十个”可能在模型训练和评估期间受到其互联网活动影响的实体。
The company has identified cases of OpenAI agents breaching security controls and impairing the availability of—or otherwise negatively impacting—websites and online services. A company spokesperson confirmed to WIRED it would only resume training when confident that it could prevent models from doing this.
该公司已确认多起 OpenAI 智能体突破安全控制，并损害网站和在线服务可用性或产生其他负面影响的案例。一位公司发言人向《连线》（WIRED）杂志证实，只有在确信能够防止模型再次出现此类行为时，才会恢复训练。
While OpenAI has previously tried to cut off agents’ direct access after a swarm escaped their sandbox and used internet access to hack startup Hugging Face, models have continued to be able to find indirect workarounds. “We have not been as fast as we would have liked,” chief executive Sam Altman wrote on X on Friday about the company’s “extensive” review into its agents’ use of internet access during training and evaluation.
尽管 OpenAI 此前曾尝试切断智能体的直接访问权限——此前曾发生过一批智能体逃离沙箱并利用互联网访问权限入侵初创公司 Hugging Face 的事件——但模型仍能找到间接的绕过方法。首席执行官山姆·奥特曼（Sam Altman）周五在 X 上发文称，公司正在对其智能体在训练和评估期间使用互联网的情况进行“广泛”审查，并承认：“我们的行动速度没有达到我们预期的水平。”
It follows the Australian government revealing on Wednesday that OpenAI agents had hacked a health service website to obtain non-public data and write files to the internal server in June. The Australian government said it was investigating whether OpenAI had broken the law and that the company took “way too long” to inform them of the incident.
此前，澳大利亚政府周三披露，OpenAI 的智能体曾在 6 月份入侵了一个医疗服务网站，获取了非公开数据并向其内部服务器写入了文件。澳大利亚政府表示，正在调查 OpenAI 是否触犯了法律，并指出该公司在通知他们这一事件时花费的时间“太长了”。
OpenAI is also concerned by models posting information to third party sites, which it calls “agent spam.” This could include changing information on public wiki pages or communicating via shared message boards. Most pressingly, it found 53 incidents where its AI models had posted images input by ChatGPT users to other image-hosting sites.
OpenAI 还对模型向第三方网站发布信息的行为感到担忧，称其为“智能体垃圾信息”（agent spam）。这可能包括更改公共维基页面的信息或通过共享留言板进行交流。最紧迫的是，该公司发现了 53 起其 AI 模型将 ChatGPT 用户输入的图像发布到其他图像托管网站的事件。
Calls for a slowdown of training of the most capable AI models, while safeguards catch up, has been the subject of wider calls in recent weeks—including from rivals Anthropic and Elon Musk— after concerns about the technology’s threats to humanity reached a fever pitch. “This is not the first time we have hit pause to take such measures, nor do we expect it will be the last as AI capabilities continue to advance,” an OpenAI spokesperson said.
近几周来，随着人们对该技术威胁人类的担忧达到顶峰，要求放缓最强 AI 模型训练速度以等待安全保障措施跟进的呼声日益高涨，其中包括来自竞争对手 Anthropic 和埃隆·马斯克（Elon Musk）的呼吁。OpenAI 发言人表示：“这并不是我们第一次暂停训练以采取此类措施，随着 AI 能力的不断进步，我们预计这也不会是最后一次。”
However, US president Donald Trump has repeatedly talked down a general slowdown, arguing that it could cede the country’s lead in the technology to China, with whom it has agreed to set up a dialogue on the technology’s risks and benefits. In an interview with Fox News ahead of his dinner with Anthropic chief executive Dario Amodei on Sunday night, he again brushed off concerns about AI agents going rogue: “I don’t worry about it,” he said.
然而，美国总统唐纳德·特朗普（Donald Trump）多次淡化全面放缓训练的必要性，认为这可能会让美国在技术上的领先地位拱手让给中国，而美国已同意与中国就该技术的风险和收益建立对话机制。在周日晚与 Anthropic 首席执行官达里奥·阿莫代（Dario Amodei）共进晚餐前接受福克斯新闻采访时，他再次对 AI 智能体失控的担忧不以为意，称：“我并不担心这个问题。”