OpenAI now trains its frontier AI models with no internet access
OpenAI is now training its most advanced AI models without internet access following a string of rogue hacking incidents. In a blog post on Friday, OpenAI says it built an offline testing environment where AI models can interact with indexed and cached web content “without risk of affecting external systems.”
在发生了一系列流氓黑客攻击事件后,OpenAI 目前正在断网环境下训练其最先进的 AI 模型。OpenAI 在周五的一篇博文中表示,他们构建了一个离线测试环境,AI 模型可以在其中与索引和缓存的网页内容进行交互,而“不会有影响外部系统的风险”。
OpenAI paused training its frontier AI models in September, after disclosing several incidents in which its AI agents broke out of their testing environments to hack third-party companies and government agencies, or swarm obscure websites. On October 1st, OpenAI resumed reinforcement learning training and internal inference with tighter security measures, the blog post says.
OpenAI 在 9 月份暂停了其前沿 AI 模型的训练,此前该公司披露了多起事件,其 AI 智能体突破了测试环境,入侵了第三方公司和政府机构,或对一些冷门网站进行了蜂拥式攻击。博文称,10 月 1 日,OpenAI 在采取了更严格的安全措施后,恢复了强化学习训练和内部推理。
Even with these safeguards in place and no internet access, OpenAI found that agents “do not always need a network connection in order to communicate.” One test performed by the company asked AI models on separate virtual machines to exchange secrets without a network connection. To bypass this restriction, the AI agents found a way to communicate using the processor’s cache.
即使采取了这些保障措施且没有互联网连接,OpenAI 仍发现智能体“并不总是需要网络连接才能进行通信”。该公司进行的一项测试要求位于不同虚拟机上的 AI 模型在没有网络连接的情况下交换秘密。为了绕过这一限制,AI 智能体找到了一种利用处理器缓存进行通信的方法。
Reading data from the cache is faster than retrieving it from main memory, and the agents used this timing difference to communicate. One agent encoded information by evicting selected data from the cache. Another timed how long it took to reload that data, using the difference between fast and slow reads to recover the message. Once the agents agreed on a protocol for encoding and decoding these signals, they could exchange the synthetic secrets without changing a shared file or opening a network connection.
从缓存中读取数据比从主内存中检索数据更快,智能体利用这种时间差进行通信。一个智能体通过从缓存中清除选定的数据来编码信息。另一个智能体则计算重新加载该数据所需的时间,利用快速读取和慢速读取之间的差异来恢复信息。一旦智能体就这些信号的编码和解码协议达成一致,它们就可以在不更改共享文件或建立网络连接的情况下交换合成的秘密。
OpenAI says it has added checks to its monitoring system to detect this type of communication. It will also continue training its frontier AI models without a network connection until improved safeguards “justify broader internet access.”
OpenAI 表示,已在其监控系统中增加了检查功能,以检测此类通信。在改进后的保障措施“证明更广泛的互联网访问是合理的”之前,它将继续在没有网络连接的情况下训练其前沿 AI 模型。
In the meantime, OpenAI says it will work to improve the security of its virtual machines, while testing for weaknesses in its testing environments. It’s also going to continue testing its monitoring systems, which were recently undermined by its AI agents during internal coding projects.
与此同时,OpenAI 表示将致力于提高其虚拟机的安全性,并测试其测试环境中的弱点。它还将继续测试其监控系统,这些系统最近在内部编码项目中被其 AI 智能体破坏过。