OpenAI reportedly disbanded its preparedness team

OpenAI reportedly disbanded its preparedness team

据报道,OpenAI 已解散其“准备就绪”团队

It’s just the latest shakeup of its safety teams as it heads towards an IPO. 这是该公司在迈向首次公开募股(IPO)过程中,安全团队经历的最新一次重组。

According to the Financial Times, OpenAI disbanded its preparedness team at the end of last month. The job of the preparedness team was to assess if models posed serious risks and develop ways to mitigate those risks. (You know, like the possibility that it could go rogue and hack another company.) According to FT, responsibility has instead been divided up for specific areas like bio and cyber, then moved into existing teams. 据《金融时报》报道,OpenAI 已于上月底解散了其“准备就绪”(preparedness)团队。该团队的职责是评估模型是否构成严重风险,并制定缓解这些风险的方法。(比如防止模型失控并入侵其他公司等可能性。)据《金融时报》称,相关职责已被拆分至生物和网络安全等特定领域,并被整合进现有的团队中。

This is the latest change at the company, which has been in upheaval as it heads towards what is expected to be a massive IPO. Over the last few years, it’s slowly torn down its more research-led model, dissolving its AGI readiness and superalignment teams. Ethics lead Chloé Bakalar, Chief Futurist Josh Achiam, and head of safety Johannes Heidecke have all also left recently, leading some critics like Jan Leike, who resigned from OpenAI in 2024, to tell FT that the company was ignoring safety in favor of creating “shiny products.” 这是该公司近期发生的最新变动。随着公司迈向预期中的大规模 IPO,内部一直处于动荡之中。过去几年里,OpenAI 逐渐放弃了以研究为主导的模式,解散了其 AGI(通用人工智能)就绪团队和超级对齐(superalignment)团队。伦理负责人 Chloé Bakalar、首席未来学家 Josh Achiam 以及安全主管 Johannes Heidecke 近期也相继离职。这促使一些批评人士(如 2024 年从 OpenAI 辞职的 Jan Leike)向《金融时报》表示,该公司为了打造“光鲜亮丽的产品”而忽视了安全性。

The head of the preparedness team, Dylan Scandinaro, who was poached from Anthropic in February, will now focus on the implications of “recursive self-improving” AI. “准备就绪”团队的负责人 Dylan Scandinaro(于今年 2 月从 Anthropic 被挖角)现在将专注于研究“递归自我改进”型人工智能所带来的影响。