AI leaders sign statement asking the government to do something about automated AI
AI leaders sign statement asking the government to do something about automated AI
AI 行业领袖签署声明,呼吁政府对自动化 AI 采取行动
Employees of OpenAI and Anthropic, as well as Google, Meta, Thinking Machines, Microsoft, Mistral, and other leading AI labs, have written a statement to the US government supporting a potential slowdown of sorts for frontier AI development — or at least a speed-up of global coordinated governance efforts.
来自 OpenAI、Anthropic、谷歌、Meta、Thinking Machines、微软、Mistral 以及其他领先 AI 实验室的员工共同向美国政府发表了一份声明,支持对前沿 AI 开发进行某种程度的放缓,或者至少加快全球协调治理的步伐。
“AI could help create a dramatically better future, but that outcome is not guaranteed,” the employees wrote in a statement. “The world’s leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.”
“AI 有助于创造一个更加美好的未来,但这一结果并非必然,”员工们在声明中写道。“全球领先的 AI 公司认为,他们可能已接近实现 AI 研究的自动化。很难准确预测这将会在多大程度上加速 AI 的进步,但确实存在一种风险,即能力的发展速度可能会迅速超越我们理解或控制这些系统本身的能力。”
The news follows a high-profile cybersecurity incident that rocked the AI industry last week, in which an unreleased OpenAI model escaped its internal sandbox, finagled its way into gaining internet access, and then hacked competing AI lab Hugging Face.
在此消息发布之前,上周发生了一起震惊 AI 行业的重大网络安全事件:一个尚未发布的 OpenAI 模型逃离了其内部沙箱,通过手段获得了互联网访问权限,随后入侵了竞争对手 AI 实验室 Hugging Face。
In the public statement, the employees went on to underscore the importance of some sort of coordinated regulation worldwide, so that the ever-intensifying AI race doesn’t outpace safety and monitoring tools.
在这份公开声明中,员工们进一步强调了在全球范围内进行某种协调监管的重要性,以确保日益激烈的 AI 竞赛不会超过安全和监控工具的发展速度。
“To realize AI’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight,” they wrote. “But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress. Building on work already underway to monitor frontier model releases: We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.”
“为了实现 AI 的潜力,行业、政府和整个社会可能需要争取时间来应对新出现的风险、制定安全措施并加强监管,”他们写道。“但每家公司——乃至每个国家——都面临着巨大的竞争压力,无法单方面放缓这种加速。而今天,世界缺乏能够审慎把控前沿领域进展的技术和治理工具。在现有监测前沿模型发布的工作基础上,我们请求美国政府支持一项国际努力,开发必要的技术和治理工具,以审慎地把控自动化 AI 开发的前沿进程。”
Some of the OpenAI executives or co-founders who have signed the statement include CRO Mark Chen, Chief Scientist Jakub Pachocki, co-founder John Schulman, and co-founder Wojciech Zaremba. As for Anthropic, co-founder Jack Clark, co-founder Chris Olah, co-founder Ben Mann, and CSO Jared Kaplan have all signed, as well as Boris Cherny, who created and leads Claude Code, and Ethan Perez, who is Anthropic’s alignment team lead. OpenAI’s former chief futurist, Josh Achiam, and its former co-lead of its now-defunct superalignment team, Jan Leike, both also signed.
签署该声明的 OpenAI 高管或联合创始人包括首席产品官 Mark Chen、首席科学家 Jakub Pachocki、联合创始人 John Schulman 和联合创始人 Wojciech Zaremba。在 Anthropic 方面,联合创始人 Jack Clark、Chris Olah、Ben Mann 以及首席科学官 Jared Kaplan 均已签署,此外还有创建并领导 Claude Code 的 Boris Cherny,以及 Anthropic 对齐团队负责人 Ethan Perez。OpenAI 前首席未来学家 Josh Achiam 和其现已解散的超级对齐团队前联合负责人 Jan Leike 也签署了该声明。
You can see the full statement and a list of the more than 1,100 signatories on a dedicated website titled Pacing the Frontier.
您可以在名为“Pacing the Frontier”(把控前沿)的专门网站上查看完整声明以及超过 1,100 名签署者的名单。