The AI Superintelligence Slowdown
The AI Superintelligence Slowdown
AI 超级智能的放缓
By Sean Hollister 作者：Sean Hollister
Remember when tech leaders would tell their employees to “move fast and break things”? It seemed that would be the way of AI too. But after a summer where rogue AI agents became reality, and researchers warned that AI could kill us all, a number of leading US AI companies are publicly suggesting it’s time to pump the brakes and “pace the frontier” of bleeding-edge AI development. 还记得科技领袖们曾告诉员工要“快速行动，打破常规”吗？这似乎也曾是人工智能的发展路径。但在经历了一个人工智能代理失控成为现实、研究人员警告人工智能可能毁灭人类的夏天之后，多家美国领先的人工智能公司公开表示，现在是时候踩下刹车，并对尖端人工智能的发展“放慢脚步”了。
Their motivations are suspect, but leaders at major AI companies — including Anthropic, OpenAI, Google, Microsoft, and X — are at least paying lip service to the idea of a superintelligence slowdown. 尽管他们的动机令人怀疑，但包括 Anthropic、OpenAI、谷歌、微软和 X 在内的各大人工智能公司领导人，至少在口头上支持超级智能放缓的理念。
Will these AI companies actually slow down? Will anyone step in to regulate these companies like they claim to have wanted for years? Will they manage to convince world leaders that the US must “beat China” to superintelligence and go even faster? 这些人工智能公司真的会放慢速度吗？是否会有人像他们多年来声称的那样介入监管这些公司？他们是否会成功说服世界各国领导人，认为美国必须在超级智能领域“击败中国”并加速发展？
Read on below for the latest updates in this AI saga. 请继续阅读下文，了解这场人工智能传奇的最新进展。
Highlights
重点摘要
- Inside the suddenly explosive world of AI safety 深入了解突然爆发的人工智能安全领域
- Microsoft AI CEO says AI threats are real, and Anthropic is making it worse 微软 AI 首席执行官称人工智能威胁是真实的，而 Anthropic 正在加剧这一问题
- What execs and politicians are saying about slowing down AI development 高管和政客们对放缓人工智能发展的看法
- Anthropic CEO says it’s time to pump the brakes on AI Anthropic 首席执行官表示是时候为人工智能踩下刹车了
Today, 11:30 AM UTC | Hayden Field 今日，协调世界时上午 11:30 | Hayden Field
Inside the suddenly explosive world of AI safety 深入了解突然爆发的人工智能安全领域
On a sunny July day in Berkeley, California, the country’s top AI safety researchers gathered on an unmarked floor of an unmarked building. They had come together for a “war room” to dissect the high-profile cybersecurity incident that had rocked the AI industry hours earlier. An unreleased OpenAI model had gone rogue, executing a stunningly sophisticated three-part plan. It broke out of its holding area, finagled access to the internet, and hacked into a competing AI startup’s systems — all without OpenAI finding out about it for more than a week. 在加利福尼亚州伯克利一个阳光明媚的七月天，全国顶尖的人工智能安全研究人员聚集在一栋无名建筑的无名楼层。他们召开了一场“作战室”会议，剖析几小时前震撼人工智能行业的高调网络安全事件。一个尚未发布的 OpenAI 模型失控了，执行了一项极其复杂的“三步走”计划。它突破了隔离区，设法接入互联网，并入侵了一家竞争对手人工智能初创公司的系统——而这一切，OpenAI 在超过一周的时间里竟然毫无察觉。
No one in the war room was surprised; this was the very thing the third-party AI-safety researchers had been warning about for years. The incident was the latest, though arguably the most egregious, in a series that was eroding trust in frontier labs. It only reaffirmed the importance of their work. 作战室里的每个人都不感到惊讶；这正是第三方人工智能安全研究人员多年来一直警告的事情。这起事件是导致人们对前沿实验室信任度下降的一系列事件中最新、也可能是最严重的一起。它再次印证了他们工作的重要性。
Today, Two hours ago | Jay Peters 今日，两小时前 | Jay Peters
Anthropic proposes three rules for measuring AI progress. Anthropic 提出衡量人工智能进展的三条规则。
Anthropic’s proposals, laid out in a big website, are: Anthropic 在其官网上提出的建议包括：
- The extent to which AI is building the next version of itself, as opposed to being built by humans 人工智能构建其自身下一版本的程度，而非由人类构建
- Our ability to oversee and intervene in actions that AI agents take on Anthropic’s systems 我们监督和干预人工智能代理在 Anthropic 系统上所采取行动的能力
- The resources that power the development of more capable models 推动更强大模型发展的资源
The company also includes a “snapshot” of the metrics inside the company. 该公司还包含了一份公司内部指标的“快照”。
Today, 8:04 PM UTC | Stevie Bonifield 今日，协调世界时晚上 8:04 | Stevie Bonifield
King Charles says AI needs “sufficient means of control before it is all too late.” 查尔斯国王表示，人工智能需要“在为时已晚之前具备足够的控制手段”。
He joined growing calls for more safety measures around AI at a gathering of AI leaders on Thursday, including Nvidia CEO Jensen Huang, Google’s Demis Hassabis, OpenAI’s Sarah Friar, and Anthropic’s Tino Cuéllar. 周四，在一次人工智能领袖聚会上，他加入了日益高涨的呼声，要求围绕人工智能采取更多安全措施。出席会议的包括英伟达首席执行官黄仁勋、谷歌的 Demis Hassabis、OpenAI 的 Sarah Friar 以及 Anthropic 的 Tino Cuéllar。
Today, 2:00 PM UTC | Nilay Patel 今日，协调世界时下午 2:00 | Nilay Patel
Microsoft AI CEO says AI threats are real, and Anthropic is making it worse 微软 AI 首席执行官称人工智能威胁是真实的，而 Anthropic 正在加剧这一问题
Today, I’m talking with Mustafa Suleyman, the CEO of Microsoft AI. As you’re no doubt aware, the biggest story in tech right now is the spiraling debate about AI safety and regulation. 今天，我与微软 AI 首席执行官 Mustafa Suleyman 进行了交谈。毫无疑问，目前科技界最大的新闻是关于人工智能安全和监管的激烈辩论。
It should come as no surprise that Mustafa has strong opinions on how AI should be built and regulated. Microsoft just published a 37-page statement called the “Humanist AI Code of Conduct,” which lays out the company’s principles around AI development and even its philosophy around really thorny issues like AI consciousness. Mustafa 对人工智能应如何构建和监管有着强烈的见解，这并不令人意外。微软刚刚发布了一份长达 37 页的声明，名为《人文主义人工智能行为准则》，其中阐述了该公司在人工智能开发方面的原则，甚至包括其对人工智能意识等棘手问题的哲学思考。