Is the AI safety debate about safety or control?
Is the AI safety debate about safety or control?
AI 安全之争：究竟是为了安全，还是为了控制？
How should the tech industry approach the topic of AI safety? Increasingly, high-level executives are weighing in on this question, as a debate rages over whether incidents like the Hugging Face incident — in which an OpenAI agent hacked several different companies — suggest that AI is on the verge of throwing our world into chaos.
科技行业应如何看待 AI 安全这一议题？随着关于 AI 是否即将让世界陷入混乱的争论愈演愈烈（例如 OpenAI 的智能体黑入多家公司的 Hugging Face 事件），越来越多的高管开始对此发表看法。
In recent weeks, prominent labs have called for a slowing of the AI advancement. Most dramatically, CEO Dario Amodei penned a nearly 4,000-word essay in which he laid out the case for why AI development should be decelerated so that adequate guardrails can be deployed. That plan involves — among other things — an international strategy of collaboration between companies and governments on safe deployment. Rival AI executives — like OpenAI’s Sam Altman and xAI’s Elon Musk — have endorsed Amodei’s plan.
近几周，各大知名实验室纷纷呼吁放缓 AI 的发展步伐。其中最引人注目的是 Anthropic 公司 CEO Dario Amodei 发表了一篇近 4000 字的文章，阐述了为何应减缓 AI 开发以部署足够的防护措施。该计划包括在公司与政府之间建立关于安全部署的国际合作战略。OpenAI 的 Sam Altman 和 xAI 的 Elon Musk 等竞争对手也对 Amodei 的计划表示了支持。
The essay has spurred further conversation throughout the tech industry, although not everyone agreed with Amodei’s call for globally coordinated action. Indeed, many seem to think that government oversight need not necessarily play a role at all. The latest entrants to this debate include Meta CEO Mark Zuckerberg, who took to X this week to share his thoughts on the matter. “My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models.”
这篇文章在科技界引发了进一步讨论，尽管并非所有人都赞同 Amodei 关于全球协调行动的呼吁。事实上，许多人认为政府监管并非必要。Meta 公司 CEO Mark Zuckerberg 本周也在 X 上分享了他的看法，加入了这场辩论：“我的观点是，信任和对齐（alignment）正迅速成为区分智能体和模型最重要的能力。”
Zuckerberg revealed that his company had pushed back the release of its AI model over concerns for safety. “Meta delayed shipping Muse for several months to focus on safety and security,” Zuckerberg said. “We didn’t call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us.”
Zuckerberg 透露，出于对安全的担忧，Meta 推迟了其 AI 模型的发布。“Meta 将 Muse 的发布推迟了几个月，以专注于安全保障，”Zuckerberg 说，“我们并没有要求其他人在我们行动之前也这样做。我们只是将其作为日常工作的一部分，因为这对公众和我们自己来说显然是正确的做法。”
Zuckerberg — who endorsed parts of Amodei’s plan — seems to imply that government action is unnecessary, and that the organic incentives structuring the industry will compel companies to get security right. The market should ultimately bring success to companies that take care to create models that don’t cause chaos. This seems to align with Zuckerberg’s own massive essay — penned last month — which argued for limited collaboration with government, where necessary, but largely touted American competitiveness as the key to a prosperous technological future.
Zuckerberg 虽然支持 Amodei 计划的部分内容，但他似乎暗示政府干预是不必要的，行业内部的有机激励机制将促使公司做好安全工作。市场最终会奖励那些致力于开发不会引发混乱的模型的公司。这与 Zuckerberg 上个月发表的长文观点一致：他主张在必要时与政府进行有限合作，但主要强调美国的竞争力才是未来科技繁荣的关键。
In general, this seems to be the position of many other tech executives. Another high-level executive to chime in was Reddit co-founder Alexis Ohanian, who told CNBC on Wednesday that he felt the tech industry had been largely “tone deaf” when it came to explaining the risks of AI to the public. Yet like Zuckerberg, Ohanian also seemed to express hope that companies would be able to figure things out on their own.
总的来说，这似乎也是许多其他科技高管的立场。Reddit 联合创始人 Alexis Ohanian 周三对 CNBC 表示，他认为科技行业在向公众解释 AI 风险方面表现得相当“迟钝”。然而，像 Zuckerberg 一样，Ohanian 也表达了希望公司能够自行解决这些问题的愿望。
Shane Legg, Google DeepMind co-founder, also shared his thoughts. “We’re living in a period now where capabilities are advancing very, very quickly,” said Legg. “But we can’t let capabilities get ahead of safety.” He added: “We need to really work through the details of that and how that would work in practice.”
Google DeepMind 联合创始人 Shane Legg 也分享了他的看法：“我们现在生活在一个能力飞速发展的时代，”Legg 说，“但我们不能让能力的发展超越安全。”他补充道：“我们需要真正研究其中的细节，以及如何在实践中落实。”
Despite calls from big labs for public-private collaboration, some of those pro-regulation voices also seem relatively content with letting businesses write their own rules. Indeed, a slightly less visible but no less interesting story this week was a report from The Information that said OpenAI, Anthropic, and other major AI companies were working together to create an AI standards organization — described by one outlet as a private “self-regulatory body.”
尽管大型实验室呼吁公私合作，但一些支持监管的声音似乎也乐于让企业自行制定规则。事实上，本周有一个不太显眼但同样有趣的报道：据 The Information 称，OpenAI、Anthropic 和其他主要 AI 公司正联手创建一个 AI 标准组织，一家媒体将其描述为私营的“自律机构”。
Discussions have previously been held about creating a similar, federally run organization. However, the Trump White House — which includes vocal AI proponents and has largely pushed for an unregulated tech business (the administration has even sought to forcefully stop state governments from introducing their own AI laws) — hasn’t pursued anything. The administration’s “AI czar,” tech veteran David Sacks, has said that AI regulation should be left to the companies developing it.
此前曾有过关于建立类似联邦政府运营机构的讨论。然而，特朗普政府——其中包括直言不讳的 AI 支持者，且主要推动不受监管的科技业务（该政府甚至试图强力阻止州政府出台自己的 AI 法案）——并未采取任何行动。该政府的“AI 沙皇”、科技老兵 David Sacks 表示，AI 监管应留给开发它的公司自行处理。
Like the White House, prominent members of Congress seem equally disinterested in taking Amodei up on the offer to regulate his company. Not long after the Anthropic CEO’s essay was published, Speaker of the House Mike Johnson addressed concerns over catastrophic AI advancements thusly: “You’re not all going to be dead in 10 years,” he said.
与白宫一样，国会的重要成员似乎同样对 Amodei 提出的监管其公司的建议不感兴趣。在 Anthropic CEO 的文章发表后不久，众议院议长 Mike Johnson 在回应关于 AI 灾难性发展的担忧时说道：“你们不会在 10 年内全部死掉。”
A private organization would keep the industry unregulated except by voluntary commitments and would naturally bestow a certain amount of authority and influence to the companies responsible for creating it. This leads to another ongoing claim, which is that the industry’s calls for regulation are actually a strategy of “regulatory capture.”
一个私营组织将使行业保持不受监管的状态（仅受自愿承诺约束），并自然会赋予负责创建该组织的公司一定的权力和影响力。这引出了另一个持续存在的观点，即行业对监管的呼吁实际上是一种“监管俘获”策略。
According to this argument, powerful companies that already enjoy a position of prominence in the industry may use regulatory stratagems to ice out or disadvantage smaller, less-resourced companies — thereby stifling their competition. This need not involve actual regulations but could involve voluntary industry standards that nevertheless put pressure on less-powerful firms.
根据这一论点，已经在行业中占据显赫地位的大公司可能会利用监管策略来排挤或削弱资源较少的小公司，从而扼杀竞争。这不一定涉及实际的法律法规，但可能涉及自愿性的行业标准，这些标准依然会对实力较弱的公司施加压力。
Many prominent voices in the Chinese government have echoed that position. After Amodei called for “pacing the frontier” this week, China’s Ministry of Foreign Affairs spokesperson Guo Jiakun accused Americans of using “fearmongering” to disrupt the development of global AI governance, while an op-ed in China’s state-run newspaper called Amodei’s rhetoric straight out of a “Cold War playbook.”
中国政府的许多重要声音也呼应了这一立场。在本周 Amodei 呼吁“放缓前沿发展”后，中国外交部发言人郭佳昆指责美国利用“恐吓手段”干扰全球 AI 治理的发展，而中国官方媒体的一篇评论文章则称 Amodei 的言论完全是“冷战剧本”。
Restructuring the way companies do business with China — one of the things Amodei calls for in his essay — could naturally be an opportunity for American companies to sway things in their own favor. Amodei even admits this is the goal. “If we execute these measures well, I believe they would slow China’s progress enough to widen America’s lead significantly over the next 3–5 years — the window when AI becomes geopolitically most important,” he wrote in his essay. It’s not just China, however, that sees big American AI labs as seeking to throw the match in their own favor.
重组公司与中国的业务往来——这是 Amodei 在文中呼吁的内容之一——自然可能成为美国公司将局势转向对自己有利的机会。Amodei 甚至承认这就是目标。他在文中写道：“如果我们能很好地执行这些措施，我相信它们足以减缓中国的进展，从而在未来 3 到 5 年内显著扩大美国的领先优势——这是 AI 在地缘政治上最重要的窗口期。”然而，不仅仅是中国，其他国家也认为美国的大型 AI 实验室正试图通过操纵规则来确保自己的胜算。