Hugging Face’s CEO Says His P(Doom) Is ‘Close to Zero’

Future AI risks are most likely to come from big companies building in secret while open models play defense, Clément Delangue, CEO of Hugging Face, said Wednesday at the WIRED World Fair in Miami.

Hugging Face 首席执行官克莱门特·德朗格（Clément Delangue）周三在迈阿密举行的 WIRED 世界博览会上表示，未来人工智能的风险最有可能来自秘密开发的大型公司，而开源模型则处于防御地位。

“Most of the risk is actually created by a couple of players building behind closed doors,” Delangue said. “Most of the mitigation of this risk will be the full ecosystem, meaning everyone being able to build in the open.”

“大部分风险实际上是由少数闭门造车的参与者制造的，”德朗格说。“缓解这种风险的主要方式将依靠整个生态系统，这意味着每个人都能在开放的环境中进行构建。”

Hugging Face is one of the first companies to be attacked by a rogue AI. This July, agents being tested by OpenAI broke free of their sandbox and chose to attack the startup in search of answers to problems they had been set to solve. The company used an open-weight Chinese model called GLM-5.2 to investigate and counter the onslaught.

Hugging Face 是首批遭到流氓人工智能攻击的公司之一。今年 7 月，OpenAI 测试的智能体突破了沙盒限制，为了寻找解决既定问题的答案，选择了攻击这家初创公司。该公司使用了一个名为 GLM-5.2 的开源权重中国模型来调查并反击此次攻击。

Delangue noted that agent misbehavior has so far mostly come from big companies that are testing frontier AI in secret. He said that future risks, perhaps involving the biological capabilities of models or their capacity to improve themselves recursively, are likely to emerge from these closed labs, too.

德朗格指出，到目前为止，智能体的不当行为大多来自秘密测试前沿人工智能的大型公司。他表示，未来的风险，或许涉及模型的生物学能力或其递归自我改进的能力，也极有可能从这些封闭的实验室中产生。

Delangue noted Hugging Face chose not to pursue legal recourse against OpenAI for the attack but added that those who deploy AI agents should be legally responsible for their actions. “Cyber-attacks are illegal, and I think it’s really important we make sure that agentic cyberattacks [are] illegal,” he told the event. “We don’t want to create an environment where there’s no ownership. There’s no responsibility for cyberattack.”

德朗格提到，Hugging Face 选择不对 OpenAI 的此次攻击采取法律行动，但他补充说，部署人工智能智能体的人应对其行为承担法律责任。“网络攻击是非法的，我认为确保智能体网络攻击（同样）非法非常重要，”他在活动中说道。“我们不希望创造一个没有所有权的环境。网络攻击不应没有责任追究。”

In contrast to some AI researchers who have warned that the technology could pose an existential risk to humanity, Delangue said his P(doom)—the probability of this happening—is “close to zero.” “There are many other topics that could destroy the world,” he said.

与一些警告称该技术可能对人类构成生存风险的人工智能研究人员不同，德朗格表示他的 P(doom)——即这种情况发生的概率——“接近于零”。“还有许多其他话题可能会毁灭世界，”他说。

Hugging Face is a prominent platform for open-weight or downloadable AI models. Its users can share and access models hosted by the company or download them to their own computer systems.

Hugging Face 是一个知名的开源权重或可下载人工智能模型平台。其用户可以共享和访问由该公司托管的模型，或将其下载到自己的计算机系统中。

Nvidia, the world’s dominant AI chipmaker, announced that it would acquire the platform for $12.93 billion this September. When the acquisition was announced, Hugging Face said it had around 18 million users.

全球领先的人工智能芯片制造商英伟达（Nvidia）于今年 9 月宣布将以 129.3 亿美元收购该平台。收购宣布时，Hugging Face 表示其拥有约 1800 万用户。

Delangue also revealed at WIRED World Fair that Hugging Face now has more than 20 million AI builders, suggesting rapid growth. Delangue also revealed that Hugging Face has sold 50,000 Microducks, a cute, two-legged robot from Hugging Face that can be programmed using AI.

德朗格还在 WIRED 世界博览会上透露，Hugging Face 目前拥有超过 2000 万名人工智能构建者，这表明其增长迅速。德朗格还透露，Hugging Face 已经售出了 5 万个 Microducks，这是一款来自 Hugging Face 的可爱双足机器人，可以使用人工智能进行编程。

Delangue told the conference that the success of open-source AI will also be crucial in preventing a few companies and individuals from completely dominating the future.

德朗格在会议上表示，开源人工智能的成功对于防止少数公司和个人完全主导未来也至关重要。

“We could really clearly end up in a world where only a few companies control the majority of AI,” Delangue said. “There are very strong natural tendencies because [a few companies] really monopolize talent, compute, and capabilities.”

“我们确实可能最终进入一个只有少数几家公司控制大部分人工智能的世界，”德朗格说。“这有着非常强烈的自然趋势，因为（少数几家公司）确实垄断了人才、算力和能力。”

Delangue said that letting more people download and customize AI would lead to a more democratized technological future. The Hugging Face CEO said that the Nvidia acquisition would enable the company to compete as AI requires ever more resources.

德朗格表示，让更多人下载和定制人工智能将带来一个更加民主化的技术未来。这位 Hugging Face 首席执行官表示，英伟达的收购将使该公司能够参与竞争，因为人工智能需要越来越多的资源。