OpenAI Boss Sam Altman Says AI On Your PC Wastes Precious Memory
OpenAI Boss Sam Altman Says AI On Your PC Wastes Precious Memory
OpenAI boss Sam Altman said people should stop running big AI programs on their own PCs because it wastes valuable memory that companies can use more efficiently in giant data centers.
OpenAI 首席执行官萨姆·奥特曼(Sam Altman)表示,人们应该停止在个人电脑上运行大型人工智能程序,因为这会浪费宝贵的内存,而这些内存本可以在大型数据中心得到更高效的利用。
Key Takeaways: Sam Altman said people should not run large AI models locally and called desktop inference a waste of memory. He argued scarce DRAM is better used in data centers than on personal computers. Altman said it is “terrible” to have RAM “sitting in your desk” when large cloud systems can pool and schedule it. His remarks framed local compute as inefficient compared with centralized data centers and challenged running models on personal hardware.
主要内容:萨姆·奥特曼表示,人们不应在本地运行大型人工智能模型,并称桌面端推理是对内存的浪费。他认为,稀缺的动态随机存取存储器(DRAM)在数据中心的使用价值高于个人电脑。奥特曼称,当大型云系统能够更高效地汇集和调度内存时,让内存“闲置在你的桌面上”是“糟糕的”。他的言论将本地计算描述为相较于集中式数据中心效率低下的方式,并对在个人硬件上运行模型提出了质疑。
In an interview with The Verge, the OpenAI CEO argued that scarce DRAM, the memory chips used to hold active model data, is better used in data centers than on personal computers. He said it is “terrible” to have RAM “sitting in your desk” when large cloud systems can pool and schedule it more efficiently.
在接受《The Verge》采访时,这位 OpenAI 首席执行官指出,用于存储活跃模型数据的稀缺 DRAM 芯片,在数据中心的使用效果要优于个人电脑。他表示,当大型云系统能够更高效地汇集和调度内存时,让内存“闲置在你的桌面上”是“糟糕的”。
Sam Altman, A Direct Shot At The Local Model Boom: Altman’s comments run counter to a growing movement of developers and companies promoting local inference and open-weight models that can run on personal hardware. His position frames local compute as inefficient compared with centralized data centers and challenges the idea that running models on laptops, desktops and edge devices is inherently empowering.
萨姆·奥特曼:对本地模型热潮的直接抨击:奥特曼的言论与当前日益增长的开发者和公司趋势背道而驰,这些开发者和公司正致力于推广可在个人硬件上运行的本地推理和开放权重模型。他的立场将本地计算定义为相较于集中式数据中心效率低下的方式,并挑战了“在笔记本电脑、台式机和边缘设备上运行模型本身就是一种赋能”的观点。
His remarks also went beyond hardware efficiency, Altman said users should not own their own models, turning a supply chain answer about RAM shortages into a broader argument for centralized control over deployment. That matters for a debate already splitting the market between cloud-first companies and open-weight model builders.
他的言论还超越了硬件效率的范畴。奥特曼表示,用户不应该拥有自己的模型,这使得关于内存短缺的供应链回应演变成了一个关于部署集中化控制的更广泛论点。这对于已经在“云优先”公司和“开放权重”模型构建者之间产生分歧的市场辩论至关重要。
Why Memory Became The Battleground: Large language models consume significant memory during inference because model weights and active context have to stay accessible while the system generates text. If RAM is tight across the supply chain, Altman’s view is that centralizing those resources can deliver higher utilization than millions of partly idle PCs.
为什么内存成为了战场:大型语言模型在推理过程中会消耗大量内存,因为系统在生成文本时,模型权重和活跃上下文必须保持可访问状态。如果整个供应链的内存供应紧张,奥特曼的观点是,集中化这些资源所能实现的利用率要高于数百万台处于部分闲置状态的个人电脑。
That argument favors companies with large clusters and steady demand, but it also sharpens concerns about resilience, pricing and user control. If inference stays concentrated in data centers, the companies operating them keep a tighter grip on uptime, policy enforcement and who gets access to the model at all.
这一论点有利于拥有大型集群和稳定需求的公司,但也加剧了人们对系统韧性、定价和用户控制权的担忧。如果推理任务继续集中在数据中心,运营这些中心的公司将能更严格地掌控正常运行时间、政策执行以及谁能获得模型访问权限。
What Comes Next For AI Deployment: The immediate consequence is not a product launch or policy shift from OpenAI. It is a clearer public stance from one of AI’s most visible CEOs at a moment when local model software and AI PCs are both gaining traction. Expect the next phase of this fight to revolve around economics people can measure, including chip availability, cloud margins, latency and how much quality smaller local models can retain as they run on limited memory.
人工智能部署的下一步:直接后果并非 OpenAI 的产品发布或政策调整,而是人工智能领域最受关注的首席执行官之一在本地模型软件和 AI PC 均受到追捧之际,表达了更明确的公开立场。预计这场争论的下一阶段将围绕可衡量的经济指标展开,包括芯片可用性、云服务利润率、延迟,以及较小的本地模型在有限内存下运行时所能保留的质量。