Genie 4

本文为原文前 6,000 字符的节选翻译,完整内容请查看原文。

Genie 4

Raia Hadsell, Diego Rivas and Hang Qi

Raia Hadsell, Diego Rivas 和 Hang Qi

Today, we are announcing Genie 4, our new world model, which unlocks unprecedented realism and improves real-time interactive simulation. Genie 4 is natively multimodal, enabling audio-like music, ambient noises, and interactive dialogue to be simultaneously generated with the world.

今天,我们宣布推出全新的世界模型 Genie 4,它解锁了前所未有的真实感,并改进了实时交互式模拟。Genie 4 原生支持多模态,能够与世界同步生成音频般的音乐、环境噪音和交互式对话。

The Genie 4 model incorporates and builds on capabilities from the Gemini family: Gemini Omni anchors the simulations in real-world appearance and behavior, while other Gemini models provide the complex reasoning needed to help maintain a simulation’s coherence and continuity.

Genie 4 模型整合并构建于 Gemini 系列的能力之上:Gemini Omni 将模拟锚定在现实世界的外观和行为中,而其他 Gemini 模型则提供维持模拟连贯性和连续性所需的复杂推理能力。

With this foundation, you can set an event in motion, and Genie 4 simulates what happens next: how the world responds, how it sounds, and how the people in it move, react, and speak.

有了这个基础,你可以启动一个事件,Genie 4 会模拟接下来发生的事情:世界如何响应、听起来如何,以及其中的人们如何移动、反应和说话。

Understanding and simulating the world is a crucial aspect of building AGI. Genie 4 advances our ability to create safe, infinitely variable simulations that can help with everything from developing training environments for robots and agents to unlocking the creation of new interactive experiences.

理解和模拟世界是构建通用人工智能(AGI)的关键环节。Genie 4 提升了我们创建安全、无限可变模拟的能力,这些模拟有助于从开发机器人和智能体的训练环境,到解锁全新的交互式体验创造等各个方面。

We have started rolling Genie 4 out as a research preview for trusted testers — gathering feedback before we release it to consumers and developers, starting with Google AI Ultra subscribers in Project Genie and early access partners of the Gemini API and Google AI Studio. Join the waitlist for Genie 4 in Project Genie here.

我们已经开始向受信任的测试人员推出 Genie 4 的研究预览版,以便在向消费者和开发者发布之前收集反馈。首批用户包括 Project Genie 中的 Google AI Ultra 订阅者,以及 Gemini API 和 Google AI Studio 的早期访问合作伙伴。点击此处加入 Project Genie 中 Genie 4 的候补名单。

Genie 4 delivers enhanced photorealism, fluid movement, and native audio. All accompanying sounds featured above are produced directly by Genie 4.

Genie 4 提供了增强的真实感、流畅的运动和原生音频。上述所有伴随声音均由 Genie 4 直接生成。

The following are recordings of real-time interactions from Genie 4, where users use standard keyboard controls for navigation and camera control, and text prompts to steer the scene as it evolves.

以下是来自 Genie 4 的实时交互录像,用户使用标准键盘控制进行导航和摄像机控制,并使用文本提示来引导场景的演变。

With Genie 4, you can use natural language to modify a simulation in real-time — like changing the weather, moving the camera, or introducing a new person or object — and Gemini will contextually adapt your prompt to match the surrounding scene. Between your inputs, Gemini also monitors and steers the scene to keep the world progressing cohesively.

使用 Genie 4,你可以用自然语言实时修改模拟——比如改变天气、移动摄像机,或引入新的人物或物体——Gemini 会根据上下文调整你的提示,以匹配周围的场景。在你的输入之间,Gemini 还会监控并引导场景,以保持世界连贯地发展。

Prompt: Use the reference image as the exact first frame and visual basis for the scene. Preserve the same floating rectangular platform, weathered concrete edges, wild grasses, ferns, twisted small tree, warm glowing amber sphere, and the same middle-aged man in a loose brown suit playing a brass saxophone.

提示词:使用参考图像作为场景的精确第一帧和视觉基础。保留相同的浮动矩形平台、风化的混凝土边缘、野草、蕨类植物、扭曲的小树、温暖发光的琥珀色球体,以及同一个穿着宽松棕色西装、吹奏萨克斯管的中年男子。

A cinematic, highly naturalistic documentary scene, photographed on 16mm film with subtle grain, soft photographic detail, extremely low contrast, muted natural colors, lifted shadows, gentle highlights, and soft diffuse overcast light. Absolutely no HDR, no dramatic contrast, no glossy digital rendering, no artificial cinematic lighting.

一个电影般的、高度自然主义的纪录片场景,用 16 毫米胶片拍摄,带有细微的颗粒感、柔和的摄影细节、极低的对比度、柔和的自然色彩、提亮的阴影、柔和的高光和柔和的漫射阴天光线。绝对没有 HDR,没有戏剧性的对比度,没有光泽的数字渲染,没有人工电影照明。

The platform floats in the middle of a vast, quiet lake surrounded by distant misty forests. Thin layers of fog drift above the water. The sky is pale blue-gray and overcast, with a soft, almost monochromatic atmosphere. The warm amber sphere provides a delicate contrasting glow, softly illuminating the surrounding vegetation and reflecting in the lake.

平台漂浮在广阔、宁静的湖泊中央,周围是遥远雾气缭绕的森林。薄薄的雾层在水面上漂浮。天空是淡蓝灰色的阴天,有着柔和、近乎单色的氛围。温暖的琥珀色球体提供了微妙的对比光,柔和地照亮了周围的植被并反射在湖面上。

Begin with a slightly closer view of the saxophone player than in the reference image, while keeping the platform, glowing sphere, tree, and surrounding lake visible. The man continues playing his saxophone naturally, with subtle breathing, finger movements, and gentle body swaying.

从比参考图像中更近一点的萨克斯管演奏者视角开始,同时保持平台、发光球体、树木和周围湖泊可见。男子自然地继续吹奏他的萨克斯管,伴随着细微的呼吸、手指动作和轻柔的身体摇摆。

The camera moves independently and can freely explore the entire environment, gliding smoothly over the water with gentle, controlled movement. The camera is not attached to the man or the platform. Maintain realistic spatial continuity and natural camera movement.

摄像机独立移动,可以自由探索整个环境,在水面上平稳滑行,动作轻柔且受控。摄像机不附着在人或平台上。保持真实的物理空间连续性和自然的摄像机运动。

Everything must remain photographic, physically believable, documentary-like, extremely low-contrast, and softly desaturated throughout the entire experience.

在整个体验过程中,一切都必须保持摄影感、物理上的可信度、纪录片风格、极低的对比度和柔和的去饱和度。

One continuous shot. Natural lake ambience, distant wind, soft water movement, and realistic saxophone sound. No background music beyond the instruments physically present in the scene.

一个连续镜头。自然的湖泊环境音、远处的风声、柔和的水流声和真实的萨克斯管声音。除了场景中实际存在的乐器外,没有背景音乐。

Environment prompt: A wide, sun-drenched hilltop meadow filled with tall green grass and scattered purple, white, and yellow wildflowers swaying in a warm breeze. Low green shrubs dot the right side of the field while distant blue-green rolling hills stretch along the left horizon beneath a bright, partly cloudy sky.

环境提示词:一片宽阔、阳光明媚的山顶草甸,长满了高高的绿草,散布着在暖风中摇曳的紫色、白色和黄色野花。低矮的绿色灌木点缀在田野的右侧,而遥远的蓝绿色连绵起伏的丘陵在明亮、多云的天空下沿着左侧地平线延伸。

Character: Winding in sweeping S-curves through the center of the grassy meadow from the immediate foreground far into the distance is a long, continuous stream of glossy bubblegum-pink satin fabric. The shimmering pink cloth billows, ripples, and lifts softly above the wildflowers like a flowing river of silk as the wind moves beneath its folds.

角色:一条长而连续的亮面泡泡糖粉色缎面织物,呈 S 形曲线蜿蜒穿过草甸中心,从近处前景一直延伸到远方。当风吹过褶皱时,闪烁的粉色布料像流动的丝绸河流一样,在野花上方轻轻起伏、荡漾并升起。

Environment prompt: A sweeping aerial view over the vast, frozen landscape of Antarctica, featuring endless snow-covered glaciers, jagged icy mountain peaks, and sculpted blue icebergs bathed in crisp polar sunlight under a clear, pale blue sky. Numerous hot air balloons dot the horizon at varying altitudes, with a large cream, red, and blue striped balloon floating prominently in the mid-distance above the ice sheet.

环境提示词:俯瞰南极洲广阔冰封景观的航拍视角,展现了无尽的积雪冰川、锯齿状的冰山峰,以及在清澈淡蓝天空下沐浴在清脆极地阳光中的雕塑般蓝色冰山。无数热气球在不同高度点缀着地平线,一个巨大的奶油色、红色和蓝色条纹气球在冰原上方的中距离处显眼地漂浮着。

Character prompt: Shot from a first-person POV standing inside the woven wicker basket of a flying hot air balloon, looking out over the leather-trimmed basket edge on the right side of the frame, where black padded support poles, metal rigging chains, and the dark base of the balloon canopy overhead frame the drifting polar vista.

角色提示词:从站在飞行热气球编织柳条篮内的第一人称视角拍摄,向右侧皮革装饰的篮筐边缘外望去,黑色的衬垫支撑杆、金属索具链条以及上方气球顶篷的深色底部构成了漂流极地景观的框架。

Genie 4 introduces a new standard of realism to real-time interactive simulation. Built on an advanced physical understanding of the world, Genie 4 simulates real-world physics scenarios, such as aerodynamics, collisions, and more.

Genie 4 为实时交互式模拟引入了真实感的新标准。基于对世界先进的物理理解,Genie 4 可以模拟现实世界的物理场景,例如空气动力学、碰撞等。

The most dramatic leap is how Genie 4 simulates people, creating characters that move naturally, respond organically to their environments, and can be interactively steered in real-time.

最显著的飞跃在于 Genie 4 如何模拟人类,创造出能够自然移动、对环境做出有机反应,并能实时交互引导的角色。

Environment prompt: A sunlit outdoor courtyard featuring a weathered stone plinth set against a soft-focus background of lush

环境提示词:一个阳光明媚的户外庭院,特色是一个风化的石基座,背景是郁郁葱葱的柔焦背景。