The Lightbulb Computer
本文为原文前 6,000 字符的节选翻译,完整内容请查看原文。
The Lightbulb Computer
Modern visions for the future of human-computer interaction are excessively focused on smart glasses and headsets - devices that are constraining & socially awkward.
对于未来人机交互的现代愿景,人们过度关注智能眼镜和头戴设备——这些设备不仅受到限制,而且在社交场合显得笨拙。
This project explores an alternative direction - a speculative device called the Lightbulb Computer that uses modern projector technology & computer vision advancements to blend ambient computation & spatial information display in everyday spaces.
本项目探索了另一个方向——一种名为“灯泡电脑”(Lightbulb Computer)的推测性设备,它利用现代投影技术和计算机视觉的进步,将环境计算与空间信息显示融合在日常空间中。
In this series of design prototypes, I want to share with you a direction for computing that involves projecting information in the real world to augment it, rather than keeping it confined to small rectangular screens, or worse - piping it through devices that live on our faces.
在这一系列设计原型中,我想与大家分享一种计算方向:将信息投射到现实世界中以增强其功能,而不是将其局限在小小的矩形屏幕内,或者更糟糕的是,通过佩戴在我们脸上的设备来传输信息。
I call this vision the Lightbulb Computer: a device that combines a projector with computer vision, in the shape of a large lightbulb.
我将这一愿景称为“灯泡电脑”:一种将投影仪与计算机视觉相结合的设备,其外形就像一个大灯泡。
The lightbulb form factor means it can easily be mounted in a small portable lamp-like base to carry it around the house; or screwed into any wall or ceiling Edison socket, for a room-scale permanent setup.
灯泡的外形意味着它可以轻松安装在便携式灯座上,在家中随处携带;或者旋入任何墙壁或天花板的爱迪生灯座中,实现房间级的永久安装。
The Lightbulb Computer reacts to voice commands; sees where you point; can analyze what it sees; and can project content and highlight things in the real world.
“灯泡电脑”能够响应语音指令;识别你的指向;分析它所看到的内容;并能在现实世界中投射内容和高亮显示物体。
Here are some things you can do with this device:
以下是你可以用该设备做的一些事情:
In the kitchen, you can pin widgets like recipes and timers, or overlays to help with mise en place, on various surfaces:
在厨房里,你可以将食谱、计时器等小部件,或辅助备餐的覆盖层固定在各种表面上:
It’s a much more natural way to get things done, especially with wet hands, or hands covered in flour. You don’t have to unlock your phone, dealing with a tiny screen full of notifications and distractions.
这是一种更自然的工作方式,尤其是在手湿或沾满面粉时。你无需解锁手机,也不必面对充满通知和干扰的小屏幕。
When studying or reading, you can ask questions about the content:
在学习或阅读时,你可以针对内容提出问题:
You get the answer right there, without having to pull out your phone, and potentially get distracted by something else.
你可以直接获得答案,而无需掏出手机,从而避免被其他事物分心。
When planning a trip with someone, rather than huddling around a phone, you get a giant map to look at things together, with basic gestures to pan & scroll the map; you can toggle transit overlays, and check out all the sights you want to see.
当与他人规划旅行时,与其围着手机看,不如使用巨大的地图共同查看,通过基本手势平移和滚动地图;你可以切换交通覆盖层,查看所有你想去的景点。
Of course you’re still free to use your phone if you want to look up something that requires typing or more complex interactions, but it’s just a much more convivial experience to be looking at a big map together like that.
当然,如果你需要查找需要输入或进行更复杂交互的内容,依然可以使用手机,但像这样一起看大地图的体验要愉快得多。
Similarly you can send photos over from your phone and have them projected on any surface.
同样,你可以将手机里的照片发送出来,并投射到任何表面上。
It’s a much nicer way to look at photos together. I think these sorts of social interactions really shine with the Lightbulb Computer.
这是一种共同欣赏照片的更好方式。我认为这种社交互动在“灯泡电脑”上表现得尤为出色。
You might even play board games - perhaps less fun than with a physical board game, but much quicker to set up, with nothing to tidy after, or worry about kids or cats knocking over tokens.
你甚至可以玩棋盘游戏——虽然可能不如实体棋盘游戏有趣,但设置速度快得多,事后无需清理,也不用担心孩子或猫弄翻棋子。
Interacting with smart home devices also becomes much more fluid - you can just point to control them.
与智能家居设备的交互也变得更加流畅——你只需指向它们即可进行控制。
If you have more than a few smart home devices, you know it’s impossible to remember their specific names, but the Lightbulb Computer can just see what you’re pointing at, and make those interactions much more natural.
如果你拥有多个智能家居设备,你就会知道记住它们的名字是不可能的,但“灯泡电脑”可以直接识别你指向的目标,使交互更加自然。
You could also use the Lightbulb Computer to have an ambient display - for example next to your bed, showing the time, your alarm clock, the weather or calendar for the next day - again all without having to stare at a screen.
你还可以将“灯泡电脑”用作环境显示器——例如放在床边,显示时间、闹钟、天气或第二天的日程安排——同样无需盯着屏幕看。
A shared family board can live in the hallway, where everyone can see it at a glance; items can be checked off just by tapping. What’s really nice about this is that it just blends into your environment, and isn’t another screen in your house.
一个共享的家庭公告板可以放在走廊里,每个人都能一目了然;只需点击即可勾选事项。它的妙处在于它能融入你的环境,而不是家里又多了一个屏幕。
Modern vision models can read information in the world in milliseconds, much faster than we can; it’d take me at least a few minutes to go through all the books on these shelves, or I can just ask:
现代视觉模型可以在几毫秒内读取世界上的信息,速度远超人类;我可能需要几分钟才能看完书架上的所有书,或者我可以直接询问:
Other physical objects in the house can also be augmented by the Lightbulb Computer.
家中的其他实体物体也可以通过“灯泡电脑”得到增强。
This beautiful 3D map of the area around my house can be overlaid with the weather, or customizable, time specific information, like conditions at my favorite ski stations during the winter:
这张我家周围美丽的 3D 地图可以叠加天气信息,或可定制的、特定时间的信息,例如冬季我最喜欢的滑雪站的情况:
It can also make the map interactive: I can ask it to highlight the location of a little mountain village I forgot the whereabouts of.
它还能使地图具有交互性:我可以要求它高亮显示我忘记位置的一个小山村。
All the videos shown here are from a real - yet bulky - prototype setup. No video editing or special effects, or AI generation.
这里展示的所有视频都来自一个真实但笨重的原型装置。没有视频剪辑、特效或人工智能生成。
And while I don’t think the technology is quite there yet to build a consumer version of this Lightbulb Computer today, I also don’t think we’re too far off.
虽然我认为目前的技术还不足以制造出“灯泡电脑”的消费版本,但我认为我们离这一目标并不遥远。
Computer vision has improved tremendously recently; and projector technology is steadily advancing, with bright, high resolution, small footprint projectors now being a reality.
计算机视觉近期取得了巨大进步;投影技术也在稳步发展,明亮、高分辨率、小尺寸的投影仪现已成为现实。
User privacy would naturally have to be a first-order consideration for such a device; that can be addressed through existing best practices like on-device processing, hardware guardrails against unauthorized camera access (camera only turns on when activated by the user, with a hard-wired indicator light; physical cover; etc.), and so on.
对于此类设备,用户隐私自然必须是首要考虑因素;这可以通过现有的最佳实践来解决,例如设备端处理、防止未经授权访问摄像头的硬件防护(摄像头仅在用户激活时开启,并配有硬连线指示灯;物理遮盖等)等等。
I think in light of the alternatives that the industry is pushing right now, it’s a path for the future of computing really worth pursuing.
我认为,考虑到目前行业正在推动的其他替代方案,这是一条非常值得追求的计算未来之路。
Today we have two very distinct ways of interacting with information.
今天,我们有两种截然不同的信息交互方式。
On one hand we have the physical objects that we’ve had for centuries: books, maps, printed pictures, physical tools; on the other, we have computing devices: laptops, phones, tablets - in short, screens.
一方面是我们沿用了几个世纪的实体对象:书籍、地图、印刷图片、物理工具;另一方面是计算设备:笔记本电脑、手机、平板电脑——简而言之,屏幕。
Recently screen-based computing has attracted a lot of criticism: for being addictive; for being antisocial; for offering us a very reductive view of the world. When we’re interacting with a screen, we’re not really interacting with the broader physical world: we’re limited to a small pane of glass, that encourages us to ignore what’s around us.
最近,基于屏幕的计算受到了很多批评:因为它容易让人上瘾;因为它具有反社交性;因为它为我们提供了一种非常简化的世界观。当我们与屏幕交互时,我们并没有真正与更广阔的物理世界互动:我们被局限在一小块玻璃后面,这促使我们忽略了周围的一切。
There’s been a new vision for computing, that I will call “eyewear-based computing”. It also gets called Virtual Reality; Mixed Reality; Augmented Reality; and more.
出现了一种新的计算愿景,我称之为“眼镜式计算”。它也被称为虚拟现实、混合现实、增强现实等。
Fundamentally, it all involves putting something on your face, in front of your
从根本上说,这一切都涉及将某种东西戴在你的脸上,放在你的……