The shock of seeing your body used in deepfake porn 

The shock of seeing your body used in deepfake porn

看到自己的身体被用于深度伪造色情内容的震惊

When Jennifer got a job doing research for a nonprofit in 2023, she ran her new professional headshot through a facial recognition program. She wanted to see if the tech would pull up the porn videos she’d made more than 10 years before, when she was in her early 20s. 2023年,当詹妮弗(Jennifer)在一家非营利组织找到一份研究工作时,她将自己新的职业头像放进了一个人脸识别程序中。她想看看这项技术是否会搜出她十多年前、也就是她20岁出头时拍摄的色情视频。

It did in fact return some of that content, and also something alarming that she’d never seen before: one of her old videos, but with someone else’s face on her body. “At first, I thought it was just a different person,” says Jennifer, who is being identified by a pseudonym to protect her privacy. But then she recognized a distinctly garish background from a video she’d shot around 2013, and she realized: “Somebody used me in a deepfake.” 结果确实搜出了一些当年的内容,但也出现了一些她从未见过的惊人画面:那是她的一段旧视频,但身体上却换成了别人的脸。“起初,我以为那只是另一个人,”詹妮弗说(为保护隐私,此处使用化名)。但随后,她认出了视频中那个极其俗气的背景,那是她2013年左右拍摄的视频,她意识到:“有人把我做成了深度伪造(deepfake)。”

Eerily, the facial recognition tech had identified her because the image still contained some of Jennifer’s features—her cheekbones, her brow, the shape of her chin. “It’s like I’m wearing somebody else’s face like a mask,” she says. 令人毛骨悚然的是,人脸识别技术之所以能识别出她,是因为图像中仍然保留了詹妮弗的一些特征——她的颧骨、眉毛和下巴的形状。“这感觉就像我戴着别人的脸当面具一样,”她说。

Conversations about sexualized deepfakes—which fall under the umbrella of nonconsensual intimate imagery, or NCII—most often center on the people whose faces are featured doing something they didn’t really do or on bodies that aren’t really theirs. These are often popular celebrities, though over the past few years more people (mostly women and sometimes youths) have been targeted, sparking alarm, fear, and even legislation. 关于性化深度伪造(属于非自愿私密影像,即NCII的范畴)的讨论,通常集中在那些被“换脸”的人身上,即他们被展示在做着自己从未做过的事,或者出现在不属于他们的身体上。这些人通常是知名名人,尽管在过去几年里,更多普通人(主要是女性,有时也包括青少年)成为了目标,引发了恐慌、恐惧,甚至促成了相关立法。

But these discussions and societal responses usually are not concerned with the bodies the faces are attached to in these images and videos. As Jennifer, now 37 and a psychotherapist working in New York City, says: “There’s never any discussion about Whose body is this?” 然而,这些讨论和社会反应通常并不关心这些图像和视频中,那些被“换脸”的身体究竟属于谁。正如现年37岁、在纽约市担任心理治疗师的詹妮弗所说:“从来没有人讨论过:‘这具身体是谁的?’”

For years, the answer has generally been adult content creators. Deepfakes in fact earned their name back in November 2017, when someone with the Reddit username “deepfakes” uploaded videos showing faces of stars like Scarlett Johansson and Gal Gadot pasted onto porn actors’ bodies. 多年来,答案通常指向成人内容创作者。事实上,“深度伪造”(deepfakes)这个名字源于2017年11月,当时一位Reddit用户名为“deepfakes”的人上传了一些视频,展示了斯嘉丽·约翰逊(Scarlett Johansson)和盖尔·加朵(Gal Gadot)等明星的脸被贴在色情演员身体上的画面。

The nonconsensual use of their bodies “happens all the time” in deepfakes, says Corey Silverstein, an attorney specializing in the adult industry. But more recently, as generative AI has improved, and as “nudify” apps have begun to proliferate, the issue has grown far more complicated—and, arguably, more dangerous for creators’ futures. 专门从事成人行业法律事务的律师科里·西尔弗斯坦(Corey Silverstein)表示,在深度伪造中,非自愿使用他人身体的情况“时有发生”。但最近,随着生成式人工智能的进步以及“一键脱衣”(nudify)应用的泛滥,这个问题变得更加复杂,对于创作者的未来而言,可以说也更加危险。

Porn actors’ bodies aren’t necessarily being taken directly from sexual images and videos anymore, or at least not in an identifiable way. Instead, they are inevitably being used as training data to inform how new AI-generated bodies look, move, and perform. This threatens the livelihood and rights of porn actors as their work is used to train AI nudes that in turn could take away their business. 色情演员的身体不再一定直接取自性图像和视频,至少不再以可识别的方式被直接使用。相反,它们不可避免地被用作训练数据,以指导AI生成的新身体如何外观、移动和表演。这威胁到了色情演员的生计和权利,因为他们的作品被用来训练AI裸体模型,而这些模型反过来可能会抢走他们的生意。

And that’s not all: Advancements in AI have also made it possible for people to wholly re-create these performers’ likenesses without their consent, and the AI copycats may do things the performers wouldn’t do in real life. This could mean their digital doubles are participating in certain sex acts that they haven’t agreed to do, or even that they’re perpetrating scams against fans. 不仅如此,人工智能的进步还使得人们可以在未经许可的情况下完全重现这些表演者的肖像,而这些AI仿制品可能会做出表演者在现实生活中绝不会做的事情。这意味着他们的数字替身可能参与了他们未曾同意的某些性行为,甚至可能利用他们的形象对粉丝进行诈骗。

Adult content creators are already marginalized by a society that largely fails to protect their safety and rights, and these developments put them in an even more vulnerable position. 成人内容创作者本就处于社会边缘,而社会在很大程度上未能保护他们的安全和权利,这些技术的发展使他们处于更加脆弱的境地。

After Jennifer found the deepfake featuring her body, she posted on social media about the psychological effects: “I’ve never seen anyone ask whether that might be traumatic for the person whose body was used without consent too. IT IS!” 在詹妮弗发现那段使用她身体的深度伪造视频后,她在社交媒体上发文谈到了心理影响:“我从未见过有人问过,对于那些身体在未经同意的情况下被使用的人来说,这是否也是一种创伤。答案是肯定的!”

Several other creators I spoke with shared the mental toll that comes with knowing their bodies have been used nonconsensually, as well as the fear that they’ll suffer financially as other people pirate their work. Silverstein says he hears from adult actors every day who “are concerned that their content is being exploited via AI, and they’re trying to figure out how to protect it.” 我采访的其他几位创作者也分享了得知自己的身体被非自愿使用后所承受的心理压力,以及担心他人盗版其作品会导致经济损失的恐惧。西尔弗斯坦说,他每天都会收到成人演员的咨询,他们“担心自己的内容被AI利用,并试图找出保护这些内容的方法”。

One law professor and expert in violence against women calls these creators the “forgotten victims” of NCII deepfakes. And several of the people I spoke with worry that as the US develops a legal framework to combat nonconsensual sexual content online, adult actors are only at risk of further injury; instead of helping them, the crackdown on deepfakes may provide a loophole through which their content and careers could be stripped from the internet altogether. 一位法学教授兼反针对女性暴力专家将这些创作者称为NCII深度伪造的“被遗忘的受害者”。我采访的几个人担心,随着美国制定打击网络非自愿性内容的法律框架,成人演员反而面临进一步受损的风险;打击深度伪造不仅不能帮助他们,反而可能提供一个漏洞,导致他们的内容和职业生涯被彻底从互联网上抹去。

How deepfakes cause “embodied harms”

深度伪造如何造成“身体伤害”

During his preteen years in the 1970s, Spike Irons, now a porn actor and president of the adult content platform XChatFans, was “in love” with Farrah Fawcett. Though Fawcett did not pose nude, Jones managed to get his hands on what looked like pictures of her naked. “People were cutting out faces and pasting them on bodies,” Irons says. “Deepfakes, before AI, had been going around for quite a while. They just weren’t as prolific.” 在20世纪70年代的少年时期,现为色情演员及成人内容平台XChatFans总裁的斯派克·艾恩斯(Spike Irons)曾“迷恋”法拉·福塞特(Farrah Fawcett)。尽管福塞特从未拍摄过裸照,但艾恩斯还是设法弄到了看起来像是她裸体的照片。“当时人们会剪下脸部,然后贴到其他身体上,”艾恩斯说。“在AI出现之前,深度伪造就已经存在很久了。只是当时没有现在这么泛滥。”

The early public internet was rife with websites capitalizing on the idea that you could use technology to “see” celebrities naked. “People would just use Microsoft Paint,” says Silverstein, the attorney. It was a simple way to mash up celebrities’ faces with porn. People later used software like Adobe After Effects or FakeApp, which was designed to swap two individuals’ faces in images or videos. 早期的公共互联网上充斥着各种网站,利用人们想通过技术“看”名人裸体的心理来牟利。“人们当时只会用微软画图(Microsoft Paint),”律师西尔弗斯坦说。这是一种将名人脸部与色情内容拼凑在一起的简单方法。后来,人们开始使用Adobe After Effects或FakeApp等软件,这些软件专门用于在图像或视频中交换两个人的脸部。

None of these programs required serious expertise to alter content, so there was a low barrier to entry. That, plus the wealth of porn performers’ videos online, helped make face-swap deepfakes that used real bodies prevalent by the 2010s. 这些程序都不需要高深的专业知识就能修改内容,因此准入门槛很低。再加上网上有大量的色情表演者视频,使得使用真实身体的换脸深度伪造在2010年代变得非常普遍。

When, later in the decade, deepfakes of Gal Gadot and Emma Watson caused something of a broader panic, their faces were allegedly swapped onto the bodies of the porn actors Pepper XO and Mary Moody, respectively. But it wasn’t just high-profile actors like them whose bodies were being used. Jennifer was “a very minor performer,” she says. “If it happened to me, I feel like it could happen to anybody who’s shot porn.” Since he started his practice in 2006, Silverstein says, “numerous clients” h… 在该年代后期,当盖尔·加朵和艾玛·沃特森(Emma Watson)的深度伪造视频引发了更广泛的恐慌时,她们的脸据称分别被换到了色情演员Pepper XO和Mary Moody的身体上。但不仅仅是像她们这样知名度高的演员的身体被使用。詹妮弗说,她只是“一个非常小的表演者”。“如果这种事发生在我身上,我觉得任何拍过色情片的人都可能遭遇同样的事。”西尔弗斯坦说,自2006年开业以来,他已经接待了“无数客户”……