They Dedicated Their Lives to Teaching. Then the Deepfakes Started
They Dedicated Their Lives to Teaching. Then the Deepfakes Started
他们毕生致力于教育事业,直到深度伪造(Deepfakes)开始出现
For Luis DeSantiago, a substitute teacher in Los Banos, California, it started with a few text messages. On March 12, as he was working his other part-time job at a coffee shop, his phone lit up. A fellow barista said there was an AI photo circulating on social media. Her cousin wanted to know if it was DeSantiago. 对于加利福尼亚州洛斯巴诺斯的代课老师路易斯·德圣地亚哥(Luis DeSantiago)来说,这一切始于几条短信。3月12日,当他在咖啡店做另一份兼职时,手机亮了起来。一位同事告诉他,社交媒体上流传着一张人工智能生成的照片,她的表亲想确认那是不是德圣地亚哥本人。
At first, DeSantiago wasn’t worried—he figured that inappropriate photos violated TikTok’s community guidelines and were usually quickly removed. 起初,德圣地亚哥并没有太担心——他认为不当照片违反了TikTok的社区准则,通常会被迅速删除。
“When I finally saw the image, that’s when it felt like a punch to the gut,” DeSantiago tells WIRED. Parts of it resembled a mirror selfie that he remembered taking at a job in college. But instead of his work uniform, he was wearing lingerie. And instead of standing normally, as he had been in the original photo, he was posing suggestive. “当我最终看到那张照片时,感觉就像被人重重地打了一拳,”德圣地亚哥告诉《连线》(WIRED)杂志。照片的部分内容看起来像他记得在大学打工时拍的一张对镜自拍。但照片里的他穿的不是工作制服,而是内衣;而且他摆出的姿势极具挑逗性,与原图中的正常站姿完全不同。
The texts kicked off a monthslong saga that crossed two schools and involved students and administrators. And DeSantiago is far from the only educator who’s been victimized this way. 这些短信引发了一场持续数月的风波,波及了两所学校,涉及多名学生和行政人员。而德圣地亚哥绝非唯一遭受此类侵害的教育工作者。
WIRED spoke with three other teachers who allege that their students made sexualized photos and videos of them, likely using AI. They say the incidents have been profoundly distressing and disappointing—and in some cases, it’s led them to reassess how they view their work and their relationships with their students. 《连线》采访了另外三位教师,他们声称学生利用人工智能制作了关于他们的色情照片和视频。他们表示,这些事件让他们感到极度痛苦和失望,在某些情况下,这甚至导致他们重新审视自己的工作以及与学生之间的关系。
“This Could Include Other Students”
“这可能还涉及其他学生”
After he received the texts, DeSantiago began to piece together who might have been behind the image. One account that shared it used their real name in their TikTok profile—it was a student DeSantiago knew from the local middle school, where he regularly filled in. DeSantiago suspected the involvement of two other students based on people who followed and interacted with that account, and his knowledge of student friend groups. He was scheduled to work at that very middle school the next day. 收到短信后,德圣地亚哥开始拼凑幕后黑手。其中一个分享该照片的账号在TikTok个人资料中使用了真实姓名——那是德圣地亚哥在当地一所中学认识的学生,他经常在那里代课。根据关注和与该账号互动的人员,以及他对学生朋友圈的了解,德圣地亚哥怀疑还有另外两名学生参与其中。而他第二天正好被安排在那所中学工作。
DeSantiago reported the incident to the assistant principal, who assured him that the school would “take care of it.” Later that evening, he decided to look for the image by searching his name on TikTok. He discovered that a different student had created an account impersonating him—it used his name, slightly misspelled, and had the same photo as their profile picture. 德圣地亚哥向副校长报告了此事,副校长向他保证学校会“处理好”。那天晚上晚些时候,他决定在TikTok上搜索自己的名字来寻找那张照片。他发现另一名学生创建了一个冒充他的账号——使用了他的名字(拼写略有改动),并将那张照片设为头像。
Over the next few weeks, DeSantiago says, he went back and forth with school administrators, the parents of the students, and even the police. 在接下来的几周里,德圣地亚哥说,他不断与学校管理人员、学生家长甚至警方进行沟通。
“If these students aren’t afraid of generating and posting these images of me, I am concerned of what they may be circulating privately through text messages and group chats,” DeSantiago wrote to the principal. “Keep in mind this could include other students as well.” “如果这些学生连生成并发布我的这些照片都不害怕,我很担心他们可能正在通过短信和群聊私下传播什么内容,”德圣地亚哥在写给校长的信中说。“请记住,这可能还涉及其他学生。”
One student, who admitted to creating the image, was disciplined with in-school suspension. DeSantiago was later told that the image was also shared on Snapchat. But DeSantiago says the image continued to proliferate, and other students began posting it. He says he also received several crude, sexual comments on his TikTok account. 一名承认制作了该照片的学生受到了校内停课的处分。德圣地亚哥后来被告知,这张照片也被分享到了Snapchat上。但德圣地亚哥表示,照片仍在继续传播,其他学生也开始发布它。他说,他的TikTok账号还收到了几条粗俗的性骚扰评论。
DeSantiago told administrators he didn’t want to take assignments at the middle school “until this matter is fully addressed.” The district did not respond to WIRED’s request for comment. 德圣地亚哥告诉管理人员,在“此事得到彻底解决之前”,他不想再接受该中学的代课任务。学区没有回应《连线》的置评请求。
He took a substitute assignment at the local high school, but the problems followed him. During one class, he received an AirDropped photo of the same AI-generated image before it was quickly revoked. He could tell it was circulating among the class. 他转而接受了当地高中的代课任务,但问题依然如影随形。在一次课上,他收到了一张通过AirDrop发送的同一张AI生成照片,随后该照片被迅速撤回。他能感觉到这张照片正在班级里流传。
The principal told him the school was launching an “immediate investigation” and offered to meet with DeSantiago or make the school counselor available, but DeSantiago says he probably won’t return to the district this year. He tells WIRED that, at least right now, he doesn’t feel safe doing so. 校长告诉他,学校正在展开“立即调查”,并提出与德圣地亚哥会面或安排学校辅导员提供帮助,但德圣地亚哥表示,他今年可能不会再回到该学区工作。他告诉《连线》,至少在目前,他觉得这样做并不安全。
“It Makes You Question Everything”
“这让你质疑一切”
When fake nude images of nonconsenting adults are disseminated, it could constitute cyberstalking and violate the federal Take It Down Act, which makes it a crime to publish nonconsensual “intimate visual depictions of individuals, both authentic and computer-generated,” on the internet. 当未经同意的成年人虚假裸照被传播时,这可能构成网络跟踪,并违反联邦《删除法案》(Take It Down Act)。该法案规定,在互联网上发布未经同意的“个人亲密视觉描绘”(无论是真实的还是计算机生成的)属于犯罪行为。
In most of the accounts shared with WIRED, the teachers didn’t directly report the content to the platforms on which it appeared. Snap spokesperson Monique Bellamy shared the company’s policies on harassment and sexual content, which prohibit sharing AI-generated or manipulated content to humiliate or sexually harass others. She told WIRED that the company has “established processes” for reporting such content, and that it continues to “develop features and tools designed to support the safety, privacy, and well-being of our community.” TikTok did not provide comment before publication. 在《连线》获悉的大多数案例中,教师们并没有直接向发布内容的平台举报。Snap发言人莫妮克·贝拉米(Monique Bellamy)分享了该公司关于骚扰和色情内容的政策,禁止分享旨在羞辱或性骚扰他人的AI生成或篡改内容。她告诉《连线》,公司有举报此类内容的“既定流程”,并持续“开发旨在支持社区安全、隐私和福祉的功能与工具”。TikTok在截稿前未予置评。
Donna Ballman, a retired employment advocacy lawyer, tells WIRED that if a student creates and shares sexual images of a teacher, it constitutes a “clear case” of sexual harassment in the workplace. 已退休的就业权益律师唐娜·鲍尔曼(Donna Ballman)告诉《连线》,如果学生制作并分享教师的色情照片,这构成了职场性骚扰的“明确案例”。
Ballman says that under federal antidiscrimination laws, employers have an obligation to create a workplace free of sexual harassment. In a school, this could mean disciplining the student or moving them to a different classroom. She adds, however, that there’s “no blueprint” for how schools need to respond to these incidents. Administrators don’t even have to tell a victimized teacher how a student may have been disciplined. 鲍尔曼表示,根据联邦反歧视法,雇主有义务创造一个没有性骚扰的工作环境。在学校里,这意味着要处分学生或将其调至其他班级。然而她补充说,对于学校应如何应对这些事件,目前“没有蓝图”。行政人员甚至不必告知受害教师学生受到了何种处分。
“They just have to make [and] create a safe environment for the victim,” Ballman says. “他们只需要为受害者创造一个安全的环境,”鲍尔曼说。
One middle school teacher in her mid-twenties tells WIRED that she’s seen so much AI-generated content used to harass teachers that she’s bracing for the next wave. (She requested anonymity because she did not have permission from her school district to speak about her experience.) 一位二十多岁的中学教师告诉《连线》,她已经看到太多利用AI生成内容骚扰教师的案例,以至于她正在为下一波浪潮做准备。(她要求匿名,因为她未获得所在学区的许可来谈论自己的经历。)
Last year, she says, students found public photos of a teacher in her sixties, manipulated them to make it appear that she was committing sex acts, and shared them with each other in a Snapchat group chat. 她说,去年,学生们找到了一位六十多岁教师的公开照片,对其进行篡改,使其看起来像是在进行性行为,并在Snapchat群聊中互相分享。
A few months ago, the teacher says, she learned from a student about a TikTok account impersonating her. It looked AI-generated—her face had the characteristic smoothness of… 这位老师说,几个月前,她从一名学生那里得知有一个TikTok账号在冒充她。那看起来像是AI生成的——她的脸有着那种典型的平滑感……