Lawyer fined $5K over AI-hallucinated witnesses in a murder case

Lawyer fined $5K over AI-hallucinated witnesses in a murder case

因在谋杀案中使用 AI 虚构证人,律师被罚款 5000 美元

New Mexico’s Supreme Court is punishing a lawyer for including AI-fabricated witnesses and fake police testimony in an appeal for his client’s murder conviction, according to a report from Reuters. In a filing on Wednesday, the court fined Stephen Aarons $5,000 and held him in contempt for failing to “verify the factual claims and legal authority in his AI-generated brief.”

据路透社报道,新墨西哥州最高法院正在对一名律师进行处罚,原因是他为客户的谋杀罪定罪进行上诉时,在文件中包含了 AI 虚构的证人和伪造的警方证词。在周三提交的一份文件中,法院对斯蒂芬·阿伦斯(Stephen Aarons)处以 5000 美元罚款,并以其未能“核实 AI 生成摘要中的事实主张和法律依据”为由,裁定其藐视法庭。

The filing says the brief “contained false testimony from wholly fabricated witnesses,” along with “false testimony” about the shooter’s clothing and appearance. Justice C. Shannon Bacon questioned how Aarons wasn’t aware of the risks posed by AI during an August hearing, where he admitted to using ChatGPT and thinking it would generate a “bulletproof summary” of the trial.

文件指出,该摘要“包含了来自完全虚构证人的虚假证词”,以及关于枪手衣着和外貌的“虚假证词”。在八月份的一次听证会上,法官 C. 香农·培根(C. Shannon Bacon)质问阿伦斯为何没有意识到 AI 带来的风险。阿伦斯当时承认使用了 ChatGPT,并认为它能生成一份“无懈可击的”庭审摘要。

“Counsel, do you watch the news? Do you listen to the radio? Do you read anything about what’s going on in the world?” Justice Bacon said, according to Reuters. “Because the problem with lawyers relying on AI hallucinations is an above-the-fold story every single day.”

据路透社报道,培根法官当时说道:“律师,你看新闻吗?你听广播吗?你读过关于世界上正在发生的事情的任何报道吗?因为律师依赖 AI 幻觉的问题每天都占据着新闻头条。”

With the number of lawyers using AI tools in their work increasing, so are the instances in which a court discovers citations that are fabricated — or hallucinated — by AI. Last year, a judge slammed two law firms for submitting a brief with “numerous false, inaccurate, and misleading legal citations and quotations,” while lawyers for MyPillow’s Mike Lindell were also fined for putting AI-generated misquotes and fake AI citations in a brief.

随着在工作中利用 AI 工具的律师人数增加,法院发现 AI 伪造(或产生幻觉)引用的案例也随之增多。去年,一位法官严厉批评了两家律师事务所,因为他们提交的摘要中包含“大量虚假、不准确和误导性的法律引用及引文”;MyPillow 公司迈克·林德尔(Mike Lindell)的律师也因在摘要中放入 AI 生成的错误引文和虚假 AI 引用而被罚款。

“I am remorseful but hopeful that the disciplinary board takes into account it was an honest mistake,” Aarons says in a statement to Reuters.

阿伦斯在给路透社的一份声明中表示:“我感到很懊悔,但希望纪律委员会能考虑到这只是一个无心之失。”