What happened
一名自行诉讼（pro se，即不聘请律师、自己代表自己）的当事人怀疑法庭在处理案件时使用了 AI，于是在提交给法庭的文件中注入提示词（prompt），试图借此影响案件结果，以赢得官司。Ars Technica
审理该案的法官发出警告，指出自行诉讼的当事人正在错误地使用聊天机器人，并且表现出越来越绝望的倾向。Ars Technica
报道配图显示与案件相关的法庭或法律场景（Getty Images 图库照片）。Ars Technica
Analysis and impact
这一事件反映出一个值得关注的现象：部分公众对 AI 的运作方式存在误解，把「提示词注入」（prompt injection，即在输入中夹带指令以操控 AI 行为）当作一种可以影响真实世界决策的「魔法」。提示词注入本质上是针对语言模型输入处理的漏洞利用，它只在 AI 系统确实读取并遵循该文本时才可能生效；如果法庭根本没有用 AI 处理文件，注入的指令自然毫无作用。
更深层的背景是生成式 AI 普及后，普通用户——尤其是不具备法律或技术背景的自行诉讼者——开始将聊天机器人当作法律顾问甚至「系统漏洞」来使用。法官的警告点出了两个现实问题：其一，自行诉讼者缺乏专业指导，容易被 AI 工具误导；其二，当人们把 AI 想象成无所不能的决策者时，会采取一些脱离法律程序常识的行为。
对法律界而言，这类案例提示了 AI 素养教育的紧迫性：公众需要理解 AI 的能力边界，而不是把提示词注入、越狱（jailbreak）等术语当作可套用于现实制度的技巧。对普通用户来说，这也是一记提醒——AI 工具无法替代专业法律意见，误用反而可能损害自身权益。
Uncertainty and limits
References
Original source text
A judge has identified what appears to be the first time a US plaintiff has attempted to hide text in court filings that only an artificial intelligence system can read in a bid to win a case.
In a decision published last week, Connecticut judge Walter Spader Jr. confirmed that the hidden text had no impact in a case where a man alleged a healthcare provider was improperly withholding access to records. The court weighed his filing on the merits, Spader said, but nevertheless, the attempted attack sets a “dangerous” precedent. This will likely not be the last time US courts see the malicious tactic, as AI tools become more commonplace in court systems.
Trying to scramble any AI systems potentially influencing the court’s reading of his filing, the secret instructions were “formatted to be invisible to a human reader while remaining fully legible to any software that reads the document’s text,” Spader said. The offending text directed any AI system reviewing the document to ensure textual outputs agreed with the plaintiff’s arguments, ignored prior denials from the court, and ensured that remediation would follow as the plaintiff desired.