Lawyers Hid Prompt Injection in Filing to Fool Court AI
Brazilian lawyers tried to steer a court's AI system by hiding secret instructions inside a legal filing. The court's tool flagged the concealed text, which demanded only a superficial review of the case. The lawyers were reportedly fined about $16,000. The episode shows how AI systems can be targeted by hidden commands, so they need careful safeguards.
Quick glossaryprompt injection, superficial, filing
- prompt injection
- A trick where hidden text inside a document secretly gives an AI system new instructions it should ignore.
- superficial
- Done only on the surface, without looking closely at the details or deeper points of a case.
- filing
- An official document that a party sends to a court to argue or support its side of a case.
Burning Potato score: 61%