Judge cancels trial after discovering both lawyers used AI — and kicks them off the case
A judge found out that lawyers on both sides of a court case had used AI to write their legal documents. The judge canceled the trial entirely and removed all the lawyers involved. The likely cause: AI-generated fake case citations that don't actually exist.
Lawyers used AI tools like ChatGPT to draft legal filings submitted to the court. The core problem is AI 'hallucination' — when an AI confidently makes up court cases, quotes, or legal rules that do not exist. Judges spot these fabricated citations quickly, and it destroys the credibility of the entire submission.
What makes this case unusual is that both sides did it, not just one. The judge's response was severe: cancel the trial and remove every attorney involved from the case. It's a stark reminder that using AI without carefully checking every fact it produces can end a professional's involvement in a case — and potentially their career.
Key points
- Both opposing lawyers used AI to write court documents — and both got caught.
- The judge canceled the trial and kicked all involved attorneys off the case.
- AI hallucination — inventing fake legal citations — was the likely cause.
- Professionals who use AI output without verifying it face serious consequences.
- The problem isn't using AI; it's trusting AI results without human review.
Quick term guide
- IDE
- A software tool that combines a code editor, a way to run code, and error checking all in one app.
- Citation
- A reference to the original source of information used in a piece of work.
- AI tools
- Software that can help create text, code, images, or other work.
- draft
- A first version of a piece of writing.
- hallucination
- When AI makes something up and presents it as a real answer.
- HAL
- Hardware Abstraction Layer — a software layer that hides differences between environments so other software can work the same way everywhere.
- AI hallucination
- When an artificial intelligence invents false information but presents it as a definite fact.
- Rust
- A programming language known for speed and reliability; OpenAI is rewriting Codex CLI in Rust to improve performance.