South African magistrate cautions against blind trust in AI after ChatGPT generates fictitious case law
In a defamation case in Johannesburg, lawyers for plaintiff Michelle Parker used ChatGPT to find supporting judgments, but the cases turned out to be entirely fictitious, generated by the AI's hallucination. The opposing counsel and law librarians could not locate the cited judgments, leading to the discovery that they were fabricated. The magistrate found no intent to mislead but ordered Parker to pay punitive costs, warning against relying on AI without verification.
- AI system
- ChatGPT