Australian lawyer confesses using ChatGPT to create court filings
An Australian lawyer was referred to the Office of the NSW Legal Services Commissioner after admitting to using ChatGPT to create court filings containing nonexistent case citations for an immigration case - one of many instances of lawyers quietly using chatbots to cut costs and increase margins. What happened An unnamed lawyer submitted documents to the Federal Circuit and Family Court of Australia that included case references and quotes fabricated - aka "hallucinated" - by ChatGPT, resulting in wasted court time as officials attempted to locate the non-existent cases. The incident caused delays in the proceedings and required additional timetabling to allow for proper filing of amended documents. Why it happened The lawyer cited time constraints and health issues as reasons for relying on ChatGPT to generate a summary of cases without verifying the information's accuracy. Their decision appeared to stem from a lack of understanding of the limitations of the chatbot and its technology, and of its proper use in legal practice. What it means The fracas saw the client's case compromised, potentially affecting its outcome. In addition, the court experienced unnecessary delays wasted resources, and cost. The lawyer faces potential disciplinary action and damage to his professional reputation. More broadly, the incident highlights the need for clear guidelines and training on the use of AI in the legal profession, and emphasises the importance of maintaining human oversight and verification in AI-assisted legal work. System 🤖 ChatGPT Developer: OpenAI Country: Australia Sector: Business/p rofessional services Purpose: Gen erate legal case citations Technology: Chatbot; Generative AI; Machine learning Issue: Accuracy/reliability; Mis/disinformation
- Date it happened
- 2024-10-01
- Product, system or model
- ChatGPT
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.