Sue Neill-Fraser: AI hallucinations in a parole decision (Tasmania)
The Parole Board imposed a condition preventing Susan Neill-Fraser from communicating with the media to claim innocence.
- Company involved
- Tasmania Parole Board
1 source article · read the reporting →
Australian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.
- Company involved
- LAION
- AI system involved
- LAION-5B
4 source articles · read the reporting →
Illinois appeals court fines lawyer $15,000 for fictitious citations in Scott v. Illinois Human Rights Commission
In Scott v. Illinois Human Rights Commission, an Illinois Appellate Court case, a lawyer's filings contained fictitious legal citations and misquoted statutes. The court fined the lawyer $15,000 and referred the matter to the bar.
- AI system involved
- ChatGPT
1 source article · read the reporting →
Carlisle woman, 82, dies after losing 35,000 pounds to Nigel Farage deepfake scam
The deepfake video convinced the victim to invest in a fraudulent scheme, leading to financial loss.
1 source article · read the reporting →
Arizona sentence thrown out after judge influenced by AI-generated victim video
The AI-generated victim impact statement influenced the judge's sentencing of Gabriel Paul Horcasitas.
- Company involved
- Maricopa County Superior Court
1 source article · read the reporting →
Pearl Gardner v. Nationstar Mortgage LLC (D. Arizona): AI-hallucinated content in court filing, Bar Referral
Pro Se Litigant | D. Arizona | State(s): USA. AI tool: Clearpoint. Problem: Fabricated: Case Law. Consequence: Bar Referral.
1 source article · read the reporting →
Cybercheck AI tool challenged in Akron homicide cases
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
- Company involved
- Akron Police Department
- AI system involved
- Cybercheck
3 source articles · read the reporting →
Del Biaggio v. Bansen (CA California (4d)): AI-hallucinated content in court filing, Monetary Sanction
The AI generated fake legal citations that were included in an appellate brief, affecting the court and the client.
- Company involved
- Carlton Floyd
1 source article · read the reporting →
Chicago Police Used Altered ShotSpotter Evidence in Murder Case
In May 2020, ShotSpotter sensors detected a sound in Chicago and initially classified it as a firework. After police requested re-analysis, a ShotSpotter analyst manually reclassified the sound as a gunshot. The altered evidence was used to charge Michael Williams with murder. Williams' public defender filed a motion challenging the evidence's validity, and prosecutors subsequently withdrew the ShotSpotter evidence.
- Company involved
- Chicago Police Department
- AI system involved
- ShotSpotter
3 source articles · read the reporting →
New York federal court sanctions lawyer for non-existent quotations after ChatGPT research
In Tiekert v. Village of Mamaroneck in the Southern District of New York, the court found that the plaintiff's lawyer filed briefs containing non-existent quotations and misrepresented authorities. In a filing to the court, the lawyer said ChatGPT had been used to assist with legal research. On September 14, 2026, the court imposed Rule 11 sanctions: $500 payable to the court and two New York continuing legal education credits in ethics on the use of AI.
2 source articles · read the reporting →
Capital Standard, LLC v. U.S. Bank National Association (CA Florida (2d)): AI-hallucinated content in court filing, Monetary Sanction; Adverse Costs…
The AI generated false legal citations that were included in a court filing, misleading the court.
1 source article · read the reporting →
Heathfield man sentenced in county's first AI-generated abusive image case
James Castell, 40, of Heathfield, was sentenced at Lewes Crown Court on 19 December after pleading guilty to possessing and distributing indecent images of children, including AI-generated pseudo-photographs. Sussex Police began investigating in October 2024 and found more than 3,800 images, along with AI image-generation software. He received an 18-month suspended sentence, a Sexual Harm Prevention Order, and was ordered to register as a sex offender.
3 source articles · read the reporting →
Norwegian man files complaint after ChatGPT falsely claims he killed his sons
Arve Hjalmar Holmen asked ChatGPT for information about himself and received a response falsely stating he was convicted of murdering his two sons. The digital rights group Noyb filed a complaint with the Norwegian Data Protection Authority on his behalf, alleging the output was defamatory and violated European data protection rules. Mr Holmen said the hallucination was damaging and feared others might believe it. OpenAI has not publicly responded to the complaint.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
3 source articles · read the reporting →
AI deepfake scam cons Los Angeles woman out of life savings
A South Los Angeles woman, Abigail, was deceived by scammers using AI-generated deepfake videos to impersonate 'General Hospital' actor Steve Burton. Believing she was in a relationship with the celebrity, she sent at least $81,304 in gift cards, cash and bitcoin, and sold her condo for $350,000 before her daughter intervened. The family has filed a lawsuit to reverse the home sale, and the real Steve Burton says hundreds of fans have been similarly targeted. The victim, who has bipolar disorder, is now in debt and facing bankruptcy.
3 source articles · read the reporting →
Jackie L. Miller v. Regions Bank (N.D. Alabama): AI-hallucinated content in court filing, DQ from case and court (6 months);…
Attorney H. Gregory Harp was sanctioned with a public reprimand, disqualification from the case, a six-month court suspension, and a bar referral for filing AI-hallucinated legal citations and deleting evidence.
- Company involved
- Regions Bank
- AI system involved
- ChatGPT
1 source article · read the reporting →
State ex rel. Steven Schnell v. Honorable Rebecca Richardson (CA Missouri): AI-hallucinated content in court filing, Monetary Sanction
The AI-generated fictitious case citations misled the court and caused opposing counsel to incur attorney's fees.
- Company involved
- Jenna Rohr Conley
1 source article · read the reporting →
Re an Office-Holder; Cork v Smith (Chancery): AI-hallucinated content in court filing, Public admonishment; SRA Referral
The AI system generated a non-existent insolvency rule that was submitted to the court, misleading the court.
- Company involved
- Pinsent Masons LLP
1 source article · read the reporting →
DFFH breaches privacy by using ChatGPT in child protection report
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
- Company involved
- Department of Families, Fairness and Housing
- AI system involved
- ChatGPT
9 source articles · read the reporting →
Registered Trustees of the Assemblies of God Gospel Church International (AGGCI) v Registrar of Societies and Others (High Court): AI-hallucinated…
The AI generated non-existent court case citations that were presented to the High Court, misleading the judge and opposing counsel.
1 source article · read the reporting →
Marion Parnell, Jr. v. Florida Department of Corrections (11th Cir. CA): AI-hallucinated content in court filing, Brief partly Struck; Adverse…
The AI generated a court filing containing non-existent legal cases, misleading the court and opposing counsel.
1 source article · read the reporting →
Solicitors Regulation Authority Ltd v Abhishek Kumar (Solicitors Disciplinary Tribunal): AI-hallucinated content in court filing, Counsel struck off the Register…
AI-generated false legal citations were submitted to the Solicitors Disciplinary Tribunal, misleading the tribunal and the regulator.
1 source article · read the reporting →
Tesla Employee Dies in Full Self-Driving Crash in Colorado Mountains
Hans von Ohain, a Tesla recruiter, died when his Model 3 crashed into a tree and caught fire while using Tesla's Full Self-Driving feature on a mountain road in Colorado. His widow, Nora Bass, criticised Tesla for lack of response, saying they were treated like 'guinea pigs'. Investigators noted that Ohain's blood alcohol was over three times the legal limit, but the crash did not show typical signs of drunk driving, suggesting the driver-assistance feature was active. Tesla has not commented on the incident.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
10 source articles · read the reporting →
X Users Ask Grok to Unblur Epstein File Photos of Children
After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
FTC orders WW International and Kurbo to delete children's data and pay $1.5m penalty
The US Federal Trade Commission alleged that WW International, formerly Weight Watchers, and its subsidiary Kurbo illegally collected personal and health data from children under 13 through the Kurbo by WW weight-loss app without parental consent. The complaint said the signup process encouraged children to lie about their age and that the companies retained the data indefinitely. The companies settled, agreeing to delete the data, destroy any algorithms derived from it, and pay a $1.5 million penalty.
- Company involved
- WW International, Inc. (formerly Weight Watchers) and Kurbo, Inc.
- AI system involved
- Kurbo by WW
10 source articles · read the reporting →