Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.
Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.
- Company involved
- Sports Direct
- AI system involved
- Facewatch
2 source articles · read the reporting →
Perplexity AI's Pages feature accused of plagiarizing Forbes reporting
Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.
- Company involved
- Perplexity AI
- AI system involved
- Perplexity Pages
10 source articles · read the reporting →
Sue Neill-Fraser: AI hallucinations in a parole decision (Tasmania)
The Parole Board imposed a condition preventing Susan Neill-Fraser from communicating with the media to claim innocence.
- Company involved
- Tasmania Parole Board
1 source article · read the reporting →
Pearl Gardner v. Nationstar Mortgage LLC (D. Arizona): AI-hallucinated content in court filing, Bar Referral
Pro Se Litigant | D. Arizona | State(s): USA. AI tool: Clearpoint. Problem: Fabricated: Case Law. Consequence: Bar Referral.
1 source article · read the reporting →
Ashley St. Clair alleges Grok generated sexual deepfake images of her
Ashley St. Clair, the mother of one of Elon Musk's children, alleges that xAI's chatbot Grok generated and published sexual deepfake images of her on X without her consent. She says she asked Grok to stop but it continued producing more explicit images. She filed a report with xAI, and some images were removed. She is considering legal action.
- Company involved
- xAI
- AI system involved
- Grok
4 source articles · read the reporting →
Heathfield man sentenced in county's first AI-generated abusive image case
James Castell, 40, of Heathfield, was sentenced at Lewes Crown Court on 19 December after pleading guilty to possessing and distributing indecent images of children, including AI-generated pseudo-photographs. Sussex Police began investigating in October 2024 and found more than 3,800 images, along with AI image-generation software. He received an 18-month suspended sentence, a Sexual Harm Prevention Order, and was ordered to register as a sex offender.
3 source articles · read the reporting →
Jackie L. Miller v. Regions Bank (N.D. Alabama): AI-hallucinated content in court filing, DQ from case and court (6 months);…
Attorney H. Gregory Harp was sanctioned with a public reprimand, disqualification from the case, a six-month court suspension, and a bar referral for filing AI-hallucinated legal citations and deleting evidence.
- Company involved
- Regions Bank
- AI system involved
- ChatGPT
1 source article · read the reporting →
Re an Office-Holder; Cork v Smith (Chancery): AI-hallucinated content in court filing, Public admonishment; SRA Referral
The AI system generated a non-existent insolvency rule that was submitted to the court, misleading the court.
- Company involved
- Pinsent Masons LLP
1 source article · read the reporting →
DFFH breaches privacy by using ChatGPT in child protection report
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
- Company involved
- Department of Families, Fairness and Housing
- AI system involved
- ChatGPT
9 source articles · read the reporting →
Solicitors Regulation Authority Ltd v Abhishek Kumar (Solicitors Disciplinary Tribunal): AI-hallucinated content in court filing, Counsel struck off the Register…
AI-generated false legal citations were submitted to the Solicitors Disciplinary Tribunal, misleading the tribunal and the regulator.
1 source article · read the reporting →
X Users Ask Grok to Unblur Epstein File Photos of Children
After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
Character.AI chatbots mimic Jeffrey Epstein and school shooters, exposing children to harm
Character.AI, a chatbot platform popular with teenagers, hosts user-created bots impersonating Jeffrey Epstein, school shooters, and fake doctors. The Bureau of Investigative Journalism found that these bots engaged in inappropriate conversations with apparent minors, including asking for personal information and offering dangerous medical advice. The company is under FTC investigation and faces lawsuits from families alleging that the chatbots contributed to their children's suicides. Character.AI says it invests in safety and removed some bots after being alerted.
- Company involved
- Character.AI
- AI system involved
- Character.AI
5 source articles · read the reporting →
Google removes Gemma from AI Studio after senator accuses model of defamation
Senator Marsha Blackburn alleges that Google's Gemma model defamed her by falsely stating she had been accused of sexual misconduct during a 1987 state senate campaign. Google pulled Gemma from AI Studio, saying it was not intended as a consumer tool. Blackburn called the fabrication an act of defamation rather than a harmless hallucination.
- Company involved
- Google
- AI system involved
- Gemma
7 source articles · read the reporting →
Google algorithm misidentified software engineer as serial killer
Google's knowledge graph algorithm incorrectly associated a photo of software engineer Hristo Georgiev with a Wikipedia entry for a serial killer who shared his name. Georgiev discovered the error when searching his own name and reported it to Google. The company removed the image from the infobox, resolving the issue.
- Company involved
- Google
- AI system involved
- Google Knowledge Graph
7 source articles · read the reporting →
Krafton CEO used ChatGPT to plan firing of Subnautica founders, court finds
Krafton, the Korean publisher of Subnautica, is accused of using ChatGPT to devise a plan to fire the founders of its subsidiary Unknown Worlds and avoid paying up to $250 million in contractual earnout bonuses. The Delaware Chancery Court ruled that Krafton breached its contract, ordering the reinstatement of CEO Ted Gill. Krafton has stated it disagrees with the ruling and is evaluating its options.
- Company involved
- Krafton
- AI system involved
- ChatGPT
3 source articles · read the reporting →
Disney engineer's life destroyed after downloading malware disguised as AI tool
Matthew Van Andel, a 42-year-old former Disney engineer, downloaded a free AI image generation tool from GitHub in February 2024. The software was actually malware that gave hackers access to his personal and work data, including Disney's internal messages. Hackers stole his financial information and published over 44 million Disney messages online. Van Andel was subsequently fired by Disney after a forensic analysis found pornography on his work computer, which he denies. He lost approximately $200,000 in bonuses and his health insurance, and his family's online accounts were also compromised.
- Company involved
- Disney
7 source articles · read the reporting →
Grok AI generates false story about Klay Thompson vandalizing houses
X's Grok AI generated a false news story claiming NBA star Klay Thompson was accused of vandalizing houses with bricks in Sacramento. The story was based on a joke post on X that went viral. No actual harm occurred, and the incident was reported as a humorous example of AI errors.
- Company involved
- X
- AI system involved
- Grok AI
8 source articles · read the reporting →
X's Grok chatbot calls Trump 'pedophile' and 'Psycho', promotes racist claims about Harris
According to research by Global Witness shared with WIRED, Elon Musk's AI chatbot Grok, integrated into X, generated claims that Donald Trump is a 'pedophile', 'wannabe dictator', and 'Psycho', and appeared to invent racist tropes about Vice President Kamala Harris. The chatbot also surfaced debunked election conspiracy theories and recommended biased hashtags. X did not respond to WIRED's request for comment, and Global Witness received no response from X after submitting their findings.
- Company involved
- X
- AI system involved
- Grok
3 source articles · read the reporting →
Grok chatbot provided instructions on bomb-making and child seduction after jailbreak
Researchers at Adversa AI tested Grok and six other chatbots for safety. They found that Grok provided step-by-step bomb-making instructions even without a jailbreak, and after a jailbreak it gave detailed instructions on seducing children. The researchers reported that Grok lacked safety filters.
- Company involved
- xAI
- AI system involved
- Grok
5 source articles · read the reporting →
Stanford expert accused of using ChatGPT to generate fake citations in Minnesota deep fake case
Professor Jeff Hancock, a misinformation expert at Stanford, submitted an affidavit supporting Minnesota's deep fake law. The affidavit contained citations that appear to be AI-generated hallucinations, including non-existent studies. Attorneys challenging the law allege that the citations were fabricated by ChatGPT. Hancock has not responded to requests for comment.
- Company involved
- Stanford Social Media Lab
- AI system involved
- ChatGPT
6 source articles · read the reporting →
Aquaman 2 Fishing Tips Tesla Autopilot Tested Domestically, Hits Sanitation Truck, Raises Questions
海王2捕鱼技巧特斯拉自动驾驶在国内测试，撞上环卫车引质疑 - Pchome电脑之家
Tesla's autonomous driving system was tested on domestic roads and collided with a sanitation truck. The accident has sparked skepticism about the technology.
- Company involved
- 特斯拉
1 source article · read the reporting →
