Deloitte to refund Australian government after AI-generated report errors
Deloitte used generative AI (Azure OpenAI GPT-4o) to help produce an independent assurance review for Australia's Department of Employment and Workplace Relations. The report, published in July 2025, contained multiple errors including non-existent academic references and a fabricated court case. After the errors were flagged, Deloitte acknowledged the AI use and agreed to refund the final instalment of the A$439,000 contract. The report was corrected, but its substance and recommendations remained unchanged.
- Company involved
- Deloitte
- AI system involved
- Azure OpenAI GPT-4o
5 source articles · read the reporting →
North Korean hackers use ChatGPT to scam LinkedIn users
North Korean state-affiliated hacking group Emerald Sleet (Kimsuky) used OpenAI's ChatGPT to research targets and draft phishing content for scams on LinkedIn. Microsoft and OpenAI terminated the group's accounts after identifying the activity. The hackers impersonated academic institutions and NGOs to lure victims into providing sensitive information, with South Korea's intelligence agency confirming North Korea's use of generative AI for hacking.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
6 source articles · read the reporting →
Texas AG Settles with Pieces Technologies Over Deceptive Healthcare AI Claims
The Texas Attorney General investigated Pieces Technologies, a Dallas-based healthcare AI company, for making false and misleading statements about the accuracy of its generative AI product used in hospitals. The company claimed an error rate of less than 1 per 100,000, but the investigation found these metrics were likely inaccurate. As part of the settlement, Pieces agreed to accurately disclose its product's accuracy and ensure hospital staff understand the appropriate reliance on its AI. The case marks the first-of-its-kind healthcare generative AI investigation by the AG.
- Company involved
- Pieces Technologies
4 source articles · read the reporting →
KPMG drops AI report after false case studies exposed
KPMG removed a global report on AI after multiple case studies were found to be inaccurate and apparently generated from AI hallucinations. The report falsely claimed that UBS, NHS Greater Manchester, Swiss Federal Railways and Transport for London used AI agents in various ways. The companies denied the claims, and KPMG took the report down while reviewing its production.
- Company involved
- KPMG
3 source articles · read the reporting →
Microsoft funded Israeli facial recognition firm surveilling West Bank Palestinians
Microsoft invested in AnyVision, an Israeli facial recognition company whose technology powers a secret military surveillance project in the West Bank. The system, called Better Tomorrow, identifies and tracks Palestinians in live camera feeds. Microsoft said it would audit AnyVision for compliance with its ethical principles.
- Company involved
- Israeli Defense Forces
- AI system involved
- Better Tomorrow
10 source articles · read the reporting →
EEOC sues iTutorGroup for automated rejection of older tutor applicants
The US Equal Employment Opportunity Commission (EEOC) alleges that tutoring provider iTutorGroup programmed its recruitment software automatically to reject female applicants aged 55 or older and male applicants aged 60 or older. More than 200 qualified US-based applicants were denied work in 2020. The EEOC has filed a lawsuit in the Eastern District of New York seeking back pay and damages.
- Company involved
- iTutorGroup
10 source articles · read the reporting →
Walgreens deploys digital cooler doors with ads from Cooler Screens
Walgreens is rolling out digital cooler doors from Cooler Screens that display ads before showing the cooler contents. The system tracks when customers stop in front of the doors but claims to be identity-blind. Customers have expressed confusion and annoyance on social media. Walgreens says the screens provide relevant product information.
- Company involved
- Walgreens
- AI system involved
- Cooler Screens
10 source articles · read the reporting →
Gittemeier v. Liberty Mutual Personal Insurance Company (E.D. Missouri): AI-hallucinated content in court filing, Costs Order + Fine; One Attorney…
The AI system generated fictitious legal citations in a summary judgment motion, misleading the court and opposing counsel.
1 source article · read the reporting →
X bot network used ChatGPT to spread political disinformation in Ghana's election
A network of 171 bot accounts on X is using ChatGPT to generate posts supporting Ghana's incumbent president, Mahamudu Bawumia, and his New Patriotic Party ahead of the December 7, 2024 election. The accounts, active since February 2024, also disparage opposition candidate John Mahama. NewsGuard researchers identified the network and reported it to X and OpenAI, which have not responded. Two accounts were suspended and two restricted.
- Company involved
- X
- AI system involved
- ChatGPT
4 source articles · read the reporting →
Jacobs files BIPA class action against Walgreen Company over fingerprint scanning
A class action lawsuit alleges that Walgreen Company (Walgreens) collected and stored employees' fingerprint data without obtaining informed consent, in violation of the Illinois Biometric Information Privacy Act (BIPA). The plaintiff, Jacobs, claims the company used fingerprint scanners for employee timekeeping without providing required disclosures or obtaining written consent. The case is pending in Illinois state court.
- Company involved
- Walgreen Company
- AI system involved
- Fingerprint time clock
7 source articles · read the reporting →
TOV Realty, LLC v. Suarez; Kosel Equity, LLC v. MacGregor (SC Connecticut): AI-hallucinated content in court filing, 6 hours CLE;…
The AI generated legal briefs containing fabricated citations, which were submitted to the Connecticut Supreme Court.
- Company involved
- GLG Law LLC
- AI system involved
- ChatGPT
1 source article · read the reporting →
Company fires HR team after ATS auto-rejects manager's CV due to filtering error
A company's applicant tracking system (ATS) auto-rejected qualified candidates' resumes for three months because it was filtering for the outdated framework AngularJS instead of the required Angular framework. The manager discovered the flaw by submitting his own CV under a pseudonym and found it was rejected within seconds. After the manager reported the issue to upper management, the company investigated and dismissed half of its HR team. No legal action or regulatory involvement is reported.
4 source articles · read the reporting →
UnitedHealthcare sued for using AI to deny Medicare Advantage patients care
A class action complaint alleges that UnitedHealthcare and its subsidiary naviHealth deployed an artificial intelligence model to override treating physicians' determinations of medically necessary care for elderly Medicare Advantage patients. The complaint claims the AI model has a known 90% error rate and wrongfully denied patients care. The lawsuit, filed in the U.S. District Court for the District of Minnesota, seeks damages on behalf of the estates of two deceased patients and all others similarly situated.
- Company involved
- UnitedHealthcare, Inc.
10 source articles · read the reporting →
UnitedHealth used ALERT algorithm to limit mental health coverage, regulators found
ProPublica reports that UnitedHealth Group's Optum subsidiary used the ALERT algorithm to flag mental health patients and therapists as outliers, leading to therapy coverage denials. Regulators in California, Massachusetts and New York alleged this breached the federal Mental Health Parity and Addiction Equity Act, and UnitedHealth agreed to restrict the system in those jurisdictions. The company denies wrongdoing and says its programmes are compliant. Affected patients, including Medicaid enrollees, were left to pay out-of-pocket or go without care.
- Company involved
- UnitedHealth Group
- AI system involved
- ALERT
5 source articles · read the reporting →
Beus Gilbert PLLC v. Brigham Young University et al. (D. Utah): AI-hallucinated content in court filing, Two AI-ethics CLE courses;…
The AI system generated fake legal citations that were included in a court filing, misleading the court and opposing counsel.
1 source article · read the reporting →
Answer.AI tests Devin and reports 14 failures in 20 tasks
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
- AI system involved
- Devin
5 source articles · read the reporting →
Good Daily operates AI-generated local news network without disclosure
Good Daily Inc., run by Matthew Henderson, operates hundreds of AI-generated local newsletters across the U.S. that aggregate and summarize news from local outlets. The newsletters use large language models without disclosing this to subscribers, and feature fabricated testimonials. Some readers reported being signed up without their consent. Local news outlets have criticized the network for not driving meaningful traffic and for undermining trust.
- Company involved
- Good Daily Inc.
- AI system involved
- Good Daily
3 source articles · read the reporting →
EviCore denied heart catheterization for patient using algorithm
In fall 2021, Little John Cupp's doctor requested a left heart catheterization exam. EviCore, a company hired by UnitedHealthcare, denied the request twice using an algorithm called 'the dial' that adjusts thresholds for review. The algorithm flagged the request for review, and EviCore's doctors determined it was not medically necessary. Cupp did not receive the procedure and his symptoms continued.
- Company involved
- EviCore (a Cigna company)
- AI system involved
- the dial
6 source articles · read the reporting →
Judge rules lawsuit over UnitedHealth’s AI care denials can move forward - STAT
The system denied necessary medical care to Medicare Advantage beneficiaries.
- Company involved
- UnitedHealth Group
1 source article · read the reporting →
Teleperformance deploys AI to neutralise Indian call centre agents' accents
Teleperformance, the world's largest call centre operator, has announced it is using AI from Sanas to modify the accents of its Indian employees in real time. The technology, called accent translation, aims to make agents sound more neutral to native English speakers. The company invested $13 million in Sanas and gained exclusive rights. No specific incident of harm has been reported.
- Company involved
- Teleperformance
- AI system involved
- Sanas AI
6 source articles · read the reporting →
EvenUp AI errors in personal injury demand letters lead to scrutiny
EvenUp, a legal tech startup valued at $1 billion, uses AI to draft personal injury demand letters. Former employees revealed that the AI system frequently makes errors, including missing injuries and fabricating medical conditions. The company defends its hybrid approach with human oversight, but critics allege overpromised AI capabilities.
- Company involved
- EvenUp
6 source articles · read the reporting →
Bloomberg test finds racial bias in OpenAI's GPT for resume ranking
Bloomberg News conducted an experiment using GPT-3.5 and GPT-4 to rank equally qualified resumes with names associated with different races and genders. The test found that resumes with names distinct to Black Americans were least likely to be ranked as top candidates, indicating systematic bias. OpenAI responded that businesses can mitigate bias through fine-tuning and that it prohibits using GPT for automated hiring decisions.
- Company involved
- OpenAI
- AI system involved
- GPT-3.5
5 source articles · read the reporting →
OpenAI suspends developer of bot mimicking Dean Phillips
OpenAI suspended the developer of a bot that used ChatGPT to impersonate Democratic presidential candidate Dean Phillips. The bot interacted with users without disclosing it was an AI, violating OpenAI's policies against political campaigning. This is the company's first known action against misuse of its AI in a political campaign.
5 source articles · read the reporting →
Baltimore schools monitor student laptops for suicide signs using GoGuardian Beacon
Baltimore City Public Schools uses GoGuardian Beacon software to monitor student laptops for signs of suicide. Since March 2021, the system has flagged 786 alerts, with nine students taken to emergency rooms. Privacy advocates warn the monitoring could lead to disciplinary actions, outing of LGBTQ students, and disproportionately affect disadvantaged students. School officials defend the practice as a safeguard.
- Company involved
- Baltimore City Public Schools
- AI system involved
- GoGuardian Beacon
10 source articles · read the reporting →
