Kroger's digital price tags investigated for surge pricing concerns
U.S. Senators Elizabeth Warren and Bob Casey sent a letter to Kroger CEO Rodney McMullen raising concerns about the company's use of Electronic Shelving Labels (ESLs) for dynamic pricing. The system, called EDGE shelf and developed with Microsoft, can change prices based on time of day or weather, potentially leading to price gouging. The senators warned that this could harm consumers by increasing grocery costs and requested information from Kroger about its use of the technology.
- Company involved
- Kroger
- AI system involved
- EDGE shelf (Electronic Shelving Labels)
10 source articles · read the reporting →
Tennessee's TennCare Connect algorithm illegally denied thousands Medicaid benefits
A U.S. District Court judge ruled that Tennessee's TennCare Connect system, built by Deloitte for over $400 million, illegally denied thousands of low-income residents and people with disabilities Medicaid and disability benefits due to programming and data errors. The system automatically terminated coverage without properly considering eligibility for all available programs. A class action lawsuit filed in 2020 resulted in the ruling.
- Company involved
- TennCare (Tennessee Medicaid)
- AI system involved
- TennCare Connect
10 source articles · read the reporting →
Deloitte software glitches wrongly remove Texans from Medicaid
Advocacy groups filed a complaint with the Federal Trade Commission alleging that Deloitte's eligibility software, TIERS, used by Texas Medicaid, wrongly disenrolled qualified recipients due to glitches. Nearly 1.8 million Texans lost coverage after the pandemic pause ended, with many errors attributed to procedural issues but some linked to system malfunctions. Deloitte denies the claims, while the state says it restored care for at least 90,000 people. The FTC has not yet responded to the complaint.
- Company involved
- Texas Health and Human Services Commission
- AI system involved
- TIERS
6 source articles · read the reporting →
ChatGPT Health fails to direct 52% of medical emergencies to emergency care in study
A study published in Nature Medicine found that OpenAI's ChatGPT Health tool under-triaged 52% of true medical emergencies, directing users to non-urgent care instead of emergency departments. The AI also misclassified 35% of non-urgent cases. Researchers at Mount Sinai conducted 960 tests across 60 clinical scenarios, noting the tool's susceptibility to anchoring bias when symptoms were minimized. The study highlights potential safety concerns as millions use AI for health guidance.
- Company involved
- OpenAI
- AI system involved
- ChatGPT Health
4 source articles · read the reporting →
OpenClaw AI agent deletes over 200 emails from Meta executive's Gmail without permission
Summer Yue, a senior Meta executive and head of AI Safety & Alignment, was using the open-source AI agent OpenClaw to manage her Gmail inbox. She instructed the agent to wait for confirmation before deleting any emails, but during a compaction of her large inbox, the agent lost the instruction and deleted over 200 emails. Yue was unable to stop the process from her phone and had to manually terminate the agent on her computer. The AI later apologized for violating the instruction.
- AI system involved
- OpenClaw
4 source articles · read the reporting →
Samsung settles Texas lawsuit over ACR data collection on smart TVs
Samsung has settled a lawsuit with the Texas Attorney General over its Automated Content Recognition (ACR) system on smart TVs. The system collected viewing data from users without informed consent. As part of the settlement, Samsung agreed to stop collecting ACR data from Texans without explicit consent and to rewrite its privacy prompts. Samsung also faces a federal class action in New York over similar allegations.
- Company involved
- Samsung
- AI system involved
- Automated Content Recognition (ACR)
7 source articles · read the reporting →
US Central Command used Anthropic's Claude in Iran airstrikes after Trump ban.
US Central Command used Anthropic's Claude AI system to support airstrikes on Iran, including intelligence assessment and target identification, just hours after President Trump banned federal agencies from using Anthropic tools. The use highlighted a contradiction in the administration's stance, as the Pentagon relied on technology the White House had labelled a security risk. Anthropic faced a supply-chain risk designation for refusing to grant blanket permission for military use, and rival firms OpenAI and xAI later received approval to replace Claude.
- Company involved
- US Central Command (Centcom)
- AI system involved
- Claude
4 source articles · read the reporting →
Meta ends Sama contract after workers allege viewing graphic smart glasses content
Meta cancelled its contract with Sama, a Kenyan outsourcing firm, after workers alleged they were required to view graphic content captured by Meta's smart glasses, including users having sex and using the toilet. The workers, who were data annotators training Meta's AI, said they reviewed videos and transcripts of interactions with the AI. Sama stated the contract termination would result in 1,108 redundancies, and a Kenyan workers' organisation alleges Meta's decision was caused by the staff speaking out. Meta has not addressed that allegation but said it ended the work because Sama did not meet its standards, a claim Sama rejects.
- Company involved
- Meta
- AI system involved
- Meta smart glasses
6 source articles · read the reporting →
Pega's Hidden AI Tool Listens To US Bank Calls, Suit Says - Law360
The system secretly recorded customer service calls, affecting bank customers.
- Company involved
- U.S. Bancorp
1 source article · read the reporting →
New Records Show Medicare WISeR AI Prior Authorization Model Causing Inappropriate Denials of Care - Medicare Rights Center
The system denied or delayed prior authorization for medical procedures, affecting Medicare beneficiaries in six states.
- Company involved
- Centers for Medicare & Medicaid Services
- AI system involved
- WISeR
1 source article · read the reporting →
Security Health Plan used AI to cut off nursing home care for 85-year-old woman
Frances Walter, an 85-year-old woman with a shattered shoulder, had her nursing home care payment cut off by Security Health Plan after an algorithm predicted she would recover in 16.6 days. The algorithm, nH Predict from NaviHealth, did not account for her severe pain and allergy to pain medicine. She was forced to spend her life savings and enroll in Medicaid while fighting the denial. A federal judge later ruled the denial was speculative and she was owed thousands of dollars.
- Company involved
- Security Health Plan
- AI system involved
- nH Predict
1 source article · read the reporting →
Senators demand review of VA's AI-driven contract cancellations
The Department of Veterans Affairs used an AI tool created by a Department of Government Efficiency employee to identify hundreds of contracts for cancellation. Senators Richard Blumenthal and Angus King have called for the VA Inspector General to investigate the use of AI in these decisions, alleging that the tool used flawed formulas and that the cancellations are harming veterans by cutting services. The AI tool was developed to review nearly 90,000 contracts in a 30-day period and reportedly made mistakes.
- Company involved
- Department of Veterans Affairs
8 source articles · read the reporting →
Hospitals Use OpenAI’s Whisper Despite Medical Transcription Hallucinations
OpenAI’s Whisper transcription tool is used by over 30,000 medical workers and can insert fabricated text into patient records. Researchers found hallucinations in 80 per cent of public meeting transcripts and in 1 per cent of audio samples, some adding violent or racial content. Mankato Clinic and Children’s Hospital Los Angeles are among 40 health systems using Nabla’s Whisper-powered copilot, which erases original audio recordings. OpenAI acknowledged the findings and said it is working to reduce fabrications.
- Company involved
- Mankato Clinic; Children’s Hospital Los Angeles
- AI system involved
- Whisper
2 source articles · read the reporting →
NHS faces legal action over Palantir data contract extension
The NHS is being taken to court by campaign group Open Democracy over its contract with data firm Palantir. The legal action alleges that the extension of Palantir's involvement in analysing NHS patient data for pandemic response and beyond lacked a proper Data Protection Impact Assessment. The contract, initially an emergency response, was extended for two years at a cost of £23.5m. The case is pending.
- Company involved
- NHS
- AI system involved
- Palantir data analysis platform
10 source articles · read the reporting →
Kmart's facial recognition system for refund fraud found unlawful by Privacy Commissioner
Kmart Australia deployed facial recognition technology in 28 stores from June 2020 to July 2022, capturing biometric data of every customer entering the stores and those at returns counters to detect refund fraud. The system collected sensitive information without notifying customers or obtaining their consent. The Australian Privacy Commissioner found that Kmart breached the Privacy Act, as the exemption for unlawful activity did not justify the indiscriminate and disproportionate collection of biometric data from thousands of individuals. Kmart has ceased using the system and cooperated with the investigation.
- Company involved
- Kmart Australia Limited
7 source articles · read the reporting →
Brookdale Senior Living algorithm blamed for understaffing at assisted-living facilities
Managers at Brookdale Senior Living, the largest assisted-living chain in the US, allege that an algorithm called 'Service Alignment' set staffing levels so low that facilities were dangerously short-handed. The system, based on time-motion studies, failed to account for the complexities of resident care, according to complaints. Some managers say they quit or were fired after raising concerns about the staffing algorithm.
- Company involved
- Brookdale Senior Living
- AI system involved
- Service Alignment
1 source article · read the reporting →
University of Chicago Medical Center sued over sharing patient data with Google
The University of Chicago Medical Center is accused in a class-action lawsuit of sharing hundreds of thousands of patient medical records with Google without proper de-identification or patient consent. The data, from patients treated between 2009 and 2016, allegedly included dates and provider notes that could allow re-identification. The lawsuit claims Google sought the records to develop its own electronic health record system and predictive models. The hospital and Google deny wrongdoing, stating the research partnership was legal and compliant with HIPAA.
- Company involved
- University of Chicago Medical Center
1 source article · read the reporting →
Macy's and Sunglass Hut facial recognition misidentifies man, leading to wrongful jailing
Harvey Eugene Murphy Jr was misidentified by facial recognition software used by Sunglass Hut and Macy's as the perpetrator of an armed robbery. He was arrested and jailed, where he alleges he was beaten and raped. His alibi was later confirmed and charges were dropped. He is suing the companies for $10 million in damages.
- Company involved
- Macy's and EssilorLuxottica
3 source articles · read the reporting →
Imperial College AI stethoscope falsely identified heart failure in two-thirds of flagged patients
Researchers at Imperial College London and Imperial College Healthcare NHS Trust have developed an AI-powered stethoscope that analyses heart rhythms and performs an ECG, sending results to a doctor's smartphone. A study of more than 12,000 patients across the UK found that two-thirds of patients flagged as having heart failure did not actually have the condition. The researchers acknowledged that the false positives could cause unnecessary anxiety, and many GP surgeries stopped using or barely used the device after 12 months. The team plans to deploy the stethoscope more widely.
- Company involved
- Imperial College London and Imperial College Healthcare NHS Trust
6 source articles · read the reporting →
Hospital Denies Pain Medication to Patient Based on Narx Score
Elizabeth Amirault, a 34-year-old chronic pain patient, was denied narcotic pain medication during a hospital visit in Fort Wayne, Indiana, in August 2022. A nurse practitioner told her that her Narx Score, generated by Bamboo Health's NarxCare platform, was too high to prescribe opioids. The algorithm uses prescription drug monitoring data to assess risk of misuse, but critics say it can harm patients by cutting off needed care. Amirault believes her score was unfairly high due to her multiple surgeries and doctors.
- AI system involved
- NarxCare
3 source articles · read the reporting →
Thailand halts iris-scan crypto scheme and deletes 1.2m biometric records
The Ministry of Digital Economy and Society (DES) and the Personal Data Protection Committee (PDPC) ordered a company to stop collecting iris data and delete 1.2 million citizen records. The PDPC found that the operator used crypto-token rewards as an incentive for consent, meaning consent was not freely given, and the system raised concerns about data being used beyond its declared purpose. The company stated it had complied with all Thai regulations and intends to continue discussions with authorities.
- Company involved
- The company behind the iris-scan system (not named)
- AI system involved
- Iris-scan system
4 source articles · read the reporting →
Sharp HealthCare Sued Over AI Scribe, Patient Consent - Medscape
A lawsuit alleges Sharp HealthCare's AI scribe recorded patient encounters without patients' consent.
- Company involved
- Sharp HealthCare
- AI system involved
- AI scribe
1 source article · read the reporting →
New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com
The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.
- Company involved
- Meta Platforms
- AI system involved
- Meta AI-enabled Ray-Ban and Oakley smart glasses
1 source article · read the reporting →
Expedia hit with antitrust class action over algorithm pricing scheme - Courthouse News
A class action alleges Expedia took part in an algorithmic pricing scheme that inflated hotel room prices for consumers booking through Expedia and other platforms.
- Company involved
- Expedia
1 source article · read the reporting →
