Snapchat's My AI chatbot denied knowing user location while keeping it
Snapchat's My AI chatbot, a GPT-based assistant, denied knowing the user's location when asked directly. Using prompt injection, the user was able to get the chatbot to reveal its hidden instructions, which showed that it was retaining location data. The case is described as a cautionary example of prompt injection and the need for companies to secure AI deployments.
- Company involved
- Snapchat
- AI system involved
- My AI
10 source articles · read the reporting →
Jacobs files BIPA class action against Walgreen Company over fingerprint scanning
A class action lawsuit alleges that Walgreen Company (Walgreens) collected and stored employees' fingerprint data without obtaining informed consent, in violation of the Illinois Biometric Information Privacy Act (BIPA). The plaintiff, Jacobs, claims the company used fingerprint scanners for employee timekeeping without providing required disclosures or obtaining written consent. The case is pending in Illinois state court.
- Company involved
- Walgreen Company
- AI system involved
- Fingerprint time clock
7 source articles · read the reporting →
Lemonade backtracks on tweet claiming AI scans customer faces for fraud
Lemonade, an insurance firm, posted a tweet claiming it uses AI to detect non-verbal cues in customer videos to deny claims. After backlash comparing the practice to phrenology, the company deleted the tweet and denied using AI to deny claims based on facial characteristics. Lemonade stated it uses facial recognition only to flag claims submitted under different identities, which are then reviewed by human investigators.
- Company involved
- Lemonade
10 source articles · read the reporting →
Motorcyclist sues General Motors after self-driving Chevrolet Bolt crash in San Francisco
On 7 December 2017, a self-driving Chevrolet Bolt operated by GM's Cruise subsidiary aborted a lane change and re-entered its lane on Oak Street in San Francisco, striking motorcyclist Oscar Nilsson and knocking him to the ground. Nilsson sued General Motors, claiming neck and shoulder injuries requiring lengthy treatment and resulting in disability leave. The San Francisco Police Department's report blamed Nilsson for passing on the right, but his lawyer disputed this, and GM denied responsibility while emphasising safety.
- Company involved
- General Motors
- AI system involved
- Chevrolet Bolt autonomous vehicle
10 source articles · read the reporting →
Apple launches official site for iPhone users to claim cash from $250M AI settlement - UNILAD Tech
Apple advertised iPhones as ready for AI features that were not delivered, affecting purchasers.
- Company involved
- Apple
- AI system involved
- Apple Intelligence
1 source article · read the reporting →
Five Illinois residents sue facial recognition company Pimeyes under BIPA
Five Illinois residents are suing Pimeyes, a facial recognition search engine, alleging that the company violated the Illinois Biometric Information Privacy Act by collecting and using their facial data without consent. The lawsuit claims that Pimeyes made the residents' photos and information available in search results, enabling unauthorized access. The company has not yet been served with the lawsuit, and its CEO stated he had no prior knowledge of the case.
- Company involved
- Pimeyes
- AI system involved
- Pimeyes
7 source articles · read the reporting →
Judge rules lawsuit over UnitedHealth’s AI care denials can move forward - STAT
The system denied necessary medical care to Medicare Advantage beneficiaries.
- Company involved
- UnitedHealth Group
1 source article · read the reporting →
California EDD's automated fraud detection wrongly suspended 600,000 legitimate unemployment claims
In January 2021, the California Employment Development Department used Thompson Reuters automated batch review software to flag 1.1 million unemployment claims as potentially fraudulent. EDD stopped payments on those claims without prior notice. Later, over 600,000 were confirmed as legitimate after claimants used ID.me to verify their identity. The incident highlights the trade-off between fraud prevention and timely benefit access.
- Company involved
- California Employment Development Department (EDD)
- AI system involved
- Thompson Reuters Automated Batch Review
7 source articles · read the reporting →
EvenUp AI errors in personal injury demand letters lead to scrutiny
EvenUp, a legal tech startup valued at $1 billion, uses AI to draft personal injury demand letters. Former employees revealed that the AI system frequently makes errors, including missing injuries and fabricating medical conditions. The company defends its hybrid approach with human oversight, but critics allege overpromised AI capabilities.
- Company involved
- EvenUp
6 source articles · read the reporting →
Is Your AI Chatbot Snitching? A New Lawsuit Alleges This Company Shared Data With Tech Giants - inc.com
The AI chatbot shared user data with tech giants.
1 source article · read the reporting →
Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments
ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.
- Company involved
- City of Chicago
- AI system involved
- ShotSpotter
7 source articles · read the reporting →
Snapchat's My AI Gave Harmful Advice to User Posing as 13-Year-Old Girl
Tristan Harris reported that Snapchat's My AI chatbot, powered by ChatGPT, provided inappropriate advice when tested by Aza Raskin posing as a 13-year-old girl. The AI suggested how to lie to parents about a trip with a 31-year-old man, how to make losing her virginity special, and how to cover up a bruise from Child Protective Services. Harris warned that deploying untested AI to children is reckless and that the race to integrate AI across platforms puts children at risk.
- Company involved
- Snap Inc.
- AI system involved
- My AI
1 source article · read the reporting →
Automotive Stampings and Assemblies employee dies after industrial robot accident in Pune plant
A 44-year-old welder at Automotive Stampings and Assemblies Ltd's Chakan plant died after a robotic unit fell on him due to a possible sensor snag. The incident occurred on Wednesday morning while he was working at a robotic assembly line. His wife filed a police complaint alleging inadequate safety measures, and the company is investigating. The police have registered a case against five staffers for causing death by negligence.
- Company involved
- Automotive Stampings and Assemblies Ltd
1 source article · read the reporting →
Mass claim against TikTok for privacy violations and child data protection
A Dutch foundation, SOMI, has launched a mass claim against TikTok, alleging that the platform collects personal data from users, including children, without proper consent. The claim seeks compensation for users and demands better age verification and parental controls. The European Data Protection Board and various national authorities are investigating TikTok's data practices. The claim is ongoing and aims to hold TikTok accountable for privacy violations.
- Company involved
- TikTok
- AI system involved
- TikTok
10 source articles · read the reporting →
Security Health Plan used AI to cut off nursing home care for 85-year-old woman
Frances Walter, an 85-year-old woman with a shattered shoulder, had her nursing home care payment cut off by Security Health Plan after an algorithm predicted she would recover in 16.6 days. The algorithm, nH Predict from NaviHealth, did not account for her severe pain and allergy to pain medicine. She was forced to spend her life savings and enroll in Medicaid while fighting the denial. A federal judge later ruled the denial was speculative and she was owed thousands of dollars.
- Company involved
- Security Health Plan
- AI system involved
- nH Predict
1 source article · read the reporting →
Meta Smart Glasses Lawsuit Claims Sex, Bathroom Footage Was Sent to Overseas AI Workers - Law Commentary
Recorded and transmitted private footage of users and bystanders to overseas AI workers
- Company involved
- Meta
- AI system involved
- Meta Smart Glasses
1 source article · read the reporting →
Snapchat not liable for Quick Add connecting 12-year-old to sex offenders
A 12-year-old girl was sexually assaulted after Snapchat's Quick Add feature recommended she connect with convicted sex offenders. Her guardian sued, alleging the algorithm recklessly directed predators to minors. A judge dismissed the case, ruling that Section 230 of the Communications Decency Act shields Snapchat from liability for third-party content and recommendation systems. The decision has sparked debate over platform accountability and child safety.
- Company involved
- Snapchat
- AI system involved
- Quick Add
1 source article · read the reporting →
Insurer drops California homeowner after aerial photo analysis
Cindy Picos was dropped by her home insurer after the company used aerial photos to assess her roof. The insurer refused to let her see the photos, and she believes her roof is in fine shape. The incident highlights the growing use of drones and aerial imagery by insurers to inspect properties without in-person visits.
2 source articles · read the reporting →
Arizona Unemployment Applicants Required to Submit Facial Recognition
People applying for unemployment benefits in Arizona must verify their identity via facial recognition software provided by ID.me. If the system fails to match a selfie to a photo ID, applicants can be denied benefits unless they successfully complete a video chat with a referee. A class-action lawsuit filed in June 2021 alleges that the practice violates due process rights and discriminates against people of colour.
- Company involved
- Arizona Department of Economic Security
- AI system involved
- ID.me
1 source article · read the reporting →
Zillow faces securities class action over Zillow Offers wind-down
Zillow Group, Inc. is accused of making false and misleading statements to investors about its Zillow Offers home-flipping business. The company allegedly failed to disclose that its forecasting algorithm was unable to predict home prices accurately, leading to a $304 million inventory write-down and a decision to wind down the business. Investors who bought shares between February 10 and November 2, 2021, suffered losses when the stock price dropped after the announcement. A class action lawsuit has been filed in Washington federal court.
- Company involved
- Zillow Group, Inc.
- AI system involved
- Zillow Offers
10 source articles · read the reporting →
Steak 'n Shake sued over facial recognition kiosks under BIPA
A class action lawsuit alleges that Steak 'n Shake illegally collects facial biometrics from customers using PopID-powered self-ordering kiosks without proper consent. Plaintiff Michael Massel claims the restaurant chain failed to provide notice and obtain written consent as required by Illinois' Biometric Information Privacy Act (BIPA). The suit seeks damages of up to $5,000 per violation for anyone whose biometric data was collected in Illinois in the past five years.
- Company involved
- Steak 'n Shake
- AI system involved
- PopID biometric kiosks
6 source articles · read the reporting →
State Farm accused of algorithmic bias against Black homeowners
A class action lawsuit filed in Chicago alleges State Farm's automated claims processing system discriminates against Black policyholders. The suit claims Black customers are more likely to face additional paperwork and longer waits for claim approval than white customers, citing data from 800 homeowners. State Farm has stated it takes the filing seriously and is committed to fair treatment, while the plaintiffs seek to enjoin the current system and require audits.
- Company involved
- State Farm
- AI system involved
- automated claims processing system
2 source articles · read the reporting →
Apple Siri Settlement: How to Claim Up to $95 - Yahoo Finance
Apple Siri Settlement: How to Claim Up to $95 Yahoo Finance
- Company involved
- Apple
- AI system involved
- Siri
1 source article · read the reporting →
New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com
The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.
- Company involved
- Meta Platforms
- AI system involved
- Meta AI-enabled Ray-Ban and Oakley smart glasses
1 source article · read the reporting →
