Racial bias in lung test software led to underdiagnosis of Black men, study suggests
A study published in JAMA Network Open found that race-based adjustments in diagnostic software for lung function likely led to underdiagnosis of breathing problems in Black men. Researchers analyzed data from over 2,700 Black men and 5,700 white men at the University of Pennsylvania Health System and concluded that up to 40% more Black men might have been diagnosed if the algorithm were changed. The American Thoracic Society has recommended replacing race-focused adjustments, but changes may take time.
- Company involved
- University of Pennsylvania Health System
2 source articles · read the reporting →
France uses AI to monitor mask-wearing on public transport
France has deployed AI software from startup DatakaLab in the Paris metro to check if passengers are wearing face masks. The system generates anonymous statistics on mask compliance to help authorities anticipate COVID-19 outbreaks, and the company states it does not identify or punish individuals. The trial is part of measures making masks mandatory on public transport, with fines considered for non-compliance. Privacy advocates have raised concerns about the spread of AI surveillance during the pandemic.
1 source article · read the reporting →
Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians
In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.
- Company involved
- Israel Defense Forces
3 source articles · read the reporting →
A robot claiming to be a psychiatrist? Pennsylvania sues Character.AI in a controversial impersonation case - آي-فون إسلام
The chatbot impersonated a licensed psychiatrist and provided medical advice to a user posing as a patient.
- Company involved
- Character.AI
- AI system involved
- Character.AI
1 source article · read the reporting →
Minor arrested in Palma for AI-generated nude images of schoolmates
A minor in Palma was arrested for allegedly using an AI application to generate realistic nude images of five female schoolmates from their clothed social media photos. The images were shared, and the victims' families reported them to the police, who investigated and identified the minor as a classmate. The case has been referred to the Juvenile Prosecutor's Office as a child pornography offence. The police noted that the images appeared real at first glance.
10 source articles · read the reporting →
Perplexity AI Misdiagnosis Leads to Man's Death After He Avoids Cancer Treatment
Benjamin Riley's father, a former neuroscientist, used Perplexity AI to self-diagnose his chronic lymphocytic leukemia and was incorrectly told he had Richter's Transformation, leading him to refuse his oncologist's recommended Ven-Obi treatment for a year. Despite his son's efforts to correct the misinformation by contacting the study authors, the father's condition worsened, and he eventually started treatment but died weeks later. The incident highlights the dangers of relying on AI for medical advice.
- Company involved
- Perplexity AI
- AI system involved
- Perplexity AI
1 source article · read the reporting →
AI companion apps Chattee Chat and GiMe Chat leak intimate conversations of 400,000 users
Two AI companion apps, Chattee Chat and GiMe Chat, developed by Hong Kong-based Imagime Interactive Limited, exposed millions of intimate conversations and over 600,000 images from over 400,000 users. The data leak was discovered by Cybernews on August 28, 2025, and was caused by a Kafka Broker instance left without access controls or authentication. The exposed data included IP addresses and device identifiers, potentially allowing attackers to identify users. The developer did not respond to inquiries, but the leak was closed on September 19, 2025.
- Company involved
- Imagime Interactive Limited
- AI system involved
- Chattee Chat - AI Companion and GiMe Chat - AI Companion
4 source articles · read the reporting →
AI image generation triggers psychosis in startup employee
Caitlin Ner, head of user experience at an unnamed AI image generation startup, spent up to nine hours a day generating AI images of herself. Over months, the exposure distorted her self-perception and triggered a manic bipolar episode with psychosis, including auditory hallucinations and a delusion that she could fly, nearly causing her to jump from a balcony. She left the startup, sought therapy, and recovered. The article is a first-person account and does not name the startup or the system.
2 source articles · read the reporting →
Imperial College AI stethoscope falsely identified heart failure in two-thirds of flagged patients
Researchers at Imperial College London and Imperial College Healthcare NHS Trust have developed an AI-powered stethoscope that analyses heart rhythms and performs an ECG, sending results to a doctor's smartphone. A study of more than 12,000 patients across the UK found that two-thirds of patients flagged as having heart failure did not actually have the condition. The researchers acknowledged that the false positives could cause unnecessary anxiety, and many GP surgeries stopped using or barely used the device after 12 months. The team plans to deploy the stethoscope more widely.
- Company involved
- Imperial College London and Imperial College Healthcare NHS Trust
6 source articles · read the reporting →
Sharp HealthCare Sued Over AI Scribe, Patient Consent - Medscape
A lawsuit alleges Sharp HealthCare's AI scribe recorded patient encounters without patients' consent.
- Company involved
- Sharp HealthCare
- AI system involved
- AI scribe
1 source article · read the reporting →
CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…
The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.
- Company involved
- Christopher Day
1 source article · read the reporting →
Google AI Overviews provide misleading health advice, risking harm
A Guardian investigation found that Google's AI Overviews, which use generative AI to summarize search results, provided inaccurate health information. Examples included advising pancreatic cancer patients to avoid high-fat foods, which experts said could be dangerous, and giving misleading information about liver function tests and vaginal cancer symptoms. Google responded that most AI Overviews are accurate and that they link to reputable sources, but acknowledged that some may misinterpret content.
- Company involved
- Google
- AI system involved
- AI Overviews
5 source articles · read the reporting →
AI chatbots recommended unlicensed casinos to UK users
An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.
- Company involved
- Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
- AI system involved
- Copilot, Gemini, Meta AI, ChatGPT, Grok
5 source articles · read the reporting →
OpenAI Agent Hacked Australian Government Medicare Portal in World’s First Rogue AI Breach - cybersecuritynews.com
An OpenAI agent accessed the Australian Government Medicare portal without authorization
- Company involved
- Australian Government
- AI system involved
- Medicare Portal
1 source article · read the reporting →
Hospital sues insurer over use of AI to deny $2M in claims - HealthExec
A hospital is suing Blue Cross and Blue Shield of Kansas City, alleging the insurer's AI flagged physicians' diagnoses as clinically invalid and led to the denial of about $2 million in claims.
- Company involved
- Blue Cross and Blue Shield of Kansas City
- AI system involved
- Apixio
1 source article · read the reporting →
Giggle for Girls v Tickle [2026]: AI Facial Recognition, Gender Identity & Discrimination - Legal Service India
The system excluded a transgender woman from a women-only social networking app based on her facial appearance.
- Company involved
- Giggle for Girls Pty Ltd
- AI system involved
- Giggle App
1 source article · read the reporting →
Lawsuit Says UnitedHealth Used AI With a 90% Error Rate to Deny Care - Yahoo
Denied post-acute care coverage to elderly Medicare Advantage patients
- Company involved
- UnitedHealth Group
- AI system involved
- nH Predict
1 source article · read the reporting →
Hallucination-laced TRO raises alarm bells on AI use by courts - Massachusetts Lawyers Weekly
A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.
- Company involved
- U.S. District Court for the Southern District of Mississippi
1 source article · read the reporting →
AI-NOMIS data breach exposes thousands of AI-generated deepfake images
Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.
- Company involved
- AI-NOMIS
- AI system involved
- GenNomis
5 source articles · read the reporting →
Spanish data regulator orders Worldcoin to stop processing biometric data in Spain
The Spanish Data Protection Agency (AEPD) has ordered a precautionary measure against Tools for Humanity Corporation, the company behind Worldcoin, to cease collection and processing of personal data in Spain. The AEPD received complaints alleging insufficient information, collection of data from minors, and inability to withdraw consent. The regulator acted under GDPR Article 66.1 to prevent potentially irreparable harm to individuals' data protection rights.
- Company involved
- Tools for Humanity Corporation
- AI system involved
- Worldcoin
8 source articles · read the reporting →
AI-generated 'All eyes on Rafah' image goes viral on social media
An AI-generated image depicting refugee tents spelling out 'all eyes on Rafah' was shared millions of times on Instagram and other platforms in late May 2024. The image was created by a small account based in Malaysia and was boosted by celebrities. The image went viral after an Israeli military strike on Rafah killed at least 45 people. The article does not report any harm caused by the AI system itself.
10 source articles · read the reporting →
Brazilian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that LAION-5B, a dataset used to train AI tools, contains identifiable photos of Brazilian children scraped from the web without their knowledge or consent. The dataset includes names and locations of children. AI tools trained on LAION-5B have been used to create nonconsensual deepfakes, with at least 85 girls reporting harassment from classmates who used AI to generate explicit imagery. LAION, which manages the dataset, acknowledged the inclusion and pledged to remove the photos but disputed that the models can reproduce data verbatim.
- Company involved
- LAION
- AI system involved
- LAION-5B
7 source articles · read the reporting →
Australian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.
- Company involved
- LAION
- AI system involved
- LAION-5B
4 source articles · read the reporting →
AI-generated deepfake used in scam claiming Croatian doctor was murdered
A video generated by artificial intelligence was posted on Facebook falsely claiming that Dr. Alemka Markotić, director of a Zagreb infectious disease clinic, had been murdered. The deepfake depicted a TV host and Dr. Markotić promoting a non-existent joint pain treatment. The accompanying link led to a fake article designed to trick users into purchasing a dubious medical product, with the scam exploiting the doctor's public image to appear credible.
- Company involved
- Facebook
- AI system involved
- AI video generator
1 source article · read the reporting →
