AI transcription tool Otter.ai causes health data breach at Ontario hospital
A former physician at an Ontario hospital installed the Otter.ai transcription tool and gave it access to his digital calendar. Because his personal email was still on a meeting invite list, the AI agent autonomously joined a virtual hepatology round, transcribed it, and emailed the summary and transcript to 65 recipients. The transcript contained sensitive personal health information of seven patients. The hospital reported the breach to the Ontario IPC, took steps to contain it, and is implementing further safeguards.
- Company involved
- Unnamed hospital in Ontario
- AI system involved
- Otter.ai
6 source articles · read the reporting →
DataOne asks court to toss noise lawsuit over Vineland data center - Courier-Post
The data center generated excessive and intrusive noise affecting neighbors in East Vineland.
- Company involved
- DataOne USA LLC
1 source article · read the reporting →
DataOne Data Center in Vineland Sparks Protests, Microsoft Under Scrutiny
DataOne Data Center di Vineland Tuai Protes Warga, Microsoft Disorot - Telset.id
The DataOne data center in Vineland, New Jersey, is operating without permits, using gas turbines that cause air and noise pollution. It was built to supply computing power to Microsoft through a deal with Nebius, but residents were not informed until after construction began. Microsoft is facing criticism for its role in the project.
- Company involved
- DataOne
- AI system involved
- DataOne data center
1 source article · read the reporting →
Cigna uses algorithm to deny medical claims without doctor review
Cigna, one of the largest health insurers, used an algorithm called PXDX to automatically deny medical claims. The system flagged mismatches between diagnoses and procedures, and company doctors signed off on denials in batches without reviewing patient files. One patient, Nick van Terheyden, was denied coverage for a $350 vitamin D test that his doctor had ordered. Former employees said the system saved Cigna billions of dollars but left patients with unexpected bills.
- Company involved
- Cigna
- AI system involved
- PXDX
10 source articles · read the reporting →
Acclarent's AI-Powered Surgery Tool Allegedly Injures Patients, Lawsuits Claim
Two patients allege that Acclarent's TruDi Navigation System, which uses AI to confirm device positioning during sinus surgery, misled surgeons and caused severe injuries including strokes. The FDA has received over 100 reports of malfunctions and at least ten injuries since AI was added. Lawsuits claim the company rushed the technology to market with only 80% accuracy, making the device less safe than before. Acclarent denies any causal connection, and the cases are ongoing.
- Company involved
- Acclarent
- AI system involved
- TruDi Navigation System
2 source articles · read the reporting →
Deloitte report for N.L. healthcare contains likely AI-generated false citations
Newfoundland and Labrador's $1.6 million Health Human Resources Plan, authored by Deloitte, contains at least four citations to research papers that do not exist, likely generated by artificial intelligence. The errors were discovered after the report was published by the Department of Health and Community Services in May. Researchers named in the false citations confirmed their work was misattributed and the papers are nonexistent. The provincial government and Deloitte have not responded to questions about the report.
- Company involved
- Deloitte
- AI system involved
- Azure OpenAI
3 source articles · read the reporting →
Acclarent's AI-Powered Surgery Tool Allegedly Injures Patients, Lawsuits Claim
The TruDi Navigation System by Acclarent, which uses AI to confirm device positions during sinus surgery, has been linked to at least ten patient injuries including strokes, according to FDA reports and two lawsuits. Plaintiffs Erin Ralph and Donna Fernihough allege that the AI was inaccurate and misled surgeons, causing carotid artery damage and strokes in 2022. Acclarent denies the allegations, stating there is no credible evidence of a causal connection. The lawsuits are ongoing.
- Company involved
- Acclarent
- AI system involved
- TruDi Navigation System
2 source articles · read the reporting →
Montefiore Allegedly Plans to Replace Nurses with AI for Insurance Reviews
The New York State Nurses Association alleges that Montefiore Health System plans to lay off 12 utilization review nurses and replace them with AI-powered software from Datavant. The union warns that the move could compromise patient care by having AI review insurance denials without clinical judgement. Montefiore denies the claims, stating they are investing in technology for better outcomes. The plan has sparked a town hall and calls from elected officials to halt the layoffs.
- Company involved
- Montefiore Health System
3 source articles · read the reporting →
NPR's David Greene sues Google over AI voice cloning in NotebookLM
David Greene, a former NPR host, alleges that Google's NotebookLM tool replicated his voice without permission. He says he was 'completely freaked out' when a colleague asked if he had licensed his voice to the company. Greene is suing Google, claiming the product violated his rights by using an AI-generated voice that sounds like his own. The lawsuit is pending.
- Company involved
- Google
- AI system involved
- NotebookLM
1 source article · read the reporting →
IBM Watson for Oncology recommended unsafe cancer treatments
Internal IBM documents reveal that its Watson for Oncology system often provided erroneous cancer treatment advice, including 'multiple examples of unsafe and incorrect treatment recommendations'. The problems were attributed to training on a small number of synthetic cases and the expertise of a few specialists rather than real patient data or established guidelines. The system was promoted to hospitals and physicians worldwide. It is unclear whether any patients were harmed as a result.
- Company involved
- IBM
- AI system involved
- Watson for Oncology
2 source articles · read the reporting →
Royal Free London publishes audit into Streams app data processing
The Royal Free London NHS Foundation Trust published an audit into its use of the Streams app, following an investigation by the Information Commissioner's Office (ICO) in July 2017. The Streams app alerts clinicians to patients at risk of acute kidney injury. The audit, conducted by Linklaters, concluded that the trust's use of Streams was lawful and complied with data protection laws, although areas for improvement were identified. The ICO later recognised that the trust had completed all required actions.
- Company involved
- Royal Free London NHS Foundation Trust
- AI system involved
- Streams
10 source articles · read the reporting →
Babylon Health attacks clinician who raised safety concerns about its AI chatbot
Dr David Watkins, a consultant oncologist, publicly raised concerns about Babylon Health's symptom triage chatbot, alleging it missed critical conditions such as heart attacks in women. Babylon Health issued a press release attacking Watkins as a 'troll' and manipulating data to discredit his testing. Watkins denies the claims and has filed complaints with the MHRA, which remain pending.
- Company involved
- Babylon Health
6 source articles · read the reporting →
Nurse at St. Rose Dominican Hospital Averts AI-Sepsis Alert Error
A nurse at St. Rose Dominican Hospital in Henderson, Nevada, refused to follow an AI-generated sepsis alert that would have given an elderly dialysis patient IV fluids, which could have caused a life-threatening complication. The alert, part of the hospital's electronic system, prompted a charge nurse to order the fluids despite the patient's compromised kidneys. A physician intervened and ordered dopamine instead, averting harm. The incident highlights concerns about AI tools overriding clinical judgment.
- Company involved
- St. Rose Dominican Hospital
1 source article · read the reporting →
Google's Nightingale project transfers medical data of millions without patient knowledge
An anonymous Google whistleblower states that the company acquired medical data of 50 million patients from Ascension without their knowledge. The transfer, known as Project Nightingale, raised privacy and security concerns. The article reports that a federal inquiry was launched into whether HIPAA protections were followed.
- Company involved
- Google
10 source articles · read the reporting →
Kaiser Permanente doctor delivers terminal diagnosis via robot video screen
Ernest Quintana, 79, was admitted to Kaiser Permanente Medical Center in Fremont, California, with failing lungs. A doctor appeared on a telepresence robot's video screen and told him he might not make it home. The family was devastated that the news was delivered through a machine rather than in person. Kaiser Permanente issued a statement expressing regret and said it would review its practices.
- Company involved
- Kaiser Permanente
10 source articles · read the reporting →
Deepfake voice generator impersonates Jordan Peterson without consent
A website called notjordanpeterson.com released an AI engine that allows users to generate audio in Jordan Peterson's voice from any text input. The system was created using a sample of Peterson's voice from public lectures. Peterson expressed concern about potential misuse for fraud and defamation, and the site subsequently disabled its functionality in response to his objections.
- Company involved
- notjordanpeterson.com
10 source articles · read the reporting →
UK study finds AI cannot detect COVID-19 from cough sounds
The UK Department of Health and Social Care awarded contracts to Fujitsu to develop a "Cough In A Box" app that would use AI to detect COVID-19 from cough sounds, based on earlier claims of high accuracy. However, a study led by the Alan Turing Institute found that machine learning models could not accurately predict COVID-19 from coughs due to confounding variables. The study concluded that the technology does not work for COVID-19 diagnosis.
- Company involved
- UK Department of Health and Social Care
- AI system involved
- Cough In A Box
10 source articles · read the reporting →
Dartmouth Medical School charges 17 students with cheating based on tracking system.
Dartmouth College's Geisel School of Medicine charged 17 students with cheating on remote exams during the pandemic. The charges were based on secret tracking of student activity on the learning management system. Critics say the system is prone to errors and inappropriate for monitoring students.
- Company involved
- Dartmouth College Geisel School of Medicine
10 source articles · read the reporting →
Google's dermatology app underrepresents dark skin tones in training data
Google unveiled a dermatology app that uses deep learning to recognise skin conditions. However, the training data included only 3.5% images from patients with darker skin types, which may lead to inaccurate diagnoses for these groups. Dermatologists have expressed concern that the app could cause false positives or missed diagnoses, and Google has acknowledged the issue while saying it will continue to refine the technology.
- Company involved
- Google
- AI system involved
- AI-powered dermatology assist tool
9 source articles · read the reporting →
Hospitals use Epic AI to predict Covid-19 decline without validation
Dozens of hospitals across the US are using Epic's deterioration index AI system to predict which Covid-19 patients will become critically ill, despite the tool not being validated for the new disease. The rapid deployment during the pandemic bypassed normal testing and validation processes.
- AI system involved
- Deterioration index
9 source articles · read the reporting →
Google and HCA Healthcare partner to analyze 32 million patient records
Google Cloud has announced a partnership with HCA Healthcare to analyze around 32 million patient records. The anonymized data will be used to develop algorithms that could advise doctors on treatment options. Privacy advocates have raised concerns about the data sharing and the potential for AI to re-identify patients. HCA insists that patient-identifiable information will be stripped and that access will be tightly controlled.
- Company involved
- HCA Healthcare
- AI system involved
- Google Cloud
9 source articles · read the reporting →
Elon Musk asks X users to upload medical data to train Grok chatbot
Elon Musk has told X users to upload medical images to the platform so that the AI chatbot Grok can learn to interpret them. He claimed Grok can give medical diagnoses, sometimes better than doctors, but experts have raised concerns about accuracy and privacy. The article reports cases where Grok misread a tuberculosis case and a mammogram. xAI, which owns X, responded to Fortune: 'Legacy Media Lies.'
- Company involved
- X
- AI system involved
- Grok
6 source articles · read the reporting →
UnitedHealthcare sued for using AI to deny Medicare Advantage patients care
A class action complaint alleges that UnitedHealthcare and its subsidiary naviHealth deployed an artificial intelligence model to override treating physicians' determinations of medically necessary care for elderly Medicare Advantage patients. The complaint claims the AI model has a known 90% error rate and wrongfully denied patients care. The lawsuit, filed in the U.S. District Court for the District of Minnesota, seeks damages on behalf of the estates of two deceased patients and all others similarly situated.
- Company involved
- UnitedHealthcare, Inc.
10 source articles · read the reporting →
ElevenLabs voice cloning tool used to create deepfake celebrity audio clips
Speech AI startup ElevenLabs launched a beta voice cloning tool. Within days, users on 4chan posted deepfake audio clips featuring voices resembling celebrities like Emma Watson reading offensive material. ElevenLabs acknowledged the misuse and said it is considering additional safeguards.
- Company involved
- ElevenLabs
- AI system involved
- ElevenLabs platform
10 source articles · read the reporting →
