Guy's and St Thomas' NHS Trust warns of AI-generated fake doctor weight loss videos
Guy's and St Thomas' NHS Foundation Trust issued an alert after AI-generated videos on social media falsely showed its doctors endorsing weight loss patches. The videos, found on Facebook and TikTok, are fraudulent and the trust is working to have them taken down. A financial crime expert said the scam aims to sell a herbal product by bypassing rational responses. The BBC contacted the company behind the products but received no response.
1 source article · read the reporting →
Mumbai Cyber Police Bust Deepfake Share Trading Scam by Valueleaf
Mumbai Cyber Police arrested four individuals from Bengaluru-based advertising agency Valueleaf for allegedly circulating deepfake videos of stock market experts to deceive investors. The videos, created for Hong Kong-based First Bridge, were promoted despite knowledge of their falsity and potential financial harm. Meta flagged the content, but the accused evaded detection by increasing ad accounts and changing domain locations. The case, registered under the Bhartiya Nyaya Sanhita and Information Technology Act, is under investigation to determine the number of defrauded investors.
- Company involved
- Valueleaf
1 source article · read the reporting →
Hassan v ABC International Bank (Employment Tribunals): AI-hallucinated content in court filing, Costs Order
The AI generated fabricated legal citations that the claimant submitted to the tribunal, resulting in a costs order against the claimant.
1 source article · read the reporting →
Estée Lauder settles with make-up artists sacked by algorithm
Three MAC make-up artists were dismissed after failing a video interview that was scored by HireVue's algorithm. They appealed but received no clear explanation of how the system assessed them. Estée Lauder Companies settled the resulting legal challenge out of court. HireVue later discontinued the visual analysis component of its video interview platform.
- Company involved
- Estée Lauder Companies
- AI system involved
- HireVue
2 source articles · read the reporting →
Otago professor's likeness used in AI deepfake diabetes scam
A deepfake video and false online story manipulated the likeness of University of Otago professor Sir Jim Mann to promote a diabetes product. The AI-generated advertisements urged people with type 2 diabetes to stop taking their medication Metformin and instead buy alternative natural products. Professor Mann was alerted to the scam and expressed deep concern that patients who trust him may become sick after being misled. The university and law enforcement are investigating.
- Company involved
- Smart Hemp Gummies
- AI system involved
- Glyco Balance
2 source articles · read the reporting →
Myeesha Parker v. Costco Wholesale Corp. (W.D. Washington): AI-hallucinated content in court filing, Fine, Adverse Costs Order, Bar Referral
The lawyer submitted AI-generated court documents containing false citations and quotes, harming his client's discrimination case.
- AI system involved
- Callidus AI
1 source article · read the reporting →
Rite Aid Settles FTC Allegations Over Facial Recognition Use in Stores
Rite Aid used facial recognition technology in hundreds of stores to identify patrons it deemed likely to engage in shoplifting. The FTC alleged that the company failed to implement reasonable safeguards, leading to false matches and disproportionate harm to consumers based on race and gender. Rite Aid agreed to a settlement that bans its use of facial recognition for five years and requires deletion of collected data. The settlement is subject to public comment and bankruptcy court approval.
- Company involved
- Rite Aid
10 source articles · read the reporting →
Hong Kong tycoon sues Tyndaris over AI hedge fund losses
Hong Kong tycoon Samathur Li Kin-kan is suing Tyndaris Investments after its AI-powered hedge fund, K1, lost over $20 million in a single day. Li alleges that the system was not as sophisticated as claimed. The trial is set to begin in London in April 2020.
- Company involved
- Tyndaris Investments
- AI system involved
- K1
10 source articles · read the reporting →
Benjamin v. Costco Wholesale Corp (E.D. New York): AI-hallucinated content in court filing, Monetary sanction; public reprimand; order to serve…
The AI generated fake case citations that were included in a court filing, misleading the court and opposing counsel.
- Company involved
- Hovsepyan Law Group, PC
- AI system involved
- ChatOn
1 source article · read the reporting →
Texas AG Settles with Pieces Technologies Over Deceptive Healthcare AI Claims
The Texas Attorney General investigated Pieces Technologies, a Dallas-based healthcare AI company, for making false and misleading statements about the accuracy of its generative AI product used in hospitals. The company claimed an error rate of less than 1 per 100,000, but the investigation found these metrics were likely inaccurate. As part of the settlement, Pieces agreed to accurately disclose its product's accuracy and ensure hospital staff understand the appropriate reliance on its AI. The case marks the first-of-its-kind healthcare generative AI investigation by the AG.
- Company involved
- Pieces Technologies
4 source articles · read the reporting →
Trivago loses Australian appeal over misleading hotel rate rankings
The Federal Court of Australia has dismissed Trivago's appeal against a ruling that the online travel company breached Australian consumer law. The court found that Trivago's website used an algorithm that gave prominence to hotels paying higher fees, so the most prominent offers were not always the cheapest for consumers. Consumers may therefore have paid more for rooms, and hotels lost direct bookings. The case returns to the Federal Court for consideration of penalties and other orders sought by the Australian Competition and Consumer Commission.
- Company involved
- Trivago
10 source articles · read the reporting →
Facebook still allows discriminatory ads despite settlement
A Wisconsin health care agency, Tenderness Health Care, posted a job ad on Facebook targeting users under 55 with 'African American multicultural affinity.' Federal law prohibits such age and race discrimination in job ads. The Markup found the ad still appeared despite Facebook's 2019 settlement agreeing to change its practices. Facebook removed the ad after being contacted, but critics say the company's algorithm continues to deliver ads in a discriminatory manner.
- Company involved
- Facebook
- AI system involved
- Facebook Ads
10 source articles · read the reporting →
Hangzhou plans permanent health codes with scoring, sparking privacy backlash
Hangzhou health authorities announced plans to launch a permanent health-tracking QR code system that would assign residents a color and numerical score based on medical records and lifestyle choices. The proposal, an expansion of the existing COVID-19 health code system, has sparked online backlash over privacy concerns and fears of discrimination. Critics argue that the system could lead to public exposure of personal health data and potential misuse by employers. The authorities aim to complete the project by May or June 2020.
- Company involved
- Hangzhou Health Authorities
- AI system involved
- Health Code
10 source articles · read the reporting →
Kohler, BMW, MaxMara secretly collected customers' facial recognition data
During the 2021 CCTV 3·15 Gala, it was revealed that Kohler, BMW, and MaxMara stores had installed facial recognition cameras from vendors such as Wandianzhang and Youluoke. These cameras captured customers' facial data without their knowledge or consent, and the data was used to track customer visits and inform sales strategies. The systems were deployed in thousands of stores across China, collecting over 100 million facial records. The companies did not inform customers or obtain consent, violating Chinese privacy laws.
- Company involved
- Kohler (China) Investment Co., Ltd., ZhengTong Auto (BMW dealerships), MaxMara
- AI system involved
- Facial recognition cameras from Wandianzhang, Youluoke, Yaliang, Ruiwei
10 source articles · read the reporting →
Google and HCA Healthcare partner to analyze 32 million patient records
Google Cloud has announced a partnership with HCA Healthcare to analyze around 32 million patient records. The anonymized data will be used to develop algorithms that could advise doctors on treatment options. Privacy advocates have raised concerns about the data sharing and the potential for AI to re-identify patients. HCA insists that patient-identifiable information will be stripped and that access will be tightly controlled.
- Company involved
- HCA Healthcare
- AI system involved
- Google Cloud
9 source articles · read the reporting →
California regulator accuses Maxpread Technologies of using AI-generated fake CEO to scam investors
Maxpread Technologies allegedly used an AI-generated avatar to pose as its CEO in a YouTube video to deceive investors. The California DFPI issued cease and desist letters to Maxpread and four other companies for offering unqualified securities and making false promises. The regulator claims the companies promised high daily returns using AI trading, but these claims were false. Maxpread did not respond to requests for comment.
- Company involved
- Maxpread Technologies
8 source articles · read the reporting →
UnitedHealthcare sued for using AI to deny Medicare Advantage patients care
A class action complaint alleges that UnitedHealthcare and its subsidiary naviHealth deployed an artificial intelligence model to override treating physicians' determinations of medically necessary care for elderly Medicare Advantage patients. The complaint claims the AI model has a known 90% error rate and wrongfully denied patients care. The lawsuit, filed in the U.S. District Court for the District of Minnesota, seeks damages on behalf of the estates of two deceased patients and all others similarly situated.
- Company involved
- UnitedHealthcare, Inc.
10 source articles · read the reporting →
UnitedHealth used ALERT algorithm to limit mental health coverage, regulators found
ProPublica reports that UnitedHealth Group's Optum subsidiary used the ALERT algorithm to flag mental health patients and therapists as outliers, leading to therapy coverage denials. Regulators in California, Massachusetts and New York alleged this breached the federal Mental Health Parity and Addiction Equity Act, and UnitedHealth agreed to restrict the system in those jurisdictions. The company denies wrongdoing and says its programmes are compliant. Affected patients, including Medicaid enrollees, were left to pay out-of-pocket or go without care.
- Company involved
- UnitedHealth Group
- AI system involved
- ALERT
5 source articles · read the reporting →
Jessica Fuller v. Hyde School, et al. (D. Maine): AI-hallucinated content in court filing, CLE; Firm procedures and certification; Serve…
The AI generated fictitious legal citations that were submitted to the court in a legal filing.
- AI system involved
- ChatGPT or Claude
1 source article · read the reporting →
Zhengzhou officials punished for red health codes on depositors
Five officials in Zhengzhou were punished for ordering red health codes to be assigned to 1,317 depositors of four village banks, restricting their movement and preventing them from withdrawing savings. The officials acted without authorization, and the codes were later turned green after media coverage. Legal experts say the liability for privacy invasion remains unresolved, and the banks may face breach of contract claims.
- Company involved
- Zhengzhou municipal government
- AI system involved
- Health code system
10 source articles · read the reporting →
Perth hospital group bans ChatGPT after doctor used it for a patient discharge summary
South Metropolitan Health Service, which runs five hospitals in Perth, ordered staff to stop using ChatGPT for work involving patient information after an email said some staff had used the AI chatbot to write medical notes. The service later clarified that only one doctor had used the tool to generate a patient discharge summary and that no confidential patient information had been breached. The Australian Medical Association has called for national regulations to ensure a human is involved in AI-assisted health decisions.
- Company involved
- South Metropolitan Health Service
- AI system involved
- ChatGPT
6 source articles · read the reporting →
ООО «Точка опоры» v. ООО «ЦСС» (West Siberian District AC): AI-hallucinated content in court filing, Monetary Fine
The AI system generated fake legal citations that were submitted to the court, resulting in a fine for contempt.
- Company involved
- ООО «ЦСС»
1 source article · read the reporting →
Humana sued for using AI to deny seniors rehabilitation care
Health insurer Humana is accused in a class-action lawsuit of using an AI algorithm to systematically deny rehabilitation care to Medicare Advantage patients, despite recommendations from their doctors. The lawsuit, filed on December 12, 2023, alleges that the AI tool restricted medically necessary care. This is the second major health insurer to face legal action over its use of AI to deny care.
- Company involved
- Humana
9 source articles · read the reporting →
Judge rules lawsuit over UnitedHealth’s AI care denials can move forward - STAT
The system denied necessary medical care to Medicare Advantage beneficiaries.
- Company involved
- UnitedHealth Group
1 source article · read the reporting →
