Eventbrite algorithm recommended illegal opioid sales to addiction recovery seekers
Eventbrite's recommendation algorithm promoted thousands of listings selling illegal prescription drugs like oxycodone and Xanax alongside addiction recovery events. The listings, which appeared in search results and related events, directed users to unlicensed online pharmacies. Eventbrite acknowledged the issue and removed the listings after WIRED alerted them.
- Company involved
- Eventbrite
- AI system involved
- Eventbrite recommendation algorithm
4 source articles · read the reporting →
Andrea Bartz and others sue Anthropic PBC over copyright
In August 2024, Andrea Bartz, Kirk Wallace Johnson and Charles Graeber filed a lawsuit against Anthropic PBC in the US District Court for the Northern District of California. The complaint alleges copyright infringement under 17 U.S.C. § 501. Anthropic waived service, and the case was assigned to the court.
- Company involved
- Anthropic PBC
8 source articles · read the reporting →
Match Group kept Stephen Matthews on Hinge despite rape reports
A woman reported to Hinge that Stephen Matthews, a cardiologist she met on the app, drugged and sexually assaulted her in January 2023. Match Group, Hinge's parent company, had already received reports that Matthews had raped other women, but he remained on the platform until his arrest. He was later convicted of 35 counts and sentenced to 158 years to life. Lawyers for the women allege Match Group's failure to act allowed further abuse.
- Company involved
- Match Group
- AI system involved
- Hinge
4 source articles · read the reporting →
Deloitte software glitches wrongly remove Texans from Medicaid
Advocacy groups filed a complaint with the Federal Trade Commission alleging that Deloitte's eligibility software, TIERS, used by Texas Medicaid, wrongly disenrolled qualified recipients due to glitches. Nearly 1.8 million Texans lost coverage after the pandemic pause ended, with many errors attributed to procedural issues but some linked to system malfunctions. Deloitte denies the claims, while the state says it restored care for at least 90,000 people. The FTC has not yet responded to the complaint.
- Company involved
- Texas Health and Human Services Commission
- AI system involved
- TIERS
6 source articles · read the reporting →
Facebook AI bans female photography charity Hundred Heroines due to word confusion
Facebook's AI content moderation system banned the British charity Hundred Heroines for ten years, mistakenly confusing the word 'heroine' with the illegal drug 'heroin'. The charity, which promotes women in photography, was unable to resolve the issue through repeated attempts to contact Facebook. It has created a new page, HH Museum, as a temporary workaround while the original page remains banned.
- Company involved
- Facebook
3 source articles · read the reporting →
Two women hospitalized after stopping medication on ChatGPT's advice
Two women in Ho Chi Minh City, Vietnam, stopped taking prescribed medications for diabetes and high cholesterol after following advice from OpenAI's ChatGPT. This led to severe health complications, including dangerously high blood sugar and signs of myocardial ischemia, requiring hospitalization. The treating doctor warned that AI cannot replace medical professionals and that self-medicating based on AI advice can be life-threatening.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
1 source article · read the reporting →
Deepfake adverts using Barbara O'Neill's likeness promote fake prostate cures
AI-generated deepfake videos impersonating Australian naturopath Barbara O'Neill are circulating on Facebook, falsely endorsing a cure for prostate problems and erectile dysfunction. The videos, which have millions of views, are part of a scam to sell products or phish for personal information. Africa Check found the videos to be deepfakes, with audio out of sync and posted by accounts unaffiliated with O'Neill, who has previously warned about such impersonations.
2 source articles · read the reporting →
Meta Ran Hundreds of Ads for Illegal Drugs on Facebook and Instagram
Meta Platforms ran hundreds of ads on Facebook and Instagram that directed users to online marketplaces for illegal drugs, including cocaine and opioids, despite company policies prohibiting such content. The ads continued to appear as recently as July 2024, months after the Wall Street Journal reported that Meta was under federal investigation for the practice. A 15-year-old California boy, Elijah Ott, died of an overdose in 2023 after seeking drugs on Instagram. The company has not publicly commented on the ongoing ads.
- Company involved
- Meta Platforms
2 source articles · read the reporting →
Security Health Plan used AI to cut off nursing home care for 85-year-old woman
Frances Walter, an 85-year-old woman with a shattered shoulder, had her nursing home care payment cut off by Security Health Plan after an algorithm predicted she would recover in 16.6 days. The algorithm, nH Predict from NaviHealth, did not account for her severe pain and allergy to pain medicine. She was forced to spend her life savings and enroll in Medicaid while fighting the denial. A federal judge later ruled the denial was speculative and she was owed thousands of dollars.
- Company involved
- Security Health Plan
- AI system involved
- nH Predict
1 source article · read the reporting →
AI-generated video falsely shows scientist endorsing heart disease remedy
A Facebook page published an AI-generated video impersonating US-based Nigerian scientist Samuel Achilefu and a TVC News presenter to promote a fake heart disease remedy called Cordis. The video falsely claimed the product could revitalise blood vessels and stabilise blood pressure. Achilefu denied involvement and reported the video to the FBI. AFP Fact Check found the video was created using AI and the product's manufacturer denied producing it.
- Company involved
- Mohammad Al-Hamdan
2 source articles · read the reporting →
NHS faces legal action over Palantir data contract extension
The NHS is being taken to court by campaign group Open Democracy over its contract with data firm Palantir. The legal action alleges that the extension of Palantir's involvement in analysing NHS patient data for pandemic response and beyond lacked a proper Data Protection Impact Assessment. The contract, initially an emergency response, was extended for two years at a cost of £23.5m. The case is pending.
- Company involved
- NHS
- AI system involved
- Palantir data analysis platform
10 source articles · read the reporting →
Kmart's facial recognition system for refund fraud found unlawful by Privacy Commissioner
Kmart Australia deployed facial recognition technology in 28 stores from June 2020 to July 2022, capturing biometric data of every customer entering the stores and those at returns counters to detect refund fraud. The system collected sensitive information without notifying customers or obtaining their consent. The Australian Privacy Commissioner found that Kmart breached the Privacy Act, as the exemption for unlawful activity did not justify the indiscriminate and disproportionate collection of biometric data from thousands of individuals. Kmart has ceased using the system and cooperated with the investigation.
- Company involved
- Kmart Australia Limited
7 source articles · read the reporting →
Zillow faces securities class action over Zillow Offers wind-down
Zillow Group, Inc. is accused of making false and misleading statements to investors about its Zillow Offers home-flipping business. The company allegedly failed to disclose that its forecasting algorithm was unable to predict home prices accurately, leading to a $304 million inventory write-down and a decision to wind down the business. Investors who bought shares between February 10 and November 2, 2021, suffered losses when the stock price dropped after the announcement. A class action lawsuit has been filed in Washington federal court.
- Company involved
- Zillow Group, Inc.
- AI system involved
- Zillow Offers
10 source articles · read the reporting →
NEDA Fires Helpline Staff, Replaces Them with Chatbot After Unionization
The National Eating Disorders Association (NEDA) fired four full-time helpline staff and announced the shutdown of its 20-year-old helpline, replacing it with a chatbot named Tessa. The staff had recently unionized and won an NLRB election, leading to allegations that the move was union busting. NEDA claims the chatbot, a rule-based system developed by Washington University, is a separate program to better serve the community, but the union and critics argue it cannot replace human empathy and may cause irreparable harm. The helpline is set to end on June 1, 2023, with volunteers asked to become testers for the chatbot.
- Company involved
- National Eating Disorders Association (NEDA)
- AI system involved
- Tessa
10 source articles · read the reporting →
New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com
The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.
- Company involved
- Meta Platforms
- AI system involved
- Meta AI-enabled Ray-Ban and Oakley smart glasses
1 source article · read the reporting →
Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.
Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.
- Company involved
- Sports Direct
- AI system involved
- Facewatch
2 source articles · read the reporting →
Carlisle woman, 82, dies after losing 35,000 pounds to Nigel Farage deepfake scam
The deepfake video convinced the victim to invest in a fraudulent scheme, leading to financial loss.
1 source article · read the reporting →
DFFH breaches privacy by using ChatGPT in child protection report
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
- Company involved
- Department of Families, Fairness and Housing
- AI system involved
- ChatGPT
9 source articles · read the reporting →
FTC orders WW International and Kurbo to delete children's data and pay $1.5m penalty
The US Federal Trade Commission alleged that WW International, formerly Weight Watchers, and its subsidiary Kurbo illegally collected personal and health data from children under 13 through the Kurbo by WW weight-loss app without parental consent. The complaint said the signup process encouraged children to lie about their age and that the companies retained the data indefinitely. The companies settled, agreeing to delete the data, destroy any algorithms derived from it, and pay a $1.5 million penalty.
- Company involved
- WW International, Inc. (formerly Weight Watchers) and Kurbo, Inc.
- AI system involved
- Kurbo by WW
10 source articles · read the reporting →
Tinder accused of age discrimination in Tinder Plus pricing
A CHOICE mystery shop found Tinder charging users over 30 up to five times more for Tinder Plus than younger users, with prices ranging from $6.99 to $34.37 per month. An anti-discrimination law expert says this likely breaches Australia's Age Discrimination Act 2004. Tinder did not respond to CHOICE's requests for comment, but settled a similar US lawsuit by stopping age-based pricing in California and compensating affected users.
- Company involved
- Tinder
- AI system involved
- Tinder Plus
4 source articles · read the reporting →
Deepfake Elon Musk scam costs healthcare worker over $10,000
Heidi Swan, a 62-year-old healthcare worker, lost over $10,000 after investing in a cryptocurrency scheme promoted by deepfake videos of Elon Musk on Facebook and TikTok. The videos, created using artificial intelligence, appeared convincing and led her to believe the endorsement was genuine. Deepfake scams are rising, with AI-generated content contributing to over $12 billion in fraud losses last year, according to Deloitte. Swan's case remains unresolved.
2 source articles · read the reporting →
Pensioner loses $224k to AI deepfake cryptocurrency scam featuring Prime Minister Luxon
A 72-year-old Taranaki grandmother lost $224,000 after being tricked by an AI-generated deepfake video of Prime Minister Christopher Luxon promoting cryptocurrency investment. The scammers used remote access software to transfer her savings and inheritance. TSB declined liability, stating the victim enabled the scam by granting remote access. Police are investigating.
- Company involved
- TSB
2 source articles · read the reporting →
Flo Health shared fertility app users’ health data with Facebook and Google.
Flo Health Inc., the maker of the Flo Period & Ovulation Tracker app, is accused of sharing millions of users' sensitive health data with marketing and analytics firms including Facebook and Google, despite promising to keep that data private. The Federal Trade Commission (FTC) finalized a settlement requiring Flo to obtain affirmative consent before sharing health data, notify affected users, and have an independent privacy review. The company also must instruct third parties to destroy the received data and is prohibited from misrepresenting its data practices.
- Company involved
- Flo Health Inc.
- AI system involved
- Flo Period & Ovulation Tracker
10 source articles · read the reporting →
BetterHelp settles FTC charges over sharing mental health data with advertisers
Mozilla's review of mental health apps found that many, including BetterHelp, had poor privacy and security practices. BetterHelp was accused of improperly sharing customers' sensitive data with advertisers like Facebook and Snapchat after promising to keep it private. The company agreed to pay $7.8 million to settle FTC charges. The incident highlights ongoing privacy concerns in the mental health app market.
- Company involved
- BetterHelp
- AI system involved
- BetterHelp
4 source articles · read the reporting →
