Civitai introduces bounties for deepfakes of a private individual
Civitai, an online marketplace for sharing AI models, introduced a bounty feature that allows users to request and reward AI models that generate nonconsensual deepfake images of specific real people. 404 Media found at least one bounty targeting a private person with no significant public online presence, who expressed fear and distress over the misuse of her image. The platform facilitates the creation of nonconsensual sexual images without the subject's consent.
- Company involved
- Civitai
- AI system involved
- Civitai bounty feature
10 source articles · read the reporting →
Meta makes $$$ from deepfake AI scams… then fails to assist victims - Independent Australia
Meta makes $$$ from deepfake AI scams… then fails to assist victims Independent Australia
- Company involved
- Meta
1 source article · read the reporting →
AI Scammers Clone Exante Broker, Use JPMorgan Account to Defraud US Victim
Scammers used generative AI to create a fake clone of the brokerage firm Exante, including a replicated trading platform and AI-generated passports. They opened a real JPMorgan Chase bank account using a US address and tricked at least one US victim into transferring funds. Exante, which does not serve US clients, discovered the scam when the victim was registered on its real platform and reported the incident to the FBI, SEC, CFTC, and other authorities. The scammers remain unidentified, and the victim's funds have not been recovered.
2 source articles · read the reporting →
AI Hiring Platform Faces FCRA Class Action Over Data Use | Kistler et al. v. Eightfold AI Inc.
The AI platform screened job applicants, affecting their hiring prospects.
- Company involved
- Eightfold AI
- AI system involved
- Eightfold AI
1 source article · read the reporting →
Nate misrepresented AI shopping app, used human workers instead
Nate, a startup that claimed to use AI to auto-fill customer information for purchases, actually used human workers in the Philippines to manually complete transactions for 60-100% of orders throughout 2021, according to an investigation by The Information. The company denied the claims, calling them baseless. No harm to users was reported.
- Company involved
- Nate
- AI system involved
- Nate app
8 source articles · read the reporting →
Class action claims Checkr misreported criminal records in background checks
Checkr's system misreported criminal records belonging to someone else on Natasha Davis's consumer report, impeding her ability to gain employment.
- Company involved
- Checkr Inc.
1 source article · read the reporting →
DPRK-Linked Fake AI Job Platform Targets U.S. Tech Workers with Malware
Validin researchers report that a DPRK-linked operation known as Contagious Interview is running a fake AI-powered job platform called Lenvny. The site mimics legitimate recruitment software and advertises fabricated roles at companies such as Anthropic and Yuga Labs to lure software developers, AI researchers and crypto professionals. Applicants who reach the video introduction step are prompted to 'fix' their webcam, which delivers ClickFix malware to their computer, compromising their system and personal data. The campaign is ongoing and is considered highly convincing.
- Company involved
- DPRK-linked threat actors (Contagious Interview campaign)
- AI system involved
- Lenvny (fake AI-powered interview tool)
10 source articles · read the reporting →
How Your Shadow Credit Score Could Decide Whether You Get an Apartment - ProPublica
Tenant screening companies assign renters a score drawn from data far wider than credit history, an industry subject to less regulation than credit scoring agencies. ProPublica reports that experts warn these algorithms can decide who gets an apartment on the basis of information applicants cannot see or correct. Kim Fuller was denied a rental application on such a score.
- Company involved
- Habitat America
- AI system involved
- RentGrow
1 source article · read the reporting →
CFPB Acts Against Hello Digit for Faulty Savings Algorithm Causing Overdrafts
Hello Digit, a fintech company, used an automated savings algorithm that made transfers from consumers' checking accounts, falsely guaranteeing no overdrafts. The algorithm caused customers to incur overdraft fees, and the company often denied reimbursement requests. The CFPB found that Hello Digit engaged in deceptive practices and ordered the company to pay redress to harmed consumers and a $2.7 million fine.
- Company involved
- Hello Digit, LLC
- AI system involved
- Hello Digit app
1 source article · read the reporting →
Schufa's Black-Box Scoring Unfairly Penalises Consumers with Positive Credit Data
An investigation by SPIEGEL and BR Data reveals that Schufa's credit scoring algorithm often assigns poor risk scores to consumers with only positive credit information. One consumer, Sven Drewert, was denied a credit card limit increase despite having no negative entries. The algorithm uses limited data, and its secret formula can lead to arbitrary categorisations, affecting access to loans, phone contracts, and housing. The system's opacity and potential biases raise concerns about fairness and accountability.
- Company involved
- Schufa Holding AG
- AI system involved
- Schufa Score
2 source articles · read the reporting →
NPR's David Greene sues Google over AI voice cloning in NotebookLM
David Greene, a former NPR host, alleges that Google's NotebookLM tool replicated his voice without permission. He says he was 'completely freaked out' when a colleague asked if he had licensed his voice to the company. Greene is suing Google, claiming the product violated his rights by using an AI-generated voice that sounds like his own. The lawsuit is pending.
- Company involved
- Google
- AI system involved
- NotebookLM
1 source article · read the reporting →
Services Australia voiceprint system fooled by AI voice clone
A Guardian Australia investigation found that the voiceprint system used by Services Australia's Centrelink and the Australian Taxation Office can be bypassed using an AI-generated voice clone. A journalist created a clone of their own voice from four minutes of audio and used it with a customer reference number to access their Centrelink self-service account. The system is used by millions of Australians for identity verification over the phone. Services Australia stated that it continually assesses risks and applies additional tests if unusual circumstances are detected, but did not commit to changing the technology.
- Company involved
- Services Australia
- AI system involved
- Voiceprint
1 source article · read the reporting →
French regulator fines Clearview AI €20 million for privacy breaches
France's privacy watchdog CNIL fined US facial recognition firm Clearview AI €20 million for unlawfully collecting and processing facial images of individuals without consent. The company scraped billions of images from websites and social media, selling access to law enforcement. Clearview AI denied being subject to EU law and refused to delete the data, claiming it was impossible to determine French residency from public photos. The CNIL ordered the firm to stop collecting data and delete existing data within two months or face daily fines.
- Company involved
- Clearview AI
10 source articles · read the reporting →
U.S. Department of Homeland Security Uses Secret Algorithm ATLAS to Flag Naturalized Citizens for Denaturalization
The U.S. Department of Homeland Security operates a secret algorithm called ATLAS that screens naturalized citizens for potential fraud or national security concerns, flagging them for denaturalization. The system, hosted on Amazon Web Services, analyzes biometric and other data from various federal databases, and its rules are undisclosed. Human reviewers then decide whether to refer flagged individuals to Immigration and Customs Enforcement for possible deportation. Critics allege the algorithm relies on inaccurate data and lacks transparency, leading to wrongful denaturalization proceedings.
- Company involved
- U.S. Department of Homeland Security
- AI system involved
- ATLAS
2 source articles · read the reporting →
Google sues Chinese gang over AI-powered fraud targeting Americans
Google has filed a lawsuit against a Chinese cybercrime group called Outsider Enterprise, alleging it used Google's Gemini AI to create hundreds of fake websites impersonating companies and government services. The group allegedly sent millions of phishing messages to Android users, defrauding hundreds of thousands of Americans of millions of dollars. Google is coordinating with the FBI and wireless carriers to dismantle the network. The lawsuit, filed in the Southern District of New York, seeks an injunction to take down the operation.
- Company involved
- Outsider Enterprise
- AI system involved
- Gemini
3 source articles · read the reporting →
North Korean hackers use ChatGPT to scam LinkedIn users
North Korean state-affiliated hacking group Emerald Sleet (Kimsuky) used OpenAI's ChatGPT to research targets and draft phishing content for scams on LinkedIn. Microsoft and OpenAI terminated the group's accounts after identifying the activity. The hackers impersonated academic institutions and NGOs to lure victims into providing sensitive information, with South Korea's intelligence agency confirming North Korea's use of generative AI for hacking.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
6 source articles · read the reporting →
France: CNAF's discriminatory risk-scoring algorithm must be stopped
Amnesty International and coalition partners filed a complaint with the Council of State against CNAF's risk-scoring algorithm used to detect benefit overpayments. The algorithm assigns risk scores based on criteria that discriminate against vulnerable groups, including those with disabilities, single parents, and low-income households. The complaint alleges the system violates human rights to equality and privacy. The EU AI Act's social scoring ban may apply, but its definition remains unclear.
- Company involved
- CNAF
2 source articles · read the reporting →
UIUC researchers use OpenAI API to automate phone scams for under a dollar
Researchers at the University of Illinois Urbana-Champaign used OpenAI's Realtime API to create AI agents that can autonomously execute phone scams. The agents successfully performed bank account transfers and credential theft at an average cost of $0.75 per scam. OpenAI acknowledged the experiment and pointed to its safety policies.
- Company involved
- University of Illinois Urbana-Champaign
- AI system involved
- GPT-4o Realtime API
6 source articles · read the reporting →
Gradient app charges users unexpected subscription fees after free trial
The Gradient app, a celebrity lookalike app promoted by the Kardashians, charges users $19.99 per month after a three-day free trial without clear disclosure. Users complained on social media about unexpected credit card charges. The app's developer, Ticket to the Moon, has not addressed the billing complaints but denied collecting user data.
- Company involved
- Ticket to the Moon, Inc.
- AI system involved
- Gradient
9 source articles · read the reporting →
Study finds Italian car insurers charge more based on birthplace
A study by the Universities of Padua, Udine and Carnegie Mellon found that Italian car insurers, including Genertel, Mps, Quixa and Con.Te, use birthplace and citizenship in pricing algorithms, charging some drivers over €1,000 more. The practice was ruled against in a 2018 decree involving Linear, but the study says it continues. The companies contacted denied or explained the findings.
- Company involved
- Genertel, Mps, Quixa, Con.Te
8 source articles · read the reporting →
DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts
DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.
- Company involved
- DeepScore
- AI system involved
- DeepScore
6 source articles · read the reporting →
LoanDepot algorithm denied mortgage to Black couple in Charlotte
In August 2019, Crystal Marie and Eskias McDaniels, a Black couple, were denied a mortgage for a house in Charlotte, North Carolina, by loanDepot's automated underwriting algorithm. The algorithm rejected the application because Crystal Marie was a contractor, not a full-time employee, despite her high credit score and income. After the couple enlisted their real estate agent and employer to intervene, the lender reversed the decision and cleared them to close. The couple alleged that race played a role in the denial, which loanDepot denied.
- Company involved
- loanDepot
- AI system involved
- Classic FICO and Fannie Mae/Freddie Mac automated underwriting software
10 source articles · read the reporting →
Broadcasters sue Naver for using news content in AI training without permission
KBS, MBC, and SBS filed a copyright lawsuit against Naver, alleging that Naver used their news articles to train its generative AI platforms HyperCLOVA and HyperCLOVA X without permission. The broadcasters' association had previously sent notices prohibiting such use and requested compensation, but Naver did not respond. Naver has since revised its terms and refrained from using news data without consent.
- Company involved
- Naver
- AI system involved
- HyperCLOVA, HyperCLOVA X
5 source articles · read the reporting →
Good Daily operates AI-generated local news network without disclosure
Good Daily Inc., run by Matthew Henderson, operates hundreds of AI-generated local newsletters across the U.S. that aggregate and summarize news from local outlets. The newsletters use large language models without disclosing this to subscribers, and feature fabricated testimonials. Some readers reported being signed up without their consent. Local news outlets have criticized the network for not driving meaningful traffic and for undermining trust.
- Company involved
- Good Daily Inc.
- AI system involved
- Good Daily
3 source articles · read the reporting →
