US woman falsely charged with bank theft sues for $10m over AI facial recognition - The Guardian
The system identified Angela Lipps as a suspect in bank theft, leading to her false arrest and imprisonment.
- Company involved
- Fargo Police Department
1 source article · read the reporting →
AI Hiring Platform Faces FCRA Class Action Over Data Use | Kistler et al. v. Eightfold AI Inc.
The AI platform screened job applicants, affecting their hiring prospects.
- Company involved
- Eightfold AI
- AI system involved
- Eightfold AI
1 source article · read the reporting →
AI Lawsuit Pushes the Boundaries of AI Litigation—and May Signal a New Wave
Ranked job applicants' likelihood of success, affecting their hiring prospects.
- Company involved
- Eightfold AI Inc.
- AI system involved
- Eightfold AI Hiring Platform
1 source article · read the reporting →
Single mom loses six-figure job after alleged background check errors
The background check system flagged discrepancies in employment history, causing the employer to rescind a job offer to Krishan Tucker.
- Company involved
- HireRight
- AI system involved
- HireRight
1 source article · read the reporting →
AI chatbots used to steal US college financial aid
Crime rings are deploying AI chatbots as 'ghost students' to enrol in online college courses and fraudulently collect US federal financial aid. Victims of identity theft, such as Heather Brady and Brittnee Nelson, discovered loans of over $9,000 and $5,000 respectively taken out in their names for colleges they never attended. The US Education Department introduced a temporary rule requiring government-issued ID for first-time aid applicants, while California community colleges reported losing at least $11.1 million to such scams.
- Company involved
- Delgado Community College
4 source articles · read the reporting →
How Your Shadow Credit Score Could Decide Whether You Get an Apartment - ProPublica
Tenant screening companies assign renters a score drawn from data far wider than credit history, an industry subject to less regulation than credit scoring agencies. ProPublica reports that experts warn these algorithms can decide who gets an apartment on the basis of information applicants cannot see or correct. Kim Fuller was denied a rental application on such a score.
- Company involved
- Habitat America
- AI system involved
- RentGrow
1 source article · read the reporting →
Goldman Sachs Apple Card Algorithm Accused of Gender Bias in Credit Limits
In late 2019, David Heinemeier Hansson alleged on Twitter that the Apple Card underwriting algorithm, operated by Goldman Sachs, gave him a higher credit limit than his wife despite similar financial profiles. The New York Department of Financial Services investigated and found no violation of fair lending laws, but critics argue the audit methodology was outdated and failed to detect proxy discrimination. Apple later updated its credit policy to allow spouses to combine credit files, acknowledging a lack of fairness in industry credit scoring.
- Company involved
- Goldman Sachs
- AI system involved
- Apple Card
6 source articles · read the reporting →
ICE’s Mobile Fortify Facial Recognition App Misidentified a Woman Twice
During an immigration raid in Oregon, ICE agents used the Mobile Fortify facial recognition app on a detained woman to determine her identity and immigration status. The app returned two different incorrect names, according to testimony from a CBP official. ICE has claimed the app provides a definitive determination of immigration status, but this incident raises concerns about its accuracy. The misidentification could have led to wrongful removal proceedings.
- Company involved
- U.S. Immigration and Customs Enforcement (ICE)
- AI system involved
- Mobile Fortify
1 source article · read the reporting →
Scammers use AI-generated identities to steal $5.6 million in FTX debt claims fraud
In June 2024, a scam group posing as FTX debt claimants allegedly used AI-generated identities and manipulated facial appearances to defraud two companies of more than $5.6 million. The perpetrators accessed FTX customer data through public bankruptcy filings or a 2023 data breach at Kroll. Blockchain analysis traced the stolen funds through Binance, CoinEx, and Gate.io. The incident remains unresolved.
6 source articles · read the reporting →
SEC Charges Delphia and Global Predictions for False AI Claims
The SEC charged Delphia (USA) Inc. and Global Predictions Inc. for making false and misleading statements about their use of artificial intelligence. Delphia claimed from 2019 to 2023 that it used AI and machine learning to predict investments, while Global Predictions falsely claimed in 2023 to be the 'first regulated AI financial advisor'. Both firms settled the charges without admitting or denying the findings, agreeing to pay a total of $400,000 in civil penalties and to cease and desist from further violations.
- Company involved
- Delphia (USA) Inc. and Global Predictions Inc.
1 source article · read the reporting →
CFPB Acts Against Hello Digit for Faulty Savings Algorithm Causing Overdrafts
Hello Digit, a fintech company, used an automated savings algorithm that made transfers from consumers' checking accounts, falsely guaranteeing no overdrafts. The algorithm caused customers to incur overdraft fees, and the company often denied reimbursement requests. The CFPB found that Hello Digit engaged in deceptive practices and ordered the company to pay redress to harmed consumers and a $2.7 million fine.
- Company involved
- Hello Digit, LLC
- AI system involved
- Hello Digit app
1 source article · read the reporting →
Schufa's Black-Box Scoring Unfairly Penalises Consumers with Positive Credit Data
An investigation by SPIEGEL and BR Data reveals that Schufa's credit scoring algorithm often assigns poor risk scores to consumers with only positive credit information. One consumer, Sven Drewert, was denied a credit card limit increase despite having no negative entries. The algorithm uses limited data, and its secret formula can lead to arbitrary categorisations, affecting access to loans, phone contracts, and housing. The system's opacity and potential biases raise concerns about fairness and accountability.
- Company involved
- Schufa Holding AG
- AI system involved
- Schufa Score
2 source articles · read the reporting →
HSBC voice ID breached by customer's twin brother
BBC reporter Dan Simmons set up an HSBC voice-ID authenticated account. His non-identical twin brother Joe was able to mimic his voice and gain access after eight attempts, viewing balances and transactions and being offered the chance to transfer money. HSBC acknowledged the breach and reduced the number of allowed attempts from seven to three. The bank stated that the system remains secure and that the scenario was not typical of fraud.
- Company involved
- HSBC
- AI system involved
- Voice ID
3 source articles · read the reporting →
RCMP used IntelCenter facial recognition without disclosure
The RCMP in British Columbia secretly subscribed to IntelCenter's facial recognition service, which matched faces against a database of 700,000 faces tied to terrorism. Internal emails revealed the force broke its own procurement rules and hid the purchase. The RCMP claimed it was only for testing, but documents showed active use. The contracts ended in 2019.
- Company involved
- Royal Canadian Mounted Police (RCMP)
- AI system involved
- IntelCenter Check
10 source articles · read the reporting →
Arity collected drivers' data via apps for insurance scores
Popular smartphone apps including Life360, MyRadar and GasBuddy reportedly shared users' location and motion data with Arity, an Allstate-owned company. Arity used the data to calculate driving scores that could be sold to car insurers to set rates. Users were said not to be clearly informed that their data would be used for insurance pricing. Life360 and Arity stated that users had to opt in and that no personally identifiable driving data was shared without consent.
- Company involved
- Arity
- AI system involved
- Arity IQ network
2 source articles · read the reporting →
CFPB fines General Information Services for inaccurate background checks
The Consumer Financial Protection Bureau took action against General Information Services and its affiliate e-Background-checks.com for failing to ensure the accuracy of employment background screening reports. The companies allegedly provided inaccurate criminal history information to employers, potentially affecting job applicants' eligibility and causing reputational harm. The CFPB ordered the companies to provide $10.5 million in relief to harmed consumers and pay a $2.5 million penalty.
- Company involved
- General Information Services
10 source articles · read the reporting →
FinTech and traditional lenders discriminate against minority borrowers in mortgage pricing
A study of mortgage lending from 2012-2018 found that Latinx and African-American borrowers were charged higher interest rates than white borrowers with similar credit risk. FinTech algorithms reduced the disparity by 40% but did not eliminate it. The discrimination costs minority borrowers an estimated $765 million per year in extra interest.
10 source articles · read the reporting →
Wells Fargo software error caused hundreds of faulty foreclosures
Wells Fargo disclosed that a software error in its mortgage modification underwriting tool caused incorrect denials of loan modifications for approximately 870 borrowers between 2010 and 2015. The error miscalculated attorneys' fees, leading to 545 foreclosures that should not have occurred. Wells Fargo set aside $8 million for remediation and is contacting affected customers to offer compensation and mediation.
- Company involved
- Wells Fargo
3 source articles · read the reporting →
Bankrate Publishes AI-Generated Article with Numerous Factual Errors, Deletes After Futurism Inquiry
Bankrate published an AI-generated article about the best places to live in Colorado that contained multiple factual errors, including incorrect median home prices and unemployment rates. The article was removed after Futurism pointed out the mistakes. A Bankrate spokesperson blamed the errors on outdated data from an internal database, claiming the article was editor-reviewed. The incident follows a previous scandal where CNET and Bankrate paused AI content after similar errors, but the company has resumed AI article publication.
- Company involved
- Bankrate
1 source article · read the reporting →
France: CNAF's discriminatory risk-scoring algorithm must be stopped
Amnesty International and coalition partners filed a complaint with the Council of State against CNAF's risk-scoring algorithm used to detect benefit overpayments. The algorithm assigns risk scores based on criteria that discriminate against vulnerable groups, including those with disabilities, single parents, and low-income households. The complaint alleges the system violates human rights to equality and privacy. The EU AI Act's social scoring ban may apply, but its definition remains unclear.
- Company involved
- CNAF
2 source articles · read the reporting →
Nevada's AI grad score model cuts funding for low-income students
Nevada replaced its income-based school funding formula with a machine learning model developed by Infinite Campus that generates a 'grad score' for each student. The model reduced the number of students eligible for supplemental funding from 288,000 to 63,000, disproportionately affecting low-income students. Critics argue the model lacks transparency and de-emphasizes economic status, potentially leaving many high-poverty schools underfunded.
- Company involved
- Nevada Department of Education
- AI system involved
- Grad score model
7 source articles · read the reporting →
DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts
DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.
- Company involved
- DeepScore
- AI system involved
- DeepScore
6 source articles · read the reporting →
Facebook Allowed Age-Targeted Credit Card Ads Violating Its Policy
The Markup found that four companies—Aspiration, Hometap, Chime, and Varo Bank—ran Facebook ads for credit cards and home equity loans that were targeted by age, excluding users under 25 or 35. This practice violates Facebook's own anti-discrimination policy and may violate the Equal Credit Opportunity Act and California's Unruh Civil Rights Act. Facebook did not respond to requests for comment, and some advertisers said they would review their ad targeting.
- Company involved
- Facebook
- AI system involved
- Facebook Ad Platform
9 source articles · read the reporting →
Study finds credit score algorithms less accurate for minorities
A study of 50 million US consumers found that credit scoring algorithms used by mortgage lenders are less accurate for minority and low-income applicants due to sparse credit data, leading to higher rejection rates. The inaccuracy is due to noise in the data, not bias, so fairer algorithms cannot fix it. The study suggests that adjusting for bias had no effect, and that addressing the inaccuracy could reduce disparities by 50%.
- Company involved
- Mortgage lenders (unnamed)
- AI system involved
- Credit scoring algorithms
6 source articles · read the reporting →