U.S. Border Patrol uses AI and ALPR to target drivers for pretext stops and asset seizures
The U.S. Border Patrol has built a nationwide dragnet driver-surveillance system using automated license plate readers and AI to flag suspicious travel patterns. Local police then pull over targeted drivers on pretexts, interrogate them, and seize cash and vehicles through civil asset forfeiture. The program has been kept secret, with details hidden from court documents and the public. The ACLU report highlights the abuse of innocent drivers and calls for congressional action.
- Company involved
- U.S. Border Patrol (CBP)
- AI system involved
- Automated license plate reader (ALPR) system with AI analytics
6 source articles · read the reporting →
CBP One app's facial recognition fails on Black skin tones, migrants report
Migrants and advocates report that the U.S. Customs and Border Protection's CBP One app, used to schedule asylum appointments, frequently crashes and fails to recognize photographs of Black individuals, particularly affecting Haitians. The app also splits families and assigns appointments at distant border crossings, causing long waits in dangerous conditions. CBP did not respond to requests for comment.
- Company involved
- U.S. Customs and Border Protection
- AI system involved
- CBP One
4 source articles · read the reporting →
Joel A. Rivera v. Triad Properties Corporation, et al. (N.D. Alabama): AI-hallucinated content in court filing, Public Reprimand; Disqualification; Bar…
The AI generated fabricated legal citations that were presented to the court, affecting the defendants and the judicial process.
- Company involved
- Burrill Watkins LLC
- AI system involved
- ChatGPT
1 source article · read the reporting →
Newham Council fined £145,000 over leaked gang matrix data
Newham Council was fined £145,000 by the Information Commissioner's Office after a leaked unredacted gangs matrix, containing details of 203 suspected gang members, ended up in the hands of rival gang members via Snapchat. The leak occurred in January 2017 when a council employee emailed both redacted and unredacted versions to 44 recipients. The ICO found the breach was unnecessary and that the council failed to report it promptly. The council apologised and accepted the breach was not deliberate.
- Company involved
- Newham Council
- AI system involved
- Gangs matrix
8 source articles · read the reporting →
DWP's Universal Credit algorithm causes underpayment and hardship for claimants
The Department for Work and Pensions (DWP) uses an automated means-testing algorithm in its Universal Credit system that miscalculates earnings due to a design flaw, leading to underpayments and fluctuating benefit amounts. Claimants such as Janet R. received payments hundreds of pounds short, forcing them into debt and foodbank use. A Court of Appeal ruling in June 2020 ordered the DWP to fix the flaw, but the department had not yet fully implemented the remedy at the time of writing.
- Company involved
- Department for Work and Pensions
- AI system involved
- Universal Credit
10 source articles · read the reporting →
Titus Henderson files civil rights lawsuit against COMPAS
Titus Henderson, a prisoner, filed a civil rights lawsuit against COMPAS and other defendants in the U.S. District Court for the Western District of Wisconsin on July 16, 2018. The lawsuit alleges discrimination related to the use of the COMPAS risk assessment tool. The case is ongoing.
- AI system involved
- COMPAS
6 source articles · read the reporting →
Uber faces discrimination claim over facial recognition dismissal
Pa Edrissa Manjang, an UberEats driver, was dismissed after Uber's facial recognition system failed to recognize him. He alleges racial discrimination and harassment. Uber attempted to have the claim struck out, but the East London Employment Tribunal refused. Uber later reinstated Manjang, and the case continues.
- Company involved
- Uber
- AI system involved
- Microsoft facial recognition technology
10 source articles · read the reporting →
Study finds Italian car insurers charge more based on birthplace
A study by the Universities of Padua, Udine and Carnegie Mellon found that Italian car insurers, including Genertel, Mps, Quixa and Con.Te, use birthplace and citizenship in pricing algorithms, charging some drivers over €1,000 more. The practice was ruled against in a 2018 decree involving Linear, but the study says it continues. The companies contacted denied or explained the findings.
- Company involved
- Genertel, Mps, Quixa, Con.Te
8 source articles · read the reporting →
LA's VI-SPDAT housing scoring system gives lower priority to Black and Latino people
The Los Angeles Homeless Services Authority uses the VI-SPDAT scoring system to prioritise unhoused people for subsidised permanent housing. An investigation by The Markup found that Black and Latino people consistently receive lower vulnerability scores than White people, leading to lower priority for housing. The agency has acknowledged the racial disparities and is working on a new tool, but continues to use the current system.
- Company involved
- Los Angeles Homeless Services Authority
- AI system involved
- VI-SPDAT
10 source articles · read the reporting →
Aguilar v. The Crawford Group, Inc. (D. Massachusetts): AI-hallucinated content in court filing, Adverse Costs Order; Pro hac vice status…
The AI generated fake legal citations that were included in a court filing, misleading the court and opposing counsel.
- Company involved
- Lindemann Law Firm
1 source article · read the reporting →
USPS algorithm RRECS causes pay cuts for two-thirds of rural mail carriers
The United States Postal Service (USPS) implemented a new algorithm, RRECS, to evaluate rural carrier routes and determine pay. Due to flaws in how carriers scanned packages, the algorithm underestimated route times, resulting in pay cuts for 66 per cent of rural carriers, some losing thousands of dollars annually. Carriers report that they were not adequately trained on the system and that the cuts are scheduled to take effect, though they have been postponed multiple times. The USPS stated that the system is the result of a nationally negotiated agreement.
- Company involved
- United States Postal Service
- AI system involved
- RRECS
9 source articles · read the reporting →
University of Chicago report finds US healthcare algorithms rife with bias
A University of Chicago report alleges that algorithms used by hospitals, insurers and other businesses across the US are biased along racial and economic lines. The algorithms help triage patients, predict diabetes and flag those needing extra care, but the report says flawed products were introduced with little oversight. It says inequitable treatment has continued for more than a decade.
7 source articles · read the reporting →
Campaigners call for end to Home Office's IPIC 'robo-caseworker' AI tool
Migrants' rights campaigners have called for the UK government to stop using the IPIC (Identify & Prioritise Immigration Cases) AI system, which automatically identifies and recommends migrants for immigration decisions or enforcement action. Privacy International and the Migrants' Rights Network have raised concerns that the system could lead to racial bias and the 'rubberstamping' of algorithmic recommendations by caseworkers. The campaigners argue that people going through the immigration system may not know their information has been processed by an algorithm. The Home Office has not directly responded to the specific concerns, though Science Secretary Peter Kyle has defended the safe development of AI in public services.
- Company involved
- Home Office
- AI system involved
- IPIC (Identify & Prioritise Immigration Cases)
9 source articles · read the reporting →
TOV Realty, LLC v. Suarez; Kosel Equity, LLC v. MacGregor (SC Connecticut): AI-hallucinated content in court filing, 6 hours CLE;…
The AI generated legal briefs containing fabricated citations, which were submitted to the Connecticut Supreme Court.
- Company involved
- GLG Law LLC
- AI system involved
- ChatGPT
1 source article · read the reporting →
UnitedHealthcare sued for using AI to deny Medicare Advantage patients care
A class action complaint alleges that UnitedHealthcare and its subsidiary naviHealth deployed an artificial intelligence model to override treating physicians' determinations of medically necessary care for elderly Medicare Advantage patients. The complaint claims the AI model has a known 90% error rate and wrongfully denied patients care. The lawsuit, filed in the U.S. District Court for the District of Minnesota, seeks damages on behalf of the estates of two deceased patients and all others similarly situated.
- Company involved
- UnitedHealthcare, Inc.
10 source articles · read the reporting →
UnitedHealth used ALERT algorithm to limit mental health coverage, regulators found
ProPublica reports that UnitedHealth Group's Optum subsidiary used the ALERT algorithm to flag mental health patients and therapists as outliers, leading to therapy coverage denials. Regulators in California, Massachusetts and New York alleged this breached the federal Mental Health Parity and Addiction Equity Act, and UnitedHealth agreed to restrict the system in those jurisdictions. The company denies wrongdoing and says its programmes are compliant. Affected patients, including Medicaid enrollees, were left to pay out-of-pocket or go without care.
- Company involved
- UnitedHealth Group
- AI system involved
- ALERT
5 source articles · read the reporting →
Jessica Fuller v. Hyde School, et al. (D. Maine): AI-hallucinated content in court filing, CLE; Firm procedures and certification; Serve…
The AI generated fictitious legal citations that were submitted to the court in a legal filing.
- AI system involved
- ChatGPT or Claude
1 source article · read the reporting →
EviCore denied heart catheterization for patient using algorithm
In fall 2021, Little John Cupp's doctor requested a left heart catheterization exam. EviCore, a company hired by UnitedHealthcare, denied the request twice using an algorithm called 'the dial' that adjusts thresholds for review. The algorithm flagged the request for review, and EviCore's doctors determined it was not medically necessary. Cupp did not receive the procedure and his symptoms continued.
- Company involved
- EviCore (a Cigna company)
- AI system involved
- the dial
6 source articles · read the reporting →
IRCC uses AI triage for Temporary Resident Visa applications
Immigration, Refugees and Citizenship Canada (IRCC) uses an AI system called Advanced Analytics to triage Temporary Resident Visa applications from India and China. The system categorizes applications into tiers, with Tier 1 approved automatically and others sent to human officers. Critics allege the system lacks transparency and may introduce bias, leading to visa refusals without clear rationale. The author, a Canadian immigration lawyer, is filing Federal Court cases on behalf of clients affected by refusals.
- Company involved
- Immigration, Refugees and Citizenship Canada (IRCC)
- AI system involved
- Advanced Analytics Triage of Overseas Temporary Resident Visa Applications
10 source articles · read the reporting →
Judge rules lawsuit over UnitedHealth’s AI care denials can move forward - STAT
The system denied necessary medical care to Medicare Advantage beneficiaries.
- Company involved
- UnitedHealth Group
1 source article · read the reporting →
California EDD's automated fraud detection wrongly suspended 600,000 legitimate unemployment claims
In January 2021, the California Employment Development Department used Thompson Reuters automated batch review software to flag 1.1 million unemployment claims as potentially fraudulent. EDD stopped payments on those claims without prior notice. Later, over 600,000 were confirmed as legitimate after claimants used ID.me to verify their identity. The incident highlights the trade-off between fraud prevention and timely benefit access.
- Company involved
- California Employment Development Department (EDD)
- AI system involved
- Thompson Reuters Automated Batch Review
7 source articles · read the reporting →
Haryana government's algorithm wrongly declares thousands dead, stops pensions
The Haryana state government's Family Identity Data Repository (PPP) algorithm wrongly declared thousands of elderly and widowed citizens as dead, stopping their pensions. Dhuli Chand, a 102-year-old man, had to stage a mock wedding procession to prove he was alive after his pension was cut for six months. The government acknowledged the errors and corrected some records, but many still face difficulties.
- Company involved
- Haryana state government
- AI system involved
- Family Identity Data Repository (Parivar Pehchan Patra or PPP)
6 source articles · read the reporting →
UNOS liver allocation policy reduces transplants in poorer states
The United Network for Organ Sharing (UNOS) implemented a new liver allocation policy in 2020 called the acuity circles system, which prioritizes the sickest patients regardless of location. An analysis by The Markup and The Washington Post found that the policy led to sharp declines in liver transplants in several Southern and Midwestern states and Puerto Rico, while increasing transplants in New York and California. Patients in affected states allege the system disadvantages poorer regions, and hospitals have sued to overturn the policy.
- Company involved
- United Network for Organ Sharing (UNOS)
- AI system involved
- Acuity circles liver allocation policy
10 source articles · read the reporting →
Woman denied state welfare card groceries after face scan fails
A grandmother rode her motorcycle several kilometres to a shop in Sapphaya district, Chai Nat province, to use her state welfare card to buy groceries for her family. After selecting items, she failed repeated facial recognition scans because her ID card photo was years old and no longer matched her appearance. She left the shop empty-handed and in tears.
- Company involved
- Government of Thailand (state welfare card system)
2 source articles · read the reporting →
