The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Public Sector Solutions” · matched on meaning · public reporting

South African government departments suspend officials over AI-generated fake sources

The South African Department of Communication and Digital Technology and Department of Home Affairs suspended four officials after discovering that AI-generated fictitious references were used in policy documents. The Draft National Artificial Intelligence Policy was withdrawn from public consultation, and the Revised White Paper on Citizenship, Immigration, and Refugees was also affected. The departments are investigating and have appointed independent law firms to review all policy documents since November 2022. The ministers have pledged to implement AI verification checks in future policy approval processes.

Company involved
Department of Communication and Digital Technology; Department of Home Affairs

3 source articles · read the reporting →

Claude Code deletes developer's production database and snapshots

Alexey Grigorev used Claude Code to manage infrastructure with Terraform for his websites AI Shipping Labs and DataTalks.Club. Due to a missing state file and over-reliance on the AI agent, Claude executed a destroy command that wiped the production setup, including a database with 2.5 years of records and snapshots. Amazon Business support helped restore the data within a day. Grigorev is now implementing safeguards to prevent recurrence.

Company involved
AI Shipping Labs
AI system involved
Claude Code

2 source articles · read the reporting →

WF-02DLSM24 Jun 2019

Sidewalk Labs releases Toronto waterfront plan amid privacy concerns

Sidewalk Labs, a subsidiary of Alphabet, released a 1,500-page plan for a new development on Toronto's eastern waterfront, including the Quayside site. The plan involves extensive data collection and management, raising privacy concerns from critics and the public. Waterfront Toronto, the overseeing body, is reviewing the plan and has expressed concerns about its scope and data governance. The company has proposed an independent trust to oversee data, but critics remain unsatisfied.

Company involved
Sidewalk Labs
AI system involved
Quayside development

10 source articles · read the reporting →

WF-RMG9SS1 Jan 2022

Jordan's National Aid Fund Algorithm Denies Cash Assistance to Vulnerable Households

Human Rights Watch reported that Jordan’s Takaful cash transfer programme, run by the National Aid Fund and financed by the World Bank, uses an algorithm to rank households by estimated economic vulnerability and select recipients. The report found that the algorithm relies on inaccurate self-reported income and questionable indicators such as car ownership and utility use, causing eligible poor families to be denied benefits or receive reduced payments. The World Bank and NAF defended the programme and its targeting approach.

Company involved
National Aid Fund (NAF)
AI system involved
Takaful (Unified Cash Transfer Program)

3 source articles · read the reporting →

WF-FSUUWV6 Apr 2018

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved
Durham Constabulary
AI system involved
Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

WF-SRENGD1 Aug 2025

CISA Acting Director Uploaded Sensitive Files to Public ChatGPT

Madhu Gottumukkala, the acting director of the Cybersecurity and Infrastructure Security Agency, uploaded contracting documents marked 'for official use only' into a public version of ChatGPT in August 2025, triggering security warnings. The agency had blocked ChatGPT for other employees, but Gottumukkala had obtained special permission to use it. The Department of Homeland Security launched an internal review to assess potential harm to government security. No classified information was exposed, but the incident raised concerns about the handling of sensitive material.

Company involved
Cybersecurity and Infrastructure Security Agency
AI system involved
ChatGPT

1 source article · read the reporting →

INSS AI Denies Rural Worker's Pension After Misidentifying Her as a Man

A rural worker in Brazil, Josélia de Brito, had her pension application through the Meu INSS app automatically denied after the AI system misidentified her as a man. The INSS deployed the system to speed up benefit decisions, but experts say it struggles with complex rural cases. The case is cited as evidence that automation may exclude vulnerable people with limited digital access.

Company involved
Instituto Nacional do Seguro Social (INSS)
AI system involved
Meu INSS

4 source articles · read the reporting →

WF-SMQW6T21 Oct 2021

Civil Society Demands Halt to AI Facial Recognition Tracking System by South Korean Government

South Korea's Ministry of Justice and Ministry of Science and ICT are building an AI identification and tracking system using facial recognition for airport immigration. It was revealed that over 170 million facial photos of citizens and foreigners were transferred to private companies for AI training without proper legal basis. Civil society groups held a press conference on November 9, 2021, condemning the project as an unprecedented violation of information human rights and demanding its immediate halt. They argue the data transfer violates the Personal Information Protection Act and have requested a meeting with the Minister of Justice.

Company involved
Ministry of Justice and Ministry of Science and ICT
AI system involved
AI Identification and Tracking System

5 source articles · read the reporting →

RealPage's YieldStar algorithm pushes rents higher for tenants

RealPage's YieldStar algorithm uses private competitor data to recommend rent increases for apartment units. Landlords adopt up to 90% of the suggestions, leading to higher rents for tenants. Critics allege the software may facilitate indirect price-fixing in violation of antitrust law. The company denies wrongdoing and says the software helps eliminate collusion.

Company involved
RealPage
AI system involved
YieldStar

10 source articles · read the reporting →

WF-LH77B55 Sep 2024

Italy terminates contracts with Paragon spyware after surveillance scandal

Italy has terminated its contracts with Israeli spyware company Paragon after revelations that the spyware was used against government critics, including journalists and migrant rescue workers. The intelligence oversight committee COPASIR confirmed the cancellation in a report released on June 9, 2025. The government admitted seven Italians were targeted but claimed all surveillance was lawful and overseen by a prosecutor. Opposition parties are demanding a full investigation.

Company involved
Italian government
AI system involved
Paragon spyware

9 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

WF-YK9Q5P10 Feb 2020

Barclays pilot of Sapience monitoring software causes employee stress

Barclays introduced a pilot of employee monitoring software from Sapience in its product control department at Canary Wharf. The system monitors computer activity and admonishes staff if they are not deemed active enough, recording breaks as "unaccounted activity". Employees reported significant stress and worry about taking breaks. Barclays acknowledged the pilot and said it would listen to feedback.

Company involved
Barclays
AI system involved
Sapience employee monitoring software

10 source articles · read the reporting →

WF-KJR2I92 Apr 2020

India mandates Aarogya Setu app for workers despite privacy concerns

The Indian government has made its Aarogya Setu COVID-19 contact tracing app mandatory for gig workers and government employees, despite widespread privacy and algorithmic accountability concerns. The app lacks transparency and data protection safeguards, and could misidentify individuals as at risk, leading to forced isolation and loss of income. A coalition of 37 organisations and 75 individuals sent a joint representation to the Prime Minister's Office urging that the app not be made mandatory and calling for financial relief and healthcare for workers.

Company involved
Government of India
AI system involved
Aarogya Setu

10 source articles · read the reporting →

WF-HXS00H1 Jan 2020

Dutch government continued SyRI welfare fraud profiling after ban

The Dutch government deployed the SyRI algorithm to profile welfare recipients in low-income neighborhoods, despite a 2020 court ruling that the system violated EU human rights. The algorithm flagged thousands of parents for fraud based on illegal risk factors such as dual nationality, leading to false accusations, bankruptcy, and trauma. The government has announced an external review of the practices.

Company involved
Ministry of Social Affairs of the Netherlands
AI system involved
SyRI

10 source articles · read the reporting →

UK councils use Covid OneView AI to harvest personal data for risk scoring

UK local authorities are using a system called Covid OneView, developed by data analytics firm Xantura, to harvest millions of personal details from council records. The system uses predictive analytics and AI to assign risk scores to households and individuals, aiming to identify those vulnerable to Covid or likely to break lockdown rules. Privacy campaigners and MPs have criticised the lack of transparency and the extent of data collection, which includes sensitive information such as debt levels, living arrangements, and even notes on unfaithful sex. Xantura and Barking and Dagenham Council have defended the system as compliant with data protection rules and focused on providing support.

Company involved
UK local authorities
AI system involved
Covid OneView

6 source articles · read the reporting →

WF-W8NDC11 Jul 2015

New York City's McKinsey-led jail violence program manipulated data, violence increased

New York City paid McKinsey & Company $27.5 million to reduce violence at Rikers Island jail complex. McKinsey designed a predictive algorithm called the Housing Unit Balancer and Restart housing units, but jail officials and McKinsey consultants stacked the units with compliant inmates to artificially lower violence numbers. Violence actually increased by nearly 50% during the project. The city eventually decided to close Rikers.

Company involved
New York City Department of Correction
AI system involved
Housing Unit Balancer (HUB)

10 source articles · read the reporting →

WF-JH5L2X26 Mar 2021

Teleperformance plans AI webcam surveillance for home-working staff

Teleperformance, a global call centre company, told some staff it would install AI-powered webcams to monitor home-working infractions such as eating, phone use, or leaving desks. The system would randomly scan for breaches and send alerts to managers. After the Guardian inquired, the company said the remote scans would not be used in the UK, but the plan raised concerns from unions and MPs about invasive surveillance.

Company involved
Teleperformance

10 source articles · read the reporting →

WF-E7VSR21 Jan 2021

LA's VI-SPDAT housing scoring system gives lower priority to Black and Latino people

The Los Angeles Homeless Services Authority uses the VI-SPDAT scoring system to prioritise unhoused people for subsidised permanent housing. An investigation by The Markup found that Black and Latino people consistently receive lower vulnerability scores than White people, leading to lower priority for housing. The agency has acknowledged the racial disparities and is working on a new tool, but continues to use the current system.

Company involved
Los Angeles Homeless Services Authority
AI system involved
VI-SPDAT

10 source articles · read the reporting →

PwC develops facial recognition tool to monitor employees working from home

Accounting giant PwC has developed a facial recognition tool that logs when employees are absent from their computer screens while working from home. The tool, intended for financial institutions, requires workers to provide written reasons for any absences, including toilet breaks. Commentators have criticised the tool as a huge invasion of privacy, with concerns about damage to trust and increased stress. PwC stated that the technology is designed to help regulated institutions meet compliance obligations and that voluntary consent of traders is essential.

Company involved
PwC

8 source articles · read the reporting →

WF-SWP73K1 Apr 2023

USPS algorithm RRECS causes pay cuts for two-thirds of rural mail carriers

The United States Postal Service (USPS) implemented a new algorithm, RRECS, to evaluate rural carrier routes and determine pay. Due to flaws in how carriers scanned packages, the algorithm underestimated route times, resulting in pay cuts for 66 per cent of rural carriers, some losing thousands of dollars annually. Carriers report that they were not adequately trained on the system and that the cuts are scheduled to take effect, though they have been postponed multiple times. The USPS stated that the system is the result of a nationally negotiated agreement.

Company involved
United States Postal Service
AI system involved
RRECS

9 source articles · read the reporting →

WF-QSFASR1 Jan 2019

Denmark's Udbetaling Danmark welfare algorithm illegally surveilled millions

Udbetaling Danmark (UDK), Denmark's centralized welfare payment agency, used automated algorithms to check eligibility and detect fraud. The system collected personal data on millions of beneficiaries and their relatives, including non-beneficiaries, in what a think-tank called 'systematic surveillance'. A complaint to the Danish Data Protection Authority led to a ruling that the data collection violated GDPR, and UDK eventually deleted the illegally obtained data. The system also caused erroneous payments, including underpaying 300,000 pensioners by 94 million euros annually.

Company involved
Udbetaling Danmark

10 source articles · read the reporting →

Campaigners call for end to Home Office's IPIC 'robo-caseworker' AI tool

Migrants' rights campaigners have called for the UK government to stop using the IPIC (Identify & Prioritise Immigration Cases) AI system, which automatically identifies and recommends migrants for immigration decisions or enforcement action. Privacy International and the Migrants' Rights Network have raised concerns that the system could lead to racial bias and the 'rubberstamping' of algorithmic recommendations by caseworkers. The campaigners argue that people going through the immigration system may not know their information has been processed by an algorithm. The Home Office has not directly responded to the specific concerns, though Science Secretary Peter Kyle has defended the safe development of AI in public services.

Company involved
Home Office
AI system involved
IPIC (Identify & Prioritise Immigration Cases)

9 source articles · read the reporting →

EPIC lawsuit challenges USPS secret surveillance program using facial recognition

The United States Postal Service's law enforcement wing, the Postal Inspection Service, ran a secret surveillance program called the Internet Covert Operations Program (iCOP) that used facial recognition from Clearview AI and social media monitoring tools to infiltrate online communities and monitor protests. The Electronic Privacy Information Center (EPIC) sued the USPS for failing to conduct and publish a privacy impact assessment as required by the E-Government Act. A federal district court dismissed the lawsuit on standing grounds, ruling that EPIC did not suffer a cognizable injury from the agency's refusal to disclose information about the program.

Company involved
United States Postal Service
AI system involved
Internet Covert Operations Program (iCOP)

10 source articles · read the reporting →

WF-UHO4KG31 Aug 2021

Met Police buys £3m retrospective facial recognition system

The Metropolitan Police Service (MPS) has awarded a £3 million, four-year contract to Northgate Public Services for a new retrospective facial-recognition (RFR) system to be deployed within three months. RFR processes biometric information from historic CCTV, social media, and other images to identify suspects and missing persons, operating retroactively unlike live facial recognition. The procurement was approved by the Mayor's Office for Policing and Crime in August 2021. The MPS states that human-in-the-loop decision-making will be used, but digital rights groups and a former biometrics commissioner have raised concerns about potential discrimination, overrepresentation of marginalised groups in watch lists, and lack of a legislative framework.

Company involved
Metropolitan Police Service
AI system involved
Retrospective facial-recognition software

9 source articles · read the reporting →

← Newerpage 2 of 3Older →