The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “IDeaS Optix” · matched on meaning · public reporting

Westbrook Police Apologise for AI-Altered Evidence Photo

The Westbrook Police Department in Maine inadvertently shared an AI-altered photo of drug evidence on social media. An officer used a photo editing app to add the department's patch, but the app also altered the packaging and other details. The department initially denied AI involvement before confirming the use of ChatGPT and issued a public apology, inviting media to inspect the original evidence.

Company involved
Westbrook Police Department

1 source article · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

Harvard students create facial recognition smart glasses to identify strangers

Two Harvard students built a system called I-XRAY that uses Meta's Ray Ban smart glasses and the facial recognition service Pimeyes to automatically identify strangers and retrieve their personal information, including name, phone number, and home address. The students tested the system on unsuspecting people in public to demonstrate the privacy risks. They are not releasing the code.

AI system involved
I-XRAY

6 source articles · read the reporting →

Y Combinator Supports AI Startup Optifye Dehumanizing Factory Workers

Optifye, an AI startup, is accused of dehumanizing factory workers through its system. Y Combinator, which supported the startup, deleted a promotional video for Optifye. The allegations were reported by 404media.co.

Company involved
Optifye
AI system involved
Optifye

7 source articles · read the reporting →

Sound Intelligence Aggression Detectors Prove Unreliable in School Tests

ProPublica tested Sound Intelligence's aggression detection software, used in hundreds of U.S. schools and hospitals. The algorithm, which analyzes audio for signs of stress and anger, frequently misidentified innocent sounds like coughing as aggressive and failed to detect actual screams. At a New Jersey hospital, the system ignored an agitated man screaming and pounding a desk, escalating the situation. Sound Intelligence's CEO acknowledged the imperfections but defended the technology as an early warning system.

AI system involved
Sound Intelligence aggression detector

2 source articles · read the reporting →

Canada Investigates Landlords' Use of AI Rent-Setting Software YieldStar

The Competition Bureau of Canada is investigating allegations that major corporate landlords, including Dream Unlimited, used AI-powered software YieldStar to coordinate rent increases. Tenant advocacy groups filed over 100 complaints, claiming the software recommended above-market rents, exacerbating housing affordability. Some landlords have since halted use of YieldStar amid public backlash, while the investigation continues.

Company involved
Dream Unlimited
AI system involved
YieldStar

7 source articles · read the reporting →

WF-G5X76H1 Nov 2023

Israel deploys Corsight facial recognition in Gaza to locate suspects

Israel is using Corsight facial recognition technology in Gaza to identify terror suspects, according to intelligence officials. The system has also misidentified civilians. A Palestinian poet alleges he was detained after being flagged by the AI. The IDF declined to comment on operational capabilities.

Company involved
Israel Defense Forces
AI system involved
Corsight

3 source articles · read the reporting →

Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign

Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.

AI system involved
Gamma

7 source articles · read the reporting →

OpenAI and Google AI autocompletes AOC photo in bikini

Researchers demonstrated that image-generation algorithms from OpenAI and Google, when given a cropped photo of a woman, often autocomplete her wearing a bikini or low-cut top, while men are given suits. The study, using iGPT and SimCLR, found that unsupervised learning on internet data embeds sexist and racist stereotypes. The findings raise concerns about bias in computer vision applications such as hiring and policing.

Company involved
OpenAI, Google
AI system involved
iGPT, SimCLR

1 source article · read the reporting →

Suresnes allows startup XXII to use CCTV for experimental surveillance algorithms

The city of Suresnes has allowed startup XXII to use its public CCTV cameras for 18 months to develop algorithms for detecting suspicious behavior. The algorithms are experimental and may have high error rates. Residents were not informed or consulted. The startup will own the data and can use the city's surveillance center as a showroom for clients.

Company involved
Mairie de Suresnes
AI system involved
XXIISmartCity

10 source articles · read the reporting →

WF-JFGJNJ1 Nov 2025

Grok and Google Lens AI overviews falsely claim fake images show Huntingdon train attack

Grok and Google Lens AI overviews have been claiming that AI-generated images of the Huntingdon train attack are real. Grok told users one image was a genuine photo, while Google Lens claimed it was a still from a BBC news report. The AI systems also linked unrelated videos to the attack. Full Fact contacted Google, which told users they can provide feedback on errors. xAI has not yet responded.

Company involved
xAI and Google
AI system involved
Grok and Google Lens AI overviews

4 source articles · read the reporting →

WF-XBXRUJ18 Apr 2022

Intel and Class Technologies face criticism over emotion-detecting AI for students

Intel partnered with Class Technologies to use an AI system that analyses student emotions during Zoom classes to provide insights to teachers. Critics, including educator Todd Richmond, argued that facial expressions are not reliable indicators of internal states and that the system amounts to pseudoscience. The article reports these criticisms as allegations, not as proven fact. No specific incident of harm or regulatory action is reported.

Company involved
Intel
AI system involved
Class Technologies face-reading AI

10 source articles · read the reporting →

WF-1AAL5812 Oct 2023

AI or Not detector mislabels real war photo as AI-generated

The AI image detection tool AI or Not, made by Optic, incorrectly labeled a photograph of a burnt corpse from the Israel-Gaza war as AI-generated. The image was originally tweeted by Israeli officials and later shared by commentators. Experts, including UC Berkeley professor Hany Farid, confirmed the image is real based on structural consistency and shadows. The false detection contributed to disinformation about the war. Optic did not respond to requests for comment.

Company involved
Optic
AI system involved
AI or Not

10 source articles · read the reporting →

WF-9KY8EL19 Oct 2019

Outback Steakhouse franchise tests Presto Vision to monitor staff and guests

Evergreen Restaurant Group, a franchisee of Outback Steakhouse, has begun testing Presto Vision, a computer vision system that analyses surveillance camera footage to track employee performance and guest behaviour. The system compiles metrics on service, wait times, and customer turnover, which managers receive by email. Employees say they were not informed about the technology, and researchers have raised concerns about workplace stress, job losses, and data sharing with parent companies.

Company involved
Evergreen Restaurant Group
AI system involved
Presto Vision

8 source articles · read the reporting →

RealPage's YieldStar algorithm pushes rents higher for tenants

RealPage's YieldStar algorithm uses private competitor data to recommend rent increases for apartment units. Landlords adopt up to 90% of the suggestions, leading to higher rents for tenants. Critics allege the software may facilitate indirect price-fixing in violation of antitrust law. The company denies wrongdoing and says the software helps eliminate collusion.

Company involved
RealPage
AI system involved
YieldStar

10 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

Walgreens deploys digital cooler doors with ads from Cooler Screens

Walgreens is rolling out digital cooler doors from Cooler Screens that display ads before showing the cooler contents. The system tracks when customers stop in front of the doors but claims to be identity-blind. Customers have expressed confusion and annoyance on social media. Walgreens says the screens provide relevant product information.

Company involved
Walgreens
AI system involved
Cooler Screens

10 source articles · read the reporting →

WF-PEFP2L8 Sep 2020

Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims

A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.

Company involved
Proctorio
AI system involved
Proctorio

10 source articles · read the reporting →

Clearview AI tested facial recognition surveillance cameras with UFT and Rudin

Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.

Company involved
Clearview AI
AI system involved
Insight Camera

9 source articles · read the reporting →

Uttar Pradesh Police uses AI cameras to track women's distress

Uttar Pradesh Police, in collaboration with Staqu Technologies, deployed AI-powered cameras in Lucknow for surveillance of women in distress. Activists have criticised the system for invading privacy. The system is currently in use.

Company involved
Uttar Pradesh Police
AI system involved
Trinetra

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

Adobe uses Creative Cloud user data to train AI

Adobe's content analysis feature may scan Creative Cloud and Document Cloud files to train machine learning models, including object recognition in Lightroom and Liquid Mode in Acrobat. The company says it may analyze images, audio, video, text and other documents stored on its servers. Adobe offers an opt-out in account privacy settings, but the article notes the company did not ask first.

Company involved
Adobe
AI system involved
Content analysis

10 source articles · read the reporting →

WF-2ITU5Z1 Jan 2020

Canon uses AI smile recognition cameras to control office access

Canon Information Technology deployed AI cameras at its Beijing headquarters that only allow smiling employees to enter the office or book conference rooms. The system uses smile recognition to enforce a positive atmosphere. Some workers have complained about the intrusiveness of the technology. Canon defended the system, saying it encourages a positive work environment.

Company involved
Canon Information Technology (Canon China)

9 source articles · read the reporting →

EPIC lawsuit challenges USPS secret surveillance program using facial recognition

The United States Postal Service's law enforcement wing, the Postal Inspection Service, ran a secret surveillance program called the Internet Covert Operations Program (iCOP) that used facial recognition from Clearview AI and social media monitoring tools to infiltrate online communities and monitor protests. The Electronic Privacy Information Center (EPIC) sued the USPS for failing to conduct and publish a privacy impact assessment as required by the E-Government Act. A federal district court dismissed the lawsuit on standing grounds, ruling that EPIC did not suffer a cognizable injury from the agency's refusal to disclose information about the program.

Company involved
United States Postal Service
AI system involved
Internet Covert Operations Program (iCOP)

10 source articles · read the reporting →

page 1 of 2Older →