The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “Luminar Iris” · matched on meaning · public reporting

WF-I53EFV22 Mar 2023

Midjourney bans user for generating AI images of Trump arrest

Eliot Higgins, founder of Bellingcat, created AI-generated images of Donald Trump being arrested using Midjourney. He posted them on Twitter, where they went viral. Midjourney subsequently banned him for violating its terms of service. The incident highlighted the potential for AI-generated misinformation.

Company involved
Midjourney
AI system involved
Midjourney

10 source articles · read the reporting →

WF-ZQ3YFL1 Dec 2020

Retorio AI personality test swayed by candidate appearance in BR experiment

Bayerischer Rundfunk journalists conducted experiments with Retorio's AI video interview analysis tool. The AI, which assesses personality traits from short videos, produced different scores when the same actress changed her appearance (glasses, headscarf, wig) or the video background and lighting were altered. The start-up Retorio acknowledged that the AI considers external image, similar to a human interviewer. Experts warned that such software could perpetuate stereotypes and unfairly affect job candidates.

AI system involved
Retorio AI

10 source articles · read the reporting →

WF-MRYK7O14 Mar 2023

Boris Eldagsen refuses Sony World Photography Award for AI-generated image

Boris Eldagsen submitted an AI-generated image to the Sony World Photography Awards 2023 and won the Creative category. He then revealed the image was created using AI generators and refused the award, alleging that the organisers did not disclose the AI origin despite being informed. The organisers issued a generic statement and did not engage in discussion. Eldagsen's action sparked a debate about AI in photography.

Company involved
World Photography Organisation (Sony World Photography Awards)

3 source articles · read the reporting →

WF-DYTSSY24 May 2021

Lemonade backtracks on tweet claiming AI scans customer faces for fraud

Lemonade, an insurance firm, posted a tweet claiming it uses AI to detect non-verbal cues in customer videos to deny claims. After backlash comparing the practice to phrenology, the company deleted the tweet and denied using AI to deny claims based on facial characteristics. Lemonade stated it uses facial recognition only to flag claims submitted under different identities, which are then reviewed by human investigators.

Company involved
Lemonade

10 source articles · read the reporting →

Adobe uses Creative Cloud user data to train AI

Adobe's content analysis feature may scan Creative Cloud and Document Cloud files to train machine learning models, including object recognition in Lightroom and Liquid Mode in Acrobat. The company says it may analyze images, audio, video, text and other documents stored on its servers. Adobe offers an opt-out in account privacy settings, but the article notes the company did not ask first.

Company involved
Adobe
AI system involved
Content analysis

10 source articles · read the reporting →

WF-2ITU5Z1 Jan 2020

Canon uses AI smile recognition cameras to control office access

Canon Information Technology deployed AI cameras at its Beijing headquarters that only allow smiling employees to enter the office or book conference rooms. The system uses smile recognition to enforce a positive atmosphere. Some workers have complained about the intrusiveness of the technology. Canon defended the system, saying it encourages a positive work environment.

Company involved
Canon Information Technology (Canon China)

9 source articles · read the reporting →

WF-8AP0H515 Aug 2020

Fake persona with AI-generated face spreads Hunter Biden conspiracy document

A 64-page document alleging a conspiracy involving Hunter Biden was attributed to a fake intelligence firm, Typhoon Investigations, and a fabricated analyst named Martin Aspen. The profile picture for Aspen was created using an AI face generator, as identified by researchers. The document was disseminated by associates of President Trump and far-right influencers, contributing to a disinformation campaign. The article reports that the document's authorship was questionable and that the persona was fabricated.

Company involved
Typhoon Investigations
AI system involved
AI face generator

10 source articles · read the reporting →

WF-J5IU7Z3 Dec 2024

FTC settles with IntelliVision over deceptive facial recognition claims

The Federal Trade Commission (FTC) took action against IntelliVision Technologies Corp. for making false, misleading, or unsubstantiated claims about its AI-powered facial recognition software. The company allegedly claimed its software had one of the highest accuracy rates on the market and was free of gender or racial bias, without supporting evidence. The FTC also alleged that IntelliVision did not train its software on millions of faces as claimed, but on images of approximately 100,000 individuals. Under a proposed consent order, IntelliVision is prohibited from making such misrepresentations without competent and reliable testing.

Company involved
IntelliVision Technologies Corp.
AI system involved
IntelliVision facial recognition software

9 source articles · read the reporting →

Google Health's diabetic retinopathy AI faced real-world issues in Thailand clinics

Google Health deployed a deep-learning system to screen for diabetic retinopathy in 11 clinics across Thailand. The AI was highly accurate in lab tests but rejected over a fifth of eye scans in real-world conditions due to poor lighting and slow internet. Patients whose scans were rejected had to visit specialists at other clinics, causing inconvenience and frustration for nurses. Google Health is now working with local staff to improve the system's workflow.

Company involved
Google Health

10 source articles · read the reporting →

WF-CCZEWP1 Nov 2024

Magnum photographer Carl De Keyzer uses AI to create controversial photo series

Magnum photographer Carl De Keyzer used AI to create a photo series titled 'Putin's Dream' after a planned road trip to Russia was cancelled due to the war. He trained the AI with his own photographs to maintain his style. The images were posted online to promote the book, leading to outcry on social media and accusations of contributing to disinformation. De Keyzer deleted the images and had a conversation with Magnum about the project.

Company involved
Carl De Keyzer

4 source articles · read the reporting →

WF-VT0QB430 Dec 2024

Apple's Enhanced Visual Search raises privacy concerns over default data sharing

Apple's iOS 18 update introduced an 'Enhanced Visual Search' feature that automatically shares encrypted photo data with Apple to identify landmarks. The feature is enabled by default, requiring users to manually opt out, which has sparked privacy concerns. Critics argue it should be opt-in, given Apple's usual privacy standards. The article reports on the feature's design and the resulting debate, not on any specific harm to an individual.

Company involved
Apple
AI system involved
Enhanced Visual Search

5 source articles · read the reporting →

LINAGORA closes Lucie 7B after user mockery

LINAGORA, a French open-source software company, launched a beta version of its large language model Lucie 7B. The model was intended to be a transparent and ethical alternative to big tech AI. However, after users tested it and highlighted its shortcomings, the model was mocked online. LINAGORA subsequently closed the platform to address the issues and collect more data.

Company involved
LINAGORA
AI system involved
Lucie 7B

6 source articles · read the reporting →

Five Illinois residents sue facial recognition company Pimeyes under BIPA

Five Illinois residents are suing Pimeyes, a facial recognition search engine, alleging that the company violated the Illinois Biometric Information Privacy Act by collecting and using their facial data without consent. The lawsuit claims that Pimeyes made the residents' photos and information available in search results, enabling unauthorized access. The company has not yet been served with the lawsuit, and its CEO stated he had no prior knowledge of the case.

Company involved
Pimeyes
AI system involved
Pimeyes

7 source articles · read the reporting →

WF-IEKSX31 Jan 2023

PimEyes scraped Ancestry.com for photos of dead people without permission.

PimEyes, a facial recognition search engine, scraped images from Ancestry.com and other websites without authorization, including photos of deceased individuals. The company's algorithms indexed the images to create biometric faceprints, potentially allowing identification of living relatives. Cher Scarlett discovered the scraping after finding photos of her deceased sister on the platform. PimEyes has since blocked Ancestry's domain and is removing the indexes, but privacy concerns remain.

Company involved
PimEyes
AI system involved
PimEyes

7 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-Y7PFHY1 Jan 2024

Wacom responds to concerns about AI-generated images in marketing assets

Wacom acknowledged that it may have used AI-generated images in US marketing assets for the New Year. The company stated it purchased the images from a third-party vendor who indicated they were not AI-generated, and that it vetted them using online tools that also indicated they were not AI-generated. After community feedback raised doubts, Wacom discontinued the images and is reviewing its processes to prevent recurrence. The company attributed the incident to misleading vendor information and detection tool limitations.

Company involved
Wacom

10 source articles · read the reporting →

WF-3OJOAW6 Mar 2024

AI image generators produce misleading election images, study finds

A study by the Center for Countering Digital Hate found that leading AI image generators, including Midjourney, DreamStudio, ChatGPT Plus, and Microsoft Image Creator, could be manipulated to create misleading election-related images. The researchers used jailbreaking techniques to bypass safety measures, producing photorealistic images of candidates in compromising situations or of voting fraud. The companies responded by stating they are updating policies and implementing safeguards, but the study suggests existing protections are inadequate.

Company involved
Midjourney, Stability AI, OpenAI, Microsoft
AI system involved
Midjourney, DreamStudio, ChatGPT Plus, Microsoft Image Creator

8 source articles · read the reporting →

MakeApp makeup removal app adds imperfections, causing controversy

MakeApp, an AI-powered app that digitally removes makeup from photos, has caused controversy by adding imperfections such as redness and dullness to users' faces. Users complained on Twitter that the app exacerbates insecurities and low self-esteem. The founder defended the app as an experiment, denying any intent to shame women.

Company involved
MakeApp
AI system involved
MakeApp

10 source articles · read the reporting →

Late Night with the Devil directors confirm use of AI-generated images

The horror film 'Late Night with the Devil' used AI-generated images for three still interstitials. The directors confirmed the use after viewers noticed and criticized it online. The controversy highlights ongoing concerns about AI replacing human artists in entertainment.

8 source articles · read the reporting →

Leonardo AI misused to create nonconsensual explicit images of celebrities

Leonardo AI, an AI image-generating platform backed by Samsung, has been misused to create nonconsensual explicit images of celebrities. The platform allows users to generate images using user-generated Stable Diffusion models. Users bypassed ethical guardrails by misspelling celebrity names and using sexually suggestive terms. The misuse was reported by 404 Media.

Company involved
Leonardo AI
AI system involved
Leonardo AI

5 source articles · read the reporting →

WF-9FPGGA31 May 2024

Adobe Stock offers AI-generated images inspired by Ansel Adams, violating its own ethics policy

The estate of Ansel Adams publicly criticised Adobe for offering AI-generated images on Adobe Stock that were 'inspired by' Adams' work, violating Adobe's own contributor terms that prohibit using artist names in prompts. Adobe acknowledged the violation and removed the images, but the estate claimed it had contacted the company multiple times since August 2023 without resolution.

Company involved
Adobe
AI system involved
Adobe Stock

4 source articles · read the reporting →

WF-RLP6881 Apr 2023

Xiaohongshu accused of using illustrators' artwork to train its AI

Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.

Company involved
Xiaohongshu
AI system involved
Trik AI

7 source articles · read the reporting →

WF-03V5V41 Jan 2021

PimEyes faces fine proceedings over biometric facial recognition in Baden-Württemberg

PimEyes, a facial recognition search engine, is accused of scraping images from the internet and processing biometric data without a valid legal basis under the GDPR. The data protection authority of Baden-Württemberg (LfDI) opened fine proceedings after it found PimEyes's response to its questions inadequate. PimEyes argues that the images it processes are publicly available and not personal data. The LfDI says the processing endangers citizens' rights and freedoms and is not covered by the GDPR exceptions.

Company involved
PimEyes
AI system involved
PimEyes

9 source articles · read the reporting →

WF-YTWXJV13 Aug 2025

Google Lens AI overviews share misleading information about images

Google Lens's AI overviews provided false and misleading information about images, including miscaptioned videos and AI-generated footage. Full Fact found that the overviews repeated debunked claims and failed to identify inauthentic content. Google acknowledged the errors and said they were caused by problems with visual search results.

Company involved
Google
AI system involved
Google Lens AI overviews

2 source articles · read the reporting →

← Newerpage 3 of 4Older →