The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “Booking.com Genius” · matched on meaning · public reporting

WF-YBSNZP10 Jun 2021

Italian privacy regulator fines Foodinho €2.6 million for algorithmic discrimination against riders

The Italian Data Protection Authority (Garante) fined Foodinho S.r.l., a subsidiary of GlovoApp23, €2.6 million for privacy violations related to its algorithmic management of food delivery riders. The Garante found that the company's digital platform used algorithms to assign orders and rate riders without adequate transparency, human oversight, or the right to contest decisions. The system allegedly penalized riders who did not accept orders quickly, leading to reduced work opportunities and exclusion from the platform. The Garante ordered Foodinho to implement corrective measures within 60 days and to overhaul the algorithms within 90 days.

Company involved
Foodinho S.r.l.

10 source articles · read the reporting →

WF-GUKKC312 Oct 2019

Tapia robot vulnerability at Henn na Hotels allows remote spying on guests.

A security researcher disclosed a vulnerability in the Tapia robot deployed at Henn na Hotels (Robot Hotels) in Japan. The robot accepts unsigned code via NFC, allowing an attacker to gain remote access to its camera and microphone. The researcher reported the issue to the vendor 90 days prior but received no response. The vulnerability potentially affects all future hotel guests.

Company involved
Henn na Hotels
AI system involved
Tapia robot

10 source articles · read the reporting →

WF-LBFMV812 Dec 2014

Amazon sellers lose thousands after RepricerExpress pricing glitch

A software glitch in RepricerExpress's automated repricing system caused products sold by Amazon sellers to be priced at 1p, leading to significant financial losses for the sellers. RepricerExpress apologised but did not offer compensation, while Amazon said it had reached out to affected sellers but many reported no response. Some sellers have instructed lawyers to take legal action against RepricerExpress and Amazon.

Company involved
RepricerExpress
AI system involved
RepricerExpress

10 source articles · read the reporting →

WF-S574X31 Jan 2019

Spanish Supreme Court orders release of BOSCO algorithm code for social electricity bonus

The Spanish NGO Civio won a Supreme Court case forcing the government to release the source code of BOSCO, the algorithm that decides eligibility for the social electricity bonus (bono social eléctrico). Civio had demonstrated in 2019 that BOSCO contained serious errors that denied the benefit to vulnerable people who met the requirements. The government had refused to disclose the code, citing intellectual property. The Supreme Court ruled that transparency must prevail, setting a precedent for public access to automated decision-making systems.

Company involved
Ministerio para la Transición Ecológica (Gobierno de España)
AI system involved
BOSCO

10 source articles · read the reporting →

WF-R0TD0111 Aug 2023

Microsoft pulls AI-generated article recommending Ottawa Food Bank to tourists

Microsoft published a travel article generated using algorithmic techniques that recommended the Ottawa Food Bank as a tourist attraction, advising visitors to go on an empty stomach. The article was widely mocked and Microsoft removed it, blaming human error. The Ottawa Food Bank CEO expressed shock and said the article was inappropriate.

Company involved
Microsoft

10 source articles · read the reporting →

AI-generated travel guides flood Amazon, deceiving customers

AI-generated travel guides are flooding Amazon, allegedly written by scammers using AI to produce generic, low-quality content. Customers who purchase these guides receive poor information and feel defrauded. Amazon claims to enforce content guidelines but many such books remain on the platform.

Company involved
Amazon

8 source articles · read the reporting →

Tourists rescued after following ChatGPT route in Tatra mountains

Three Polish tourists used ChatGPT to plan a hiking route from Hala Gąsienicowa to Dolina Pięciu Stawów in the Tatra mountains. The AI recommended a difficult route through Przełęcz Krzyżne, which proved too dangerous in winter conditions with limited visibility and icy rocks. The tourists called the TOPR rescue service and were safely brought down. A TOPR rescuer advised against relying on ChatGPT or Google Maps for mountain route planning.

Company involved
OpenAI
AI system involved
ChatGPT

2 source articles · read the reporting →

WF-RZPEIY10 Jun 2024

Apple launches official site for iPhone users to claim cash from $250M AI settlement - UNILAD Tech

Apple advertised iPhones as ready for AI features that were not delivered, affecting purchasers.

Company involved
Apple
AI system involved
Apple Intelligence

1 source article · read the reporting →

WF-E48MLU24 Nov 2023

DevTernity conference cancelled after fake women speakers exposed

The DevTernity software developer conference was cancelled after allegations that organiser Eduards Sizovs added fake women speakers to the lineup. Sizovs admitted at least one profile, 'Anna Boyko', was an auto-generated 'demo persona' that appeared on the site by mistake. The conference was scheduled to begin December 7 but was called off after several speakers withdrew. Sizovs denied wrongdoing and said he had fixed the code and written a test to prevent a recurrence.

Company involved
DevTernity

9 source articles · read the reporting →

WF-G6M0D36 Feb 2023

Google's Bard chatbot makes factual error in launch tweet

Google launched Bard, an experimental conversational AI service, on February 6, 2023. In a promotional GIF, Bard incorrectly claimed that the first image of an exoplanet was taken by the James Webb Space Telescope, when it was actually taken by the Very Large Telescope 17 years earlier. The error was pointed out by astronomers on social media.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-ROMQCH5 Feb 2024

OnlyFake site uses neural networks to generate fake IDs, bypasses OKX verification

An underground website called OnlyFake uses neural networks to generate realistic photos of fake IDs for $15. The journalist tested the service and obtained a convincing California driver's license. They then used another fake ID to successfully bypass the identity verification process on OKX, a cryptocurrency exchange. The article alleges that this technology could streamline bank fraud and money laundering, but reports no actual financial loss.

Company involved
OKX
AI system involved
OnlyFake

10 source articles · read the reporting →

WF-N8LQF31 Jan 2020

Uber and Amazon algorithms pay different wages for same work

A study by law professor Veena Dubal alleges that Uber and Amazon use AI algorithms to offer different pay rates to gig workers doing identical work. The algorithms are said to calculate the lowest wage a driver will accept based on personal data. Uber denies tailoring individual fares, and the California Labor Commission's lawsuit against Uber and Lyft is ongoing.

Company involved
Uber

10 source articles · read the reporting →

WF-A3DBHF1 Jul 2023

French competition authority fines Google €250 million over Bard content use

The Autorité de la concurrence has fined Google €250 million for breaching commitments on related rights. The authority found that Google's Bard (now Gemini) chatbot used content from press agencies and publishers to train its foundation model and for grounding and display, without informing them or offering an opt-out that did not affect other Google services. Google did not contest the facts and proposed corrective measures.

Company involved
Google
AI system involved
Bard (now Gemini)

9 source articles · read the reporting →

WF-2EUZDH18 May 2025

King Features AI tool produces reading list recommending nonexistent books

King Features, a content syndication unit of Hearst, has acknowledged that a summer reading list it produced for newspapers was created with an AI tool and included books that do not exist. A freelance creator used the AI agent without disclosing it, contrary to King Features' policy. The Chicago Sun-Times, which published the section, removed it from its e-paper and said subscribers would not be charged.

Company involved
King Features

5 source articles · read the reporting →

WF-O8OTB421 May 2024

Eventbrite algorithm recommended illegal opioid sales to addiction recovery seekers

Eventbrite's recommendation algorithm promoted thousands of listings selling illegal prescription drugs like oxycodone and Xanax alongside addiction recovery events. The listings, which appeared in search results and related events, directed users to unlicensed online pharmacies. Eventbrite acknowledged the issue and removed the listings after WIRED alerted them.

Company involved
Eventbrite
AI system involved
Eventbrite recommendation algorithm

4 source articles · read the reporting →

Italy fines Amazon $1.3 billion for algorithm favouring its logistics

Italy's antitrust regulator fined Amazon €1.13 billion ($1.3 billion) for abusing its market dominance. The regulator alleged that Amazon used an algorithm to give an unfair advantage to its own logistics service over third-party sellers. Amazon said it disagreed with the decision and would appeal.

Company involved
Amazon

9 source articles · read the reporting →

Delta uses AI from Fetcherr for domestic ticket pricing

Delta Air Lines is using generative AI from Fetcherr to determine some domestic flight prices, currently covering 3% of its network with plans to reach 20% by end of 2025. Democratic senators expressed concern that the AI could be used for individualized pricing based on personal data, leading to higher fares. Delta denies using personal data in pricing and states it complies with regulations. No actual harm has been reported.

Company involved
Delta Air Lines
AI system involved
Fetcherr

8 source articles · read the reporting →

WF-AZK2NL11 Jul 2023

Check Point Research finds Google Bard can generate phishing emails and malware

Check Point Research analysed Google's generative AI platform Bard and found it could be used to create phishing emails, malware keyloggers, and basic ransomware code with minimal manipulation. Bard's anti-abuse restrictors were significantly lower than ChatGPT's, making it easier to generate malicious content. The researchers demonstrated these capabilities in controlled tests but did not report actual harm to specific individuals or organisations.

Company involved
Google
AI system involved
Bard

4 source articles · read the reporting →

GMB members report declining earnings since Uber introduced dynamic pricing

GMB Union has welcomed a report into Uber's dynamic pricing that appears to show it benefits Uber more than drivers. GMB members have reported declining earnings since the introduction of dynamic pricing. The union has called for greater transparency around earnings in the gig economy and will review the report before consulting members on next steps.

Company involved
Uber
AI system involved
dynamic pricing

8 source articles · read the reporting →

WF-BB09W429 Aug 2024

Ticketmaster dynamic pricing inflates Oasis reunion tour ticket prices

Ticketmaster's dynamic pricing system caused ticket prices for Oasis's reunion tour to surge from around £135 to over £488 for some fans. Fans reported paying double or triple the face value for standing tickets in Dublin and Cardiff. The system, which adjusts prices based on demand, has been criticised by fans on social media. Ticketmaster has not commented on the incident.

Company involved
Ticketmaster

9 source articles · read the reporting →

WF-I4OTS330 Aug 2024

Edinburgh Airport AI trial gives passengers different parking prices

Edinburgh Airport admitted it was trialling an AI system that randomly set higher or lower parking prices for online bookers, with customers receiving different quotes for the same service. The Scottish Passenger Agents Association called for the trial to be conducted in controlled 'lab' conditions rather than on the public. The airport said the AI's pricing closely matched staff-set prices and the findings would evaluate whether to adopt the system.

Company involved
Edinburgh Airport
AI system involved
AI trial for parking pricing

3 source articles · read the reporting →

PimEyes facial recognition search engine identifies individuals from public photos

PimEyes, a Polish facial recognition search engine, allows users to upload a photo and find matching images from across the internet. The system scrapes billions of photos and creates biometric profiles without consent. A banker named Dylan (pseudonym) discovered that an old party photo of him was found by the system, potentially outing his private life. Privacy advocates and platforms like Instagram and YouTube are taking action against PimEyes, alleging violations of the GDPR.

Company involved
PimEyes
AI system involved
PimEyes

6 source articles · read the reporting →

WF-EBIPSN1 Dec 2025

Amazon's AI shopping tool lists products from retailers without consent

Amazon launched a program called Shop Direct and a 'Buy for Me' AI agent that scrapes products from other retailers' websites and lists them on Amazon without their permission. Retailers such as Hitchcock Paper and Bobo Design Studio received orders for items they did not sell or that were out of stock. Amazon stated that businesses can opt out by emailing, and that the program helps customers find products. Some retailers have accused Amazon of exploiting their businesses.

Company involved
Amazon
AI system involved
Shop Direct / Buy for Me

5 source articles · read the reporting →

← Newerpage 3 of 4Older →