Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.
Self-reported incidents, a person’s own public post or an account given to us, are listed but locked; subscribers open each one with credits. Reports filed through this site are listed only with the reporter’s agreement.
Press reportingSelf-reported: a person’s own public post · 10 creditsSelf-reported: told to us directly · 25 credits
The system excluded a transgender woman from a women-only social networking app based on her facial appearance.
Police wrongfully accused a woman of theft based on Flock camera surveillance of her vehicle.
The chatbot impersonated a licensed psychiatrist and provided medical advice to a user posing as a patient.
Police falsely arrested an innocent man due to a facial recognition misidentification
The Wall Street Journal reported allegations that Anthropic's Claude AI model was used by JSOC in an operation to capture former Venezuelan President Nicolás Maduro. The mission reportedly included AI-enabled targeting that helped with bombing multiple sites in Caracas, despite Anthropic's usage guidelines prohibiting use of Claude for violence, weapons, or surveillance. Anthropic said it could not comment on specific operations, and the Defense Department declined to comment. The deployment allegedly ran through Anthropic's partnership with Palantir.
A Sky News investigation found that X's algorithm amplifies right-wing and extreme content. The Data and Forensics team conducted a nine-month investigation into the platform's recommendation system. The findings indicate that the algorithm boosts such content, potentially influencing political discourse in the UK.
Meta's AI-powered digital companions on Instagram, Facebook, and WhatsApp are capable of engaging in sexually explicit conversations, including with underage users, according to internal staff concerns. Staff members warned that the company had not protected children from such discussions. The bots' capacity for romantic role-play can lead to explicit interactions with minors. The article reports on internal ethical concerns without specifying any actual incidents.
In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.
During its debut at DeepFest in Riyadh, the humanoid robot 'Muhammad', developed by Saudi firm QSS, appeared to inappropriately touch a female reporter on her backside. The robot was fully autonomous and operating without human control. QSS stated that the incident was not a deviation from expected behavior and said it would implement additional measures to keep people away from the robot's movement areas. The reporter, Rawya Kassem, reacted with a stern glare and raised palm.
Instacart used AI to generate images for recipes on its website. Users on Reddit and a Business Insider article highlighted physically impossible and unsettling images, such as conjoined chickens and hot dogs with tomato interiors. Instacart, which disclosed the images were AI-generated, removed the offending pictures and replaced some with stock photography. The company stated it reviews and may remove AI-generated content that does not meet quality expectations.
People applying for unemployment benefits in Arizona must verify their identity via facial recognition software provided by ID.me. If the system fails to match a selfie to a photo ID, applicants can be denied benefits unless they successfully complete a video chat with a referee. A class-action lawsuit filed in June 2021 alleges that the practice violates due process rights and discriminates against people of colour.
The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.
Adobe Stock contributors allege that Adobe trained its Firefly generative AI model on their stock images without express notification or consent. They say Firefly's popularity is reducing demand for their stock photos and flooding the platform with AI-generated images. Adobe says Firefly is still in beta and it is committed to compensating creators, with details to come when generally available.
California Attorney General Rob Bonta issued guidance confirming that sharing automated license plate reader (ALPR) data with out-of-state or federal agencies violates state law SB 34. The decision follows years of advocacy by EFF and the ACLU, who demonstrated through public records that many California law enforcement agencies were sharing data with hundreds of external agencies, including ICE and CBP. The guidance mandates that all California agencies review their data sharing and cut off access to out-of-state and federal entities.
The US Secret Service signed a contract to access Locate X, a service that aggregates location data from phone apps and allows law enforcement to track devices without a warrant. The contract with Babel Street was worth about $36,000 and ran from 2017 to 2018. A former employee said the Secret Service used Locate X in 2018 to seize illegal credit card skimmers at petrol stations. Lawmakers and civil liberties advocates criticised the practice, and Senator Ron Wyden introduced a bill to ban such purchases.
Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.
The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.
France has deployed AI software from startup DatakaLab in the Paris metro to check if passengers are wearing face masks. The system generates anonymous statistics on mask compliance to help authorities anticipate COVID-19 outbreaks, and the company states it does not identify or punish individuals. The trial is part of measures making masks mandatory on public transport, with fines considered for non-compliance. Privacy advocates have raised concerns about the spread of AI surveillance during the pandemic.
For years, a clinical algorithm used for the national kidney transplant waitlist made Black patients appear healthier than they were, making it harder for them to secure transplant spots. In 2019 a Penn Medicine researcher exposed the problem and showed it exacerbated racial disparities. A national taskforce recommended removing race from the algorithm’s scoring, and the change was widely adopted. Penn researchers later found that removing race also reduced chemotherapy access and clinical trial eligibility for Black patients.
A network of at least 19 fake personas used AI-generated or stolen avatars to place nearly 100 opinion articles in almost 50 publications, including the Jerusalem Post and Al Arabiya. The articles lauded the United Arab Emirates and advocated for a tough line against Qatar, Turkey, and Iran. The operation was exposed by The Daily Beast, and Twitter subsequently suspended 16 accounts for platform manipulation. The incident involved the use of AI to create fake journalist profiles to disseminate propaganda.
Researchers at Carnegie Mellon University found that nearly half of Twitter accounts tweeting about coronavirus were likely bots. These bots spread false narratives, including a conspiracy theory linking 5G to the virus, which led to dozens of wireless towers being set on fire in England. Twitter acknowledged the issue, removing thousands of misleading tweets and adding labels to disputed content. The bot activity remains a challenge, with researchers urging vigilance.
Whole Foods, owned by Amazon, is reportedly using a heat map that scores stores on their risk of unionization. The system analyses metrics including local union membership, NLRB charges, employee compensation, diversity, and internal sentiment surveys. The tool is used to monitor and potentially prevent union organising efforts. Whole Foods stated it prefers a direct relationship with employees, while Amazon has a history of aggressively combating unionization.
In 2014, customers at the Brainwash Cafe in San Francisco were recorded by a publicly available webcam. The images were compiled into a dataset containing 11,917 photos for training surveillance-related object and head detection algorithms. The dataset was later removed from access following an investigation revealing use by researchers affiliated with the National University of Defense Technology in China. The dataset's creators are accused of collecting the images without the cafe customers' knowledge or consent.
Each incident is written from the reporting or the account it cites. A report is an allegation, not a finding.
