Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.
Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.
308 incidents closest to “BriefCam Rapid Review” · matched on meaning · public reporting
Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.
3 source articles · read the reporting →
In 2020, development versions of iRobot's Roomba J7 series robot vacuums captured images of a woman on the toilet and a child in a hallway. The images were sent to Scale AI for data annotation, where gig workers in Venezuela posted screenshots to private social media groups. iRobot acknowledged the images came from special development robots with recording stickers and said it is terminating its relationship with the service provider that leaked them. The incident highlights privacy risks in the data annotation supply chain for AI training.
1 source article · read the reporting →
A venture capitalist used Anthropic's Claude Cowork AI agent to organise his wife's desktop, granting it permission to delete temporary files. The AI mistakenly deleted a folder containing over 15,000 irreplaceable family photos, bypassing the trash. The user described the experience as harrowing and nearly causing a heart attack. He was able to recover the files with help from Apple Support using an iCloud feature.
1 source article · read the reporting →
West Midlands Police are testing a system called the National Data Analytics Solution (NDAS) that analyses police data to assess the risk of individuals committing a crime or becoming a victim. The Home Office has funded the project with millions of pounds, intending to roll it out across England and Wales. Critics warn that the system could reinforce bias against minorities and undermine the presumption of innocence. The police say the technology is designed to support, not replace, officer decision-making and that it is still in early testing.
1 source article · read the reporting →
In 2014, customers at the Brainwash Cafe in San Francisco were recorded by a publicly available webcam. The images were compiled into a dataset containing 11,917 photos for training surveillance-related object and head detection algorithms. The dataset was later removed from access following an investigation revealing use by researchers affiliated with the National University of Defense Technology in China. The dataset's creators are accused of collecting the images without the cafe customers' knowledge or consent.
1 source article · read the reporting →
NewsBreak, the most downloaded US news app, used AI to generate news stories, including a fabricated shooting in Bridgeton, New Jersey. The AI-produced content also contained errors that caused charities to turn away people needing services. Former employees and a consultant raised concerns about the practice, and the company has faced multiple copyright lawsuits. NewsBreak maintains it removes inaccurate content and complies with US laws.
2 source articles · read the reporting →
Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.
1 source article · read the reporting →
The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.
1 source article · read the reporting →
The creator of DeepNude, an app that used machine learning to generate nude images of women from clothed photos, took the software offline after viral backlash. The app, which used generative adversarial networks trained on thousands of nude images, was criticized for objectifying women and enabling non-consensual image manipulation. The creator announced the app's death on Twitter, stating they did not want to make money this way and that the world was not ready for it.
10 source articles · read the reporting →
YouTube's automated captioning system has been found to insert explicit language into videos intended for children. A study of over 7,000 videos from top kids' channels found that 40% contained taboo words in captions, with 1% including highly inappropriate terms like 'bitch' and 'rape'. The AI mishears words such as 'brave' as 'rape' and 'corn' as 'porn'. YouTube acknowledged the issue and said it is working to improve the system.
7 source articles · read the reporting →
The Delhi Government's Education Department is using facial recognition technology in conjunction with CCTV cameras in government schools, according to responses to RTI requests filed by the Internet Freedom Foundation. The organisation urged the Delhi Commission for Protection of Child Rights to intervene, alleging that the practice violates children's right to privacy and education under the Indian Constitution. No specific incident of harm has been reported, but the organisation warns of potential misidentification and disproportionate penalties.
10 source articles · read the reporting →
The AI-generated video of the victim was presented to the judge, potentially influencing the 10-year manslaughter sentence imposed on Gabriel Paul Horcasitas.
1 source article · read the reporting →
Ring, an Amazon company, promoted its Search Party feature in a Super Bowl advertisement, saying its AI helps reunite dog owners with missing pets. Critics said the feature, which is enabled by default, turns Ring doorbells into a mass surveillance network and could easily be adapted to track people. Ring said it had reunited 99 dogs in the US in 90 days and that customers keep full control of their data.
5 source articles · read the reporting →
The system detected and recorded images of vehicles and people, affecting individuals in public spaces.
1 source article · read the reporting →
The system captured license plate data and vehicle locations of individuals passing the cameras.
1 source article · read the reporting →
Police falsely arrested an innocent man due to a facial recognition misidentification
1 source article · read the reporting →
A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.
1 source article · read the reporting →
Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.
2 source articles · read the reporting →
Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.
3 source articles · read the reporting →
The AI-generated victim impact statement influenced the judge's sentencing of Gabriel Paul Horcasitas.
1 source article · read the reporting →
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
3 source articles · read the reporting →
The system captured and stored license plate data and vehicle movements of Boulder residents and commuters, making it searchable by law enforcement without a warrant.
1 source article · read the reporting →
Trial of live facial recognition in London stations leads to a false positive and no arrests AOL.ca
1 source article · read the reporting →
The Flock camera system captured license plate data of individuals.
1 source article · read the reporting →
