Broward College student flagged by Honorlock and accused of cheating
A 17-year-old Black student at Broward College was flagged by Honorlock, a remote proctoring system, during an online biology exam in February 2022. Her professor reviewed the recording and accused her of academic dishonesty for looking down and away from the screen; the college found her responsible for noncompliance and gave her a zero and a warning. The student says she was only thinking and fidgeting, and the article reports that the video is ambiguous. Honorlock says it does not definitively identify cheaters and the final decision rests with the school.
- Company involved
- Broward College
- AI system involved
- Honorlock
2 source articles · read the reporting →
Northeastern University Student Complains About Professor's Undisclosed AI-Generated Presentation
In February 2025, an undergraduate student at Northeastern University noticed that a professor's presentation contained misspellings and distorted images, leading her to suspect it was AI-generated. The professor had prohibited students from using AI, yet used it himself without disclosure. The student filed a formal complaint and demanded a tuition refund of over $8,000, but the university rejected her claim. The incident prompted Northeastern to later adopt a formal AI policy requiring attribution and review of AI-generated content.
- Company involved
- Northeastern University
2 source articles · read the reporting →
Brainwash cafe customers unknowingly put in AI surveillance dataset
In 2014, customers at the Brainwash Cafe in San Francisco were recorded by a publicly available webcam. The images were compiled into a dataset containing 11,917 photos for training surveillance-related object and head detection algorithms. The dataset was later removed from access following an investigation revealing use by researchers affiliated with the National University of Defense Technology in China. The dataset's creators are accused of collecting the images without the cafe customers' knowledge or consent.
- Company involved
- Stanford University
- AI system involved
- Brainwash dataset
1 source article · read the reporting →
Whiteside County deputy under investigation for possible Flock camera misuse - WQAD
Whiteside County deputy under investigation for possible Flock camera misuse WQAD
- Company involved
- Whiteside County Sheriff's Office
- AI system involved
- Flock camera
1 source article · read the reporting →
Labor unions sue Trump administration over AI social media surveillance
Three labor unions (UAW, CWA, AFT) filed a lawsuit against the U.S. Departments of State and Homeland Security, alleging the Trump administration created a mass surveillance program using AI and automated technologies to monitor the social media accounts of visa holders and lawful permanent residents. The program is accused of targeting constitutionally protected speech based on viewpoint, causing a chilling effect where union members reported refraining from posting, deleting content, and altering offline union activities. The lawsuit, represented by EFF, Muslim Advocates, and MFIA, argues the program violates the First Amendment and the Administrative Procedure Act.
- Company involved
- U.S. Department of State
- AI system involved
- Catch and Revoke
9 source articles · read the reporting →
Arizona Unemployment Applicants Required to Submit Facial Recognition
People applying for unemployment benefits in Arizona must verify their identity via facial recognition software provided by ID.me. If the system fails to match a selfie to a photo ID, applicants can be denied benefits unless they successfully complete a video chat with a referee. A class-action lawsuit filed in June 2021 alleges that the practice violates due process rights and discriminates against people of colour.
- Company involved
- Arizona Department of Economic Security
- AI system involved
- ID.me
1 source article · read the reporting →
Federal civil rights lawsuit targets Flock and local police - KDVR
Police wrongfully accused a woman of theft based on Flock camera surveillance of her vehicle.
- Company involved
- Columbine Valley Police Department
- AI system involved
- Flock
1 source article · read the reporting →
CDT study finds AI chatbots give inaccurate voting information to disabled voters
The Center for Democracy and Technology tested five AI chatbots on July 18, 2024 with 77 prompts about voting with a disability. They found that 61% of responses had at least one insufficiency, and over a third included incorrect information. Some responses could dissuade, impede or prevent a user from voting. The chatbots also hallucinated laws and organizations.
- AI system involved
- Mixtral 8x7B v0.1, Gemini 1.5 Pro, ChatGPT-4, Claude 3 Opus, Llama 2 70b
5 source articles · read the reporting →
Joliet police lieutenant charged with felony computer tampering of Flock Safety program - Shaw Local
A Joliet police lieutenant is charged with felony computer tampering, accused of using the Flock license-plate reader system to flag a female officer's vehicle as wanted, stolen or driven recklessly, which could have led to police stops.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety
1 source article · read the reporting →
Miami Police Used Clearview AI to Identify Protester
NBC 6 Investigators revealed that Miami Police used the facial recognition program Clearview AI to identify Oriana Albornoz, a 25-year-old woman, as the person accused of throwing rocks at officers during a protest on May 30, 2020. She was arrested a month later and charged with battery on a police officer; her attorney said he was unaware police had used the technology, as it was not disclosed in the arrest report. The police department acknowledged using Clearview AI to identify violent protest suspects after the fact, but stated they do not surveil peaceful protesters. The case is ongoing, with Albornoz pleading not guilty.
- Company involved
- Miami Police Department
- AI system involved
- Clearview AI
4 source articles · read the reporting →
Florida cop on leave in Flock probe after TCPalm questioned searches - Treasure Coast News
A Florida police officer was placed on leave after TCPalm questioned the officer's searches of Flock license-plate data on people's movements.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety
1 source article · read the reporting →
Volusia County Schools' Gaggle AI flags threat, leading to student's arrest
A 15-year-old student at Deltona High School wrote a threat on his school laptop, which was flagged by the Gaggle monitoring system. The alert notified a school resource deputy, who detained the student before he could leave. The teen admitted to the threat, saying he was angry about being bullied, and was arrested on a second-degree felony charge.
- Company involved
- Volusia County Schools
- AI system involved
- Gaggle
1 source article · read the reporting →
Police Investigator Accused of Making Over 4,000 Illegal Flock Camera Searches - Futurism
The system allowed unauthorized tracking of individuals' vehicles through license plate recognition, affecting five subjects including an ex-girlfriend who was searched 3,000 times.
- Company involved
- Albany County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Two Florida deputies arrested for Flock, ALPR abuse after TCPalm query - Yahoo
The Flock ALPR system was used by deputies to track the locations of a woman and a teenage girl for personal, non-law-enforcement purposes.
- Company involved
- Pinellas County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Flock seeks to have security researchers' map of Flock cameras taken down — unauthenticated flaw exposed 335,701 camera locations nationwide…
The system captured license plate data and vehicle locations of individuals passing the cameras.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety cameras
1 source article · read the reporting →
Oakland County investigating alleged misuse of Flock camera data by former deputy - WXYZ 7 News Detroit
The Flock camera system collected and stored license plate data, and a former deputy allegedly accessed it without authorization.
- Company involved
- Oakland County Sheriff's Office
- AI system involved
- Flock camera
1 source article · read the reporting →
Senate hearing targets Flock Safety as officers face misuse charges - FOX 5 Atlanta
The system incorrectly linked Lindsey Isaacs's vehicle to a fatal crash scene, leading to her wrongful arrest and 13-day detention.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety automated license plate reader
1 source article · read the reporting →
Temple Police officer resigns after internal investigation into misuse of Flock Safety automatic license plate reader system - tdtnews.com
An officer conducted an unauthorized search of the Flock Safety automatic license plate reader system without a legitimate law enforcement purpose.
- Company involved
- Temple Police Department
- AI system involved
- Flock Safety automatic license plate reader (ALPR) system
1 source article · read the reporting →
UK schools install toilet sensors that listen for keywords to monitor pupils
Several UK schools, including St Joseph's College in Stoke-on-Trent, have installed Halo Smart Sensors in toilets that use machine learning to detect keywords such as 'help me' and 'stop it'. The sensors trigger alerts to staff when keywords are detected, aiming to crack down on vaping and bullying. Privacy advocates argue the sensors violate children's privacy and may be unlawful. The schools have not sought parental consent for the monitoring.
- Company involved
- St Joseph's College
- AI system involved
- Halo Smart Sensors
4 source articles · read the reporting →
Hallucination-laced TRO raises alarm bells on AI use by courts - Massachusetts Lawyers Weekly
A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.
- Company involved
- U.S. District Court for the Southern District of Mississippi
1 source article · read the reporting →
Lawsuit claims facial recognition program led to wrongful arrest - FOX 2
Identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17 months in jail.
- Company involved
- St. Louis County Police Department
- AI system involved
- Rekognition
1 source article · read the reporting →
Chesterfield police employee arrested for misusing Flock cameras - The Richmonder
The system allowed unauthorized searches of license plate data, affecting individuals whose plates were queried.
- Company involved
- Chesterfield County Police Department
- AI system involved
- Flock Safety Automatic License Plate Reader System
1 source article · read the reporting →
Cybercheck AI tool challenged in Akron homicide cases
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
- Company involved
- Akron Police Department
- AI system involved
- Cybercheck
3 source articles · read the reporting →
Boulder police chief faces class action over Flock cameras' warrantless surveillance - Courthouse News
The system captured and stored license plate data and vehicle movements of Boulder residents and commuters, making it searchable by law enforcement without a warrant.
- Company involved
- Boulder Police Department
- AI system involved
- Flock Safety
1 source article · read the reporting →
