Michigan's MiDAS system falsely accused 34,000 of unemployment fraud
Michigan's Unemployment Insurance Agency (UIA) deployed the Michigan Integrated Data Automated System (MiDAS) to automate fraud detection. The system algorithmically adjudicated over 40,000 fraud cases between October 2013 and September 2015, with 85 percent of those resulting in incorrect fraud determinations. The false accusations led to severe financial penalties, ruined credit, and homelessness for many victims. A class-action lawsuit was filed, and while the state has apologised and returned fines, it has fought against compensation claims, though legislators have promised to seek at least $30 million for those affected.
- Company involved
- Michigan Unemployment Insurance Agency
- AI system involved
- Michigan Integrated Data Automated System (MiDAS)
10 source articles · read the reporting →
U.S. Border Patrol agent used ChatGPT to compile use-of-force report, judge finds
A U.S. Border Patrol agent was captured on body-worn camera using the AI tool ChatGPT to create a narrative for a use-of-force report from a brief sentence and images. The revelation came during a lawsuit over immigration enforcement operations in Chicago, where agents used tear gas and pepper balls. U.S. District Judge Sara Ellis found the use of ChatGPT undermined the reports’ credibility, contributing to an inaccuracy finding. The judge issued a preliminary injunction restricting chemical munitions, later stayed by the 7th Circuit Court of Appeals pending appeal.
- Company involved
- U.S. Border Patrol
- AI system involved
- ChatGPT
1 source article · read the reporting →
Sound Intelligence Aggression Detectors Prove Unreliable in School Tests
ProPublica tested Sound Intelligence's aggression detection software, used in hundreds of U.S. schools and hospitals. The algorithm, which analyzes audio for signs of stress and anger, frequently misidentified innocent sounds like coughing as aggressive and failed to detect actual screams. At a New Jersey hospital, the system ignored an agitated man screaming and pounding a desk, escalating the situation. Sound Intelligence's CEO acknowledged the imperfections but defended the technology as an early warning system.
- AI system involved
- Sound Intelligence aggression detector
2 source articles · read the reporting →
AI detector falsely accuses student of cheating at Central Methodist University
Moira Olmsted, a student at Central Methodist University, submitted a written assignment and received a zero grade after her professor said an AI detection tool flagged her work as AI-generated. Olmsted alleges the accusation was false and that her writing had been flagged at least once before. The incident highlights the risk of AI detectors falsely accusing students of cheating.
- Company involved
- Central Methodist University
1 source article · read the reporting →
Universities' use of race in student risk algorithms harms Black and Latinx students
The Markup found that several universities, including UMass Amherst, UW–Milwaukee, and Texas A&M, use EAB's Navigate software which incorporates race as a predictor of student dropout risk. The algorithms label Black and Latinx students as high risk at disproportionately high rates compared to White students. Students, professors, and experts worry this is pushing minority students out of math and science majors through biased advising.
- Company involved
- University of Massachusetts Amherst,University of Wisconsin–Milwaukee,Texas A&M University,Texas Tech University,South Dakota State University
- AI system involved
- Navigate
1 source article · read the reporting →
Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons
Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.
- Company involved
- Lockport City School District
- AI system involved
- AEGIS
1 source article · read the reporting →
Richmond Burton students' photos altered into explicit AI images
Students at Richmond Burton Community High School in Illinois allege that their photos were manipulated using AI to create sexually explicit images, which were then circulated among classmates. One student, Stevie Hyder, said she felt violated and nauseous after seeing her image. Police are investigating, and the school declined to comment due to pending litigation.
5 source articles · read the reporting →
CFPB fines General Information Services for inaccurate background checks
The Consumer Financial Protection Bureau took action against General Information Services and its affiliate e-Background-checks.com for failing to ensure the accuracy of employment background screening reports. The companies allegedly provided inaccurate criminal history information to employers, potentially affecting job applicants' eligibility and causing reputational harm. The CFPB ordered the companies to provide $10.5 million in relief to harmed consumers and pay a $2.5 million penalty.
- Company involved
- General Information Services
10 source articles · read the reporting →
UCLA abandons facial recognition plans after test reveals racial bias
UCLA had proposed using facial recognition surveillance on campus, scanning faces and checking them against a mugshot database. Fight for the Future tested Amazon Rekognition on photos of UCLA sports teams and faculty, finding that the software falsely matched 58 individuals, mostly people of color, with mugshot photos. Following community backlash and the test results, UCLA's administration announced it was abandoning the plan.
- Company involved
- UCLA
- AI system involved
- Rekognition
10 source articles · read the reporting →
Chicago PD predictive policing program led to man being shot twice
In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.
- Company involved
- Chicago Police Department
- AI system involved
- heat list
10 source articles · read the reporting →
Researchers at Shanghai Jiao Tong University train neural network to identify criminals by their faces
Researchers at Shanghai Jiao Tong University used a convolutional neural network to classify facial photographs of 1,856 Chinese men aged 18 to 55, half of whom were criminals, and reported 89.5% accuracy in distinguishing criminals from non-criminals. The study, published on arXiv, identifies facial features the network relied on and raises ethical concerns about potential misuse in pre-crime surveillance. No deployment or actual harm is reported.
- Company involved
- Shanghai Jiao Tong University
8 source articles · read the reporting →
Lake Zurich High School students used AI to generate explicit images of female classmates
In February 2026, students at Lake Zurich High School used artificial intelligence to generate sexually explicit images of female classmates without their consent. The school district acknowledged the incident and notified police, who are investigating. More than 40 girls from fifth grade to high school were reportedly affected. The school provided support and issued disciplinary consequences, while the police investigation continues.
- Company involved
- Lake Zurich Community Unit School District 95
1 source article · read the reporting →
U.S. Border Patrol uses AI and ALPR to target drivers for pretext stops and asset seizures
The U.S. Border Patrol has built a nationwide dragnet driver-surveillance system using automated license plate readers and AI to flag suspicious travel patterns. Local police then pull over targeted drivers on pretexts, interrogate them, and seize cash and vehicles through civil asset forfeiture. The program has been kept secret, with details hidden from court documents and the public. The ACLU report highlights the abuse of innocent drivers and calls for congressional action.
- Company involved
- U.S. Border Patrol (CBP)
- AI system involved
- Automated license plate reader (ALPR) system with AI analytics
6 source articles · read the reporting →
ShotSpotter held in contempt over refusal to release documents
ShotSpotter, a gunshot-detection technology company, was held in contempt of court after refusing to release documents about how it assesses gunshot alerts. The case stems from a November 2021 DUI arrest in Chicago, where the defence alleges the police pulled the driver over solely based on a ShotSpotter alert. Rather than comply with a subpoena from the Cook County Public Defender Office, ShotSpotter's attorney requested the contempt order to enable an appeal. The defence sought materials on analyst qualifications, alert reclassifications, and sensor accuracy data.
- Company involved
- ShotSpotter
- AI system involved
- ShotSpotter
1 source article · read the reporting →
Suspended ACSO investigator arraigned for alleged Flock camera misuse - NEWS10 ABC
Unauthorized access to license plate data of ex-girlfriend and four other individuals
- Company involved
- Flock
- AI system involved
- Flock
1 source article · read the reporting →
Dutch government continued SyRI welfare fraud profiling after ban
The Dutch government deployed the SyRI algorithm to profile welfare recipients in low-income neighborhoods, despite a 2020 court ruling that the system violated EU human rights. The algorithm flagged thousands of parents for fraud based on illegal risk factors such as dual nationality, leading to false accusations, bankruptcy, and trauma. The government has announced an external review of the practices.
- Company involved
- Ministry of Social Affairs of the Netherlands
- AI system involved
- SyRI
10 source articles · read the reporting →
Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims
A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.
- Company involved
- Proctorio
- AI system involved
- Proctorio
10 source articles · read the reporting →
The People v. Raziel Ruiz Alvarez (CA California): AI-hallucinated content in court filing, Published order; monetary sanction payable by Counsel…
The AI generated fabricated legal citations that were included in a court filing, affecting the defendant's legal representation and the court's resources.
- Company involved
- Attorney Siddell
1 source article · read the reporting →
Clearview AI tested facial recognition surveillance cameras with UFT and Rudin
Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.
- Company involved
- Clearview AI
- AI system involved
- Insight Camera
9 source articles · read the reporting →
Judge rules police search using Flock was mass surveillance
A judge ruled that a police search using Flock's automated license plate readers constituted a form of mass surveillance. The ruling concerns the deployment of the AI-based camera system by law enforcement, which the court found to be an invasive surveillance practice. No further details of the case were provided in the article.
- AI system involved
- Flock
4 source articles · read the reporting →
Cleveland State University's room scan requirement ruled unconstitutional
A federal judge ruled that Cleveland State University's requirement for a student to undergo a 360-degree room scan before an online exam was an unreasonable search under the Fourth Amendment. The student, enrolled at the public university, was told shortly before the exam that he would need to scan his private space. The court found that the university's justifications did not outweigh the privacy protections of the home. No final judgment or injunction has been issued yet.
- Company involved
- Cleveland State University
10 source articles · read the reporting →
DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts
DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.
- Company involved
- DeepScore
- AI system involved
- DeepScore
6 source articles · read the reporting →
EPIC lawsuit challenges USPS secret surveillance program using facial recognition
The United States Postal Service's law enforcement wing, the Postal Inspection Service, ran a secret surveillance program called the Internet Covert Operations Program (iCOP) that used facial recognition from Clearview AI and social media monitoring tools to infiltrate online communities and monitor protests. The Electronic Privacy Information Center (EPIC) sued the USPS for failing to conduct and publish a privacy impact assessment as required by the E-Government Act. A federal district court dismissed the lawsuit on standing grounds, ruling that EPIC did not suffer a cognizable injury from the agency's refusal to disclose information about the program.
- Company involved
- United States Postal Service
- AI system involved
- Internet Covert Operations Program (iCOP)
10 source articles · read the reporting →
LAPD told officers to collect social media data on every civilian stopped
The Los Angeles Police Department directed officers to record the social media accounts of every civilian they interviewed, including those not arrested or accused of a crime, according to records obtained by the Brennan Center for Justice. The field interview cards, which also ask for social security numbers, have raised civil liberties concerns. Prosecutors have accused three officers of using the cards to falsely label civilians as gang members. The LAPD said the policy was being updated but did not respond to questions about its use of social media monitoring tools including Media Sonar and Geofeedia.
- Company involved
- Los Angeles Police Department (LAPD)
- AI system involved
- Field interview cards, Media Sonar, Geofeedia
10 source articles · read the reporting →
