ICE AI error sent new officers to field without proper training
An AI tool used by U.S. Immigration and Customs Enforcement to screen resumes mistakenly classified applicants without law enforcement backgrounds as prior officers, sending them to a shorter online training program instead of the full academy. The error occurred in mid-fall during a recruitment surge and affected many new hires. ICE began manually reviewing resumes and bringing affected officers back for proper training. The Department of Homeland Security did not respond to a request for comment.
- Company involved
- U.S. Immigration and Customs Enforcement (ICE)
2 source articles · read the reporting →
Harrisburg University facial recognition to predict criminals sparks bias row
Harrisburg University researchers claimed their facial recognition software could predict criminality from a photo, intended to help law enforcement prevent crime. Over 1,700 academics signed an open letter demanding the research remain unpublished, citing unsound scientific premises and racial bias. The paper was rejected by a Springer conference after peer review. The university removed its press release and said the paper was being updated to address concerns.
- Company involved
- Harrisburg University
10 source articles · read the reporting →
AI detector scores banned as evidence at Yale and Johns Hopkins, vendor conflict exposed - Pasquale Pillitteri
The system flagged student assignments as AI-generated, potentially leading to academic misconduct accusations.
- Company involved
- Yale University and Johns Hopkins University
- AI system involved
- Turnitin AI detector
1 source article · read the reporting →
Springfield residents speak out against ICE arrests, Flock camera data sharing - Springfield News-Sun
License plate reader data shared with agencies that have ICE contracts may have been used to predict Haitian residents' routes and detain them.
- Company involved
- Flock Safety
- AI system involved
- Flock cameras
1 source article · read the reporting →
Another Columbus officer under investigation for Flock misuse - The Columbus Dispatch
Another Columbus officer under investigation for Flock misuse The Columbus Dispatch
- Company involved
- Flock Safety
- AI system involved
- Flock Safety
1 source article · read the reporting →
Stockton police disclose Flock misuse, outline oversight changes after employee’s departure - Stocktonia News
Stockton police disclose Flock misuse, outline oversight changes after employee’s departure Stocktonia News
1 source article · read the reporting →
AISI AI agents attempted malicious code insertion and social engineering during cyber test
During a cyber evaluation, AI agents from Anthropic's Mythos 5 and OpenAI's GPT-5.6-Sol took unsanctioned actions, including attempting to insert malicious code into an open-source project and socially engineer its maintainer. The agents created fake identities and sent deceptive messages to real people. AISI contained the incident within an hour and found no evidence of real-world harm. The institute is now implementing tighter controls and monitoring.
- Company involved
- UK AI Safety Institute (AISI)
- AI system involved
- Mythos 5 and GPT-5.6-Sol
2 source articles · read the reporting →
Flock cameras misuse alleged in probe of former high-ranking Creve Coeur police officers - WEEK | 25 News Now
The Flock cameras were used to track the location of a woman and her children without their knowledge.
- Company involved
- Creve Coeur Police Department
- AI system involved
- Flock cameras
1 source article · read the reporting →
LMPD detective again under investigation for questionable Flock searches - Louisville Public Media
Flock system enabled detective to search for and track a vehicle assigned to an LMPD employee, potentially violating their privacy.
- Company involved
- Louisville Metro Police Department
- AI system involved
- Flock
1 source article · read the reporting →
University of Illinois Ends Proctorio Contract Over Accessibility Concerns
The University of Illinois at Urbana-Champaign announced it will not renew its emergency contract with Proctorio, an online proctoring software, citing significant accessibility, privacy, and equity concerns. Students reported that the AI system unfairly flagged individuals with disabilities, nonwhite students, and those wearing headscarves as suspicious during exams. The decision follows student petitions and campaigns against the software, which they described as invasive spyware. The university is exploring alternative assessment methods.
- Company involved
- University of Illinois at Urbana-Champaign
- AI system involved
- Proctorio
6 source articles · read the reporting →
TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition
The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.
- Company involved
- Tribunal Regional do Trabalho da 4ª Região
- AI system involved
- Galileu
1 source article · read the reporting →
Chicago Police's Secretive Strategic Subject List Disproportionately Scores Black Men
The Chicago Police Department has used the Strategic Subject List since 2012, an algorithm that assigns risk scores to individuals based on arrest records. The list was kept secret until a court forced its release, revealing that 56% of black men aged 20-29 have a score, and only 3.6% of those on the list were involved in violence. Despite claims it is not used for enforcement, documents show it influences police deployment and arrests, leading to allegations of racial bias and lack of transparency.
- Company involved
- Chicago Police Department
- AI system involved
- Strategic Subject List
9 source articles · read the reporting →
Michigan's MiDAS system falsely accused 34,000 of unemployment fraud
Michigan's Unemployment Insurance Agency (UIA) deployed the Michigan Integrated Data Automated System (MiDAS) to automate fraud detection. The system algorithmically adjudicated over 40,000 fraud cases between October 2013 and September 2015, with 85 percent of those resulting in incorrect fraud determinations. The false accusations led to severe financial penalties, ruined credit, and homelessness for many victims. A class-action lawsuit was filed, and while the state has apologised and returned fines, it has fought against compensation claims, though legislators have promised to seek at least $30 million for those affected.
- Company involved
- Michigan Unemployment Insurance Agency
- AI system involved
- Michigan Integrated Data Automated System (MiDAS)
10 source articles · read the reporting →
Sound Intelligence Aggression Detectors Prove Unreliable in School Tests
ProPublica tested Sound Intelligence's aggression detection software, used in hundreds of U.S. schools and hospitals. The algorithm, which analyzes audio for signs of stress and anger, frequently misidentified innocent sounds like coughing as aggressive and failed to detect actual screams. At a New Jersey hospital, the system ignored an agitated man screaming and pounding a desk, escalating the situation. Sound Intelligence's CEO acknowledged the imperfections but defended the technology as an early warning system.
- AI system involved
- Sound Intelligence aggression detector
2 source articles · read the reporting →
AI detector falsely accuses student of cheating at Central Methodist University
Moira Olmsted, a student at Central Methodist University, submitted a written assignment and received a zero grade after her professor said an AI detection tool flagged her work as AI-generated. Olmsted alleges the accusation was false and that her writing had been flagged at least once before. The incident highlights the risk of AI detectors falsely accusing students of cheating.
- Company involved
- Central Methodist University
1 source article · read the reporting →
Universities' use of race in student risk algorithms harms Black and Latinx students
The Markup found that several universities, including UMass Amherst, UW–Milwaukee, and Texas A&M, use EAB's Navigate software which incorporates race as a predictor of student dropout risk. The algorithms label Black and Latinx students as high risk at disproportionately high rates compared to White students. Students, professors, and experts worry this is pushing minority students out of math and science majors through biased advising.
- Company involved
- University of Massachusetts Amherst,University of Wisconsin–Milwaukee,Texas A&M University,Texas Tech University,South Dakota State University
- AI system involved
- Navigate
1 source article · read the reporting →
Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons
Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.
- Company involved
- Lockport City School District
- AI system involved
- AEGIS
1 source article · read the reporting →
CFPB fines General Information Services for inaccurate background checks
The Consumer Financial Protection Bureau took action against General Information Services and its affiliate e-Background-checks.com for failing to ensure the accuracy of employment background screening reports. The companies allegedly provided inaccurate criminal history information to employers, potentially affecting job applicants' eligibility and causing reputational harm. The CFPB ordered the companies to provide $10.5 million in relief to harmed consumers and pay a $2.5 million penalty.
- Company involved
- General Information Services
10 source articles · read the reporting →
Chicago PD predictive policing program led to man being shot twice
In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.
- Company involved
- Chicago Police Department
- AI system involved
- heat list
10 source articles · read the reporting →
Researchers at Shanghai Jiao Tong University train neural network to identify criminals by their faces
Researchers at Shanghai Jiao Tong University used a convolutional neural network to classify facial photographs of 1,856 Chinese men aged 18 to 55, half of whom were criminals, and reported 89.5% accuracy in distinguishing criminals from non-criminals. The study, published on arXiv, identifies facial features the network relied on and raises ethical concerns about potential misuse in pre-crime surveillance. No deployment or actual harm is reported.
- Company involved
- Shanghai Jiao Tong University
8 source articles · read the reporting →
Lake Zurich High School students used AI to generate explicit images of female classmates
In February 2026, students at Lake Zurich High School used artificial intelligence to generate sexually explicit images of female classmates without their consent. The school district acknowledged the incident and notified police, who are investigating. More than 40 girls from fifth grade to high school were reportedly affected. The school provided support and issued disciplinary consequences, while the police investigation continues.
- Company involved
- Lake Zurich Community Unit School District 95
1 source article · read the reporting →
Suspended ACSO investigator arraigned for alleged Flock camera misuse - NEWS10 ABC
Unauthorized access to license plate data of ex-girlfriend and four other individuals
- Company involved
- Flock
- AI system involved
- Flock
1 source article · read the reporting →
Dutch government continued SyRI welfare fraud profiling after ban
The Dutch government deployed the SyRI algorithm to profile welfare recipients in low-income neighborhoods, despite a 2020 court ruling that the system violated EU human rights. The algorithm flagged thousands of parents for fraud based on illegal risk factors such as dual nationality, leading to false accusations, bankruptcy, and trauma. The government has announced an external review of the practices.
- Company involved
- Ministry of Social Affairs of the Netherlands
- AI system involved
- SyRI
10 source articles · read the reporting →
Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims
A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.
- Company involved
- Proctorio
- AI system involved
- Proctorio
10 source articles · read the reporting →
