Where automated decisions went wrong

Flock camera concerns rise amid Indiana deputy's criminal charges - WTHR

Flock camera concerns rise amid Indiana deputy's criminal charges WTHR

Company involved

Flock Safety

AI system involved

Flock camera

1 source article · read the reporting →

Franklin County detective fired after using Flock cameras to track private citizen - WXII

The system was used to track the movements of a private citizen.

Company involved

Franklin County Sheriff's Office

AI system involved

Flock cameras

1 source article · read the reporting →

New Orleans Police Secretly Used Facial Recognition to Monitor Citizens

New Orleans police secretly used Project NOLA's facial recognition cameras to automatically alert officers to possible crime suspects, potentially violating a city ordinance requiring human review and disclosure. An investigation found the system played a role in dozens of arrests but its use was often not disclosed in police reports. The program was paused in April 2025 pending a review by the police superintendent. The ACLU has called for a permanent halt, warning of threats to privacy and civil rights.

Company involved

New Orleans Police Department

AI system involved

Project NOLA

10 source articles · read the reporting →

Police Officer Accused of Using Flock Cameras To Secretly Track Women - Newsweek

The system tracked the license plates and movements of seven women and four men without their knowledge or consent.

Company involved

Flock Safety

AI system involved

Flock Safety

1 source article · read the reporting →

Covington cop fired after investigation into Flock technology system - WSB-TV

The system tracked vehicle locations and movements of individuals without legitimate law enforcement purpose.

Company involved

Covington Police Department

AI system involved

Flock

1 source article · read the reporting →

From false arrest claims to alleged stalking, Flock cameras face scrutiny in Florida - cbs12.com

The system identified Lindsey Isaacs as a suspect in a triple vehicular homicide, leading to her arrest and 13 days in jail.

Company involved

Flock

AI system involved

Flock

1 source article · read the reporting →

Lindsey Isaacs Flock camera wrongful arrest case explained - Attack of the Fanboy

The system identified Lindsey Isaacs' vehicle as being near a fatal crash, leading to her wrongful arrest and 13-day imprisonment.

Company involved

Flock Safety

AI system involved

Flock automated license plate reader

1 source article · read the reporting →

Shively Officer Charged in Flock Camera Stalking Case - Hoodline

The Flock license plate camera system was used to track and harass a woman's movements.

Company involved

Flock Safety

AI system involved

Flock Safety ALPR

1 source article · read the reporting →

Ex-cop charged after using Flock cameras to stalk girlfriend - NJ.com

The system tracked the location of the ex-cop's girlfriend.

Company involved

Flock Safety

AI system involved

Flock

1 source article · read the reporting →

California cop shared Flock camera data with domestic violence suspect who tracked down victim - Yahoo

The Flock camera system captured the location of a domestic violence victim's vehicle, and an officer shared it with her alleged abuser, who tracked her down.

Company involved

Flock Safety

AI system involved

Flock camera system

1 source article · read the reporting →

Police Officer Uses Flock Cameras To Hand an Abuser His Victim’s Exact Location - motorbiscuit.com

The Flock camera system tracked a domestic violence victim's vehicle and disclosed her live location to her suspected abuser.

Company involved

Flock Safety

AI system involved

Flock Safety

1 source article · read the reporting →

Police: Former Amarillo police officer used Flock cameras to track victim 76 times - NewsChannel 10

A former Amarillo police officer used the Flock camera system to track a victim's license plate 76 times and searched the victim's name in TLOxp twice without legitimate purpose.

Company involved

Flock Safety

AI system involved

Flock camera system

1 source article · read the reporting →

Flock cameras misuse alleged in probe of former high-ranking Creve Coeur police officers - WEEK | 25 News Now

The Flock cameras were used to track the location of a woman and her children without their knowledge.

Company involved

Creve Coeur Police Department

AI system involved

Flock cameras

1 source article · read the reporting →

Unwanted Witness warns of state surveillance in Uganda

Unwanted Witness has raised concerns about the Ugandan government's use of surveillance technology, including facial recognition and location monitoring, to suppress political dissent. The organisation alleges that CCTV footage was used to monitor opposition rallies and protests ahead of the 2021 elections. It also highlights the use of cybercrime laws to silence free speech, citing the imprisonment of activist Dr Stella Nyanzi.

Company involved

Uganda Police Force

AI system involved

CCTV Camera command centre

3 source articles · read the reporting →

25 Investigates: Former Braintree officer accused of using police technology to track ex-girlfriend - Boston 25 News

The Flock camera system tracked the ex-girlfriend's vehicle license plate over 1,000 times, enabling the officer to stalk and harass her.

Company involved

Flock Safety

AI system involved

Flock camera system

1 source article · read the reporting →

RCMP used IntelCenter facial recognition without disclosure

The RCMP in British Columbia secretly subscribed to IntelCenter's facial recognition service, which matched faces against a database of 700,000 faces tied to terrorism. Internal emails revealed the force broke its own procurement rules and hid the purchase. The RCMP claimed it was only for testing, but documents showed active use. The contracts ended in 2019.

Company involved

Royal Canadian Mounted Police (RCMP)

AI system involved

IntelCenter Check

10 source articles · read the reporting →

Selangor police investigate AI deepfake video falsely linking former IGP to scam

A deepfake video on TikTok used artificial intelligence to depict former Inspector-General of Police Tan Sri Acryl Sani Abdullah Sani endorsing a money scam linked to a 'Datuk'. The video, which circulated from 20 June 2025, was entirely fabricated. Acryl Sani lodged a police report, and Selangor police are investigating under the Penal Code and Communications and Multimedia Act, warning of firm action against those spreading the fake content.

1 source article · read the reporting →

MIT Media Lab creates 'Norman', a psychopath AI trained on biased data

MIT Media Lab developed Norman, an AI image captioning system trained on graphic content from Reddit. The project demonstrated how biased training data can lead to disturbing outputs. Norman was compared to a standard AI on Rorschach inkblot tests, showing the influence of data bias. The project was active from April to June 2018.

Company involved

MIT Media Lab

AI system involved

Norman

10 source articles · read the reporting →

Speedcam Anywhere developers face abuse from UK drivers after app launch

Speedcam Anywhere, an app that uses AI to estimate the speed of passing vehicles, was launched in March 2022. Its developers have received abusive emails from drivers and are now hiding their identities. Google and Apple have not approved the app for distribution, and the Home Office has not vetted it for speeding prosecutions.

AI system involved

Speedcam Anywhere

10 source articles · read the reporting →

Suspended ACSO investigator arraigned for alleged Flock camera misuse - NEWS10 ABC

Unauthorized access to license plate data of ex-girlfriend and four other individuals

Company involved

Flock

AI system involved

Flock

1 source article · read the reporting →

HP webcam facial tracking fails to follow black man's face

A black man, Desi, posted a YouTube video showing that HP's webcam facial tracking software failed to follow his face while it tracked a white woman's face. HP acknowledged the issue and said it was working with partners to investigate. The company attributed the problem to insufficient lighting affecting contrast detection.

Company involved

HP

AI system involved

HP Webcam facial tracking software

10 source articles · read the reporting →

Clearview AI tested facial recognition surveillance cameras with UFT and Rudin

Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.

Company involved

Clearview AI

AI system involved

Insight Camera

9 source articles · read the reporting →

Uttar Pradesh Police uses AI cameras to track women's distress

Uttar Pradesh Police, in collaboration with Staqu Technologies, deployed AI-powered cameras in Lucknow for surveillance of women in distress. Activists have criticised the system for invading privacy. The system is currently in use.

Company involved

Uttar Pradesh Police

AI system involved

Trinetra

10 source articles · read the reporting →

Retorio AI personality test swayed by candidate appearance in BR experiment

Bayerischer Rundfunk journalists conducted experiments with Retorio's AI video interview analysis tool. The AI, which assesses personality traits from short videos, produced different scores when the same actress changed her appearance (glasses, headscarf, wig) or the video background and lighting were altered. The start-up Retorio acknowledged that the AI considers external image, similar to a human interviewer. Experts warned that such software could perpetuate stereotypes and unfairly affect job candidates.

AI system involved

Retorio AI

10 source articles · read the reporting →