The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “BriefCam Ltd. (now integrated into Milestone Systems A/S, Canon Group)” · matched on meaning · public reporting

Chinese tech companies patented Uyghur detection analytics

IPVM reported that Huawei, Megvii, SenseTime, and other Chinese tech companies filed patents in China for AI systems that can detect Uyghur ethnicity. The patents included Uyghur as a detectable attribute for facial recognition and image retrieval. The companies responded by saying they would amend or withdraw the patents, claiming the references were misunderstood or regrettable, while the technology is used by police for surveillance and targeting of Uyghurs.

10 source articles · read the reporting →

WF-JH5L2X26 Mar 2021

Teleperformance plans AI webcam surveillance for home-working staff

Teleperformance, a global call centre company, told some staff it would install AI-powered webcams to monitor home-working infractions such as eating, phone use, or leaving desks. The system would randomly scan for breaches and send alerts to managers. After the Guardian inquired, the company said the remote scans would not be used in the UK, but the plan raised concerns from unions and MPs about invasive surveillance.

Company involved
Teleperformance

10 source articles · read the reporting →

WF-TX7ZJM8 Mar 2021

Verkada security breach exposes customer video and data

In March 2021, attackers compromised Verkada's platform and accessed video and image data from 97 customer organisations. The attackers used a misconfigured customer support server to gain access and viewed live video, accessed badge credentials for eight customers, and downloaded user lists. Verkada cut off access within hours and notified affected customers. The attacker, Tillie Kottmann, was later indicted by the U.S. Department of Justice.

Company involved
Verkada
AI system involved
Verkada Command platform with People Analytics

10 source articles · read the reporting →

WF-BWQHCV23 Feb 2021

AnyVision patents drone facial recognition technology

AnyVision, an Israeli private surveillance company, filed a US patent for drone technology that uses facial recognition to identify people on the ground. The patent describes adaptive positioning of drones to find optimal angles for accurate facial recognition. The technology is not yet in production, but the company's CEO stated it will become a reality soon. Potential privacy concerns have been raised.

Company involved
AnyVision
AI system involved
Adaptive positioning of drones for enhanced facial recognition

9 source articles · read the reporting →

Kohler, BMW, MaxMara secretly collected customers' facial recognition data

During the 2021 CCTV 3·15 Gala, it was revealed that Kohler, BMW, and MaxMara stores had installed facial recognition cameras from vendors such as Wandianzhang and Youluoke. These cameras captured customers' facial data without their knowledge or consent, and the data was used to track customer visits and inform sales strategies. The systems were deployed in thousands of stores across China, collecting over 100 million facial records. The companies did not inform customers or obtain consent, violating Chinese privacy laws.

Company involved
Kohler (China) Investment Co., Ltd., ZhengTong Auto (BMW dealerships), MaxMara
AI system involved
Facial recognition cameras from Wandianzhang, Youluoke, Yaliang, Ruiwei

10 source articles · read the reporting →

WF-2LPYR714 Dec 2020

Myanmar junta deploys Huawei facial recognition system threatening rights

In December 2020, the Myanmar military junta rolled out the first phase of its Safe City initiative in Naypyidaw, using 335 surveillance cameras from Huawei equipped with facial recognition and license plate recognition technology. The system automatically scans faces and plates and alerts authorities to individuals on a wanted list. Human Rights Watch warns that the system poses a grave risk to privacy and rights, especially for anti-coup activists, and that the junta has suspended key privacy protections.

Company involved
Myanmar military junta
AI system involved
Safe City surveillance system

10 source articles · read the reporting →

Uttar Pradesh Police uses AI cameras to track women's distress

Uttar Pradesh Police, in collaboration with Staqu Technologies, deployed AI-powered cameras in Lucknow for surveillance of women in distress. Activists have criticised the system for invading privacy. The system is currently in use.

Company involved
Uttar Pradesh Police
AI system involved
Trinetra

10 source articles · read the reporting →

WF-2ZNE3K8 Jan 2018

Huawei and Megvii tested Uyghur alarm facial recognition system

Huawei and Megvii conducted an interoperability test in 2018 that verified a 'Uyghur alarm' function in Megvii's facial recognition system, according to a confidential report found by IPVM. The system could identify Uyghur minorities and alert police. Huawei denied real-world application and deleted the report after IPVM inquired. Megvii denied targeting ethnic groups. The test report was publicly accessible on Huawei's European website.

Company involved
Huawei
AI system involved
Megvii Dynamic Face Recognition

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

Adobe uses Creative Cloud user data to train AI

Adobe's content analysis feature may scan Creative Cloud and Document Cloud files to train machine learning models, including object recognition in Lightroom and Liquid Mode in Acrobat. The company says it may analyze images, audio, video, text and other documents stored on its servers. Adobe offers an opt-out in account privacy settings, but the article notes the company did not ask first.

Company involved
Adobe
AI system involved
Content analysis

10 source articles · read the reporting →

WF-G3SQSO1 Jan 2018

Canadian Tire chided by BC privacy commissioner for facial recognition without consent

Canadian Tire deployed facial recognition in at least four British Columbia stores between 2018 and 2021 to curb theft and increase staff safety. The BC Privacy Commissioner investigated and found the retailer failed to show a reasonable purpose and did not obtain customer consent, violating the province's Personal Information Protection Act. After the investigation was announced, Canadian Tire discontinued use of the system at all 12 locations and deleted customer data. The commissioner recommended stronger privacy policies and government regulation of biometric technologies.

Company involved
Canadian Tire

10 source articles · read the reporting →

WF-YO0AUI1 Jan 2019

Clearview AI to pull out of Canada and stop working with RCMP amid privacy investigation

Clearview AI, the US facial recognition company, has agreed to stop offering its services in Canada amid a joint investigation by Canadian privacy regulators. The company's technology, which matches images against billions of photos scraped from the internet, was used by the RCMP and more than 20 other police services across Canada. The Office of the Privacy Commissioner of Canada announced the 'indefinite suspension' of Clearview's contract with the RCMP, its last remaining Canadian client. The investigation into whether the technology breaches Canadian privacy laws will continue.

Company involved
Clearview AI
AI system involved
Clearview AI

10 source articles · read the reporting →

WF-2ITU5Z1 Jan 2020

Canon uses AI smile recognition cameras to control office access

Canon Information Technology deployed AI cameras at its Beijing headquarters that only allow smiling employees to enter the office or book conference rooms. The system uses smile recognition to enforce a positive atmosphere. Some workers have complained about the intrusiveness of the technology. Canon defended the system, saying it encourages a positive work environment.

Company involved
Canon Information Technology (Canon China)

9 source articles · read the reporting →

WF-IK4RSL1 Jul 2016

CBSA tested facial recognition on millions at Toronto Pearson Airport in 2016

In 2016, the Canada Border Services Agency (CBSA) secretly tested facial recognition technology on millions of travellers at Toronto Pearson Airport without their knowledge. The system, supplied by Face4 Systems, matched faces against a database of previously deported individuals. The CBSA stated that no one was deported as a result of the pilot, and the technology was removed after six months. Privacy advocates raised concerns about lack of consent, transparency, and potential racial bias.

Company involved
Canada Border Services Agency
AI system involved
Faces on the Move

8 source articles · read the reporting →

WF-CQ2Y4G1 Jan 2019

Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade

In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.

Company involved
Ministry of Interior
AI system involved
Huawei smart surveillance cameras

10 source articles · read the reporting →

WF-J5IU7Z3 Dec 2024

FTC settles with IntelliVision over deceptive facial recognition claims

The Federal Trade Commission (FTC) took action against IntelliVision Technologies Corp. for making false, misleading, or unsubstantiated claims about its AI-powered facial recognition software. The company allegedly claimed its software had one of the highest accuracy rates on the market and was free of gender or racial bias, without supporting evidence. The FTC also alleged that IntelliVision did not train its software on millions of faces as claimed, but on images of approximately 100,000 individuals. Under a proposed consent order, IntelliVision is prohibited from making such misrepresentations without competent and reliable testing.

Company involved
IntelliVision Technologies Corp.
AI system involved
IntelliVision facial recognition software

9 source articles · read the reporting →

WF-UHO4KG31 Aug 2021

Met Police buys £3m retrospective facial recognition system

The Metropolitan Police Service (MPS) has awarded a £3 million, four-year contract to Northgate Public Services for a new retrospective facial-recognition (RFR) system to be deployed within three months. RFR processes biometric information from historic CCTV, social media, and other images to identify suspects and missing persons, operating retroactively unlike live facial recognition. The procurement was approved by the Mayor's Office for Policing and Crime in August 2021. The MPS states that human-in-the-loop decision-making will be used, but digital rights groups and a former biometrics commissioner have raised concerns about potential discrimination, overrepresentation of marginalised groups in watch lists, and lack of a legislative framework.

Company involved
Metropolitan Police Service
AI system involved
Retrospective facial-recognition software

9 source articles · read the reporting →

WF-VIE4ZV13 Aug 2024

Deep-Live-Cam enables real-time face swapping, raising fraud concerns

A software package called Deep-Live-Cam has gone viral for enabling real-time face swapping on webcams using a single photo. The tool, which is free and open source, allows anyone to impersonate another person's appearance in a video chat, raising concerns about remote deception and fraud. The article notes that similar technology has been used in a $25 million heist in Hong Kong and in audio deepfake scams.

AI system involved
Deep-Live-Cam

7 source articles · read the reporting →

WF-S2D5111 Nov 2020

Dahua facial recognition technology can sort by race and alert police when detecting Uighurs

Dahua Technologies, a Chinese surveillance camera company, developed facial recognition software that can classify individuals by race and send real-time warnings to police when it identifies Uighur people. Documents and code revealed the capability, though it is unclear if it has been deployed. Human rights advocates and Uighur individuals have expressed concern about potential surveillance and discrimination. The company did not respond to requests for comment.

Company involved
Dahua Technologies
AI system involved
Dahua facial recognition software

10 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-Y7PFHY1 Jan 2024

Wacom responds to concerns about AI-generated images in marketing assets

Wacom acknowledged that it may have used AI-generated images in US marketing assets for the New Year. The company stated it purchased the images from a third-party vendor who indicated they were not AI-generated, and that it vetted them using online tools that also indicated they were not AI-generated. After community feedback raised doubts, Wacom discontinued the images and is reviewing its processes to prevent recurrence. The company attributed the incident to misleading vendor information and detection tool limitations.

Company involved
Wacom

10 source articles · read the reporting →

WF-ZD7HFH1 Jan 2022

Network Rail denies using AI cameras to detect passengers' emotions

Network Rail conducted a trial of AI cameras at major stations in 2022 that analysed demographic details and reportedly assessed emotions. Documents obtained by Big Brother Watch indicate the system was capable of determining whether a passenger was happy, sad or angry, with potential use for measuring satisfaction and advertising. Network Rail denied that any emotion analysis took place and stated the image analysis for demographic details has ended. Big Brother Watch has submitted a complaint to the Information Commissioner about the trial.

Company involved
Network Rail
AI system involved
Amazon Rekognition

7 source articles · read the reporting →

WF-HCNIXO1 Dec 2007

Oxford Town Centre CCTV dataset used without consent for AI research

The Oxford Town Centre dataset is a CCTV video of pedestrians in Oxford, England, captured from a public surveillance camera without the knowledge or consent of the approximately 2,200 people shown. The footage was used in over 60 research projects, including commercial research by Amazon, Disney, and Huawei, for developing facial recognition, sex classification, and social distancing algorithms. The dataset was taken down in June 2020, but no remediation was provided to the individuals depicted.

Company involved
University of Oxford
AI system involved
Oxford Town Centre dataset

5 source articles · read the reporting →

WF-DLNNBB1 Jan 2015

French police secretly used Briefcam facial recognition since 2015

The French National Police has been using Briefcam's Video Synopsis software since 2015, according to internal documents obtained by Disclose. The software, which includes facial recognition capabilities, was deployed without the required data protection impact assessment or notification to the CNIL. The Ministry of the Interior concealed the use of this tool for eight years. The police hierarchy allegedly used the software for facial recognition without judicial requisition, and the DGPN did not respond to requests for comment.

Company involved
French National Police
AI system involved
Briefcam Video Synopsis

10 source articles · read the reporting →

← Newerpage 3 of 4Older →