Hikvision sells Uyghur recognition system to Chinese authorities
Hikvision, a Chinese surveillance company, sold a facial recognition system powered by NVIDIA to authorities in the People's Republic of China. The system is designed to identify Uyghur individuals, enabling ethnic profiling and surveillance. The article reports that the system was marketed as a tool for public security and was deployed without transparency or accountability. No specific incident of harm is described, but the potential for widespread discrimination and human rights abuses is highlighted.
- Company involved
- Hikvision
- AI system involved
- Uyghur recognition system
10 source articles · read the reporting →
Brooklyn landlord abandons facial recognition plan after tenant protests
Robert Nelson, president of Nelson Management Group, planned to install a facial recognition system at Atlantic Plaza Towers, a rent-stabilized building in Brownsville, Brooklyn. Tenants protested, citing privacy concerns and studies showing the technology disproportionately impacts people of color. After a town hall meeting, Nelson announced he was withdrawing the application with the state housing agency. The reversal was seen as a victory by tenants, who continue to push for legislation banning facial recognition in residential buildings.
- Company involved
- Nelson Management Group
10 source articles · read the reporting →
Intel and Class Technologies face criticism over emotion-detecting AI for students
Intel partnered with Class Technologies to use an AI system that analyses student emotions during Zoom classes to provide insights to teachers. Critics, including educator Todd Richmond, argued that facial expressions are not reliable indicators of internal states and that the system amounts to pseudoscience. The article reports these criticisms as allegations, not as proven fact. No specific incident of harm or regulatory action is reported.
- Company involved
- Intel
- AI system involved
- Class Technologies face-reading AI
10 source articles · read the reporting →
Hong Kong tycoon sues Tyndaris over AI hedge fund losses
Hong Kong tycoon Samathur Li Kin-kan is suing Tyndaris Investments after its AI-powered hedge fund, K1, lost over $20 million in a single day. Li alleges that the system was not as sophisticated as claimed. The trial is set to begin in London in April 2020.
- Company involved
- Tyndaris Investments
- AI system involved
- K1
10 source articles · read the reporting →
SenseNets silent after data leak exposes millions of people's records
SenseNets Technology Ltd., a Shenzhen-based facial recognition company, left a database containing personal information of more than 2.5 million people publicly accessible without password protection for months. Dutch security researcher Victor Gevers and the GDI Foundation discovered the exposure in July and warned the company, which did not respond. The database was secured in February after the leak was reported, and the company is reported to be conducting an internal investigation. SenseNets has declined to comment publicly.
- Company involved
- SenseNets Technology Ltd.
10 source articles · read the reporting →
Beijing school uses Hanwang emotion recognition system to monitor student behaviour
Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.
- Company involved
- Niulanshan First Secondary School
- AI system involved
- Classroom Care System
10 source articles · read the reporting →
Texas AG Settles with Pieces Technologies Over Deceptive Healthcare AI Claims
The Texas Attorney General investigated Pieces Technologies, a Dallas-based healthcare AI company, for making false and misleading statements about the accuracy of its generative AI product used in hospitals. The company claimed an error rate of less than 1 per 100,000, but the investigation found these metrics were likely inaccurate. As part of the settlement, Pieces agreed to accurately disclose its product's accuracy and ensure hospital staff understand the appropriate reliance on its AI. The case marks the first-of-its-kind healthcare generative AI investigation by the AG.
- Company involved
- Pieces Technologies
4 source articles · read the reporting →
EEOC sues iTutorGroup for automated rejection of older tutor applicants
The US Equal Employment Opportunity Commission (EEOC) alleges that tutoring provider iTutorGroup programmed its recruitment software automatically to reject female applicants aged 55 or older and male applicants aged 60 or older. More than 200 qualified US-based applicants were denied work in 2020. The EEOC has filed a lawsuit in the Eastern District of New York seeking back pay and damages.
- Company involved
- iTutorGroup
10 source articles · read the reporting →
Cense exposed 2.5 million records of auto accident victims online
On July 7, 2020, a security researcher discovered 2.5 million records containing personal and medical data of auto accident victims exposed online. The records, belonging to New York-based AI company Cense, included names, insurance policy numbers, claim numbers, and medical diagnosis notes. The data was labeled as staging data, possibly intended for temporary storage before being loaded into an AI system. After the researcher sent a responsible disclosure notice, Cense restricted public access to the database.
- Company involved
- Cense
- AI system involved
- Cense
5 source articles · read the reporting →
Chinese tech companies patented Uyghur detection analytics
IPVM reported that Huawei, Megvii, SenseTime, and other Chinese tech companies filed patents in China for AI systems that can detect Uyghur ethnicity. The patents included Uyghur as a detectable attribute for facial recognition and image retrieval. The companies responded by saying they would amend or withdraw the patents, claiming the references were misunderstood or regrettable, while the technology is used by police for surveillance and targeting of Uyghurs.
10 source articles · read the reporting →
Teleperformance plans AI webcam surveillance for home-working staff
Teleperformance, a global call centre company, told some staff it would install AI-powered webcams to monitor home-working infractions such as eating, phone use, or leaving desks. The system would randomly scan for breaches and send alerts to managers. After the Guardian inquired, the company said the remote scans would not be used in the UK, but the plan raised concerns from unions and MPs about invasive surveillance.
- Company involved
- Teleperformance
10 source articles · read the reporting →
Kohler, BMW, MaxMara secretly collected customers' facial recognition data
During the 2021 CCTV 3·15 Gala, it was revealed that Kohler, BMW, and MaxMara stores had installed facial recognition cameras from vendors such as Wandianzhang and Youluoke. These cameras captured customers' facial data without their knowledge or consent, and the data was used to track customer visits and inform sales strategies. The systems were deployed in thousands of stores across China, collecting over 100 million facial records. The companies did not inform customers or obtain consent, violating Chinese privacy laws.
- Company involved
- Kohler (China) Investment Co., Ltd., ZhengTong Auto (BMW dealerships), MaxMara
- AI system involved
- Facial recognition cameras from Wandianzhang, Youluoke, Yaliang, Ruiwei
10 source articles · read the reporting →
iFlytek suspends AI study device after it generates essay critical of Mao
iFlytek, a Chinese AI firm, suspended sales of its study assistance device after a parent complained that the device generated an essay critical of Mao Zedong, calling him 'narrow-minded' and 'intolerant' for starting the Cultural Revolution. The company blamed a supplier for the content and said both the supplier and staff had been punished. Shares in iFlytek fell 10% following the news.
- Company involved
- iFlytek
- AI system involved
- study assistance device
3 source articles · read the reporting →
Huawei and Megvii tested Uyghur alarm facial recognition system
Huawei and Megvii conducted an interoperability test in 2018 that verified a 'Uyghur alarm' function in Megvii's facial recognition system, according to a confidential report found by IPVM. The system could identify Uyghur minorities and alert police. Huawei denied real-world application and deleted the report after IPVM inquired. Megvii denied targeting ethnic groups. The test report was publicly accessible on Huawei's European website.
- Company involved
- Huawei
- AI system involved
- Megvii Dynamic Face Recognition
10 source articles · read the reporting →
Plastic Forte fined for using facial recognition on workers without notice
The Spanish data protection agency AEPD fined Plastic Forte, a plastics manufacturer in Alicante, €20,000 for using facial recognition to record employees' working hours without informing them. A worker requested information about his personal data and discovered the biometric processing. The company initially argued it was only for time tracking but later acknowledged responsibility, resulting in a reduced fine of €12,000. The AEPD deemed facial recognition for time control as highly intrusive and requiring prior impact assessment.
- Company involved
- Plastic Forte
7 source articles · read the reporting →
California regulator accuses Maxpread Technologies of using AI-generated fake CEO to scam investors
Maxpread Technologies allegedly used an AI-generated avatar to pose as its CEO in a YouTube video to deceive investors. The California DFPI issued cease and desist letters to Maxpread and four other companies for offering unqualified securities and making false promises. The regulator claims the companies promised high daily returns using AI trading, but these claims were false. Maxpread did not respond to requests for comment.
- Company involved
- Maxpread Technologies
8 source articles · read the reporting →
FTC settles with IntelliVision over deceptive facial recognition claims
The Federal Trade Commission (FTC) took action against IntelliVision Technologies Corp. for making false, misleading, or unsubstantiated claims about its AI-powered facial recognition software. The company allegedly claimed its software had one of the highest accuracy rates on the market and was free of gender or racial bias, without supporting evidence. The FTC also alleged that IntelliVision did not train its software on millions of faces as claimed, but on images of approximately 100,000 individuals. Under a proposed consent order, IntelliVision is prohibited from making such misrepresentations without competent and reliable testing.
- Company involved
- IntelliVision Technologies Corp.
- AI system involved
- IntelliVision facial recognition software
9 source articles · read the reporting →
360 Kid's Smartwatch gives racist response about Chinese people
A parent in Henan Province, China, asked a 360 Kid's Smartwatch whether Chinese are the smartest people in the world. The watch replied with racist insults and questioned China's Four Great Inventions. The company's founder acknowledged the issue, stating the answer was pulled from public internet content, and said the harmful information was removed and the software is being upgraded to an AI version.
- Company involved
- 360 company
- AI system involved
- 360 Kid's Smartwatch
4 source articles · read the reporting →
WorldCoin suspended in Kenya over data security concerns
WorldCoin, a digital identification protocol using iris scans, was suspended by Kenyan regulators (ODPC and Communications Authority) over concerns about data security, consent, and oversight. The system had issued digital IDs and cryptocurrency tokens to over 350,000 Kenyans. Reports of hacked orb operators and iris scans traded on the dark web have also emerged.
- Company involved
- Tools for Humanity GmbH
- AI system involved
- WorldCoin
10 source articles · read the reporting →
Dahua facial recognition technology can sort by race and alert police when detecting Uighurs
Dahua Technologies, a Chinese surveillance camera company, developed facial recognition software that can classify individuals by race and send real-time warnings to police when it identifies Uighur people. Documents and code revealed the capability, though it is unclear if it has been deployed. Human rights advocates and Uighur individuals have expressed concern about potential surveillance and discrimination. The company did not respond to requests for comment.
- Company involved
- Dahua Technologies
- AI system involved
- Dahua facial recognition software
10 source articles · read the reporting →
Apple launches official site for iPhone users to claim cash from $250M AI settlement - UNILAD Tech
Apple advertised iPhones as ready for AI features that were not delivered, affecting purchasers.
- Company involved
- Apple
- AI system involved
- Apple Intelligence
1 source article · read the reporting →
DeepSeek-R1 censors 85% of sensitive Chinese political prompts in tests
Promptfoo tested DeepSeek-R1 against a dataset of 1,360 politically sensitive prompts and found that about 85% of them were refused. The refusals followed a standard form aligned with Chinese Communist Party policy. The testing also demonstrated that the censorship could be trivially bypassed using simple jailbreak techniques, such as prompt injection or changing the context.
- Company involved
- DeepSeek
- AI system involved
- DeepSeek-R1
5 source articles · read the reporting →
Teleperformance deploys AI to neutralise Indian call centre agents' accents
Teleperformance, the world's largest call centre operator, has announced it is using AI from Sanas to modify the accents of its Indian employees in real time. The technology, called accent translation, aims to make agents sound more neutral to native English speakers. The company invested $13 million in Sanas and gained exclusive rights. No specific incident of harm has been reported.
- Company involved
- Teleperformance
- AI system involved
- Sanas AI
6 source articles · read the reporting →
Guangzhou court finds AI company infringed Ultraman copyright
The Guangzhou Internet Court ruled on 8 February 2024 that an unnamed AI company infringed the copyright and adaptation rights of the plaintiff, the exclusive licensee of the Ultraman series images in China. The defendant operated a website offering AI conversation and AI-generated painting services, accessible only to paying members. The plaintiff alleged that the defendant used its Ultraman images without authorisation to train its model and generate substantially similar images. The court ordered the defendant to pay 10,000 yuan ($1,389) in compensation.
- Company involved
- unnamed AI company
- AI system involved
- AI conversation and AI-generated painting website
9 source articles · read the reporting →
