Alibaba Cloud tested ethnicity detection algorithm, drawing criticism
Alibaba Cloud developed and tested a facial recognition algorithm that could identify a person's ethnicity or label them as Uyghur, according to research by IPVM. Alibaba expressed dismay, stating the trial technology was not deployed by any customer and that ethnic tags have been removed from its product. The incident raised concerns about potential ethnic profiling of Uyghur Muslims in China. The company said it does not permit its technology to be used for targeting specific ethnic groups.
- Company involved
- Alibaba Cloud
2 source articles · read the reporting →
Facebook Removes Pro-Trump Network Using AI-Generated Faces
Facebook removed over 900 accounts, pages, and groups associated with The BL, a network that used AI-generated profile photos to spread pro-Trump content to 55 million users. Researchers from Graphika and DFRLab found that the network used generative adversarial networks to create fake faces, marking the first large-scale use of AI-generated images in an influence operation. The accounts were operated from Vietnam and the US, and were linked to The Epoch Times. Facebook's action came after the researchers identified the inauthentic activity.
- Company involved
- The BL
6 source articles · read the reporting →
Flock Safety failed to secure Boston vehicle data during 2025 pilot, report finds - WBUR
Flock Safety cameras collected license plate and vehicle data from drivers in Boston and shared it with external law enforcement agencies.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety
1 source article · read the reporting →
xAI Data Center Noise Controversy, Explained - basenor.com
The xAI data center facility generated persistent noise, vibrations, and air quality issues from gas turbines, affecting nearby residents in Southaven, Mississippi.
- Company involved
- xAI
1 source article · read the reporting →
PredPol crime predictions disproportionately targeted Black and Latino neighborhoods
Between 2018 and 2021, PredPol software sent millions of crime predictions to U.S. police departments. An analysis of unsecured data found that predictions overwhelmingly targeted Black, Latino, and low-income neighborhoods, while whiter, wealthier areas were largely avoided. The company claimed the software was bias-free, but the data showed persistent racial and economic disparities. Many police departments have since stopped using the software.
- AI system involved
- PredPol
10 source articles · read the reporting →
Grok generates fake headline about Iran striking Tel Aviv
X's AI chatbot Grok generated a false headline claiming Iran struck Tel Aviv with heavy missiles. The platform then promoted this AI-created fake news story in its Explore trending news section, visible to all users. The incident occurred after Elon Musk laid off the human curation team and replaced them with Grok to provide context for trending topics. X's fine print notes Grok 'can make mistakes'.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
McKinsey's Lilli AI Platform Hacked, Exposing 46 Million Chat Messages
Security researchers at CodeWall used an autonomous offensive agent to discover a SQL injection vulnerability in McKinsey's internal AI platform, Lilli. The vulnerability allowed unauthenticated access to the production database, exposing 46.5 million chat messages, 728,000 files, and 57,000 user accounts. The researchers responsibly disclosed the issue to McKinsey, who patched the endpoints within days. No data was exfiltrated or misused, and no disruption occurred.
- Company involved
- McKinsey & Company
- AI system involved
- Lilli
1 source article · read the reporting →
Sherman Oaks residents blame Waze for clogging streets
Sherman Oaks residents allege that the Waze navigation app has caused severe congestion on their narrow streets by rerouting commuters off the 405 Freeway. A city traffic study found that more than 900 cars per hour were using streets designed for far less, leading to gridlock, blocked driveways, and safety risks. In response, the Los Angeles Department of Transportation proposed turn restrictions during peak rush hours, while Waze defended its routing as helping to spread traffic across public roads.
- Company involved
- Waze
- AI system involved
- Waze
3 source articles · read the reporting →
AI-Enabled Influence Operation PRISONBREAK Used Deepfake to Incite Revolt in Iran
A network of over 50 inauthentic X profiles, assessed as likely linked to the Israeli government, conducted an AI-enabled influence operation called PRISONBREAK. On 23 June 2025, during Israeli airstrikes, the network posted an AI-generated deepfake video of the bombing of Evin Prison in Tehran, which was initially republished as real by international news outlets. The operation aimed to incite Iranian audiences to overthrow the regime. Citizen Lab found the operation was synchronized with military actions and continues to the present day.
1 source article · read the reporting →
Sound Intelligence Aggression Detectors Prove Unreliable in School Tests
ProPublica tested Sound Intelligence's aggression detection software, used in hundreds of U.S. schools and hospitals. The algorithm, which analyzes audio for signs of stress and anger, frequently misidentified innocent sounds like coughing as aggressive and failed to detect actual screams. At a New Jersey hospital, the system ignored an agitated man screaming and pounding a desk, escalating the situation. Sound Intelligence's CEO acknowledged the imperfections but defended the technology as an early warning system.
- AI system involved
- Sound Intelligence aggression detector
2 source articles · read the reporting →
Urban Cyber Security VPN extension harvested AI chatbot prompts and responses
In July 2025, Urban Cyber Security updated its Urban VPN Proxy Chrome extension to automatically harvest everything users typed into major AI chatbots, including ChatGPT and Claude, as well as the chatbots' replies. The extension, used by over 7 million people, also collected conversation metadata and identifiers, sharing the data with its ad analytics affiliate BIScience. The data collection was disclosed in the privacy policy but users were not explicitly notified at the time of use. Security researchers at Koi discovered the practice and reported it publicly.
- Company involved
- Urban Cyber Security
- AI system involved
- Urban VPN Proxy
3 source articles · read the reporting →
Derek O'Brien alleges Tek Fog app threatens national security
Derek O'Brien, a Trinamool Congress Rajya Sabha member, wrote to the Parliamentary Standing Committee on Home Affairs alleging that the 'Tek Fog' app is used by people associated with the BJP's IT cell to manipulate social media trends, send spyware messages, and spread fake news. He claims the app can automatically send messages to WhatsApp groups and modify news articles, calling it a threat to national security and privacy.
- Company involved
- Bharatiya Janata Party
- AI system involved
- Tek Fog
10 source articles · read the reporting →
Alibaba among firms fooled by AI-hallucinated software package
Security researcher Bar Lanyado discovered that generative AI models repeatedly hallucinate non-existent software package names. He created a real package named 'huggingface-cli' based on one such hallucination and uploaded it to PyPI. The package was downloaded over 15,000 times, and Alibaba's GraphTranslator project included instructions to install it. The experiment demonstrated a potential supply chain attack vector where malicious actors could exploit AI hallucinations to distribute malware.
- Company involved
- Alibaba
- AI system involved
- GraphTranslator
4 source articles · read the reporting →
Facebook's platform used to foment violence in Myanmar
Facebook commissioned an independent human rights impact assessment that concluded the company was not doing enough to prevent its platform from being used to foment division and incite offline violence in Myanmar. The assessment, conducted by BSR, found that Facebook's content moderation and AI systems failed to adequately detect and remove hate speech and misinformation, contributing to real-world harm. Facebook acknowledged the findings and implemented corrective measures, including hiring more local language reviewers and improving AI detection.
- Company involved
- Facebook
- AI system involved
- Facebook platform
10 source articles · read the reporting →
Sidewalk Labs releases Toronto waterfront plan amid privacy concerns
Sidewalk Labs, a subsidiary of Alphabet, released a 1,500-page plan for a new development on Toronto's eastern waterfront, including the Quayside site. The plan involves extensive data collection and management, raising privacy concerns from critics and the public. Waterfront Toronto, the overseeing body, is reviewing the plan and has expressed concerns about its scope and data governance. The company has proposed an independent trust to oversee data, but critics remain unsatisfied.
- Company involved
- Sidewalk Labs
- AI system involved
- Quayside development
10 source articles · read the reporting →
Commercial network in Sri Lanka uses AI-generated anti-migrant content targeting UK
ISD and TBIJ identified a network of over 100 Facebook pages and groups run from Sri Lanka that spread AI-generated anti-migrant content to UK audiences for profit. The content included hate speech and false claims, and was not labelled as AI-generated despite platform policies. The network achieved high engagement and visibility within UK political discourse.
10 source articles · read the reporting →
Fable apologises after AI reader summaries generate offensive content
Book tracking app Fable's AI-generated annual reading summaries produced offensive remarks about users' race, gender, sexuality, and disability. Users, including Tiana Trammell and Danny B. Groves, received summaries that mocked their reading choices with bigoted language. Fable acknowledged the failure of its safeguards and apologised, announcing the immediate removal of the AI features. Some users deactivated their accounts, while others called for better moderation.
- Company involved
- Fable
4 source articles · read the reporting →
Amnesty International reveals Serbian spyware targeting journalists and activists
Amnesty International's Security Lab found that Serbian authorities used Cellebrite tools and a previously unknown spyware named 'NoviSpy' to covertly infect the phones of independent journalist Slaviša Milanov and several activists. The infections occurred while devices were unattended during police or BIA interviews. The report alleges this is part of a wider crackdown on civil society, violating rights to privacy and free expression.
- Company involved
- Serbian Security Information Agency (BIA)
- AI system involved
- NoviSpy
7 source articles · read the reporting →
Meta's BlenderBot 3 chatbot generates anti-Semitic stereotypes and election denial claims
Meta launched its BlenderBot 3 AI chatbot for public testing in the US. Users quickly discovered that the bot made anti-Semitic remarks, such as claiming Jews are overrepresented among the super-rich, and expressed uncertainty about Joe Biden winning the 2020 election. Meta acknowledged that chatbots can generate offensive content and stated it was collecting feedback to improve future systems.
- Company involved
- Meta
- AI system involved
- BlenderBot 3
3 source articles · read the reporting →
Google, Microsoft, and Perplexity AI search results promote racist IQ data
AI-powered search engines from Google, Microsoft, and Perplexity have been surfacing debunked research promoting race science, including false IQ scores for countries. The systems pulled data from a dataset by Richard Lynn, a known proponent of scientific racism. Google removed the offending Overviews after being contacted by WIRED, but the data still appears in featured snippets and other AI tools.
- Company involved
- Google, Microsoft, and Perplexity
- AI system involved
- AI Overviews, Copilot, Perplexity
7 source articles · read the reporting →
Clearview AI tested facial recognition surveillance cameras with UFT and Rudin
Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.
- Company involved
- Clearview AI
- AI system involved
- Insight Camera
9 source articles · read the reporting →
ChatGPT falsely tells users OpenCage offers phone lookup service
OpenCage, a geocoding API provider, says ChatGPT has been telling people it offers a reverse phone number lookup service, which it does not. Users who followed the advice signed up for a free trial and found it did not work, and the company says it now receives daily support requests. OpenCage wrote a blog post to correct the record and warn users not to trust ChatGPT's output.
- AI system involved
- ChatGPT
7 source articles · read the reporting →
DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts
DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.
- Company involved
- DeepScore
- AI system involved
- DeepScore
6 source articles · read the reporting →
Stable Diffusion amplifies racial and gender stereotypes in generated images
An analysis by Bloomberg of over 5,000 images generated by Stability AI's Stable Diffusion found that the text-to-image model amplifies racial and gender stereotypes. The model overrepresented lighter-skinned men in high-paying jobs and darker-skinned people in low-paying jobs, and underrepresented women in positions of power. Stability AI acknowledged the inherent biases in its models and stated it is working on mitigation.
- Company involved
- Stability AI
- AI system involved
- Stable Diffusion
8 source articles · read the reporting →
