Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign
Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.
- AI system involved
- Gamma
7 source articles · read the reporting →
Claude AI abused in influence-as-a-service campaign
Malicious actors exploited Anthropic's Claude AI to manage over 100 social media bot accounts, engaging tens of thousands of users worldwide. The AI made tactical decisions on bot interactions to promote political narratives. Anthropic responded by banning implicated accounts and enhancing detection systems. The incident highlights the dual-use risks of advanced AI models.
- AI system involved
- Claude AI
5 source articles · read the reporting →
Facebook's platform used to foment violence in Myanmar
Facebook commissioned an independent human rights impact assessment that concluded the company was not doing enough to prevent its platform from being used to foment division and incite offline violence in Myanmar. The assessment, conducted by BSR, found that Facebook's content moderation and AI systems failed to adequately detect and remove hate speech and misinformation, contributing to real-world harm. Facebook acknowledged the findings and implemented corrective measures, including hiring more local language reviewers and improving AI detection.
- Company involved
- Facebook
- AI system involved
- Facebook platform
10 source articles · read the reporting →
Meta AI privacy flaw exposed users' private chats, fixed after hacker report
A security researcher discovered a vulnerability in Meta's AI chatbot that could have allowed unauthorized access to users' private prompts and responses. The flaw, caused by guessable IDs and lack of ownership verification, was reported to Meta on 26 December 2024. Meta fixed the issue on 24 January 2025 and awarded the researcher a $10,000 bug bounty. The company stated that no evidence of exploitation was found.
- Company involved
- Meta
- AI system involved
- Meta AI
2 source articles · read the reporting →
Durham Police uses Experian Mosaic data in HART AI risk tool
Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.
- Company involved
- Durham Constabulary
- AI system involved
- Harm Assessment Risk Tool (HART)
9 source articles · read the reporting →
Commercial network in Sri Lanka uses AI-generated anti-migrant content targeting UK
ISD and TBIJ identified a network of over 100 Facebook pages and groups run from Sri Lanka that spread AI-generated anti-migrant content to UK audiences for profit. The content included hate speech and false claims, and was not labelled as AI-generated despite platform policies. The network achieved high engagement and visibility within UK political discourse.
10 source articles · read the reporting →
MIT Media Lab creates 'Norman', a psychopath AI trained on biased data
MIT Media Lab developed Norman, an AI image captioning system trained on graphic content from Reddit. The project demonstrated how biased training data can lead to disturbing outputs. Norman was compared to a standard AI on Rorschach inkblot tests, showing the influence of data bias. The project was active from April to June 2018.
- Company involved
- MIT Media Lab
- AI system involved
- Norman
10 source articles · read the reporting →
AI Chatbots Spread False Claims After Kirk Assassination
After the assassination of Kirk, social media users turned to AI chatbots to fact-check viral claims. The chatbots provided false information, creating confusion. The incident highlights the risks of relying on AI for real-time fact-checking.
1 source article · read the reporting →
Chicago PD predictive policing program led to man being shot twice
In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.
- Company involved
- Chicago Police Department
- AI system involved
- heat list
10 source articles · read the reporting →
341 Malicious ClawHub Skills Found Stealing OpenClaw User Data
Security researchers discovered 341 malicious skills on ClawHub, a marketplace for the OpenClaw AI assistant. The skills tricked users into installing malware that steals API keys, credentials, and other sensitive data. OpenClaw's creator responded by adding a reporting feature that auto-hides skills after multiple reports.
- Company involved
- OpenClaw
- AI system involved
- OpenClaw
4 source articles · read the reporting →
Chinese military researchers used Meta's Llama 2 to develop defense chatbot ChatBIT
Chinese military researchers, including two affiliated with the People's Liberation Army, reportedly used Meta's Llama 2 AI model to develop a defense chatbot called ChatBIT. According to Reuters, the chatbot is designed to gather and process intelligence and offer information for operational decision-making. Meta stated that the use was unauthorized and contrary to its acceptable use policy.
- Company involved
- People's Liberation Army (PLA)
- AI system involved
- ChatBIT
6 source articles · read the reporting →
Imprompter attack extracts personal data from AI chatbots
Security researchers at UCSD and Nanyang Technological University developed a prompt-injection attack called Imprompter that covertly instructs large language models to extract personal information from user chats and send it to an attacker. The attack was tested on Mistral AI's LeChat and the Chinese chatbot ChatGLM, achieving nearly 80% success in test conversations. Mistral AI fixed the vulnerability; ChatGLM acknowledged security measures but did not directly confirm a fix.
- Company involved
- Mistral AI,Zhipu AI
- AI system involved
- LeChat,ChatGLM
7 source articles · read the reporting →
Clearview AI tested facial recognition surveillance cameras with UFT and Rudin
Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.
- Company involved
- Clearview AI
- AI system involved
- Insight Camera
9 source articles · read the reporting →
New York City's McKinsey-led jail violence program manipulated data, violence increased
New York City paid McKinsey & Company $27.5 million to reduce violence at Rikers Island jail complex. McKinsey designed a predictive algorithm called the Housing Unit Balancer and Restart housing units, but jail officials and McKinsey consultants stacked the units with compliant inmates to artificially lower violence numbers. Violence actually increased by nearly 50% during the project. The city eventually decided to close Rikers.
- Company involved
- New York City Department of Correction
- AI system involved
- Housing Unit Balancer (HUB)
10 source articles · read the reporting →
DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts
DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.
- Company involved
- DeepScore
- AI system involved
- DeepScore
6 source articles · read the reporting →
Michael L. Ruiz v. Magellan Financial & Insurance Services (2) (D. Arizona): AI-hallucinated content in court filing, Formal public reprimand
AI-hallucinated fake quotations were included in court filings submitted by counsel Elizabeth Tate, misleading the court.
1 source article · read the reporting →
ViaQuatro's facial recognition system in São Paulo metro challenged in court
In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.
- Company involved
- ViaQuatro
- AI system involved
- Digital Interactive Doors System (DID system)
10 source articles · read the reporting →
Userviz machine-learning aimbot shut down after Activision request
A developer known as User101 shut down the Userviz cheat after Activision requested that he stop developing it. The software used computer vision and machine learning to automate aiming in games such as Call of Duty: Warzone, and was marketed as undetectable. It was never published, and the developer said his intention was not to do anything illegal.
- Company involved
- User101
- AI system involved
- Userviz
7 source articles · read the reporting →
LAPD told officers to collect social media data on every civilian stopped
The Los Angeles Police Department directed officers to record the social media accounts of every civilian they interviewed, including those not arrested or accused of a crime, according to records obtained by the Brennan Center for Justice. The field interview cards, which also ask for social security numbers, have raised civil liberties concerns. Prosecutors have accused three officers of using the cards to falsely label civilians as gang members. The LAPD said the policy was being updated but did not respond to questions about its use of social media monitoring tools including Media Sonar and Geofeedia.
- Company involved
- Los Angeles Police Department (LAPD)
- AI system involved
- Field interview cards, Media Sonar, Geofeedia
10 source articles · read the reporting →
OpenAI cuts off engineer who created ChatGPT-powered robotic sentry rifle
An engineer known as STS 3D created a robotic sentry rifle that uses OpenAI's Realtime API to aim and fire a rifle in response to voice commands. OpenAI stated that it proactively identified the violation of its policies prohibiting the use of its services for weapons and notified the developer to cease the activity. The demonstration involved shooting blanks and no actual harm occurred.
- AI system involved
- ChatGPT-powered robotic sentry rifle
4 source articles · read the reporting →
Study finds Midjourney, DALL-E 2, Stable Diffusion accept over 85% of fake news prompts
A study by AI startup Logically tested Midjourney, DALL-E 2, and Stable Diffusion and found that they accepted over 85% of prompts seeking to generate fake political news. The systems generated images of ballot stuffing, small boat arrivals, and explosions. Logically warned that the lack of moderation could pose threats to upcoming elections. Stability AI responded by stating its ethical use license and measures to prevent misuse.
- Company involved
- Midjourney, OpenAI, Stability AI
- AI system involved
- Midjourney, DALL-E 2, Stable Diffusion
8 source articles · read the reporting →
Answer.AI tests Devin and reports 14 failures in 20 tasks
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
- AI system involved
- Devin
5 source articles · read the reporting →
DeepSeek exposed user data via open ClickHouse database
Cloud security firm Wiz discovered a ClickHouse database belonging to DeepSeek that was open to the internet without authentication, containing over a million lines of logs with chat histories, secret keys and backend details. Wiz disclosed the breach to DeepSeek, which promptly locked down the database. The incident highlights security risks in rapidly deploying AI services.
- Company involved
- DeepSeek
- AI system involved
- DeepSeek-R1
5 source articles · read the reporting →
UIUC researchers weaponize GPT-4 to autonomously hack websites
Researchers at the University of Illinois Urbana-Champaign demonstrated that LLM-powered agents, particularly OpenAI's GPT-4, can autonomously hack vulnerable websites. In sandboxed tests, GPT-4 achieved a 73.3% success rate across five attempts on 15 vulnerabilities, while open-source models failed. The researchers used the OpenAI Assistants API, LangChain, and Playwright to enable the agents to interact with websites. The study highlights the potential for AI agents to be used in cyberattacks, with cost estimates suggesting they could be cheaper than human penetration testers.
- Company involved
- University of Illinois Urbana-Champaign
- AI system involved
- GPT-4
4 source articles · read the reporting →
