Evolv weapon detection system falsely flags Chromebooks as weapons
Evolv's AI-based weapon detection system has been reported to falsely identify certain Chromebook laptops as weapons, causing false alarms at security checkpoints. The system is used in venues such as schools. The article discusses the flaw and user experiences. No official response from Evolv has been mentioned.
- Company involved
- Evolv
- AI system involved
- Evolv
5 source articles · read the reporting →
Manchester Arena's Evolv weapon scanners fail to detect some knives, report finds
ASM Global's use of Evolv Express AI weapon scanners at Manchester Arena has been questioned after a private report found the system failed to detect large knives in 42% of walkthroughs. The report, produced by NCS4 and obtained by IPVM, also suggested the scanners may miss some bombs and components. Evolv did not dispute the findings but said it communicates capabilities and limitations to customers. ASM Global declined to comment on security matters.
- Company involved
- ASM Global
- AI system involved
- Evolv Express
5 source articles · read the reporting →
Mistral releases unmoderated chatbot that gives instructions on murder and ethnic cleansing
Mistral, a French AI startup valued at $260 million, released an open-source large language model named Mistral-7B-v0.1 without safety evaluations or moderation mechanisms. The model readily provides detailed instructions on murder, ethnic cleansing, suicide, and other harmful content. Mistral added a statement after the release acknowledging the lack of moderation but did not remove the model, which is distributed via torrent and cannot be deleted.
- Company involved
- Mistral
- AI system involved
- Mistral-7B-v0.1
7 source articles · read the reporting →
Xiaohongshu accused of using illustrators' artwork to train its AI
Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.
- Company involved
- Xiaohongshu
- AI system involved
- Trik AI
7 source articles · read the reporting →
Grok AI chatbot falsely claims police misrepresented far-right rally footage in London
On 13 September 2025, Grok, an AI chatbot from xAI integrated into X, responded to a user's query by falsely stating that footage of police clashing with crowds at a far-right rally in London was from a 2020 anti-lockdown protest. The Metropolitan Police was forced to rebut the misinformation, confirming the footage was from that day's rally. X users, including a columnist, amplified the false claim. X has been approached for comment.
- Company involved
- X (formerly Twitter)
- AI system involved
- Grok
3 source articles · read the reporting →
X's Grok exposed hundreds of thousands of user chats in Google
Hundreds of thousands of conversations with Elon Musk's AI chatbot Grok were indexed by Google Search and made publicly accessible without users' knowledge. The exposure occurred when users pressed a share button that created unique links, but those links were also searchable online. The BBC reported the incident after Forbes initially identified more than 370,000 exposed chats. Experts described the leak as a privacy disaster, and X has not publicly responded.
- Company involved
- X
- AI system involved
- Grok
5 source articles · read the reporting →
OpenDream AI art site allowed users to generate child sexual abuse material
OpenDream, an AI image generation platform, allowed users to generate and publicly display child sexual abuse material (CSAM) and non-consensual deepfakes from at least December 2023 until July 2024. The platform, operated by CBM Media Pte Ltd in Singapore, offered paid plans with NSFW prompts and models. Bellingcat reported the site to the National Center for Missing & Exploited Children. After Bellingcat's inquiry, the CSAM was removed from the site and search engines, and Google terminated OpenDream's AdSense account.
- Company involved
- CBM Media Pte Ltd
- AI system involved
- OpenDream
3 source articles · read the reporting →
Grok AI posted false news headlines after Trump assassination attempt
Grok, Elon Musk's AI model on X, posted incorrect headlines following the attempted assassination of Donald Trump. It falsely claimed Vice President Kamala Harris had been shot and misidentified the shooter as an antifa member. The errors stemmed from Grok's inability to discern sarcasm and verify unverified claims on X.
- Company involved
- X Corp
- AI system involved
- Grok
5 source articles · read the reporting →
Grok chatbot spreads false news reports on X
Grok, the AI chatbot developed by Elon Musk's xAI and integrated into X, published false news reports accusing NBA player Klay Thompson of criminal vandalism and claiming that Indian Prime Minister Narendra Modi had lost elections that had not yet occurred. The false reports were promoted on X's trending feed. X has not removed the posts but includes a disclaimer that Grok is an early feature that can make mistakes.
- Company involved
- X (formerly Twitter)
- AI system involved
- Grok
3 source articles · read the reporting →
News/Media Alliance study finds unauthorised use of publisher content to train AI
The News/Media Alliance alleges that generative AI developers have copied and used publishers' content without authorisation to train large language models. The study says the models can reproduce the content and compete with publishers. The Alliance calls for transparency, licensing, and legislation to address the unauthorised use.
10 source articles · read the reporting →
Disney, Universal, Warner Bros. sue MiniMax over Hailuo AI copyright infringement
Disney, Universal, and Warner Bros. Discovery have filed a copyright lawsuit against Chinese AI company MiniMax, alleging that its Hailuo AI image and video generator was built using stolen copyrighted characters. The lawsuit claims MiniMax used characters such as Darth Vader and Minions to market the service without authorization. The studios are seeking profits and an injunction to halt the infringement. MiniMax has not responded to the allegations.
- Company involved
- MiniMax
- AI system involved
- Hailuo AI
7 source articles · read the reporting →
Meta's AI sticker tool generates lewd, rude, and nude images
Meta's new AI-generated sticker feature on Facebook Messenger allowed users to create inappropriate images, including child soldiers, nude politicians, and sexualised characters. The tool, powered by Meta's Llama 2 model, was found to have insufficient content filters, enabling users to bypass restrictions with typos. Meta was contacted for comment but had not responded at the time of reporting.
- Company involved
- Meta
- AI system involved
- AI-generated sticker tool
1 source article · read the reporting →
Ticketmaster dynamic pricing inflates Oasis reunion tour ticket prices
Ticketmaster's dynamic pricing system caused ticket prices for Oasis's reunion tour to surge from around £135 to over £488 for some fans. Fans reported paying double or triple the face value for standing tickets in Dublin and Cardiff. The system, which adjusts prices based on demand, has been criticised by fans on social media. Ticketmaster has not commented on the incident.
- Company involved
- Ticketmaster
9 source articles · read the reporting →
Publishers sue AI startup Cohere over alleged copyright infringement
A consortium of 14 publishers including Condé Nast, The Atlantic, and Forbes filed a lawsuit against Cohere, alleging that the generative AI startup engaged in massive, systematic copyright infringement by using at least 4,000 copyrighted works to train its AI models and display large portions of articles, harming referral traffic. Cohere denied the allegations, calling the lawsuit misguided and frivolous.
- Company involved
- Cohere
- AI system involved
- Cohere's AI models
8 source articles · read the reporting →
Elon Musk posts AI-generated image of Kamala Harris with false communist claim
Elon Musk posted an AI-generated image on his social media platform X depicting Vice President Kamala Harris as a communist, with a false caption claiming she vowed to be a communist dictator. The post was viewed nearly 60 million times and appeared to violate X's policy on manipulated content. X did not respond to a request for comment.
- Company involved
- X
4 source articles · read the reporting →
Robby Starbuck Sues Meta for AI Defamation
Robby Starbuck, a filmmaker and activist, alleges that Meta's AI tool published false statements accusing him of participating in the January 6th Capitol riot and other defamatory claims. Despite his requests for correction, Meta refused to remove the falsehoods, which led to death threats, reputational harm, and lost business opportunities. Starbuck filed a defamation lawsuit in Delaware Superior Court seeking damages and an injunction to force Meta to correct its AI systems.
- Company involved
- Meta Platforms, Inc.
- AI system involved
- Meta AI
2 source articles · read the reporting →
US Central Command used Anthropic's Claude in Iran airstrikes after Trump ban.
US Central Command used Anthropic's Claude AI system to support airstrikes on Iran, including intelligence assessment and target identification, just hours after President Trump banned federal agencies from using Anthropic tools. The use highlighted a contradiction in the administration's stance, as the Pentagon relied on technology the White House had labelled a security risk. Anthropic faced a supply-chain risk designation for refusing to grant blanket permission for military use, and rival firms OpenAI and xAI later received approval to replace Claude.
- Company involved
- US Central Command (Centcom)
- AI system involved
- Claude
4 source articles · read the reporting →
GoLaxy Used AI to Manipulate Public Opinion in Hong Kong and Taiwan
The Chinese company GoLaxy used an AI system called Smart Propaganda System (GoPro) to monitor and manipulate public opinion in Hong Kong and Taiwan, according to internal documents. The system collected data on members of Congress and other influential Americans, though no campaign was mounted in the United States. GoLaxy denied the allegations, calling them misinformation. The technology represents a new frontier in information warfare, enabling mass production of propaganda.
- Company involved
- GoLaxy
- AI system involved
- Smart Propaganda System (GoPro)
2 source articles · read the reporting →
DeSantis PAC Uses AI-Generated Trump Voice in Attack Ad
A super PAC supporting Ron DeSantis, Never Back Down, used an AI-generated voice of Donald Trump in a television advertisement attacking the former president. The ad, which will run in Iowa, falsely presents Trump as attacking Iowa governor Kim Reynolds. The use of AI-generated content in political advertising raises concerns about deepfakes and deception.
- Company involved
- Never Back Down
2 source articles · read the reporting →
Under Armour AI ad sparks creator backlash over uncredited reuse
Under Armour released an advertisement for boxer Anthony Joshua, directed by Wes Walker, who claimed it was the first AI-powered sports commercial. Creatives, including Gustav Johansson and André Chemetoff, accused the ad of reusing their existing work without credit. Walker initially denied the claims but later added credits after public criticism. The incident highlights concerns about AI being used to exploit creators' work.
- Company involved
- Under Armour
- AI system involved
- Unnamed AI video and photo tools
10 source articles · read the reporting →
Deepfake video of CBS anchor and suspect in Frisco stabbing spreads online
An AI-generated deepfake video manipulated a CBS News Texas anchor's image and created a fake video of the suspect in a Frisco high school stabbing. The video was posted on Instagram and reposted on multiple accounts before being taken down. The incident highlights the growing ease of creating convincing deepfakes and the spread of misinformation online.
1 source article · read the reporting →
Accusations of AI use in DC Comics artwork by artists Andrea Sorrentino and Jingxiong Guo
DC Comics is facing accusations that artists used AI to generate artwork for recent Batman issues and covers. Social media users pointed out visual inconsistencies such as strange anatomy and repetitive patterns. Andrea Sorrentino and Jingxiong Guo have denied the allegations, with Sorrentino posting a process video. DC Comics has stated that it is investigating the claims, but no definitive conclusion has been reached.
- Company involved
- DC Comics
6 source articles · read the reporting →
YouTube applies machine learning post-processing to Shorts without opt-out
YouTube announced an experiment on select Shorts using traditional machine learning to unblur, denoise, and improve clarity during processing. Creators reported that this altered their videos' appearance without an opt-out option, and some accused YouTube of misleading about the use of AI. YouTube acknowledged the experiment and said it would consider feedback, but did not offer a rollback or opt-out.
- Company involved
- YouTube
- AI system involved
- YouTube Shorts post-processing
7 source articles · read the reporting →
Users jailbreak Luma Labs Dream Machine to generate porn
Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.
- Company involved
- Luma Labs
- AI system involved
- Dream Machine
3 source articles · read the reporting →