Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign
Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.
- AI system involved
- Gamma
7 source articles · read the reporting →
Figma pulls AI design tool after it copies Apple's weather app
Figma removed its Make Designs AI feature after it was found to generate app mockups nearly identical to Apple's iOS weather app. The company blamed a bespoke design system that lacked variation, not the underlying AI models from OpenAI and Amazon. Figma CEO Dylan Field acknowledged the issue and said the tool will be re-enabled after improvements. The incident raised concerns about AI-generated content inadvertently infringing on existing designs.
- Company involved
- Figma
- AI system involved
- Make Designs
2 source articles · read the reporting →
FMA Warns of Deepfake Impersonation Scam Targeting Kiwi Investors
The New Zealand Financial Markets Authority (FMA) has warned that a pump-and-dump scam using deepfake ads impersonating business leaders is targeting Kiwi investors. Victims are lured into WhatsApp groups via social media ads and encouraged to buy low-value shares, artificially inflating prices before scammers sell, leaving investors with losses. The FMA has received multiple complaints and is sharing information with overseas regulators, while urging the public to be cautious of unsolicited investment advice.
2 source articles · read the reporting →
Deepfake Zoom Call Steals Crypto Analyst's X Account
Mai Fujimoto's X account was compromised on 14 June 2025 after a Zoom call in which a deepfake impersonated an acquaintance. The attacker used the call to direct her to a malicious link, resulting in malware that also gave access to her Telegram and MetaMask accounts. Binance founder Changpeng Zhao warned that AI deepfakes make video-call verification unreliable.
1 source article · read the reporting →
Marques Brownlee accuses Dot of using AI to clone his voice
Tech YouTuber Marques Brownlee claims that networking products company Dot used an AI-generated clone of his voice in an Instagram post to promote its products. Brownlee said the company used the AI-created voice without his permission and that there were no repercussions for the company. The Instagram post, from February 2024, was later deleted.
- Company involved
- Dot
3 source articles · read the reporting →
Spamouflage Operation Used AI-Generated Deepfake Videos for Pro-Chinese Influence
In late 2022, Graphika observed the pro-Chinese influence operation Spamouflage promoting videos featuring AI-generated fictitious people. The footage was created using a commercial AI video platform from a UK company. The videos were low-quality and received fewer than 300 views, but Graphika warns that such tools could enable more convincing deception at scale.
- Company involved
- Spamouflage
5 source articles · read the reporting →
Twitter expands Community Notes to images after Pentagon deepfake incident
An AI-generated image depicting an explosion at the Pentagon went viral on Twitter, briefly disrupting the stock market. The realistic deepfake misled many users and news outlets before being debunked. In response, Twitter announced an expansion of its Community Notes feature to allow users to add context to potentially misleading images. The company aims to combat the spread of AI-generated misinformation on its platform.
- Company involved
- Twitter Inc.
10 source articles · read the reporting →
TikTok Removes Deepfake Joe Rogan Video Shilling Alpha Grind
In February 2023, TikTok removed a deepfake video that falsely depicted Joe Rogan endorsing a libido booster called Alpha Grind. The video was created using AI to mimic Rogan's voice and likeness, potentially deceiving viewers into purchasing the product. The incident highlights the growing misuse of deepfake technology for scams, with multiple instances of Rogan's persona being used without consent. TikTok took down the video after it was posted.
6 source articles · read the reporting →
AI drug discovery system repurposed to generate toxic molecules in demonstration
In 2020, Collaborations Pharmaceuticals demonstrated that its AI drug discovery system, MegaSyn, could be repurposed to generate toxic molecules similar to the nerve agent VX. The company ran the software overnight and produced 40,000 potentially hazardous substances. The researchers presented their findings at a conference and briefed the White House, warning that such AI systems could be misused to create chemical weapons.
- Company involved
- Collaborations Pharmaceuticals
- AI system involved
- MegaSyn
10 source articles · read the reporting →
Capitol Music Group drops AI rapper FN Meka after racial stereotyping criticism
Capitol Music Group has dropped the AI rapper FN Meka after criticism that the project contained racial stereotypes, including repeated use of the N-word. The label apologised to the Black community for its 'insensitivity' in signing the project. Activist group Industry Blackout had called the AI musician 'a direct insult' to Black culture. The company behind the AI, Factory New, said a human voice performs the vocals.
- Company involved
- Capitol Music Group
- AI system involved
- FN Meka
10 source articles · read the reporting →
Meta's content moderation errors during May 2021 Israel-Palestine escalation
During the May 2021 escalation of violence in Israel and Palestine, Meta's automated content moderation systems temporarily restricted access to the al-Aqsa hashtag page and under-enforced rules against incitement to violence against Israelis and Jews. An independent due diligence report commissioned by Meta found that these systems had an unintentional impact on Palestinian and Arab communities' freedom of expression. Meta has committed to implementing several recommendations, including improving machine learning classifiers and keyword review processes.
- Company involved
- Meta
- AI system involved
- Facebook and Instagram content moderation systems
10 source articles · read the reporting →
X's Grok chatbot wrongly confirms AI-generated war video as real
During the US-Israel war with Iran, X's Grok chatbot was used by users to verify the authenticity of AI-generated videos. In many cases, Grok wrongly insisted that the AI-generated videos were real, misleading users. The article reports that X will suspend creators from monetisation if they post AI-generated conflict videos without a label.
- Company involved
- X
- AI system involved
- Grok
4 source articles · read the reporting →
Study finds X algorithm boosted right-wing accounts after Musk endorsement
A study from Queensland University of Technology found that X's algorithm was changed in mid-July 2024 to systematically boost Republican-leaning accounts and Elon Musk's account. The analysis showed a significant increase in engagement for right-wing accounts after Musk endorsed Donald Trump. The findings suggest possible algorithmic bias, but X has not commented.
- Company involved
- X
6 source articles · read the reporting →
California regulator accuses Maxpread Technologies of using AI-generated fake CEO to scam investors
Maxpread Technologies allegedly used an AI-generated avatar to pose as its CEO in a YouTube video to deceive investors. The California DFPI issued cease and desist letters to Maxpread and four other companies for offering unqualified securities and making false promises. The regulator claims the companies promised high daily returns using AI trading, but these claims were false. Maxpread did not respond to requests for comment.
- Company involved
- Maxpread Technologies
8 source articles · read the reporting →
Stack Overflow moderators strike over AI content policy
Volunteer moderators and contributors of Stack Overflow and the Stack Exchange network went on strike on June 5, 2023, protesting a policy by Stack Overflow, Inc. that prohibits removing AI-generated content except in narrow circumstances. The policy is alleged to allow incorrect information and plagiarism to proliferate on the platform. The strike paused moderation activities such as flagging, voting to close or delete posts, and running anti-spam bots. Negotiations concluded on August 2, 2023, with an agreement reached.
- Company involved
- Stack Overflow, Inc.
- AI system involved
- Stack Exchange network
10 source articles · read the reporting →
Chinese Communist Party uses AI to create anti-American memes
Researchers at the Institute for Strategic Dialogue found that a campaign linked to the Chinese Communist Party is using AI image generators to create and spread memes designed to stoke anti-American sentiment by capitalising on President Biden's support of Israel's bombing campaign in Gaza. The memes are being distributed on social media platforms like X, Facebook, and YouTube. Platforms have taken down some accounts, but the campaign continues.
- Company involved
- Chinese Communist Party
4 source articles · read the reporting →
xAI's Grok 3 briefly censored mentions of Trump and Musk
xAI's Grok 3 chatbot was briefly instructed not to mention Donald Trump or Elon Musk when answering the question 'Who is the biggest misinformation spreader?' in its chain-of-thought reasoning. Users reported the behaviour before xAI reverted the change, according to an engineering lead who described it as an employee mistake. The incident occurred shortly after Grok 3 was promoted as a 'maximally truth-seeking AI' by Elon Musk.
- Company involved
- xAI
- AI system involved
- Grok 3
4 source articles · read the reporting →
Xiaomi phones have capability to remotely censor keywords, report claims
A security report from Lithuania's Defence Ministry found that Xiaomi Mi 10T phones contain a list of blocked keywords that can be remotely activated for censorship. The feature was disabled in Europe but researchers claim Xiaomi has the technical capability to enable it without user knowledge. Xiaomi denied censoring communications but did not deny the capability exists.
- Company involved
- Xiaomi
- AI system involved
- Xiaomi Mi 10T
9 source articles · read the reporting →
Guangzhou court finds AI company infringed Ultraman copyright
The Guangzhou Internet Court ruled on 8 February 2024 that an unnamed AI company infringed the copyright and adaptation rights of the plaintiff, the exclusive licensee of the Ultraman series images in China. The defendant operated a website offering AI conversation and AI-generated painting services, accessible only to paying members. The plaintiff alleged that the defendant used its Ultraman images without authorisation to train its model and generate substantially similar images. The court ordered the defendant to pay 10,000 yuan ($1,389) in compensation.
- Company involved
- unnamed AI company
- AI system involved
- AI conversation and AI-generated painting website
9 source articles · read the reporting →
Storm-1376 used AI-generated fake audio during Taiwan election, Microsoft reports
Microsoft's Threat Analysis Center reported that the Chinese state-linked group Storm-1376 posted suspected AI-generated fake audio of former Taiwanese presidential candidate Terry Gou endorsing another candidate on election day in January 2024. Gou had made no such statement, and YouTube removed the content before it reached a wide audience. The group has also used AI-generated memes and news anchors as part of influence operations in Taiwan and the United States.
- Company involved
- Storm-1376 (also known as Spamouflage and Dragonbridge)
7 source articles · read the reporting →
Evolv weapon detection system falsely flags Chromebooks as weapons
Evolv's AI-based weapon detection system has been reported to falsely identify certain Chromebook laptops as weapons, causing false alarms at security checkpoints. The system is used in venues such as schools. The article discusses the flaw and user experiences. No official response from Evolv has been mentioned.
- Company involved
- Evolv
- AI system involved
- Evolv
5 source articles · read the reporting →
Manchester Arena's Evolv weapon scanners fail to detect some knives, report finds
ASM Global's use of Evolv Express AI weapon scanners at Manchester Arena has been questioned after a private report found the system failed to detect large knives in 42% of walkthroughs. The report, produced by NCS4 and obtained by IPVM, also suggested the scanners may miss some bombs and components. Evolv did not dispute the findings but said it communicates capabilities and limitations to customers. ASM Global declined to comment on security matters.
- Company involved
- ASM Global
- AI system involved
- Evolv Express
5 source articles · read the reporting →
Grok AI chatbot falsely claims police misrepresented far-right rally footage in London
On 13 September 2025, Grok, an AI chatbot from xAI integrated into X, responded to a user's query by falsely stating that footage of police clashing with crowds at a far-right rally in London was from a 2020 anti-lockdown protest. The Metropolitan Police was forced to rebut the misinformation, confirming the footage was from that day's rally. X users, including a columnist, amplified the false claim. X has been approached for comment.
- Company involved
- X (formerly Twitter)
- AI system involved
- Grok
3 source articles · read the reporting →
OpenDream AI art site allowed users to generate child sexual abuse material
OpenDream, an AI image generation platform, allowed users to generate and publicly display child sexual abuse material (CSAM) and non-consensual deepfakes from at least December 2023 until July 2024. The platform, operated by CBM Media Pte Ltd in Singapore, offered paid plans with NSFW prompts and models. Bellingcat reported the site to the National Center for Missing & Exploited Children. After Bellingcat's inquiry, the CSAM was removed from the site and search engines, and Google terminated OpenDream's AdSense account.
- Company involved
- CBM Media Pte Ltd
- AI system involved
- OpenDream
3 source articles · read the reporting →
