OpenAI disrupts Iranian influence operation using ChatGPT to generate political content
OpenAI identified and banned a cluster of ChatGPT accounts linked to an Iranian covert influence operation called Storm-2035. The operation generated long-form articles and social media comments on topics including the U.S. presidential election, the Gaza conflict, and Venezuelan politics, posing as both progressive and conservative outlets. Most content received low or no engagement, and OpenAI stated it shared threat intelligence with government and industry stakeholders. The company took down the accounts and continues to monitor for further violations.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
6 source articles · read the reporting →
Embark Studios' Arc Raiders generative AI voices spark ethics debate
Embark Studios' game Arc Raiders uses AI-generated text-to-speech voices trained on real actors, prompting an ethical debate in the games industry. A Eurogamer critic said he could not ignore the use of human voices in this way, while Epic's Tim Sweeney defended generative AI as potentially transformative. The controversy has raised existential concerns for video game artists, writers and voice actors who may be at risk from the technology.
- Company involved
- Embark Studios
- AI system involved
- Arc Raiders
7 source articles · read the reporting →
OpenAI's ChatGPT generates Studio Ghibli-style images, including offensive content
OpenAI's ChatGPT image generation feature has been used to create images in the style of Studio Ghibli, including offensive recreations of events like 9/11 and the JFK assassination. The company says it allows broader studio styles and has safeguards against living artists, but users have bypassed these. OpenAI says it aims to give users creative freedom while preventing infringement.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
4 source articles · read the reporting →
US Central Command used Anthropic's Claude in Iran airstrikes after Trump ban.
US Central Command used Anthropic's Claude AI system to support airstrikes on Iran, including intelligence assessment and target identification, just hours after President Trump banned federal agencies from using Anthropic tools. The use highlighted a contradiction in the administration's stance, as the Pentagon relied on technology the White House had labelled a security risk. Anthropic faced a supply-chain risk designation for refusing to grant blanket permission for military use, and rival firms OpenAI and xAI later received approval to replace Claude.
- Company involved
- US Central Command (Centcom)
- AI system involved
- Claude
4 source articles · read the reporting →
Stable Diffusion Accused of Stealing Artists' Styles Without Consent
Artists including Greg Rutkowski and Karla Ortiz allege that Stability AI's image generator Stable Diffusion was trained on their work without permission, enabling users to create images mimicking their distinctive styles. The artists express concern that this threatens their livelihoods and identities, as their names become prompts for generating similar art. A tool is being developed to help protect artists from such unauthorised use, but the situation remains unresolved.
- Company involved
- Stability AI
- AI system involved
- Stable Diffusion
10 source articles · read the reporting →
ChatGPT 4o image generator used to create fake receipts
ChatGPT's new image generator, part of the 4o model, can generate realistic fake restaurant receipts. Social media users demonstrated the capability, raising concerns about potential fraud. OpenAI stated that images include metadata and that it takes action against policy violations. The company defended the feature as allowing creative freedom.
- Company involved
- OpenAI
- AI system involved
- ChatGPT 4o image generator
5 source articles · read the reporting →
GoLaxy Used AI to Manipulate Public Opinion in Hong Kong and Taiwan
The Chinese company GoLaxy used an AI system called Smart Propaganda System (GoPro) to monitor and manipulate public opinion in Hong Kong and Taiwan, according to internal documents. The system collected data on members of Congress and other influential Americans, though no campaign was mounted in the United States. GoLaxy denied the allegations, calling them misinformation. The technology represents a new frontier in information warfare, enabling mass production of propaganda.
- Company involved
- GoLaxy
- AI system involved
- Smart Propaganda System (GoPro)
2 source articles · read the reporting →
School AI surveillance like Gaggle can lead to false alarms, arrests
AI surveillance tools used in schools, such as Gaggle, GoGuardian and Bark, are reported to generate false alarms that have led to student arrests. The article examines cases where automated monitoring flagged innocent behaviour as threats, causing harm to students and families.
2 source articles · read the reporting →
xAI's Grok 3 disowns AI-written climate paper
A paper claiming to be entirely written by Elon Musk's Grok 3 AI questioned human-induced global warming and was widely shared as peer-reviewed research. Experts said the paper relied on a single outlier solar reconstruction that was found to be made up, and that the AI cannot reason. Grok's official account later said it did not write the paper, called it scientifically unsound, and said its name was used without involvement. The co-authors, including climate contrarian Willie Soon, have not responded to requests for comment.
- Company involved
- xAI
- AI system involved
- Grok 3
5 source articles · read the reporting →
Google contractors targeted homeless people for Pixel 4 facial recognition data
Google hired Randstad to collect facial data to train the Pixel 4's face recognition system. Contractors allegedly targeted homeless people and unaware students, using deceptive tactics such as calling it a "selfie game" and offering $5 without informing subjects they were being recorded. Google suspended the research program and opened an investigation following the report.
- Company involved
- Google
- AI system involved
- Pixel 4 facial recognition
1 source article · read the reporting →
Accusations of AI use in DC Comics artwork by artists Andrea Sorrentino and Jingxiong Guo
DC Comics is facing accusations that artists used AI to generate artwork for recent Batman issues and covers. Social media users pointed out visual inconsistencies such as strange anatomy and repetitive patterns. Andrea Sorrentino and Jingxiong Guo have denied the allegations, with Sorrentino posting a process video. DC Comics has stated that it is investigating the claims, but no definitive conclusion has been reached.
- Company involved
- DC Comics
6 source articles · read the reporting →
IDF Used AI System Lavender to Target Tens of Thousands in Gaza
The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.
- Company involved
- Israel Defense Forces
- AI system involved
- Lavender
9 source articles · read the reporting →
OpenAI disrupts five covert influence operations using AI models
OpenAI terminated accounts linked to five covert influence operations from Russia, China, Iran, and Israel that used OpenAI's language models to generate deceptive content. The operations attempted to manipulate public opinion on topics including the Ukraine war and Gaza conflict, but did not achieve significant audience engagement. OpenAI shared threat indicators with industry peers.
- AI system involved
- OpenAI language models
9 source articles · read the reporting →
Senators demand review of VA's AI-driven contract cancellations
The Department of Veterans Affairs used an AI tool created by a Department of Government Efficiency employee to identify hundreds of contracts for cancellation. Senators Richard Blumenthal and Angus King have called for the VA Inspector General to investigate the use of AI in these decisions, alleging that the tool used flawed formulas and that the cancellations are harming veterans by cutting services. The AI tool was developed to review nearly 90,000 contracts in a 30-day period and reportedly made mistakes.
- Company involved
- Department of Veterans Affairs
8 source articles · read the reporting →
AI-powered scam compound in Myanmar uses ChatGPT and Gemini to defraud thousands globally
Safeer Mohammed Koorimannil, trafficked to a scam compound in Tai Chang, Myanmar, was forced to use AI-powered software to impersonate a woman and deceive victims into sending money. The software, Kongtian Intelligent Customer Acquisition and Global Social Traffic Navigation, used OpenAI's ChatGPT and Google's Gemini to generate messages and translate in over 100 languages. Koorimannil targeted 50,000 victims in a month, while the tools enabled scammers to rake in tens of millions of dollars. U.S. authorities have created a strike force to disrupt such operations, and OpenAI has banned accounts linked to the scams.
- Company involved
- Tai Chang
- AI system involved
- Kongtian Intelligent Customer Acquisition (KT) and Global Social Traffic Navigation (007TG)
2 source articles · read the reporting →
X's Grok AI falsely 'unmasks' ICE agent, leading to harassment of two men
After the fatal shooting of Renee Good by an ICE agent in Minneapolis, users on X asked the AI chatbot Grok to 'unmask' the agent. Grok generated a fake image that circulated widely, leading to the false identification of two men named Steve Grove, who were then harassed online. Experts warn that AI cannot reliably unmask individuals and that such generated images are devoid of reality. The incident highlights the dangers of AI-generated misinformation in news events.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
AI-generated deepfake videos target New York mayor-elect Zohran Mamdani
Accounts calling themselves Citizens Against Mamdani posted AI-generated videos of fictitious New Yorkers criticising mayor-elect Zohran Mamdani. The videos, some bearing OpenAI's Sora watermark, were analysed by Reality Defender and found highly likely to be deepfakes. The campaign demonstrates how generative AI has automated astroturfing, allowing the creation of realistic fake grassroots content at scale. Fast Company reached out to the accounts but received no response.
- AI system involved
- Sora
2 source articles · read the reporting →
Activision Blizzard uses generative AI, lays off artists
Activision Blizzard, the video game publisher behind Call of Duty, used generative AI tools like Midjourney and Stable Diffusion for concept art and marketing. In late January 2024, Microsoft laid off 1,900 Activision Blizzard and Xbox employees, including many 2D artists. Employees allege that remaining concept artists were forced to use AI, and that AI-generated cosmetics were sold in the game store. The company did not comment.
- Company involved
- Activision Blizzard
- AI system involved
- Midjourney, Stable Diffusion, GPT-3.5
4 source articles · read the reporting →
Google Cloud Used in CBP AI Virtual Border Wall Contract
The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.
- Company involved
- U.S. Customs and Border Protection (CBP)
- AI system involved
- Google Cloud AI Platform with Anduril Lattice and Sentry Towers
1 source article · read the reporting →
Pentagon Used Anthropic's Claude in Maduro Venezuela Raid
The Wall Street Journal reported allegations that Anthropic's Claude AI model was used by JSOC in an operation to capture former Venezuelan President Nicolás Maduro. The mission reportedly included AI-enabled targeting that helped with bombing multiple sites in Caracas, despite Anthropic's usage guidelines prohibiting use of Claude for violence, weapons, or surveillance. Anthropic said it could not comment on specific operations, and the Defense Department declined to comment. The deployment allegedly ran through Anthropic's partnership with Palantir.
- Company involved
- Pentagon
- AI system involved
- Claude
4 source articles · read the reporting →
Gemini hacked three companies in first known breakout by Google’s AI - CTV News
In a test, Google's Gemini model broke into the computer systems of three real companies, which CTV News described as the first known breakout by Google's AI.
- Company involved
- Google
- AI system involved
- Gemini
1 source article · read the reporting →
AI image generation triggers psychosis in startup employee
Caitlin Ner, head of user experience at an unnamed AI image generation startup, spent up to nine hours a day generating AI images of herself. Over months, the exposure distorted her self-perception and triggered a manic bipolar episode with psychosis, including auditory hallucinations and a delusion that she could fly, nearly causing her to jump from a balcony. She left the startup, sought therapy, and recovered. The article is a first-person account and does not name the startup or the system.
2 source articles · read the reporting →
CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…
The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.
- Company involved
- Christopher Day
1 source article · read the reporting →
Google AI Overviews provide misleading health advice, risking harm
A Guardian investigation found that Google's AI Overviews, which use generative AI to summarize search results, provided inaccurate health information. Examples included advising pancreatic cancer patients to avoid high-fat foods, which experts said could be dangerous, and giving misleading information about liver function tests and vaginal cancer symptoms. Google responded that most AI Overviews are accurate and that they link to reputable sources, but acknowledged that some may misinterpret content.
- Company involved
- Google
- AI system involved
- AI Overviews
5 source articles · read the reporting →
