Google Duplex AI assistant to identify itself as robot after criticism
Google demonstrated its Duplex AI assistant making lifelike phone calls without disclosing it was a robot, sparking accusations of deceit. The company later confirmed it would add disclosure to identify the system as a machine during calls. The feature was not yet a finished product at the time.
- Company involved
- Google
- AI system involved
- Google Duplex
10 source articles · read the reporting →
Microsoft Copilot Exposes Private GitHub Repositories via Bing Cache
In August 2024, Lasso Security researchers discovered that Microsoft Copilot could access and expose data from private GitHub repositories that had been briefly public, due to Bing's caching mechanism. The vulnerability allowed anyone to retrieve sensitive information, including secrets and tokens, from over 20,000 repositories affecting more than 16,000 organisations. Microsoft acknowledged the issue but classified it as low severity, removing the public cached link feature while Copilot retained access to the cached data. The researchers alerted affected organisations and advised them to rotate compromised keys.
- Company involved
- Microsoft
- AI system involved
- Microsoft Copilot
2 source articles · read the reporting →
Rep. Anna Paulina Luna denies staff used AI to draft defence amendment
Rep. Anna Paulina Luna's congressional office used Claude, an AI chatbot, to spellcheck and grammar-check a summary of an amendment to the 2027 National Defense Authorization Act. Screenshots of the summary circulated online because it still contained the text 'Claude responded:'. Luna initially said staff used AI to correct draft text and did not edit it, then clarified that AI was only used on the summary and that no legislation is drafted with AI. The incident drew public speculation about AI use in legislative work.
- Company involved
- Office of Rep. Anna Paulina Luna
- AI system involved
- Claude
2 source articles · read the reporting →
McDonald's tests AI drive-thru ordering in Chicago
McDonald's is testing automated voice-ordering technology at ten drive-thru locations in Chicago. The system, developed by Apprente, uses artificial intelligence to take customer orders with about 85% accuracy, handling 80% of orders without human intervention. The company's CEO stated that wider implementation faces challenges such as menu and dialect variations. No incidents of harm were reported.
- Company involved
- McDonald's
3 source articles · read the reporting →
Marques Brownlee accuses Dot of using AI to clone his voice
Tech YouTuber Marques Brownlee claims that networking products company Dot used an AI-generated clone of his voice in an Instagram post to promote its products. Brownlee said the company used the AI-created voice without his permission and that there were no repercussions for the company. The Instagram post, from February 2024, was later deleted.
- Company involved
- Dot
3 source articles · read the reporting →
Deloitte to refund Australian government after AI-generated report errors
Deloitte used generative AI (Azure OpenAI GPT-4o) to help produce an independent assurance review for Australia's Department of Employment and Workplace Relations. The report, published in July 2025, contained multiple errors including non-existent academic references and a fabricated court case. After the errors were flagged, Deloitte acknowledged the AI use and agreed to refund the final instalment of the A$439,000 contract. The report was corrected, but its substance and recommendations remained unchanged.
- Company involved
- Deloitte
- AI system involved
- Azure OpenAI GPT-4o
5 source articles · read the reporting →
iFlytek accused of passing off human translation as AI at Shanghai forum
At a Shanghai forum, Chinese AI company iFlytek presented a speech translation as fully automated. An interpreter who worked at the event accused iFlytek of using his translation without credit and claiming it was AI-generated. iFlytek denies the allegation.
- Company involved
- iFlytek
10 source articles · read the reporting →
Deepfake voice generator impersonates Jordan Peterson without consent
A website called notjordanpeterson.com released an AI engine that allows users to generate audio in Jordan Peterson's voice from any text input. The system was created using a sample of Peterson's voice from public lectures. Peterson expressed concern about potential misuse for fraud and defamation, and the site subsequently disabled its functionality in response to his objections.
- Company involved
- notjordanpeterson.com
10 source articles · read the reporting →
Chinese military researchers used Meta's Llama 2 to develop defense chatbot ChatBIT
Chinese military researchers, including two affiliated with the People's Liberation Army, reportedly used Meta's Llama 2 AI model to develop a defense chatbot called ChatBIT. According to Reuters, the chatbot is designed to gather and process intelligence and offer information for operational decision-making. Meta stated that the use was unauthorized and contrary to its acceptable use policy.
- Company involved
- People's Liberation Army (PLA)
- AI system involved
- ChatBIT
6 source articles · read the reporting →
MBN introduces AI news anchor AI Kim in South Korea
MBN, a South Korean cable channel, introduced an AI-powered news anchor based on anchor Kim Ju-ha. The AI, named AI Kim, was created through deep learning using 10 hours of video of Kim. It presents news in her voice and manner, intended to allow 24/7 broadcasting.
- Company involved
- MBN
- AI system involved
- AI Kim
10 source articles · read the reporting →
Imprompter attack extracts personal data from AI chatbots
Security researchers at UCSD and Nanyang Technological University developed a prompt-injection attack called Imprompter that covertly instructs large language models to extract personal information from user chats and send it to an attacker. The attack was tested on Mistral AI's LeChat and the Chinese chatbot ChatGLM, achieving nearly 80% success in test conversations. Mistral AI fixed the vulnerability; ChatGLM acknowledged security measures but did not directly confirm a fix.
- Company involved
- Mistral AI,Zhipu AI
- AI system involved
- LeChat,ChatGLM
7 source articles · read the reporting →
AI drug discovery system repurposed to generate toxic molecules in demonstration
In 2020, Collaborations Pharmaceuticals demonstrated that its AI drug discovery system, MegaSyn, could be repurposed to generate toxic molecules similar to the nerve agent VX. The company ran the software overnight and produced 40,000 potentially hazardous substances. The researchers presented their findings at a conference and briefed the White House, warning that such AI systems could be misused to create chemical weapons.
- Company involved
- Collaborations Pharmaceuticals
- AI system involved
- MegaSyn
10 source articles · read the reporting →
South Korean AI recreates deceased singer's voice for TV show
South Korean broadcaster SBS used AI technology from Supertone to recreate the voice of deceased folk singer Kim Kwang-seok for a TV show. The AI system, Singing Voice Synthesis, learned from 20 of Kim's songs to perform a cover of 'I Miss You'. The family gave permission after hearing the AI version. The show aired on January 29, 2021.
- Company involved
- SBS
- AI system involved
- Singing Voice Synthesis (SVS)
10 source articles · read the reporting →
iFlytek suspends AI study device after it generates essay critical of Mao
iFlytek, a Chinese AI firm, suspended sales of its study assistance device after a parent complained that the device generated an essay critical of Mao Zedong, calling him 'narrow-minded' and 'intolerant' for starting the Cultural Revolution. The company blamed a supplier for the content and said both the supplier and staff had been punished. Shares in iFlytek fell 10% following the news.
- Company involved
- iFlytek
- AI system involved
- study assistance device
3 source articles · read the reporting →
AI companies trained on Hollywood writers' dialogue without consent
The Atlantic investigation found that dialogue from over 53,000 movies and 85,000 TV episodes was included in the OpenSubtitles data set used by Apple, Anthropic, Meta, Nvidia, Salesforce, and Bloomberg to train AI systems. The article alleges that this use of copyrighted material was done without permission from the writers.
4 source articles · read the reporting →
ElevenLabs voice cloning tool used to create deepfake celebrity audio clips
Speech AI startup ElevenLabs launched a beta voice cloning tool. Within days, users on 4chan posted deepfake audio clips featuring voices resembling celebrities like Emma Watson reading offensive material. ElevenLabs acknowledged the misuse and said it is considering additional safeguards.
- Company involved
- ElevenLabs
- AI system involved
- ElevenLabs platform
10 source articles · read the reporting →
Microsoft Copilot gives false election information in Swiss and Bavarian elections
AI Forensics and Algorithm Watch tested Microsoft's Copilot chatbot during the 2023 Swiss federal elections and German state elections in Hesse and Bavaria. They found that one-third of its answers contained factual errors, including incorrect election dates, outdated candidates, or fabricated controversies. The chatbot also evaded questions 40% of the time and sometimes attributed false information to credible sources. The organisations alerted Microsoft multiple times.
- Company involved
- Microsoft
- AI system involved
- Copilot (Bing Chat)
10 source articles · read the reporting →
Presto Automation uses off-site human agents to double-check AI drive-thru orders
Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.
- Company involved
- Presto Automation Inc.
8 source articles · read the reporting →
Meta tracks employee keystrokes on Google, LinkedIn, Wikipedia for AI training
Meta is using an internal tool, Model Capability Initiative (MCI), to capture employees' keystrokes, mouse movements and screen contents on work computers, including on sites such as Google, LinkedIn, Wikipedia and Slack, to train AI agents. Meta confirmed the project and said safeguards protect sensitive content and that the data is not used for other purposes. Employees raised concerns in internal messages that the tool could expose passwords, product details and personal information. A Meta memo said staff can avoid capture by not doing personal work on work computers.
- Company involved
- Meta
- AI system involved
- Model Capability Initiative (MCI)
5 source articles · read the reporting →
Voice actor Greg Marston alleges IBM cloned his voice without permission
Voice actor Greg Marston alleges that IBM used voice recordings he made for them 20 years ago to create an AI clone of his voice without his consent. The clone is being sold by a third party under the name 'Conor', and Marston says he is now competing with it for work. IBM has acknowledged the complaint and claims it obtained the rights from the original agreement. Marston is sending a take-down notice to stop the use.
- Company involved
- IBM
7 source articles · read the reporting →
AI image generators produce misleading election images, study finds
A study by the Center for Countering Digital Hate found that leading AI image generators, including Midjourney, DreamStudio, ChatGPT Plus, and Microsoft Image Creator, could be manipulated to create misleading election-related images. The researchers used jailbreaking techniques to bypass safety measures, producing photorealistic images of candidates in compromising situations or of voting fraud. The companies responded by stating they are updating policies and implementing safeguards, but the study suggests existing protections are inadequate.
- Company involved
- Midjourney, Stability AI, OpenAI, Microsoft
- AI system involved
- Midjourney, DreamStudio, ChatGPT Plus, Microsoft Image Creator
8 source articles · read the reporting →
Storm-1376 used AI-generated fake audio during Taiwan election, Microsoft reports
Microsoft's Threat Analysis Center reported that the Chinese state-linked group Storm-1376 posted suspected AI-generated fake audio of former Taiwanese presidential candidate Terry Gou endorsing another candidate on election day in January 2024. Gou had made no such statement, and YouTube removed the content before it reached a wide audience. The group has also used AI-generated memes and news anchors as part of influence operations in Taiwan and the United States.
- Company involved
- Storm-1376 (also known as Spamouflage and Dragonbridge)
7 source articles · read the reporting →
Beijing Internet Court rules AI voice cloning infringes personality rights
A Chinese dubbing artist, Yin, discovered that his voice was being used without permission in a text-to-speech AI product. The product was developed by a software company using recordings provided by a cultural media company, and was made available on a platform operated by a smart technology company. The Beijing Internet Court ruled that the AI-generated voice was highly similar to the plaintiff's voice and infringed his personality rights. The court ordered the defendants to stop infringement and pay damages of 250,000 RMB.
5 source articles · read the reporting →
Microsoft sued after MSN circulates AI-generated fake article accusing Irish broadcaster of sexual misconduct
Dave Fanning, an Irish DJ and talk show host, is suing Microsoft and BNN Breaking after MSN featured an AI-generated article falsely claiming he faced trial for alleged sexual misconduct. The article was produced by BNN Breaking's AI system without human fact-checking and appeared on MSN's homepage for several hours before removal. Fanning alleges defamation and reputational damage. The lawsuit is pending.
- Company involved
- Microsoft
- AI system involved
- BNN Breaking
6 source articles · read the reporting →