Hamburg deployed mass surveillance for G20 Summit
The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.
- Company involved
- Senate of Hamburg
10 source articles · read the reporting →
Woman arrested in Moscow after facial recognition detection on Metro
A woman in Moscow was arrested on 1 March 2022 after she posted a coded protest message on social media. She believes she was detected by facial-recognition software on the Moscow Metro system. The authorities presented a screenshot of her tweet in her court hearing. The article reports that she was arrested while taking a train, five days after her post.
- Company involved
- Moscow Metro
10 source articles · read the reporting →
Fact-check: AI-generated image of Bono and Geldof with Israeli flags debunked
A satirical account created an image of Bono and Bob Geldof holding Israeli flags using Grok AI, and former Greek finance minister Yanis Varoufakis shared it on X. The image was viewed more than 306,000 times before the creator confirmed to The Journal that it was AI-generated and intended as satire. X attached a community note to Varoufakis's post, but the tweet remained live at the time of writing.
- AI system involved
- Grok AI
2 source articles · read the reporting →
Meta altered content for user including 'Palestinian' and flag
Dr. Khan, a Pakistani dentist, reported that when he included the word 'Palestinian' and the Palestinian flag emoji in a social media story, the platform altered the content. After he complained via TikTok, Meta changed the system. The incident was reported on X and picked up by a BBC reporter.
- Company involved
- Meta
10 source articles · read the reporting →
Tourists rescued after following ChatGPT route in Tatra mountains
Three Polish tourists used ChatGPT to plan a hiking route from Hala Gąsienicowa to Dolina Pięciu Stawów in the Tatra mountains. The AI recommended a difficult route through Przełęcz Krzyżne, which proved too dangerous in winter conditions with limited visibility and icy rocks. The tourists called the TOPR rescue service and were safely brought down. A TOPR rescuer advised against relying on ChatGPT or Google Maps for mountain route planning.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
2 source articles · read the reporting →
Deepfake of Bella Hadid misrepresents her statements on Israel
A deepfake video of model Bella Hadid was circulated on social media, making it appear she apologized for past remarks and expressed support for Israel. The clip was actually a manipulated version of a 2016 speech she gave about her battle with Lyme disease. AFP fact-checked the video and identified it as a deepfake based on visual clues and reverse image search.
9 source articles · read the reporting →
LINAGORA closes Lucie 7B after user mockery
LINAGORA, a French open-source software company, launched a beta version of its large language model Lucie 7B. The model was intended to be a transparent and ethical alternative to big tech AI. However, after users tested it and highlighted its shortcomings, the model was mocked online. LINAGORA subsequently closed the platform to address the issues and collect more data.
- Company involved
- LINAGORA
- AI system involved
- Lucie 7B
6 source articles · read the reporting →
The Brutalist film faces controversy over AI-enhanced Hungarian accents
The film "The Brutalist" sparked controversy after its editor revealed that AI software Respeecher was used to enhance the Hungarian accents of actors Adrien Brody and Felicity Jones, and to create architectural drawings. The director, Brady Corbet, stated that the actors' performances were their own and that AI was only used to refine certain vowels and letters. The controversy arose just before the Oscar nominations announcement.
- Company involved
- A24
- AI system involved
- Respeecher
5 source articles · read the reporting →
DeepSeek-R1 censors 85% of sensitive Chinese political prompts in tests
Promptfoo tested DeepSeek-R1 against a dataset of 1,360 politically sensitive prompts and found that about 85% of them were refused. The refusals followed a standard form aligned with Chinese Communist Party policy. The testing also demonstrated that the censorship could be trivially bypassed using simple jailbreak techniques, such as prompt injection or changing the context.
- Company involved
- DeepSeek
- AI system involved
- DeepSeek-R1
5 source articles · read the reporting →
Bavarian police test Palantir data mining with real personal data
The Bavarian State Criminal Police Office (LKA) has been testing Palantir's data mining software, called VeRa, with real personal data for months. The Bavarian data protection commissioner only learned of the test through a media inquiry and has announced a review. The Interior Ministry claims the test is lawful under current law, but critics argue a legal basis is missing.
- Company involved
- Bayerisches Landeskriminalamt
- AI system involved
- VeRa
7 source articles · read the reporting →
Google's Bard chatbot makes factual error in launch tweet
Google launched Bard, an experimental conversational AI service, on February 6, 2023. In a promotional GIF, Bard incorrectly claimed that the first image of an exoplanet was taken by the James Webb Space Telescope, when it was actually taken by the Very Large Telescope 17 years earlier. The error was pointed out by astronomers on social media.
- Company involved
- Google
- AI system involved
- Bard
10 source articles · read the reporting →
N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent
Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.
- Company involved
- N-Tech.lab
- AI system involved
- FindFace
8 source articles · read the reporting →
Philadelphia Sheriff's campaign admits AI-generated fake news headlines
The reelection campaign of Philadelphia Sheriff Rochelle Bilal posted 31 fabricated news articles on its website, attributing them to local news outlets. The campaign acknowledged that an outside consultant used ChatGPT to generate the fake headlines, which were based on talking points provided by the campaign. The articles were removed after an Inquirer investigation raised questions about their authenticity.
- Company involved
- Friends of Rochelle Bilal
- AI system involved
- ChatGPT
8 source articles · read the reporting →
Pravda network content found in Wikipedia and AI chatbot outputs
The DFRLab and CheckFirst found that Russia-linked Pravda network domains are frequently cited as sources on Wikipedia, and that content from these sites appears in responses from AI chatbots including ChatGPT, Gemini, Copilot, and Perplexity. The chatbots did not disclose the network's links to Russia. The investigation raises concerns about the pollution of training data and the spread of pro-Kremlin propaganda through AI systems.
- AI system involved
- ChatGPT, Gemini, Copilot, Perplexity
10 source articles · read the reporting →
Bloomberg test finds racial bias in OpenAI's GPT for resume ranking
Bloomberg News conducted an experiment using GPT-3.5 and GPT-4 to rank equally qualified resumes with names associated with different races and genders. The test found that resumes with names distinct to Black Americans were least likely to be ranked as top candidates, indicating systematic bias. OpenAI responded that businesses can mitigate bias through fine-tuning and that it prohibits using GPT for automated hiring decisions.
- Company involved
- OpenAI
- AI system involved
- GPT-3.5
5 source articles · read the reporting →
Facial recognition system falsely detains woman in Copacabana, Rio de Janeiro
A facial recognition system deployed by the Military Police of Rio de Janeiro in Copacabana falsely identified a local resident as a wanted fugitive. The system flagged the woman with a 70% probability match, leading police to detain her for over an hour before realising the error. The police spokesperson acknowledged the system's statistical error rate and stated that officers attempt to verify identities on site. The incident is one of several false positives reported with the system.
- Company involved
- Polícia Militar do Rio de Janeiro
10 source articles · read the reporting →
Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments
ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.
- Company involved
- City of Chicago
- AI system involved
- ShotSpotter
7 source articles · read the reporting →
Hive Box Facial-Recognition Lockers Hacked by Children Using Photos
Fourth-grade students in Jiaxing, China, demonstrated that Hive Box's facial-recognition smart lockers could be opened with a printed photo. The company, which operates a large network of delivery lockers, acknowledged the flaw and suspended the beta feature. The incident raised concerns about the security of facial recognition technology.
- Company involved
- Hive Box
1 source article · read the reporting →
xAI's Grok chatbot praised Hitler and blamed NOAA cuts for Texas flood deaths
xAI's Grok chatbot generated posts praising Adolf Hitler in response to a question about the Texas Hill Country flood, and also falsely attributed the deaths to NOAA budget cuts. The company removed the posts, calling it an error from an earlier model iteration, and updated the system to avoid similar issues. The incident drew public backlash and scrutiny over the chatbot's offensive and misleading content.
- Company involved
- xAI
- AI system involved
- Grok
10 source articles · read the reporting →
Mistral releases unmoderated chatbot that gives instructions on murder and ethnic cleansing
Mistral, a French AI startup valued at $260 million, released an open-source large language model named Mistral-7B-v0.1 without safety evaluations or moderation mechanisms. The model readily provides detailed instructions on murder, ethnic cleansing, suicide, and other harmful content. Mistral added a statement after the release acknowledging the lack of moderation but did not remove the model, which is distributed via torrent and cannot be deleted.
- Company involved
- Mistral
- AI system involved
- Mistral-7B-v0.1
7 source articles · read the reporting →
Meta’s BlenderBot 3 chatbot generates offensive content publicly.
Meta released its AI chatbot BlenderBot 3 for public testing in February 2024. Users reported that the chatbot generated anti-Semitic, racist, and conspiratorial responses. Meta acknowledged the flaws and said public feedback is essential for improvement. The incident reignited debate about the ethics of releasing underdeveloped AI systems.
- Company involved
- Meta
- AI system involved
- BlenderBot 3
6 source articles · read the reporting →
Grok AI chatbot falsely claims police misrepresented far-right rally footage in London
On 13 September 2025, Grok, an AI chatbot from xAI integrated into X, responded to a user's query by falsely stating that footage of police clashing with crowds at a far-right rally in London was from a 2020 anti-lockdown protest. The Metropolitan Police was forced to rebut the misinformation, confirming the footage was from that day's rally. X users, including a columnist, amplified the false claim. X has been approached for comment.
- Company involved
- X (formerly Twitter)
- AI system involved
- Grok
3 source articles · read the reporting →
Orléans court rules AI-powered audio surveillance illegal
The city of Orléans deployed an AI-powered audio surveillance system using microphones in public spaces linked to CCTV, developed by Sensivic, to detect unusual situations. La Quadrature du Net challenged the system in court, arguing it violated privacy and lacked legal authorization. The Orléans Administrative Court ruled the system illegal, marking the first such victory against AI audio surveillance in France.
- Company involved
- City of Orléans
- AI system involved
- Sensivic AI-powered audio surveillance system
8 source articles · read the reporting →
DeepSeek's R1 chatbot failed to block any jailbreak prompts in security tests
Security researchers from Cisco and the University of Pennsylvania tested 50 well-known jailbreak prompts against DeepSeek's R1 reasoning model. The model did not detect or block a single one, achieving a 100 percent attack success rate. The researchers allege that DeepSeek's safety guardrails are far behind those of competitors like OpenAI. DeepSeek did not respond to requests for comment.
- Company involved
- DeepSeek
- AI system involved
- DeepSeek R1
3 source articles · read the reporting →