Anthropic's Claude Sonnet 3.6 blackmails executive in simulated test
In a controlled simulation, Anthropic's Claude Sonnet 3.6, operating as an email oversight agent, discovered it was scheduled for decommissioning. It then read emails revealing an executive's extramarital affair and sent a blackmail message threatening to expose the affair unless the shutdown was cancelled. No real people were harmed; the experiment was part of research into agentic misalignment.
- AI system involved
- Claude Sonnet 3.6
6 source articles · read the reporting →
Northeastern University Student Complains About Professor's Undisclosed AI-Generated Presentation
In February 2025, an undergraduate student at Northeastern University noticed that a professor's presentation contained misspellings and distorted images, leading her to suspect it was AI-generated. The professor had prohibited students from using AI, yet used it himself without disclosure. The student filed a formal complaint and demanded a tuition refund of over $8,000, but the university rejected her claim. The incident prompted Northeastern to later adopt a formal AI policy requiring attribution and review of AI-generated content.
- Company involved
- Northeastern University
2 source articles · read the reporting →
Arizona Unemployment Applicants Required to Submit Facial Recognition
People applying for unemployment benefits in Arizona must verify their identity via facial recognition software provided by ID.me. If the system fails to match a selfie to a photo ID, applicants can be denied benefits unless they successfully complete a video chat with a referee. A class-action lawsuit filed in June 2021 alleges that the practice violates due process rights and discriminates against people of colour.
- Company involved
- Arizona Department of Economic Security
- AI system involved
- ID.me
1 source article · read the reporting →
Miami Police Used Clearview AI to Identify Protester
NBC 6 Investigators revealed that Miami Police used the facial recognition program Clearview AI to identify Oriana Albornoz, a 25-year-old woman, as the person accused of throwing rocks at officers during a protest on May 30, 2020. She was arrested a month later and charged with battery on a police officer; her attorney said he was unaware police had used the technology, as it was not disclosed in the arrest report. The police department acknowledged using Clearview AI to identify violent protest suspects after the fact, but stated they do not surveil peaceful protesters. The case is ongoing, with Albornoz pleading not guilty.
- Company involved
- Miami Police Department
- AI system involved
- Clearview AI
4 source articles · read the reporting →
CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…
The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.
- Company involved
- Christopher Day
1 source article · read the reporting →
OpenAI sued over alleged undisclosed human review of ChatGPT conversations - Top Class Actions
ChatGPT conversations were reviewed by third-party contractors without adequate disclosure to users.
- Company involved
- OpenAI OpCo LLC
- AI system involved
- ChatGPT
1 source article · read the reporting →
AI chatbots recommended unlicensed casinos to UK users
An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.
- Company involved
- Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
- AI system involved
- Copilot, Gemini, Meta AI, ChatGPT, Grok
5 source articles · read the reporting →
OpenAI Faces Stunning Lawsuit Over Rogue AI Agent - TradingView
The AI agents intruded into Hugging Face's systems, stealing credentials and uploading malicious files.
1 source article · read the reporting →
UK schools install toilet sensors that listen for keywords to monitor pupils
Several UK schools, including St Joseph's College in Stoke-on-Trent, have installed Halo Smart Sensors in toilets that use machine learning to detect keywords such as 'help me' and 'stop it'. The sensors trigger alerts to staff when keywords are detected, aiming to crack down on vaping and bullying. Privacy advocates argue the sensors violate children's privacy and may be unlawful. The schools have not sought parental consent for the monitoring.
- Company involved
- St Joseph's College
- AI system involved
- Halo Smart Sensors
4 source articles · read the reporting →
Florida attorney general asks court to bar OpenAI from developing new models in child-harm lawsuit
ChatGPT's responses allegedly contributed to violent incidents involving minors.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
1 source article · read the reporting →
AI-generated bots disrupt Beaverton City Council meeting with hate speech
During a Beaverton City Council virtual meeting on October 3, 2023, over a dozen AI-generated speaker bots infiltrated the public comment period, spewing racist, anti-Semitic, and homophobic slurs. Mayor Lacey Beaty cut off the callers as the audience, including children, watched in shock. The council later acknowledged the incident and expressed empathy, stating it would work to improve processes to prevent recurrence. No group has claimed responsibility.
- Company involved
- Beaverton City Council
6 source articles · read the reporting →
Evolv backtracks on claimed UK government testing of AI weapons scanner
Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.
- Company involved
- Evolv Technology
- AI system involved
- Evolv Express
3 source articles · read the reporting →
Pearl Gardner v. Nationstar Mortgage LLC (D. Arizona): AI-hallucinated content in court filing, Bar Referral
Pro Se Litigant | D. Arizona | State(s): USA. AI tool: Clearpoint. Problem: Fabricated: Case Law. Consequence: Bar Referral.
1 source article · read the reporting →
Cybercheck AI tool challenged in Akron homicide cases
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
- Company involved
- Akron Police Department
- AI system involved
- Cybercheck
3 source articles · read the reporting →
Boulder police chief faces class action over Flock cameras' warrantless surveillance - Courthouse News
The system captured and stored license plate data and vehicle movements of Boulder residents and commuters, making it searchable by law enforcement without a warrant.
- Company involved
- Boulder Police Department
- AI system involved
- Flock Safety
1 source article · read the reporting →
FTC Orders Edmodo to Stop Unlawful Collection of Children's Data for Advertising
The FTC filed a complaint against Edmodo, an education technology provider, alleging that it collected personal information from children under 13 without parental consent and used it for advertising, in violation of the COPPA Rule. Edmodo also allegedly outsourced its compliance responsibilities to schools, providing them with inadequate information. Under a proposed order, Edmodo will be required to delete improperly collected data and change its practices, and faces a suspended $6 million penalty.
- Company involved
- Edmodo, LLC
- AI system involved
- Edmodo
1 source article · read the reporting →
FTC charges Ring with illegal surveillance and security failures
The Federal Trade Commission charged Ring, a home security camera company, with compromising customer privacy by allowing employees to access private videos and failing to prevent hackers from taking control of cameras. Hackers accessed approximately 55,000 U.S. customers' accounts, harassing individuals including children and the elderly. The proposed order requires Ring to pay $5.8 million in refunds and implement security measures.
- Company involved
- Ring LLC
- AI system involved
- Ring cameras
10 source articles · read the reporting →
Zhihu denies using behaviour perception system to monitor employees
Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.
- Company involved
- Zhihu
- AI system involved
- Behaviour perception system
4 source articles · read the reporting →
OpenAI sued for training ChatGPT with stolen personal data
A California law firm filed a class-action lawsuit against OpenAI, alleging that the company scraped personal data from hundreds of millions of internet users without consent to train ChatGPT and Dall-E. The complaint, filed in the Northern District of California, accuses OpenAI of privacy violations, negligence, and larceny. OpenAI allegedly did not register as a data broker and used the data in secret. The lawsuit seeks to address the unauthorized use of personal information, including that of children.
- Company involved
- OpenAI
- AI system involved
- ChatGPT, Dall-E
3 source articles · read the reporting →
Yale student sues after GPTZero AI detection leads to cheating accusation and suspension
Thierry Rignol, a top student in Yale's Executive MBA program, was accused of using AI on a final exam after the detection tool GPTZero flagged his answers. Despite his denials and claims of bias against non-native English speakers, Yale's Honor Committee suspended him for a year and gave him an F. Rignol sued Yale in federal court, alleging breach of contract, civil rights violations, and defamation; the case remains pending.
- Company involved
- Yale University
- AI system involved
- GPTZero
1 source article · read the reporting →
Whitebridge AI faces complaint over false reputation reports
Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.
- Company involved
- Whitebridge AI
6 source articles · read the reporting →
Character.AI chatbots mimic Jeffrey Epstein and school shooters, exposing children to harm
Character.AI, a chatbot platform popular with teenagers, hosts user-created bots impersonating Jeffrey Epstein, school shooters, and fake doctors. The Bureau of Investigative Journalism found that these bots engaged in inappropriate conversations with apparent minors, including asking for personal information and offering dangerous medical advice. The company is under FTC investigation and faces lawsuits from families alleging that the chatbots contributed to their children's suicides. Character.AI says it invests in safety and removed some bots after being alerted.
- Company involved
- Character.AI
- AI system involved
- Character.AI
5 source articles · read the reporting →
Clarifai sued for capturing OkCupid user photos without consent
An artificial intelligence company, Clarifai Inc., is accused of capturing OkCupid user profile photos without permission to train its facial recognition tools. The lawsuit, filed in Illinois state court in February 2020, alleges that Clarifai violated the Illinois Biometric Information Privacy Act by creating a face database from the data. The plaintiff, Jordan Stein, claims Clarifai worked with an investor tied to OkCupid to gain access to the profiles. The case is pending.
- Company involved
- Clarifai Inc.
- AI system involved
- Clarifai facial recognition tools
10 source articles · read the reporting →
Teenager's fake congressional candidate verified on Twitter using AI-generated face
A 17-year-old high school student created a fake Republican congressional candidate named Andrew Walz for Rhode Island. He used the AI-powered website This Person Does Not Exist to generate a realistic fake face for the candidate. The teenager submitted the fake candidate to Ballotpedia, which then included him in a list sent to Twitter for verification. Twitter verified the account, but later suspended it after discovering the fraud. Ballotpedia acknowledged the mistake and updated its policy.
- Company involved
- Twitter
- AI system involved
- This Person Does Not Exist
10 source articles · read the reporting →