CPS apologises after AI generates fake legal citations in court documents
The Crown Prosecution Service (CPS) used generative AI to draft court documents for extradition appeals, resulting in the inclusion of non-existent legal authorities. The error was identified by opposing counsel before the hearing and had no impact on the outcome. The CPS apologised to the High Court, attributing the mistake to a failure by a reviewing lawyer to verify the AI-generated content, and undertook an internal review to prevent recurrence. The judge accepted the apology and noted the serious risks of using AI without proper oversight.
- Company involved
- Crown Prosecution Service
1 source article · read the reporting →
Neighbors say PAX-1 data center blasting rattles homes in Middlesex Township
Neighbours of the PAX-1 (Pennsylvania Digital 1) data centre under construction in Middlesex Township, Cumberland County, say blasting and drilling rattle their homes and make it impossible to be outdoors. A resident of a nearby mobile home community reported new cracks in her home after the blasts.
- Company involved
- Pennsylvania Digital 1
- AI system involved
- PAX-1 data centre
1 source article · read the reporting →
AI-Generated Fake Investment Websites Target Australian Fraud Analyst
A fraud analyst, Leon, was targeted by scammers who used AI to create convincing fake websites for non-existent investment firms. The scammers posed as employees of Assent Advisory and directed him to elaborate sites for APPC Capital Singapore and Thackeray Mines and Minerals Inc., complete with AI-generated images and fake details. Leon recognised the scam, but the sophistication of the AI-generated content made him second-guess his own judgment. The incident highlights how AI is enabling more convincing investment scams.
1 source article · read the reporting →
Cadillac Fairview malls use facial recognition without consent
At least two Calgary malls owned by Cadillac Fairview, Chinook Centre and Market Mall, deployed facial recognition software in their directories to estimate shoppers' ages and genders without notifying them or obtaining consent. The software, provided by MappedIn, counts users and predicts demographics but does not store images, which the company claims makes consent unnecessary. Privacy advocates expressed concern that the data could be combined with other information to profile individuals, and noted that under Alberta's PIPA, notification is required for collection of personal information. The malls did not offer an opt-out, and the practice was ongoing as of July 2018.
- Company involved
- Cadillac Fairview
- AI system involved
- MappedIn
1 source article · read the reporting →
PredPol crime predictions disproportionately targeted Black and Latino neighborhoods
Between 2018 and 2021, PredPol software sent millions of crime predictions to U.S. police departments. An analysis of unsecured data found that predictions overwhelmingly targeted Black, Latino, and low-income neighborhoods, while whiter, wealthier areas were largely avoided. The company claimed the software was bias-free, but the data showed persistent racial and economic disparities. Many police departments have since stopped using the software.
- AI system involved
- PredPol
10 source articles · read the reporting →
Florida Title Company Stops AI Deepfake Property Fraud Attempt
A title company owner in Hallandale Beach, Florida, detected an attempted property fraud using a deepfake video. The scammer posed as the owner of a vacant lot, providing a fake driver's licence and a looped video during a video call. The title company owner noticed the video was not interactive and halted the sale. The true owner's property tax bills had been sent to the Bahamas, and the scammer used a photo of a missing woman from California.
- Company involved
- Florida Title and Trust
4 source articles · read the reporting →
Dutch city uses black-box algorithm for home valuation
In 2016, the municipality of Castricum, Netherlands, used an algorithm to set the WOZ value of a resident's home at €320,000, affecting their property tax. The resident challenged the valuation, arguing earthquake damage reduced the value, but the municipality could not explain how the algorithm arrived at the figure. On appeal, an Amsterdam court upheld the valuation, finding it reasonable based on comparable sales, but ordered the municipality to pay court costs for failing to provide an explanation as required by GDPR.
- Company involved
- Municipality of Castricum
1 source article · read the reporting →
Sound Intelligence Aggression Detectors Prove Unreliable in School Tests
ProPublica tested Sound Intelligence's aggression detection software, used in hundreds of U.S. schools and hospitals. The algorithm, which analyzes audio for signs of stress and anger, frequently misidentified innocent sounds like coughing as aggressive and failed to detect actual screams. At a New Jersey hospital, the system ignored an agitated man screaming and pounding a desk, escalating the situation. Sound Intelligence's CEO acknowledged the imperfections but defended the technology as an early warning system.
- AI system involved
- Sound Intelligence aggression detector
2 source articles · read the reporting →
Anthropic accuses Chinese labs of illicitly distilling Claude
Anthropic accused three Chinese AI labs—DeepSeek, Moonshot, and MiniMax—of running industrial-scale distillation campaigns to extract capabilities from its Claude model. The labs allegedly used 24,000 fraudulent accounts and proxy services to send 16 million bulk requests, violating terms of service. Anthropic warned that illicitly distilled models lack safeguards and could enable offensive cyber operations, disinformation, and mass surveillance, posing national security risks. The company called for stronger export controls.
- Company involved
- Anthropic
- AI system involved
- Claude
4 source articles · read the reporting →
Canada Investigates Landlords' Use of AI Rent-Setting Software YieldStar
The Competition Bureau of Canada is investigating allegations that major corporate landlords, including Dream Unlimited, used AI-powered software YieldStar to coordinate rent increases. Tenant advocacy groups filed over 100 complaints, claiming the software recommended above-market rents, exacerbating housing affordability. Some landlords have since halted use of YieldStar amid public backlash, while the investigation continues.
- Company involved
- Dream Unlimited
- AI system involved
- YieldStar
7 source articles · read the reporting →
DC attorney general sues 14 landlords over RealPage rent collusion
The Attorney General of Washington DC filed a lawsuit against 14 large landlords, alleging they used RealPage's YieldStar software to form “a District-wide housing cartel” that artificially inflated rents. The complaint claims RealPage's pricing algorithm used data supplied by the landlords and pressurised them to follow its rate recommendations, with one firm's internal presentation stating at least 95% compliance was expected. This alleged scheme caused residents to pay millions of dollars above fair market prices during a housing affordability crisis.
- Company involved
- Greystar Management Services
- AI system involved
- YieldStar
10 source articles · read the reporting →
RCMP used IntelCenter facial recognition without disclosure
The RCMP in British Columbia secretly subscribed to IntelCenter's facial recognition service, which matched faces against a database of 700,000 faces tied to terrorism. Internal emails revealed the force broke its own procurement rules and hid the purchase. The RCMP claimed it was only for testing, but documents showed active use. The contracts ended in 2019.
- Company involved
- Royal Canadian Mounted Police (RCMP)
- AI system involved
- IntelCenter Check
10 source articles · read the reporting →
Apple Intelligence feature flags scam messages as priority alerts
Apple's 'Apple Intelligence' notification summarisation feature, introduced in late 2024, is reportedly prioritising scam messages on iPhones, iPads, and Macs. Users have reported that the AI struggles to differentiate fraudulent emails from genuine alerts, with one user seeing a scam email claiming he owed $465 flagged as a priority. Experts warn that the summarisation removes context, potentially making scams more effective. Apple has stated it plans to update the feature to clarify when summaries are AI-generated.
- Company involved
- Apple
- AI system involved
- Apple Intelligence
5 source articles · read the reporting →
Chicago Tribune sues Perplexity AI for copyright infringement
Chicago Tribune Company, LLC filed a lawsuit against Perplexity AI, Inc. in the Southern District of New York on December 4, 2025. The complaint alleges copyright infringement under 17 U.S.C. § 501. The case is assigned to Judge Loretta A. Preska.
- Company involved
- Perplexity AI, Inc.
5 source articles · read the reporting →
Durham Police uses Experian Mosaic data in HART AI risk tool
Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.
- Company involved
- Durham Constabulary
- AI system involved
- Harm Assessment Risk Tool (HART)
9 source articles · read the reporting →
RealPage's YieldStar algorithm pushes rents higher for tenants
RealPage's YieldStar algorithm uses private competitor data to recommend rent increases for apartment units. Landlords adopt up to 90% of the suggestions, leading to higher rents for tenants. Critics allege the software may facilitate indirect price-fixing in violation of antitrust law. The company denies wrongdoing and says the software helps eliminate collusion.
- Company involved
- RealPage
- AI system involved
- YieldStar
10 source articles · read the reporting →
U.S. Border Patrol uses AI and ALPR to target drivers for pretext stops and asset seizures
The U.S. Border Patrol has built a nationwide dragnet driver-surveillance system using automated license plate readers and AI to flag suspicious travel patterns. Local police then pull over targeted drivers on pretexts, interrogate them, and seize cash and vehicles through civil asset forfeiture. The program has been kept secret, with details hidden from court documents and the public. The ACLU report highlights the abuse of innocent drivers and calls for congressional action.
- Company involved
- U.S. Border Patrol (CBP)
- AI system involved
- Automated license plate reader (ALPR) system with AI analytics
6 source articles · read the reporting →
KPMG drops AI report after false case studies exposed
KPMG removed a global report on AI after multiple case studies were found to be inaccurate and apparently generated from AI hallucinations. The report falsely claimed that UBS, NHS Greater Manchester, Swiss Federal Railways and Transport for London used AI agents in various ways. The companies denied the claims, and KPMG took the report down while reviewing its production.
- Company involved
- KPMG
3 source articles · read the reporting →
King's Cross developer scraps facial recognition after public outcry
The developer of the King's Cross site in London admitted it had used facial recognition software in two cameras on a busy pedestrian street between May 2016 and March 2018 without public consent. Following a backlash and questions from the Information Commissioner's Office, the developer announced it would not deploy the technology in the future and had abandoned plans for wider use. The system was used to help police detect crime, but critics highlighted the lack of transparency and privacy concerns.
- Company involved
- King's Cross development (Argent-led consortium)
10 source articles · read the reporting →
Cense exposed 2.5 million records of auto accident victims online
On July 7, 2020, a security researcher discovered 2.5 million records containing personal and medical data of auto accident victims exposed online. The records, belonging to New York-based AI company Cense, included names, insurance policy numbers, claim numbers, and medical diagnosis notes. The data was labeled as staging data, possibly intended for temporary storage before being loaded into an AI system. After the researcher sent a responsible disclosure notice, Cense restricted public access to the database.
- Company involved
- Cense
- AI system involved
- Cense
5 source articles · read the reporting →
CivitAI hosts AI models generating non-consensual porn of real people
A 404 Media investigation found that CivitAI, a platform for sharing AI image generation models, hosts numerous models that can produce pornographic images of real people without their consent. These models are trained on images scraped from the internet, and have been downloaded tens of thousands of times, enabling widespread creation of non-consensual sexual content. Sex workers and public figures are particularly affected, with no remediation or recourse reported.
- Company involved
- CivitAI
7 source articles · read the reporting →
UK councils use Covid OneView AI to harvest personal data for risk scoring
UK local authorities are using a system called Covid OneView, developed by data analytics firm Xantura, to harvest millions of personal details from council records. The system uses predictive analytics and AI to assign risk scores to households and individuals, aiming to identify those vulnerable to Covid or likely to break lockdown rules. Privacy campaigners and MPs have criticised the lack of transparency and the extent of data collection, which includes sensitive information such as debt levels, living arrangements, and even notes on unfaithful sex. Xantura and Barking and Dagenham Council have defended the system as compliant with data protection rules and focused on providing support.
- Company involved
- UK local authorities
- AI system involved
- Covid OneView
6 source articles · read the reporting →
Guangxi homeowners lose homes in facial recognition fraud
Over 10 homeowners in Guangxi, China, were defrauded by a real estate agent who used the government's '邕e登' app to transfer their property without consent. The agent tricked them into using facial recognition for what they thought was file checking, but instead the system processed property transfers. The agent has been arrested and the case is under investigation. The local government has restricted the properties and plans to upgrade the app's security.
- Company involved
- 南宁市自然资源局
- AI system involved
- 邕e登
10 source articles · read the reporting →
Clearview AI tested facial recognition surveillance cameras with UFT and Rudin
Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.
- Company involved
- Clearview AI
- AI system involved
- Insight Camera
9 source articles · read the reporting →
