Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.
Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.
68 incidents closest to “aiR for Case Strategy” · matched on meaning · public reporting
The AI tool generated fictitious case law citations that were included in a court filing, affecting the plaintiff and the court.
1 source article · read the reporting →
The Department of Government Efficiency developed an AI tool to identify unnecessary VA contracts, but it used outdated models and lacked context, leading to misclassification. At least 24 contracts were canceled, affecting cancer research and nurse care tools. The VA acknowledged the tool's role but stated all contracts undergo human review. Experts criticized the use of AI for such complex decisions.
2 source articles · read the reporting →
Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.
9 source articles · read the reporting →
The father's court filing contained AI-generated fake case citations, leading to a costs order against him.
1 source article · read the reporting →
The lawyer submitted AI-generated court documents containing false citations and quotes, harming his client's discrimination case.
1 source article · read the reporting →
Air Canada's customer service chatbot allegedly fabricated a discount during a conversation with a customer last year. The incident resulted in a court case against the airline. Insurer Armilla stated that its new AI mishap policy would have covered the loss from selling tickets at the discounted price if the chatbot was found to have underperformed.
6 source articles · read the reporting →
The AI generated fabricated legal citations that were presented to the court, affecting the defendants and the judicial process.
1 source article · read the reporting →
The Austrian Public Employment Service (AMS) uses an algorithm to classify job seekers into categories A, B, and C, determining their access to benefits and training. Scientists from TU Wien, WU Wien, and University of Vienna have criticised the algorithm for lacking transparency, as only two of 96 model variants have been published. They allege that the system may discriminate against women and people with migration background, and that job seekers are not informed about how the algorithm works or given a chance to appeal.
10 source articles · read the reporting →
The AI system generated hallucinated legal citations in court filings, causing the court to strike the briefs of both plaintiff and defendant.
1 source article · read the reporting →
The AI generated fake legal citations that were included in a court filing, potentially harming the plaintiff's case.
1 source article · read the reporting →
The Austrian Federal Administrative Court overturned a ban by the Data Protection Authority on the AMS algorithm, which predicts job chances of unemployed people. The system, trained on historical data including age, gender, and nationality, categorises individuals as high, medium or low chance of re-employment. Critics argue it discriminates against women and mothers, and that the data is now outdated due to the COVID-19 pandemic. The court ruled that the algorithm is lawful as long as a human advisor makes the final decision on training support.
5 source articles · read the reporting →
The AI generated fabricated case law that was included in a court filing, misleading the court and resulting in sanctions against the litigant.
1 source article · read the reporting →
AI-generated fake court precedents were included in a legal appeal, leading to sanctions against the litigant for bad-faith litigation.
1 source article · read the reporting →
The AI generated fabricated legal citations that were included in a court filing, affecting the defendant's legal representation and the court's resources.
1 source article · read the reporting →
New York City paid McKinsey & Company $27.5 million to reduce violence at Rikers Island jail complex. McKinsey designed a predictive algorithm called the Housing Unit Balancer and Restart housing units, but jail officials and McKinsey consultants stacked the units with compliant inmates to artificially lower violence numbers. Violence actually increased by nearly 50% during the project. The city eventually decided to close Rikers.
10 source articles · read the reporting →
Bayerischer Rundfunk journalists conducted experiments with Retorio's AI video interview analysis tool. The AI, which assesses personality traits from short videos, produced different scores when the same actress changed her appearance (glasses, headscarf, wig) or the video background and lighting were altered. The start-up Retorio acknowledged that the AI considers external image, similar to a human interviewer. Experts warned that such software could perpetuate stereotypes and unfairly affect job candidates.
10 source articles · read the reporting →
The AI generated fabricated case law and quotes that were included in a court filing, affecting the plaintiffs and the judicial process.
1 source article · read the reporting →
AI-generated court filing contained fabricated case law, affecting the defendant.
1 source article · read the reporting →
In Loomis v. Wisconsin, a judge used a COMPAS risk score from Northpointe to sentence a defendant to a harsher punishment. The algorithm was kept secret as a trade secret, preventing the defendant from challenging its accuracy. The Wisconsin Supreme Court upheld the sentence, ruling that the score was only one part of the rationale. The case raises concerns about due process and the use of secret algorithms in criminal sentencing.
10 source articles · read the reporting →
The AI generated fake legal citations that were included in a court filing, misleading the court and opposing counsel.
1 source article · read the reporting →
A study by Carnegie Mellon University found that Airbnb's smart-pricing algorithm increased the revenue gap between White and Black hosts, even though it narrowed the gap among hosts who adopted it. The algorithm, which sets daily prices automatically, was adopted by fewer Black hosts, so its suggested prices were closer to the optimum for White hosts. The researchers said the tool could reduce racial disparities only if more Black hosts adopted it.
10 source articles · read the reporting →
AI generated hallucinated content in a court filing, affecting the legal process and the lawyers who filed it.
1 source article · read the reporting →
The AI-generated hallucinated citations in an expert report led to the exclusion of the expert and dismissal of the plaintiff's case.
1 source article · read the reporting →
The system generated fake legal citations that were included in a court filing, potentially misleading the court and prejudicing the client's case.
1 source article · read the reporting →
