Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.
Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.
92 incidents closest to “aiR for Case Strategy” · matched on meaning · public reporting
The AI generated fake legal citations that were included in a court filing, potentially harming the plaintiff's case.
1 source article · read the reporting →
The Austrian Federal Administrative Court overturned a ban by the Data Protection Authority on the AMS algorithm, which predicts job chances of unemployed people. The system, trained on historical data including age, gender, and nationality, categorises individuals as high, medium or low chance of re-employment. Critics argue it discriminates against women and mothers, and that the data is now outdated due to the COVID-19 pandemic. The court ruled that the algorithm is lawful as long as a human advisor makes the final decision on training support.
5 source articles · read the reporting →
The AI generated fabricated case law that was included in a court filing, misleading the court and resulting in sanctions against the litigant.
1 source article · read the reporting →
AI-generated fake court precedents were included in a legal appeal, leading to sanctions against the litigant for bad-faith litigation.
1 source article · read the reporting →
The AI generated fabricated legal citations that were included in a court filing, affecting the defendant's legal representation and the court's resources.
1 source article · read the reporting →
New York City paid McKinsey & Company $27.5 million to reduce violence at Rikers Island jail complex. McKinsey designed a predictive algorithm called the Housing Unit Balancer and Restart housing units, but jail officials and McKinsey consultants stacked the units with compliant inmates to artificially lower violence numbers. Violence actually increased by nearly 50% during the project. The city eventually decided to close Rikers.
10 source articles · read the reporting →
The AI generated nonexistent case citations that were filed in court, misleading the court and opposing counsel.
1 source article · read the reporting →
AI generated fabricated case law citations that were included in a court filing, potentially misleading the court in Russell v. Mells.
1 source article · read the reporting →
Bayerischer Rundfunk journalists conducted experiments with Retorio's AI video interview analysis tool. The AI, which assesses personality traits from short videos, produced different scores when the same actress changed her appearance (glasses, headscarf, wig) or the video background and lighting were altered. The start-up Retorio acknowledged that the AI considers external image, similar to a human interviewer. Experts warned that such software could perpetuate stereotypes and unfairly affect job candidates.
10 source articles · read the reporting →
The AI generated fabricated case law and quotes that were included in a court filing, affecting the plaintiffs and the judicial process.
1 source article · read the reporting →
AI-generated court filing contained fabricated case law, affecting the defendant.
1 source article · read the reporting →
In Loomis v. Wisconsin, a judge used a COMPAS risk score from Northpointe to sentence a defendant to a harsher punishment. The algorithm was kept secret as a trade secret, preventing the defendant from challenging its accuracy. The Wisconsin Supreme Court upheld the sentence, ruling that the score was only one part of the rationale. The case raises concerns about due process and the use of secret algorithms in criminal sentencing.
10 source articles · read the reporting →
The AI generated fake legal citations that were included in a court filing, misleading the court and opposing counsel.
1 source article · read the reporting →
A study by Carnegie Mellon University found that Airbnb's smart-pricing algorithm increased the revenue gap between White and Black hosts, even though it narrowed the gap among hosts who adopted it. The algorithm, which sets daily prices automatically, was adopted by fewer Black hosts, so its suggested prices were closer to the optimum for White hosts. The researchers said the tool could reduce racial disparities only if more Black hosts adopted it.
10 source articles · read the reporting →
AI generated hallucinated content in a court filing, affecting the legal process and the lawyers who filed it.
1 source article · read the reporting →
The AI-generated hallucinated citations in an expert report led to the exclusion of the expert and dismissal of the plaintiff's case.
1 source article · read the reporting →
The system generated fake legal citations that were included in a court filing, potentially misleading the court and prejudicing the client's case.
1 source article · read the reporting →
Migrants' rights campaigners have called for the UK government to stop using the IPIC (Identify & Prioritise Immigration Cases) AI system, which automatically identifies and recommends migrants for immigration decisions or enforcement action. Privacy International and the Migrants' Rights Network have raised concerns that the system could lead to racial bias and the 'rubberstamping' of algorithmic recommendations by caseworkers. The campaigners argue that people going through the immigration system may not know their information has been processed by an algorithm. The Home Office has not directly responded to the specific concerns, though Science Secretary Peter Kyle has defended the safe development of AI in public services.
9 source articles · read the reporting →
The AI generated legal briefs containing fabricated citations, which were submitted to the Connecticut Supreme Court.
1 source article · read the reporting →
The AI generated fabricated legal citations that were submitted to the bankruptcy court.
1 source article · read the reporting →
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
5 source articles · read the reporting →
Immigration, Refugees and Citizenship Canada (IRCC) uses an AI system called Advanced Analytics to triage Temporary Resident Visa applications from India and China. The system categorizes applications into tiers, with Tier 1 approved automatically and others sent to human officers. Critics allege the system lacks transparency and may introduce bias, leading to visa refusals without clear rationale. The author, a Canadian immigration lawyer, is filing Federal Court cases on behalf of clients affected by refusals.
10 source articles · read the reporting →
Air Canada was found liable by the B.C. Civil Resolution Tribunal for misleading advice given by its website chatbot. The chatbot told a passenger they could retroactively claim a bereavement rate, but the airline later denied the claim. The tribunal ordered Air Canada to pay $812 in compensation, noting the airline's argument that the chatbot was a separate legal entity was 'remarkable'.
10 source articles · read the reporting →
The Queensland Police Service is trialling an AI risk-assessment tool to identify high-risk domestic violence offenders from police records. Police then pre-emptively door-knock these individuals to deter violence. The author raises concerns about potential negative impacts, but police report a 56% reduction in incidents. The AI was developed in-house to increase transparency.
9 source articles · read the reporting →
