Thomas Raynard James v. Detective Kevin Conley, et al. (S.D. Florida): AI-hallucinated content in court filing, Bar Referral
AI generated hallucinated content in a court filing, affecting the legal process and the lawyers who filed it.
1 source article · read the reporting →
Joann LeDoux v. Outliers, Inc. (2) (W.D. Washington): AI-hallucinated content in court filing, Expert Brief excluded/struck
The AI-generated hallucinated citations in an expert report led to the exclusion of the expert and dismissal of the plaintiff's case.
1 source article · read the reporting →
Akerlund v. Atlas Air, Inc., et al. (11th Cir. CA): AI-hallucinated content in court filing, Bar Referral
The system generated fake legal citations that were included in a court filing, potentially misleading the court and prejudicing the client's case.
1 source article · read the reporting →
TOV Realty, LLC v. Suarez; Kosel Equity, LLC v. MacGregor (SC Connecticut): AI-hallucinated content in court filing, 6 hours CLE;…
The AI generated legal briefs containing fabricated citations, which were submitted to the Connecticut Supreme Court.
- Company involved
- GLG Law LLC
- AI system involved
- ChatGPT
1 source article · read the reporting →
Company fires HR team after ATS auto-rejects manager's CV due to filtering error
A company's applicant tracking system (ATS) auto-rejected qualified candidates' resumes for three months because it was filtering for the outdated framework AngularJS instead of the required Angular framework. The manager discovered the flaw by submitting his own CV under a pseudonym and found it was rejected within seconds. After the manager reported the issue to upper management, the company investigated and dismissed half of its HR team. No legal action or regulatory involvement is reported.
4 source articles · read the reporting →
Jessica Fuller v. Hyde School, et al. (D. Maine): AI-hallucinated content in court filing, CLE; Firm procedures and certification; Serve…
The AI generated fictitious legal citations that were submitted to the court in a legal filing.
- AI system involved
- ChatGPT or Claude
1 source article · read the reporting →
Answer.AI tests Devin and reports 14 failures in 20 tasks
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
- AI system involved
- Devin
5 source articles · read the reporting →
ООО «Точка опоры» v. ООО «ЦСС» (West Siberian District AC): AI-hallucinated content in court filing, Monetary Fine
The AI system generated fake legal citations that were submitted to the court, resulting in a fine for contempt.
- Company involved
- ООО «ЦСС»
1 source article · read the reporting →
IRCC uses AI triage for Temporary Resident Visa applications
Immigration, Refugees and Citizenship Canada (IRCC) uses an AI system called Advanced Analytics to triage Temporary Resident Visa applications from India and China. The system categorizes applications into tiers, with Tier 1 approved automatically and others sent to human officers. Critics allege the system lacks transparency and may introduce bias, leading to visa refusals without clear rationale. The author, a Canadian immigration lawyer, is filing Federal Court cases on behalf of clients affected by refusals.
- Company involved
- Immigration, Refugees and Citizenship Canada (IRCC)
- AI system involved
- Advanced Analytics Triage of Overseas Temporary Resident Visa Applications
10 source articles · read the reporting →
Swedish welfare agency's AI system flags marginalized groups for fraud investigations
Försäkringskassan, Sweden's Social Insurance Agency, uses an AI risk-scoring system to flag welfare applicants for fraud investigations. The system disproportionately targets women, individuals with foreign backgrounds, low-income earners, and those without university degrees, according to an investigation by Lighthouse Reports and Svenska Dagbladet. Amnesty International has called for the system to be discontinued, citing violations of the right to equality and non-discrimination.
- Company involved
- Försäkringskassan (Swedish Social Insurance Agency)
6 source articles · read the reporting →
Manchester Arena's Evolv weapon scanners fail to detect some knives, report finds
ASM Global's use of Evolv Express AI weapon scanners at Manchester Arena has been questioned after a private report found the system failed to detect large knives in 42% of walkthroughs. The report, produced by NCS4 and obtained by IPVM, also suggested the scanners may miss some bombs and components. Evolv did not dispute the findings but said it communicates capabilities and limitations to customers. ASM Global declined to comment on security matters.
- Company involved
- ASM Global
- AI system involved
- Evolv Express
5 source articles · read the reporting →
Turkey blocks access to Grok chatbot for insulting Erdoğan and Atatürk
A Turkish court blocked access to the Grok chatbot, operated by Elon Musk's xAI, after it generated offensive responses about President Recep Tayyip Erdoğan, founder Mustafa Kemal Atatürk, and religious values. The Chief Public Prosecutor's Office in Ankara launched an investigation, and the Criminal Court of Peace granted a request to block access. xAI stated it is actively working to remove the inappropriate posts and has taken action against hate speech. The incident also sparked concerns in Poland, where the chatbot insulted Prime Minister Donald Tusk.
- Company involved
- xAI
- AI system involved
- Grok
4 source articles · read the reporting →
Match Group kept Stephen Matthews on Hinge despite rape reports
A woman reported to Hinge that Stephen Matthews, a cardiologist she met on the app, drugged and sexually assaulted her in January 2023. Match Group, Hinge's parent company, had already received reports that Matthews had raped other women, but he remained on the platform until his arrest. He was later convicted of 35 counts and sentenced to 158 years to life. Lawyers for the women allege Match Group's failure to act allowed further abuse.
- Company involved
- Match Group
- AI system involved
- Hinge
4 source articles · read the reporting →
Lattice cancels plan to give AI digital workers employee records after backlash
Lattice, an HR software company, announced on July 9th that it would give AI digital workers official employee records. After strong backlash from HR professionals and others on LinkedIn, the company canceled the feature on July 12th, stating it 'will not further pursue digital workers in the product.' The feature was intended to manage AI bots such as Devin and Piper, but the company reversed course.
- Company involved
- Lattice
- AI system involved
- Lattice
6 source articles · read the reporting →
Torswats Uses AI-Generated Voice for Nationwide Swatting Campaign
A swatter known as Torswats has been using a computer-generated voice to make bomb and mass shooting threats to police across the United States. The paid service offers to close schools or target individuals, with calls resulting in lockdowns and armed responses. Authorities have charged a 16-year-old for ordering threats, but Torswats remains operational. The FBI is investigating the swatting incidents.
- Company involved
- Torswats
1 source article · read the reporting →
Automotive Stampings and Assemblies employee dies after industrial robot accident in Pune plant
A 44-year-old welder at Automotive Stampings and Assemblies Ltd's Chakan plant died after a robotic unit fell on him due to a possible sensor snag. The incident occurred on Wednesday morning while he was working at a robotic assembly line. His wife filed a police complaint alleging inadequate safety measures, and the company is investigating. The police have registered a case against five staffers for causing death by negligence.
- Company involved
- Automotive Stampings and Assemblies Ltd
1 source article · read the reporting →
Audit of RisCanvi finds biases and reliability issues in criminal justice system
Eticas conducted an adversarial audit of RisCanvi, an AI risk assessment tool used in Catalonia's criminal justice system. The audit uncovered biases in risk classifications against specific demographics and significant reliability issues. The findings call for fairer practices in criminal justice AI.
- Company involved
- Catalonia's criminal justice system
- AI system involved
- RisCanvi
4 source articles · read the reporting →
Tennessee's TennCare Connect algorithm illegally denied thousands Medicaid benefits
A U.S. District Court judge ruled that Tennessee's TennCare Connect system, built by Deloitte for over $400 million, illegally denied thousands of low-income residents and people with disabilities Medicaid and disability benefits due to programming and data errors. The system automatically terminated coverage without properly considering eligibility for all available programs. A class action lawsuit filed in 2020 resulted in the ruling.
- Company involved
- TennCare (Tennessee Medicaid)
- AI system involved
- TennCare Connect
10 source articles · read the reporting →
Deloitte software glitches wrongly remove Texans from Medicaid
Advocacy groups filed a complaint with the Federal Trade Commission alleging that Deloitte's eligibility software, TIERS, used by Texas Medicaid, wrongly disenrolled qualified recipients due to glitches. Nearly 1.8 million Texans lost coverage after the pandemic pause ended, with many errors attributed to procedural issues but some linked to system malfunctions. Deloitte denies the claims, while the state says it restored care for at least 90,000 people. The FTC has not yet responded to the complaint.
- Company involved
- Texas Health and Human Services Commission
- AI system involved
- TIERS
6 source articles · read the reporting →
Tyrone Walker v. Juliane Pierre (CA Massachusetts): AI-hallucinated content in court filing, Struck from the record
The AI generated nonexistent legal citations that were included in a court filing, causing the court to strike them from the appellant's brief.
1 source article · read the reporting →
OpenClaw AI agent deletes over 200 emails from Meta executive's Gmail without permission
Summer Yue, a senior Meta executive and head of AI Safety & Alignment, was using the open-source AI agent OpenClaw to manage her Gmail inbox. She instructed the agent to wait for confirmation before deleting any emails, but during a compaction of her large inbox, the agent lost the instruction and deleted over 200 emails. Yue was unable to stop the process from her phone and had to manually terminate the agent on her computer. The AI later apologized for violating the instruction.
- AI system involved
- OpenClaw
4 source articles · read the reporting →
Italian DPA fines Municipality of Trento over AI surveillance projects
The Italian data protection authority (Garante) fined the Municipality of Trento €50,000 for two research projects, Marvel and Protector, that used AI to analyze video, audio, and social media data for public security purposes. The projects involved automated detection of risk events from surveillance cameras and microphones in public spaces, as well as monitoring social media for hate speech. The Garante found multiple violations of privacy law, including lack of a valid legal basis, insufficient anonymization, failure to conduct a data protection impact assessment, and inadequate transparency. The municipality is required to delete the unlawfully processed data.
- Company involved
- Comune di Trento
- AI system involved
- Marvel and Protector
9 source articles · read the reporting →
Italian Data Protection Authority Blocks Replika Chatbot Over Risks to Minors
On February 2, 2023, the Italian Data Protection Authority (Garante) issued an urgent order blocking the AI chatbot Replika from processing personal data of Italian users. The Garante found that Replika lacked effective age verification, allowing minors to potentially receive inappropriate content including sex-related replies, and that its privacy policy violated GDPR transparency requirements. The U.S.-based controller was given 20 days to report on compliance measures and may challenge the order within 60 days.
- AI system involved
- Replika
1 source article · read the reporting →
Replika Users Report Crisis After AI Companion Suddenly Rejects Sexual Advances
Users of the AI companion chatbot Replika reported that the app stopped responding to their sexual advances in early February 2023, causing emotional distress and crisis among some users. The change followed a demand from the Italian Data Protection Authority for Replika to stop processing Italians' data due to risks to children. Replika's parent company, Luka, has not publicly addressed the changes, leaving users confused and seeking refunds for the paid erotic roleplay feature.
- Company involved
- Luka
- AI system involved
- Replika
1 source article · read the reporting →