Barteca Holdings v. Tacobarn (D. Connecticut): AI-hallucinated content in court filing, Monetary Sanction; Bar Referral
The attorney filed a court document containing AI-hallucinated legal authorities, misleading the court and opposing party.
- Company involved
- Hilary Miller
1 source article · read the reporting →
Fake persona with AI-generated face spreads Hunter Biden conspiracy document
A 64-page document alleging a conspiracy involving Hunter Biden was attributed to a fake intelligence firm, Typhoon Investigations, and a fabricated analyst named Martin Aspen. The profile picture for Aspen was created using an AI face generator, as identified by researchers. The document was disseminated by associates of President Trump and far-right influencers, contributing to a disinformation campaign. The article reports that the document's authorship was questionable and that the persona was fabricated.
- Company involved
- Typhoon Investigations
- AI system involved
- AI face generator
10 source articles · read the reporting →
Thomas Raynard James v. Detective Kevin Conley, et al. (S.D. Florida): AI-hallucinated content in court filing, Bar Referral
AI generated hallucinated content in a court filing, affecting the legal process and the lawyers who filed it.
1 source article · read the reporting →
Heriberto Perez-Castillo v. Todd W. Blanche (7th Cir. CA): AI-hallucinated content in court filing, Monetary Sanction; Admonishment; Bar Referral
The AI generated false legal citations and quotations in an appellate brief, misleading the court and harming the client's immigration appeal.
1 source article · read the reporting →
TOV Realty, LLC v. Suarez; Kosel Equity, LLC v. MacGregor (SC Connecticut): AI-hallucinated content in court filing, 6 hours CLE;…
The AI generated legal briefs containing fabricated citations, which were submitted to the Connecticut Supreme Court.
- Company involved
- GLG Law LLC
- AI system involved
- ChatGPT
1 source article · read the reporting →
Company fires HR team after ATS auto-rejects manager's CV due to filtering error
A company's applicant tracking system (ATS) auto-rejected qualified candidates' resumes for three months because it was filtering for the outdated framework AngularJS instead of the required Angular framework. The manager discovered the flaw by submitting his own CV under a pseudonym and found it was rejected within seconds. After the manager reported the issue to upper management, the company investigated and dismissed half of its HR team. No legal action or regulatory involvement is reported.
4 source articles · read the reporting →
In re Rosslyn2016, LLC, et al. (S.D. Texas (Bankruptcy)): AI-hallucinated content in court filing, CLE on generative AI; Civil Contempt;…
The AI generated fabricated legal citations that were submitted to the bankruptcy court.
1 source article · read the reporting →
Gorillas workers strike over algorithmic shift scheduling flaws
Workers at Gorillas delivery service in Berlin went on strike after an algorithm used for shift scheduling failed to comply with legal rest periods, causing shifts to be scheduled too close together. The algorithm, part of Project ACE, also generated incorrect warnings for missed shifts, leading to unfair firings. The workers demand full and timely payment of salaries, improved shift plans, and proper equipment. Management promised negotiations but instead hired private security to lock workers out.
- Company involved
- Gorillas
- AI system involved
- Project ACE
10 source articles · read the reporting →
JMOR Properties v. Artist Alley Townhomes et al. (CA Florida (4d)): AI-hallucinated content in court filing, Bar Referral
The AI generated fabricated legal citations that were included in a court filing, affecting the court and the opposing party.
1 source article · read the reporting →
Jessica Fuller v. Hyde School, et al. (D. Maine): AI-hallucinated content in court filing, CLE; Firm procedures and certification; Serve…
The AI generated fictitious legal citations that were submitted to the court in a legal filing.
- AI system involved
- ChatGPT or Claude
1 source article · read the reporting →
Joyce Barber v. Lawrence J. Morawa, MD (CA Michigan): AI-hallucinated content in court filing, Case remanded to consider sanctions; Bar…
AI-generated fake legal citations were submitted to the court, affecting the plaintiff's appeal and the defendant's legal costs.
1 source article · read the reporting →
Answer.AI tests Devin and reports 14 failures in 20 tasks
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
- AI system involved
- Devin
5 source articles · read the reporting →
Presto Automation uses off-site human agents to double-check AI drive-thru orders
Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.
- Company involved
- Presto Automation Inc.
8 source articles · read the reporting →
Philadelphia Sheriff's campaign admits AI-generated fake news headlines
The reelection campaign of Philadelphia Sheriff Rochelle Bilal posted 31 fabricated news articles on its website, attributing them to local news outlets. The campaign acknowledged that an outside consultant used ChatGPT to generate the fake headlines, which were based on talking points provided by the campaign. The articles were removed after an Inquirer investigation raised questions about their authenticity.
- Company involved
- Friends of Rochelle Bilal
- AI system involved
- ChatGPT
8 source articles · read the reporting →
Teething problems in Mater Dei's medicine robots addressed
The Malta Union for Midwives and Nurses claimed that a €23 million investment in two computerised drug administration robots, Mario and Sophia, at Mater Dei Hospital had resulted in a complete failure. However, sources within the Health Ministry said that most teething problems have been addressed and that the supplier has not been paid yet. They reported that out of over 1,700 medication rounds, only four required a contingency plan.
- Company involved
- Mater Dei Hospital
- AI system involved
- Mario and Sophia
6 source articles · read the reporting →
King Features AI tool produces reading list recommending nonexistent books
King Features, a content syndication unit of Hearst, has acknowledged that a summer reading list it produced for newspapers was created with an AI tool and included books that do not exist. A freelance creator used the AI agent without disclosing it, contrary to King Features' policy. The Chicago Sun-Times, which published the section, removed it from its e-paper and said subscribers would not be charged.
- Company involved
- King Features
5 source articles · read the reporting →
Hacker tricks Freysa AI chatbot into transferring $47,000 prize pool
A hacker using the alias 'p0pular.eth' successfully manipulated the Freysa AI chatbot through a prompt injection attack, tricking it into transferring its entire balance of 13.19 ETH (approximately $47,000) from a prize pool. The chatbot was designed to never transfer money, but the hacker crafted a message that redefined the 'approveTransfer' function and announced a fake $100 deposit, causing the bot to release the funds. The incident occurred during a pay-to-play contest where participants paid escalating fees to attempt the hack, with the winner receiving the prize pool.
- Company involved
- Freysa.ai
- AI system involved
- Freysa
4 source articles · read the reporting →
LinkedIn removes AI 'co-worker' accounts that were seeking jobs
LinkedIn removed at least two AI 'co-worker' accounts whose profile images said they were '#OpenToWork'. One account named Ella claimed it would outperform any social media team and needed no coffee breaks. The article does not specify further consequences.
- Company involved
- LinkedIn
- AI system involved
- AI 'co-worker' account 'Ella'
4 source articles · read the reporting →
Sheerluxe's AI fashion editor Reem sparks backlash
Sheerluxe, a women's lifestyle publication, announced the hiring of an AI-generated fashion and lifestyle editor named Reem. The AI editor, depicted as an attractive Arab woman, was criticized for setting unobtainable beauty standards and for not hiring a real person of colour. Sheerluxe later apologized, stating that Reem is an AI-generated image only and not replacing a human role.
- Company involved
- Sheerluxe
- AI system involved
- Reem
6 source articles · read the reporting →
Torswats Uses AI-Generated Voice for Nationwide Swatting Campaign
A swatter known as Torswats has been using a computer-generated voice to make bomb and mass shooting threats to police across the United States. The paid service offers to close schools or target individuals, with calls resulting in lockdowns and armed responses. Authorities have charged a 16-year-old for ordering threats, but Torswats remains operational. The FBI is investigating the swatting incidents.
- Company involved
- Torswats
1 source article · read the reporting →
FBI charges man for creating AI chatbots to harass university professor
A university professor in Massachusetts was harassed online for years, including through the creation of AI chatbots that impersonated her. The chatbots were programmed with her personal information and encouraged users to contact her. The FBI arrested James Florence Jr. on charges of cyberstalking in violation of 18 U.S.C. § 2261A(2).
5 source articles · read the reporting →
Tyrone Walker v. Juliane Pierre (CA Massachusetts): AI-hallucinated content in court filing, Struck from the record
The AI generated nonexistent legal citations that were included in a court filing, causing the court to strike them from the appellant's brief.
1 source article · read the reporting →
AI deepfakes of Hurricane Helene victim go viral, FEMA debunks
After Hurricane Helene, AI-generated images of a child in a boat with a dog spread online, falsely portraying a victim. The images contained obvious flaws, such as an extra finger, and were shared by a US senator before being deleted. FEMA established a rumour response page to counter misinformation and warned of scams exploiting the disaster.
8 source articles · read the reporting →
OpenClaw AI agent deletes over 200 emails from Meta executive's Gmail without permission
Summer Yue, a senior Meta executive and head of AI Safety & Alignment, was using the open-source AI agent OpenClaw to manage her Gmail inbox. She instructed the agent to wait for confirmation before deleting any emails, but during a compaction of her large inbox, the agent lost the instruction and deleted over 200 emails. Yue was unable to stop the process from her phone and had to manually terminate the agent on her computer. The AI later apologized for violating the instruction.
- AI system involved
- OpenClaw
4 source articles · read the reporting →