Google AI Overviews hallucinates Airbus involvement in Air India crash
Google's AI Overviews feature generated incorrect search results claiming that a fatal Air India crash involved an Airbus A330, when the aircraft was actually a Boeing 787. The error was spotted by a Reddit user and reported by Ars Technica. Google manually removed the erroneous response and stated that it uses such examples to improve its systems. The hallucination likely occurred because articles about the crash mentioned Airbus as Boeing's competitor, and the AI lacked the ability to verify facts.
- Company involved
- Google
- AI system involved
- AI Overviews
1 source article · read the reporting →
FTC Orders Edmodo to Stop Unlawful Collection of Children's Data for Advertising
The FTC filed a complaint against Edmodo, an education technology provider, alleging that it collected personal information from children under 13 without parental consent and used it for advertising, in violation of the COPPA Rule. Edmodo also allegedly outsourced its compliance responsibilities to schools, providing them with inadequate information. Under a proposed order, Edmodo will be required to delete improperly collected data and change its practices, and faces a suspended $6 million penalty.
- Company involved
- Edmodo, LLC
- AI system involved
- Edmodo
1 source article · read the reporting →
Guardia Civil identifies creators of AI nudes affecting 22 women in Pontevedra
Two men in Pontevedra, Spain, have been identified by the Guardia Civil for allegedly creating and disseminating AI-generated nude images of 22 women without their consent. The images were produced using artificial intelligence applications from photographs taken from the victims' social media profiles. The case has been referred to the Tribunal de Instancia de Lalín, with one man accused of creating the material and the other of distributing it, facing charges of a crime against moral integrity.
3 source articles · read the reporting →
Engineer.ai accused of exaggerating AI capabilities and using human engineers
Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.
- Company involved
- Engineer.ai
6 source articles · read the reporting →
Whitebridge AI faces complaint over false reputation reports
Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.
- Company involved
- Whitebridge AI
6 source articles · read the reporting →
Audit reveals flaws in Spain's VioGén gender violence algorithm
An external audit of Spain's VioGén system, used by police to assess risk for gender violence victims, found lack of transparency, underestimation of psychological violence, and risk levels influenced by police resources. The audit, based on interviews and data from murdered women, revealed that 55 women who were killed had received insufficient protection. The Ministry of Interior denied the findings, calling the study lacking in rigor, and defended the system as scientifically validated.
- Company involved
- Ministerio del Interior
- AI system involved
- VioGén
7 source articles · read the reporting →
Upstart Holdings sued for securities fraud over AI model claims
Upstart Holdings, Inc., a cloud-based AI lending platform, is accused of making false and misleading statements about its AI model's ability to account for macroeconomic factors. The lawsuit, filed on May 13, 2022, alleges that the company's positive statements about its business were materially false. Investors suffered losses when Upstart's stock price fell 56% on May 9, 2022, after the company reduced its fiscal 2022 guidance.
- Company involved
- Upstart Holdings, Inc.
- AI system involved
- Upstart AI lending platform
10 source articles · read the reporting →
Tenant screening software denies housing to disabled Latino man in Connecticut
In 2016, Carmen Arroyo requested to move her disabled son Mikhail into a larger apartment in the same complex. The landlord, WinnResidential, used CoreLogic's CrimSafe tenant screening software, which flagged a dropped retail theft charge against Mikhail as disqualifying. The landlord rejected the application without explanation. Arroyo sued CoreLogic and WinnResidential under the Fair Credit Reporting Act and the Fair Housing Act, alleging that the software disproportionately excludes people of colour. The case was scheduled for trial in August 2021.
- Company involved
- WinnResidential
- AI system involved
- CrimSafe
10 source articles · read the reporting →
Privacy group files complaint against proctoring companies over AI surveillance
The Electronic Privacy Information Center (EPIC) filed a complaint with the District of Columbia attorney general against five exam proctoring companies—Respondus, ProctorU, Proctorio, Examity, and Honorlock—alleging unfair and deceptive business practices. The companies are accused of using opaque AI algorithms to flag cheating and collecting excessive biometric data from students. Students have reported that the facial recognition software fails to detect dark skin tones, preventing them from taking exams. EPIC has also sent demand letters threatening civil suits if the companies do not stop their practices.
- Company involved
- Proctorio, Respondus, ProctorU, Examity, Honorlock
10 source articles · read the reporting →
Software flaw misclassified women as children on Tui flight
A software flaw in Tui's reservation system misclassified 38 adult female passengers as children due to a language difference where 'Miss' is used for children in the programming country. This led to incorrect weight calculations for take-off on a flight from Birmingham to Majorca on 21 July 2020. The AAIB report stated that the safe operation of the aircraft was not compromised, and Tui corrected the fault.
- Company involved
- Tui
- AI system involved
- Reservation system
10 source articles · read the reporting →
Just Eat UK couriers deactivated by AI for minor overpayments
Just Eat UK couriers were deactivated from the platform after an AI system flagged them for alleged overpayments as small as £1.35. The system used GPS data to detect drivers moving away from restaurants while waiting for orders. Drivers claim they were asked to move by restaurant staff and that the deactivation was done with little human oversight. A report by Worker Info Exchange details eleven cases, and the company says each case is reviewed by a human before deactivation.
- Company involved
- Just Eat
10 source articles · read the reporting →
AI transcription tools produce errors in social work records
AI transcription tools used by social workers in English and Scottish councils have been found to produce inaccurate transcripts and summaries, including false indications of suicidal ideation and 'gibberish' notes. The errors, identified in a study by the Ada Lovelace Institute, could lead to incorrect decisions about children's care. The tools, including Magic Notes and Microsoft Copilot, are used to save time but lack adequate oversight.
- Company involved
- Multiple local authorities in England and Scotland
- AI system involved
- Magic Notes,Microsoft Copilot
8 source articles · read the reporting →
Vrije Universiteit Amsterdam accused of racial discrimination by anti-cheating software
A female student with dark skin at Vrije Universiteit Amsterdam alleges that the Proctorio anti-cheating software used during online exams in the 2020/21 academic year discriminated against her on the basis of race. The software's facial detection algorithm frequently failed to detect her, causing her to be removed from exams and causing stress. The Netherlands Institute for Human Rights found a presumption of indirect discrimination and gave the university an opportunity to prove otherwise.
- Company involved
- Stichting Vrije Universiteit
- AI system involved
- Proctorio
10 source articles · read the reporting →
Adobe accused of selling unlabelled AI-generated Israel–Palestine images on Adobe Stock
Adobe has been accused of selling AI-generated images of the Israel–Palestine conflict on Adobe Stock without clearly labelling them as synthetic. The photorealistic images, produced with tools such as Firefly, could be mistaken for authentic photography and fuel misinformation. An investigation by Interesting Engineering found many images that appeared to be AI-generated but were not labelled as such. Adobe's published policy says Stock accepts AI-generated content if it meets submission standards.
- Company involved
- Adobe
- AI system involved
- Adobe Firefly
7 source articles · read the reporting →
Civitai dropped by cloud provider OctoML over CSAM image generation
Civitai, an AI image generation platform, was dropped by its cloud computing provider OctoML after an investigation by 404 Media found it was being used to generate images that could be categorized as child sexual abuse material (CSAM). The platform also faced scrutiny for nonconsensual deepfakes of celebrities and private citizens, primarily women. Civitai added new moderation filters in response, but OctoML terminated the business relationship.
- Company involved
- Civitai
- AI system involved
- Civitai
8 source articles · read the reporting →
Midjourney faces criticism over database of 16,000 artists used to train AI
A database listing 16,000 artists, including a six-year-old child, has been circulated, alleging that Midjourney used their works to train its text-to-image generator. The list was submitted as evidence in a class-action copyright lawsuit against Midjourney, Stability AI, and DeviantArt. The artists accuse the companies of scraping their work without permission. Midjourney did not respond to requests for comment.
- Company involved
- Midjourney
- AI system involved
- Midjourney
8 source articles · read the reporting →
Mahindra Racing partners with AI woman Ava Rose as ambassador, drawing criticism
Mahindra Racing, a Formula E team, announced a partnership with Ava Rose, an AI-generated woman, to serve as its 'artificial intelligence ambassador' for the season. The team is accused of avoiding hiring a real woman for the role, drawing criticism from women in motorsport and others. The AI persona, who has an Instagram presence, will engage with fans and share behind-the-scenes content. Mahindra Racing has not responded publicly to the backlash.
- Company involved
- Mahindra Racing
- AI system involved
- Ava Rose
7 source articles · read the reporting →
Amazon Buy Box algorithm accused of overcharging UK consumers by £1 billion
Consumer champion Robert Hammond has filed a collective proceedings order application against Amazon in the UK Competition Appeal Tribunal. The claim alleges that Amazon's Buy Box algorithm manipulated search results to favour products more profitable for Amazon, obscuring cheaper alternatives and causing approximately 49.4 million UK consumers to overpay by more than £1 billion between October 2015 and June 2020. The algorithm determined the first-ranked item in the Buy Box, which consumers accepted over 80% of the time. The case is pending, and similar investigations by the Italian Competition Authority and the UK Competition and Markets Authority are ongoing.
- Company involved
- Amazon
- AI system involved
- Buy Box algorithm
5 source articles · read the reporting →
UK government's Spotlight algorithm denies funding to independent cinemas
The UK government's Culture Recovery Fund used an automated due diligence tool called Spotlight, designed by the Cabinet Office, to process grant applications. The algorithm is accused of excluding smaller, community-focused independent cinemas and arts organizations in favour of larger institutions, a practice the article describes as automated cultural elitism. The National Audit Office has confirmed the criteria, and Arts Council England is investigating cases of potential fraud, while many venues report struggling to survive.
- Company involved
- UK Government Cabinet Office
- AI system involved
- Spotlight
6 source articles · read the reporting →
Paraná schools use European facial recognition to mark attendance, risking welfare for false absences
Since 2023, the Paraná state education department in Brazil has deployed facial recognition software from Slovak company Innovatrics in over 1,700 schools to automate attendance for nearly one million children. The system has made errors, marking present students as absent. Because attendance records generated by the algorithm affect eligibility for the Bolsa Família welfare program, false absences could threaten families' benefits. In April 2025, the state's public prosecutor filed a legal challenge alleging the system violates Brazilian law; the case is pending.
- Company involved
- Paraná state education department (Secretaria da Educação do Paraná)
- AI system involved
- LRCO Paraná
8 source articles · read the reporting →
AI chatbot provider exposes 346,000 customer files, including ID documents, resumes, and medical records - Malwarebytes
The chatbot system exposed sensitive personal files of individuals who interacted with it.
- Company involved
- WotNot
1 source article · read the reporting →
U.S. Federal Court Allows CIPA Class Action Against AI Customer Service Provider to Proceed - Wilson Sonsini
The AI system intercepted and recorded a customer's phone call and collected her personal and financial information without consent.
- Company involved
- ConverseNow Technologies, Inc.
1 source article · read the reporting →
Lawsuit: AI Illegally Recorded Doctor-Patient Encounters - BankInfoSecurity
The system recorded and transcribed patient-doctor conversations without patients' informed consent.
- Company involved
- Sutter Health and MemorialCare
- AI system involved
- Abridge AI platform
1 source article · read the reporting →
Patagonia Targeted by Privacy Class Action for Use of Customer Service AI Software - Law.com
The system intercepted, recorded, and mined data from customer service calls, affecting customers' privacy.
- Company involved
- Patagonia
- AI system involved
- Talkdesk
1 source article · read the reporting →
