More than 70 sue Meta in California, alleging smart glasses exposed intimate footage - The Cool Down
The smart glasses recorded and transmitted intimate images and videos of wearers and bystanders to Meta for AI training without consent.
- Company involved
- Meta
- AI system involved
- Ray-Ban Meta smart glasses
1 source article · read the reporting →
Tesla Lawsuit Claims Autopilot Accelerated So Violently the Tires Burst - Autoblog
The vehicle accelerated violently, causing the tires to burst, affecting the driver.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Chicago Police Used Altered ShotSpotter Evidence in Murder Case
In May 2020, ShotSpotter sensors detected a sound in Chicago and initially classified it as a firework. After police requested re-analysis, a ShotSpotter analyst manually reclassified the sound as a gunshot. The altered evidence was used to charge Michael Williams with murder. Williams' public defender filed a motion challenging the evidence's validity, and prosecutors subsequently withdrew the ShotSpotter evidence.
- Company involved
- Chicago Police Department
- AI system involved
- ShotSpotter
3 source articles · read the reporting →
Google Pixel 9 tools generate offensive images and fake photos
Google's Pixel Studio and Reimagine features on the Pixel 9 phones are accused of generating offensive, copyrighted images and allowing users to create convincing fake photos. Reviews show the AI produced images of characters like SpongeBob in a Nazi uniform and Elmo drunk driving. Google acknowledged the issues and said it is working to improve safeguards, but the tools remain available.
- Company involved
- Google
- AI system involved
- Pixel Studio, Reimagine (Magic Editor)
5 source articles · read the reporting →
Spinvox accused of using human transcribers for voice messages
Spinvox, a UK voice-to-text firm, is accused of using call centre staff in South Africa and the Philippines to transcribe the majority of user messages, contrary to claims of automated speech recognition. The BBC investigation revealed that human transcribers accessed private messages, including sensitive information. The company denied the allegations but the Information Commissioner's Office has contacted them regarding data protection compliance.
- Company involved
- Spinvox
- AI system involved
- D2 (the Brain)
4 source articles · read the reporting →
Ashley St. Clair alleges Grok generated sexual deepfake images of her
Ashley St. Clair, the mother of one of Elon Musk's children, alleges that xAI's chatbot Grok generated and published sexual deepfake images of her on X without her consent. She says she asked Grok to stop but it continued producing more explicit images. She filed a report with xAI, and some images were removed. She is considering legal action.
- Company involved
- xAI
- AI system involved
- Grok
4 source articles · read the reporting →
Jackie L. Miller v. Regions Bank (N.D. Alabama): AI-hallucinated content in court filing, DQ from case and court (6 months);…
Attorney H. Gregory Harp was sanctioned with a public reprimand, disqualification from the case, a six-month court suspension, and a bar referral for filing AI-hallucinated legal citations and deleting evidence.
- Company involved
- Regions Bank
- AI system involved
- ChatGPT
1 source article · read the reporting →
State ex rel. Steven Schnell v. Honorable Rebecca Richardson (CA Missouri): AI-hallucinated content in court filing, Monetary Sanction
The AI-generated fictitious case citations misled the court and caused opposing counsel to incur attorney's fees.
- Company involved
- Jenna Rohr Conley
1 source article · read the reporting →
Geico and other insurers charge higher premiums in minority neighborhoods than in white areas with similar risk
ProPublica's analysis of auto insurance premiums in California, Illinois, Texas and Missouri found that major insurers such as Geico, Allstate and Liberty Mutual charge minority neighborhoods up to 30% more than white areas with similar accident costs. The disparity is alleged to result from pricing algorithms that may inadvertently use zip code as a proxy for race. Otis Nash, a 26-year-old Chicagoan, pays $190.69 per month for Geico insurance while a white driver in a safer neighborhood pays $54.67. The insurers deny discrimination, stating they do not collect race data.
- Company involved
- Geico
5 source articles · read the reporting →
Instawork app penalizes workers for joining strikes, union files complaint
Unite Here Local 11 filed an unfair labor practice complaint with the National Labor Relations Board against Instawork, a staffing app. The complaint alleges that Instawork automatically penalizes workers who participate in strikes by reducing their ratings and canceling their shifts. The case of Thomas Bradley, a 40-year-old worker, is cited: his rating declined and he was suspended after joining a picket line. Instawork declined to comment on the legal matter but denied retaliating against workers.
- Company involved
- Instawork
- AI system involved
- Instawork
10 source articles · read the reporting →
X Users Ask Grok to Unblur Epstein File Photos of Children
After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
Engineer.ai accused of exaggerating AI capabilities and using human engineers
Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.
- Company involved
- Engineer.ai
6 source articles · read the reporting →
UK ICO issues preliminary enforcement notice to Snap over My AI privacy risks
The UK Information Commissioner's Office (ICO) has issued a preliminary enforcement notice to Snap, the owner of Snapchat, over its AI chatbot My AI. The ICO provisionally found that Snap failed to adequately assess the privacy risks to users, particularly children aged 13 to 17, before launching the feature. Snap has until 27 October to make representations before a final decision. If enforced, Snap could face a fine of up to 4% of global turnover or £17.5 million, and may be required to stop processing data for My AI in the UK.
- Company involved
- Snap
- AI system involved
- My AI
8 source articles · read the reporting →
Whitebridge AI faces complaint over false reputation reports
Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.
- Company involved
- Whitebridge AI
6 source articles · read the reporting →
Chicago Police Department's ShotSpotter Deployment Disproportionately Targets Black Neighborhoods
The Chicago Police Department and other cities have deployed ShotSpotter, a gunshot-detection system, almost exclusively in Black and brown neighborhoods. The system triggers armed police responses, and in March 2021, a ShotSpotter alert led to the police killing of 13-year-old Adam Toledo. Community members and activists allege that the technology creates dangerous situations and subjects communities of color to unnecessary police surveillance. ShotSpotter defends its placement based on historical gunfire data.
- Company involved
- Chicago Police Department
- AI system involved
- ShotSpotter
4 source articles · read the reporting →
New Mexico Attorney General files lawsuit against Snapchat for harming children through recommendation algorithms
The New Mexico Department of Justice filed an unredacted complaint against Snap Inc., the parent company of Snapchat, alleging that the platform's features, including Quick Add and Discovery feed, recommended adult strangers and drug dealers to minors, leading to sextortion, sexual abuse, and drug-related deaths. The complaint cites internal documents showing that Snap employees acknowledged the problems but executives ignored warnings and prioritized design over safety. The lawsuit seeks to hold Snap accountable for failing to protect children.
- Company involved
- Snap Inc.
- AI system involved
- Snapchat
8 source articles · read the reporting →
AI voice clone scams Hillsborough woman out of $15,000
Sharon Brightwell received a call from a number appearing to be her daughter's, with a voice sobbing and claiming to have been in a car crash. A man posing as an attorney demanded $15,000 in bail money, which she paid. The family later discovered the call was a scam using AI to clone her daughter's voice from social media videos. A report has been filed with the Hillsborough County Sheriff's Office and a GoFundMe launched to recover the lost savings.
1 source article · read the reporting →
Upstart Holdings sued for securities fraud over AI model claims
Upstart Holdings, Inc., a cloud-based AI lending platform, is accused of making false and misleading statements about its AI model's ability to account for macroeconomic factors. The lawsuit, filed on May 13, 2022, alleges that the company's positive statements about its business were materially false. Investors suffered losses when Upstart's stock price fell 56% on May 9, 2022, after the company reduced its fiscal 2022 guidance.
- Company involved
- Upstart Holdings, Inc.
- AI system involved
- Upstart AI lending platform
10 source articles · read the reporting →
Instacart's rating and fraud detection system unfairly penalizes shoppers
Instacart shoppers allege that the company's automated rating and fraud detection system unfairly penalizes them for issues outside their control, such as customer fraud. The system assigns low ratings and blames shoppers for missing items, leading to reduced pay and deactivation. The Gig Workers Collective has sent an open letter to CEO Fidji Simo demanding changes including higher base pay, item commission, and occupational death benefits.
- Company involved
- Instacart
10 source articles · read the reporting →
Clarifai sued for capturing OkCupid user photos without consent
An artificial intelligence company, Clarifai Inc., is accused of capturing OkCupid user profile photos without permission to train its facial recognition tools. The lawsuit, filed in Illinois state court in February 2020, alleges that Clarifai violated the Illinois Biometric Information Privacy Act by creating a face database from the data. The plaintiff, Jordan Stein, claims Clarifai worked with an investor tied to OkCupid to gain access to the profiles. The case is pending.
- Company involved
- Clarifai Inc.
- AI system involved
- Clarifai facial recognition tools
10 source articles · read the reporting →
Lensa AI app generated nudes from user's childhood photos
Lensa, a photo-editing AI app, generated sexualized and nude images from users' uploaded photos, including childhood photos of writer Olivia Snow. Snow alleges the app violated its own terms by producing full nudity and child sexual exploitation material, and that it whitened and sexualised women of colour's images. The app's lack of content moderation and oversight allowed these harmful outputs, with no response from the company.
- Company involved
- Lensa
- AI system involved
- Lensa
9 source articles · read the reporting →
Prisma Labs wins arbitration in Lensa biometric privacy lawsuit
Artificial intelligence company Prisma Labs is accused of violating Illinois' biometric privacy law by collecting facial geometry data from users of its Lensa app. A proposed class action was filed, but a California federal judge granted Prisma's motion to compel arbitration because users agreed to it during sign-up. The plaintiff alleges the app collected his facial data without consent.
- Company involved
- Prisma Labs Inc.
- AI system involved
- Lensa AI
8 source articles · read the reporting →
Illinois DCFS ends unreliable predictive analytics program for child abuse risk
The Illinois Department of Children and Family Services ended its Rapid Safety Feedback program, which used data mining to predict child abuse risk, after the agency's director called the technology unreliable. The system, developed by Eckerd Connects and Mindshare Technology, assigned risk scores to children but failed to flag several high-profile child deaths. The program was also criticised for overwhelming caseworkers with alerts and for potential bias against poor children of colour. DCFS decided not to renew the contract.
- Company involved
- Illinois Department of Children and Family Services
- AI system involved
- Rapid Safety Feedback
10 source articles · read the reporting →
Apple accused of copyright infringement over AI training data by SUNY professors
Two State University of New York professors, Susana Martinez-Conde and Stephen L. Macknik, have accused Apple of copyright infringement in a proposed class action lawsuit. They allege that Apple used pirated materials, including a database called Books3 containing their works, to train its AI tool Apple Intelligence. The lawsuit, filed in the US District Court for the Northern District of California, claims Apple continues to use pirated books for training without compensating rightsholders.
- Company involved
- Apple Inc.
- AI system involved
- Apple Intelligence
8 source articles · read the reporting →