Five Illinois residents sue facial recognition company Pimeyes under BIPA
Five Illinois residents are suing Pimeyes, a facial recognition search engine, alleging that the company violated the Illinois Biometric Information Privacy Act by collecting and using their facial data without consent. The lawsuit claims that Pimeyes made the residents' photos and information available in search results, enabling unauthorized access. The company has not yet been served with the lawsuit, and its CEO stated he had no prior knowledge of the case.
- Company involved
- Pimeyes
- AI system involved
- Pimeyes
7 source articles · read the reporting →
PimEyes scraped Ancestry.com for photos of dead people without permission.
PimEyes, a facial recognition search engine, scraped images from Ancestry.com and other websites without authorization, including photos of deceased individuals. The company's algorithms indexed the images to create biometric faceprints, potentially allowing identification of living relatives. Cher Scarlett discovered the scraping after finding photos of her deceased sister on the platform. PimEyes has since blocked Ancestry's domain and is removing the indexes, but privacy concerns remain.
- Company involved
- PimEyes
- AI system involved
- PimEyes
7 source articles · read the reporting →
N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent
Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.
- Company involved
- N-Tech.lab
- AI system involved
- FindFace
8 source articles · read the reporting →
Wacom responds to concerns about AI-generated images in marketing assets
Wacom acknowledged that it may have used AI-generated images in US marketing assets for the New Year. The company stated it purchased the images from a third-party vendor who indicated they were not AI-generated, and that it vetted them using online tools that also indicated they were not AI-generated. After community feedback raised doubts, Wacom discontinued the images and is reviewing its processes to prevent recurrence. The company attributed the incident to misleading vendor information and detection tool limitations.
- Company involved
- Wacom
10 source articles · read the reporting →
AI image generators produce misleading election images, study finds
A study by the Center for Countering Digital Hate found that leading AI image generators, including Midjourney, DreamStudio, ChatGPT Plus, and Microsoft Image Creator, could be manipulated to create misleading election-related images. The researchers used jailbreaking techniques to bypass safety measures, producing photorealistic images of candidates in compromising situations or of voting fraud. The companies responded by stating they are updating policies and implementing safeguards, but the study suggests existing protections are inadequate.
- Company involved
- Midjourney, Stability AI, OpenAI, Microsoft
- AI system involved
- Midjourney, DreamStudio, ChatGPT Plus, Microsoft Image Creator
8 source articles · read the reporting →
MakeApp makeup removal app adds imperfections, causing controversy
MakeApp, an AI-powered app that digitally removes makeup from photos, has caused controversy by adding imperfections such as redness and dullness to users' faces. Users complained on Twitter that the app exacerbates insecurities and low self-esteem. The founder defended the app as an experiment, denying any intent to shame women.
- Company involved
- MakeApp
- AI system involved
- MakeApp
10 source articles · read the reporting →
Late Night with the Devil directors confirm use of AI-generated images
The horror film 'Late Night with the Devil' used AI-generated images for three still interstitials. The directors confirmed the use after viewers noticed and criticized it online. The controversy highlights ongoing concerns about AI replacing human artists in entertainment.
8 source articles · read the reporting →
Leonardo AI misused to create nonconsensual explicit images of celebrities
Leonardo AI, an AI image-generating platform backed by Samsung, has been misused to create nonconsensual explicit images of celebrities. The platform allows users to generate images using user-generated Stable Diffusion models. Users bypassed ethical guardrails by misspelling celebrity names and using sexually suggestive terms. The misuse was reported by 404 Media.
- Company involved
- Leonardo AI
- AI system involved
- Leonardo AI
5 source articles · read the reporting →
A24 faces backlash for using AI-generated images to promote 'Civil War'
Film studio A24 used AI-generated images to promote its dystopian film 'Civil War' on Instagram, without disclosing that the images were AI-generated. The images depicted iconic American locations in ruins, but contained inaccuracies typical of AI models. The public reacted with outrage, accusing A24 of devaluing artistry and failing to label AI content.
- Company involved
- A24
9 source articles · read the reporting →
Huawei Pura 70 series AI editing tool removes clothing unintentionally
Huawei's Pura 70 series includes an AI retouching feature that can inadvertently remove clothing from images. Users on Weibo posted videos demonstrating this, raising privacy concerns. Huawei customer service acknowledged the issue, attributing it to algorithm loopholes, and promised a fix in upcoming system updates.
- Company involved
- Huawei
- AI system involved
- Pura 70 series AI retouching feature
5 source articles · read the reporting →
Adobe Stock offers AI-generated images inspired by Ansel Adams, violating its own ethics policy
The estate of Ansel Adams publicly criticised Adobe for offering AI-generated images on Adobe Stock that were 'inspired by' Adams' work, violating Adobe's own contributor terms that prohibit using artist names in prompts. Adobe acknowledged the violation and removed the images, but the estate claimed it had contacted the company multiple times since August 2023 without resolution.
- Company involved
- Adobe
- AI system involved
- Adobe Stock
4 source articles · read the reporting →
Xiaohongshu accused of using illustrators' artwork to train its AI
Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.
- Company involved
- Xiaohongshu
- AI system involved
- Trik AI
7 source articles · read the reporting →
PimEyes faces fine proceedings over biometric facial recognition in Baden-Württemberg
PimEyes, a facial recognition search engine, is accused of scraping images from the internet and processing biometric data without a valid legal basis under the GDPR. The data protection authority of Baden-Württemberg (LfDI) opened fine proceedings after it found PimEyes's response to its questions inadequate. PimEyes argues that the images it processes are publicly available and not personal data. The LfDI says the processing endangers citizens' rights and freedoms and is not covered by the GDPR exceptions.
- Company involved
- PimEyes
- AI system involved
- PimEyes
9 source articles · read the reporting →
Stable Diffusion 3 Medium release generates anatomically incorrect images
Stability AI released Stable Diffusion 3 Medium, an AI image generator, on June 12, 2024. Users on Reddit reported that the model produces mangled human anatomy, such as deformed hands and bodies. The failures are attributed to aggressive NSFW content filtering in the training data that removed images of human anatomy. The company has not responded to the criticism.
- Company involved
- Stability AI
- AI system involved
- Stable Diffusion 3 Medium
4 source articles · read the reporting →
Google Lens AI overviews share misleading information about images
Google Lens's AI overviews provided false and misleading information about images, including miscaptioned videos and AI-generated footage. Full Fact found that the overviews repeated debunked claims and failed to identify inauthentic content. Google acknowledged the errors and said they were caused by problems with visual search results.
- Company involved
- Google
- AI system involved
- Google Lens AI overviews
2 source articles · read the reporting →
Sheerluxe's AI fashion editor Reem sparks backlash
Sheerluxe, a women's lifestyle publication, announced the hiring of an AI-generated fashion and lifestyle editor named Reem. The AI editor, depicted as an attractive Arab woman, was criticized for setting unobtainable beauty standards and for not hiring a real person of colour. Sheerluxe later apologized, stating that Reem is an AI-generated image only and not replacing a human role.
- Company involved
- Sheerluxe
- AI system involved
- Reem
6 source articles · read the reporting →
Luma's Dream Machine generates video with Disney character
Luma's AI video tool Dream Machine generated a trailer that included a recognizable character from Disney's Monsters, Inc. The company's CEO said a user uploaded an image containing the character, which the system then animated. The incident raises concerns about lack of transparency in training data and potential copyright infringement. Disney has not publicly commented.
- Company involved
- Luma
- AI system involved
- Dream Machine
7 source articles · read the reporting →
Developer iperov releases DeepFaceLive real-time face-swap AI on GitHub
The developer iperov has published DeepFaceLive, a neural network for real-time face swapping, on GitHub. The tool automatically replaces a user's face in live streams and video calls with a nonexistent model or a celebrity, and the installation instructions are simple. The developer claims 95% of deepfakes on YouTube were made with the related DeepFaceLab. No specific harm is reported, but the article highlights the tool's potential for misuse.
- Company involved
- iperov
- AI system involved
- DeepFaceLive
7 source articles · read the reporting →
Vumacam's AI CCTV system flagged 28 black people as suspicious in Johannesburg suburbs
In Johannesburg suburbs, Vumacam's AI-powered CCTV network using iSentry software flagged 28 black individuals as 'suspicious' in a shift report, according to a 2019 article. The system, deployed by private security firms, uses video analytics to detect abnormal behavior and alerts security guards. The article alleges that the system disproportionately targets people of color, reflecting racial bias in a racially divided country.
- Company involved
- Vumacam
- AI system involved
- iSentry
6 source articles · read the reporting →
AI news presenters James and Rose terminated after two months at Hawaii newspaper
The Garden Island newspaper in Hawaii deployed AI-generated news presenters James and Rose, created by Caledo, to produce video broadcasts. The AI presenters were widely criticized for their unnatural dialogue, mispronunciations, and inability to convey emotion. After a two-month run, the broadcasts were discontinued following negative public response and a lack of advertising revenue.
- Company involved
- Oahu Publications
- AI system involved
- James and Rose
8 source articles · read the reporting →
PimEyes facial recognition search engine identifies individuals from public photos
PimEyes, a Polish facial recognition search engine, allows users to upload a photo and find matching images from across the internet. The system scrapes billions of photos and creates biometric profiles without consent. A banker named Dylan (pseudonym) discovered that an old party photo of him was found by the system, potentially outing his private life. Privacy advocates and platforms like Instagram and YouTube are taking action against PimEyes, alleging violations of the GDPR.
- Company involved
- PimEyes
- AI system involved
- PimEyes
6 source articles · read the reporting →
Stable Diffusion Accused of Stealing Artists' Styles Without Consent
Artists including Greg Rutkowski and Karla Ortiz allege that Stability AI's image generator Stable Diffusion was trained on their work without permission, enabling users to create images mimicking their distinctive styles. The artists express concern that this threatens their livelihoods and identities, as their names become prompts for generating similar art. A tool is being developed to help protect artists from such unauthorised use, but the situation remains unresolved.
- Company involved
- Stability AI
- AI system involved
- Stable Diffusion
10 source articles · read the reporting →
Remini app allegedly generated child pornography image from user's photo
Asia Marie Williams, a digital creator, used the Remini app to generate an image of her future baby. The app allegedly produced a half-naked image of a toddler-aged child with her face, which she described as child pornography. She shared the image on Facebook with private parts censored. The incident has not been resolved.
- Company involved
- Remini
- AI system involved
- Remini
8 source articles · read the reporting →
Adobe Firefly trained on thousands of Midjourney images, Bloomberg reports
Bloomberg has reported that Adobe's Firefly image generator was trained using thousands of images from competitor Midjourney. Adobe says these made up about 5% of the training data and were part of the Adobe Stock library. The company has marketed Firefly as ethically trained and offered enterprise customers indemnity against copyright claims. Adobe responded that all Adobe Stock images undergo moderation, but the report has raised questions about Firefly's copyright safety.
- Company involved
- Adobe
- AI system involved
- Firefly
7 source articles · read the reporting →
