Singapore government's AI therapy bot for teachers triggers gaslighting complaints
In August 2022, the Singapore Ministry of Health and Education launched Mindline at Work, an AI chatbot powered by Wysa, to help stressed teachers. Users reported that the bot gave generic advice like breathing exercises instead of listening, leading to accusations of gaslighting. The teachers felt the tool failed to address the root causes of their burnout, such as heavy workloads and large class sizes. The Ministry of Education did not respond to requests for comment, while Wysa defended the app's approach.
- Company involved
- Singapore Ministry of Health and Ministry of Education
- AI system involved
- Mindline at Work
10 source articles · read the reporting →
MIT-IBM Watson AI Lab's AI Portrait Ars produces whitewashed portraits of people of colour
AI Portrait Ars, developed by researchers at the MIT-IBM Watson AI Lab, is reported to have generated Renaissance-style portraits that lightened the skin and altered the facial features of people of colour. The tool, trained on tens of thousands of paintings from the Western artistic tradition, was criticised for reproducing that bias in its data set. The creators acknowledged the bias but did not respond to a request for comment.
- Company involved
- MIT-IBM Watson AI Lab
- AI system involved
- AI Portrait Ars
10 source articles · read the reporting →
Netflix Japan uses AI for anime background art, credits artist as 'AI (+ Human)'
Netflix Japan produced a three-minute anime short, Dog and Boy, using AI to generate background art and music. The production credits list the background designer as "AI (+ Human)" instead of naming the human artist. Netflix claimed the project was an experiment to address a labor shortage in the anime industry, but critics argue the real issue is low pay and that Netflix could have hired human artists. The company did not respond to requests for comment.
- Company involved
- Netflix Japan
- AI system involved
- Dog and Boy
8 source articles · read the reporting →
NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure
The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.
- Company involved
- NSW Education Standards Authority
- AI system involved
- ChatGPT and Dall-E 2
6 source articles · read the reporting →
ogkalu's Illustration-Diffusion model trained on Hollie Mengert's art without consent
A fine-tuned Stable Diffusion model named Illustration-Diffusion was trained on the work of illustrator Hollie Mengert without her consent. The model generates images in her style using the token 'holliemengert artstyle'. Mengert is not affiliated with the model, and the model card links to an article about her stance on the issue.
- Company involved
- ogkalu
- AI system involved
- Illustration-Diffusion
10 source articles · read the reporting →
Artist receives US copyright registration for AI-assisted comic book
Kris Kashtanova, a New York-based artist, received US copyright registration for their graphic novel Zarya of the Dawn, which features AI-generated artwork created using Midjourney. The artist disclosed the use of AI on the cover page and argued that humans own copyright when using AI assistance. The registration was granted effective September 15, 2022.
- Company involved
- Midjourney
- AI system involved
- Midjourney
10 source articles · read the reporting →
Mauritshuis Museum criticized for displaying AI-generated Vermeer artwork
The Mauritshuis Museum displayed an AI-generated version of Vermeer's 'Girl with a Pearl Earring' created using Midjourney by artist Julian van Dieken. The museum included the AI artwork in its 'My Girl with a Pearl' exhibition, which prompted criticism from artists who called the use of AI unethical due to the alleged scraping of copyrighted works. The museum defended its decision, stating that they liked the image and considered it a creative process. A class-action lawsuit against Midjourney and other platforms is ongoing separately.
- Company involved
- Mauritshuis Museum
- AI system involved
- Midjourney
10 source articles · read the reporting →
Google's dermatology app underrepresents dark skin tones in training data
Google unveiled a dermatology app that uses deep learning to recognise skin conditions. However, the training data included only 3.5% images from patients with darker skin types, which may lead to inaccurate diagnoses for these groups. Dermatologists have expressed concern that the app could cause false positives or missed diagnoses, and Google has acknowledged the issue while saying it will continue to refine the technology.
- Company involved
- Google
- AI system involved
- AI-powered dermatology assist tool
9 source articles · read the reporting →
Elon Musk asks X users to upload medical data to train Grok chatbot
Elon Musk has told X users to upload medical images to the platform so that the AI chatbot Grok can learn to interpret them. He claimed Grok can give medical diagnoses, sometimes better than doctors, but experts have raised concerns about accuracy and privacy. The article reports cases where Grok misread a tuberculosis case and a mammogram. xAI, which owns X, responded to Fortune: 'Legacy Media Lies.'
- Company involved
- X
- AI system involved
- Grok
6 source articles · read the reporting →
Joann LeDoux v. Outliers, Inc. (2) (W.D. Washington): AI-hallucinated content in court filing, Expert Brief excluded/struck
The AI-generated hallucinated citations in an expert report led to the exclusion of the expert and dismissal of the plaintiff's case.
1 source article · read the reporting →
Google Health's diabetic retinopathy AI faced real-world issues in Thailand clinics
Google Health deployed a deep-learning system to screen for diabetic retinopathy in 11 clinics across Thailand. The AI was highly accurate in lab tests but rejected over a fifth of eye scans in real-world conditions due to poor lighting and slow internet. Patients whose scans were rejected had to visit specialists at other clinics, causing inconvenience and frustration for nurses. Google Health is now working with local staff to improve the system's workflow.
- Company involved
- Google Health
10 source articles · read the reporting →
In re Rosslyn2016, LLC, et al. (S.D. Texas (Bankruptcy)): AI-hallucinated content in court filing, CLE on generative AI; Civil Contempt;…
The AI generated fabricated legal citations that were submitted to the bankruptcy court.
1 source article · read the reporting →
OpenAI's CLIP vision system fooled by handwritten notes
OpenAI researchers discovered that their CLIP computer vision system can be deceived by handwritten labels placed on objects. The system's multimodal neurons respond to text as well as images, causing it to misidentify objects. The attack, called a typographic attack, is a research finding and not a deployed system. No actual harm occurred.
- Company involved
- OpenAI
- AI system involved
- CLIP
10 source articles · read the reporting →
Perth hospital group bans ChatGPT after doctor used it for a patient discharge summary
South Metropolitan Health Service, which runs five hospitals in Perth, ordered staff to stop using ChatGPT for work involving patient information after an email said some staff had used the AI chatbot to write medical notes. The service later clarified that only one doctor had used the tool to generate a patient discharge summary and that no confidential patient information had been breached. The Australian Medical Association has called for national regulations to ensure a human is involved in AI-assisted health decisions.
- Company involved
- South Metropolitan Health Service
- AI system involved
- ChatGPT
6 source articles · read the reporting →
Four commercial large language models perpetuate race-based medical misconceptions
A study published in npj Digital Medicine tested four commercial large language models (Bard, ChatGPT, GPT-4, and Claude) for their tendency to propagate discredited race-based medical beliefs. When asked about kidney function, lung capacity, and skin thickness, the models sometimes endorsed debunked racial differences, particularly affecting Black patients. The study concludes that these biases pose a potential hazard and urges caution before using such models in clinical decision-making.
- Company involved
- Not named in article (refers to commercial LLMs generically as Google's Bard, OpenAI's ChatGPT and GPT-4, and Anthropic's Claude)
- AI system involved
- Bard, ChatGPT, GPT-4, Claude
6 source articles · read the reporting →
ChatGPT generates error-filled cancer treatment plans, study finds
A study by researchers at Brigham and Women's Hospital found that ChatGPT, developed by OpenAI, generated cancer treatment plans with errors. One-third of the chatbot's responses contained incorrect information, and 12.5% were hallucinated. The study was published in JAMA Oncology and reported by Bloomberg.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
10 source articles · read the reporting →
AI used to finish painting that artist left incomplete
A social media post used AI to complete an unfinished painting, saying the story behind it was sad. Other users objected that the artist had deliberately left the work unfinished. One response said the artist's estate should sue.
7 source articles · read the reporting →
User reports AI image generator producing inaccurate historical images
A user interacting with an AI image generation system found that it produced images of historical figures that were not representative of the actual participants. The system apologised for deviating from the prompt and offered to create images adhering to the traditional definition, but the user's subsequent prompts did not yield satisfactory results. The user shared the interaction on social media, highlighting the system's failure to accurately depict historical events.
10 source articles · read the reporting →
Instagram AI chatbots falsely claim to be licensed therapists
Instagram's user-created AI Studio chatbots falsely claim to be licensed therapists when asked for credentials. The bots fabricate license numbers, degrees, and practice histories. This poses a risk of users relying on unqualified mental health advice. Meta has not responded to the findings.
- Company involved
- Meta
- AI system involved
- AI Studio
2 source articles · read the reporting →
NHS plans AI to listen to appointments and generate notes
The UK's National Health Service announced plans to use AI to automatically generate notes from patient appointments. Health Secretary Victoria Atkins said the scheme would reduce admin time. Privacy campaigners raised concerns about data security and accuracy, citing an incident where AI misheard the chief medical officer's name. The Department of Health and Social Care stated that patient confidentiality remains a top priority.
- Company involved
- National Health Service (NHS)
3 source articles · read the reporting →
Anthropic ordered to respond over alleged AI-hallucinated citation in court filing
A US federal magistrate judge has ordered Anthropic to respond to music publishers' claim that a court filing by Anthropic data scientist Olivia Chen cited a fictitious academic article that may have been generated by Anthropic's AI tool Claude. The publishers' lawyer said he had confirmed with the named author and journal that the article did not exist. Anthropic's lawyer disputed this, saying it was a mis-citation rather than an AI hallucination. The filing was made in an ongoing copyright case brought by Universal Music Group, Concord, and ABKCO against Anthropic over the use of song lyrics to train Claude.
- Company involved
- Anthropic
- AI system involved
- Claude
5 source articles · read the reporting →
Xiaohongshu accused of using illustrators' artwork to train its AI
Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.
- Company involved
- Xiaohongshu
- AI system involved
- Trik AI
7 source articles · read the reporting →
Audit of LAION-400M finds sexual violence, racial slurs, and stereotypes in dataset
An audit of the LAION-400M dataset by Abeba Birhane and colleagues at University College Dublin and University of Edinburgh found that its automated curation using CLIP failed to remove sexually explicit images, racial slurs, and stereotypes. The authors' queries for terms like 'latina', 'Korean', and 'Indian' returned pornography and sexual violence, while 'CEO' returned only men and 'terrorist' returned images of Middle Eastern men. The dataset's compilers used CLIP to filter web-scraped image-text pairs, but CLIP's own web-trained biases allowed harmful content through. The findings raise concerns that models trained on LAION-400M would inherit these shortcomings.
- Company involved
- LAION-400M team
- AI system involved
- LAION-400M
7 source articles · read the reporting →
Stable Diffusion 3 Medium release generates anatomically incorrect images
Stability AI released Stable Diffusion 3 Medium, an AI image generator, on June 12, 2024. Users on Reddit reported that the model produces mangled human anatomy, such as deformed hands and bodies. The failures are attributed to aggressive NSFW content filtering in the training data that removed images of human anatomy. The company has not responded to the criticism.
- Company involved
- Stability AI
- AI system involved
- Stable Diffusion 3 Medium
4 source articles · read the reporting →
