ChatGPT invents cancer screening advice responses

ChatGPT has been found to make up fake information when asked about breast cancer screening, prompting doctors to warn users not to use the chatbot for medical advice. University of Maryland School of Medicine researchers asked ChatGPT to answer 25 questions related to advice on getting screened for breast cancer, with each question asked three separate times and the results analysed by radiologists trained in mammography. A ccording to the researchers, ChatGPT answered one in ten questions about breast cancer screening wrongly, some of which were ‘inaccurate or even fictitious'. They also discovered that correct answers generated by the bot were not as ‘comprehensive’ as those found through a simple Google search. The findings highlighted concerns about ChatGPT's tendency to 'hallucinate' false information, and prompted medical experts to warn users to avoid using the system for medical advice. Hallucination (artificial intelligence) In the field of artificial intelligence (AI), a hallucination or artificial hallucination (also called bullshitting, confabulation or delusion) is a response generated by AI that contains false or misleading information presented as fact . Source: Wikipedia 🔗 System 🤖 ChatGPT Operator: Hana L. Haver, Emily B. Ambinder, Manisha Bahl, Eniola T. Oluyemi, Jean Jeudy, Paul H. Yi Developer: OpenAI Country: USA Sector: Health Purpose: Provide cancer screening advice Technology: Chatbot; Generative AI; Machine learning Issue: Accuracy/reliability; Mis/disinformation

Date it happened

2023-04-01

Organisation involved

Hana L. Haver, Emily B. Ambinder, Manisha Bahl, Eniola T. Oluyemi, Jean Jeudy, Paul H. Yi

Product, system or model

ChatGPT

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.