ChatGPT provides inaccurate medication query responses
The free version of ChatGPT provided inaccurate, incomplete or non-existent responses to medication-related questions, potentially endangering patients, according to a research study. Pharmacists at Long Island University posed 39 medication-related questions to GPT-3.5, which powers ChatGPT . The bot gave inaccurate responses to 10 questions, and wrong or incomplete answers to 12. It failed t o directly address 11 questions, according to the study, and only provided references in eight responses, with each including sources that do not exist. The study demonstrated that patients and health-care professionals should be cautious about relying on OpenAI’s viral chatbot for drug information and verify any of the responses with trusted sources, according to the study’s lead author Sara Grossman. System 🤖 ChatGPT Operator: Sara Grossman Developer: OpenAI Country: USA Sector: Health Purpose: Provide medication information Technology: Chatbot; Generative AI; Machine learning Issue: Accuracy/reliability
- Date it happened
- 2023-12-01
- Organisation involved
- Sara Grossman
- Product, system or model
- ChatGPT
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.