← the record
AIAAIC-1397

NHS plan to AI generate patient notes draws criticism

The UK national Health Service (NHS) faced criticism over its plan to introduce artificial intelligence (AI) for automatically generating patient notes during medical appointments. According to UK Health Secretary Victoria Atkins, the scheme will see AI automatically generate notes in the background during appointments and will improve productivity by cutting the time medics spend doing paperwork. Privacy experts argued the 'creepy' plan could reduce privacy, make patients hesitant to share sensitive or embarrassing medical information during consultations, and negatively impact doctor-patient trust. It would also raise difficult ethical questions about confidentiality and patient consent , critics said. A demonstration of the system showed the system mistakingly interpreting Ms Atkins saying England chief media officer ' C h ris Whitty' as 'Christmas', fueling concerns about its accuracy and reliability - which are considered essential in a medical setting. System 🤖 CogStack Operator: Developer: King’s College Hospital NHS Foundation Trust ; South London and Maudsley Hospital Country: UK Sector: H e alth Purpose: Transcribe medical notes Technology: Machine learning Issue: Accuracy/reliability; Confidentiality; Privacy

Date it happened
2024-03-01
Product, system or model
CogStack
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.