Student uses GPT-2 to dupe Medicaid
A Harvard medical student fooled volunteers into thinking automatically generated comments submitted about a Medicaid proposal were real, raising concerns about the misuse of AI for misinformation and disinformation. Of the 1,000 or so comments on proposed changes to Idaho's Medicaid programme on the medicaid.gov website, half had been generated by student Max Weiss using OpenAI's GPT-2 large language model . Weiss' research shows Medicaid users were unable to distinguish real comments from fake ones. The stunt demonstrates how easily large language systems such as OpenAI's GPT-2 can be deployed to produce effective misinformation and disinformation campaigns. System 🤖 GPT-2 Developer: OpenAI Country: USA Sector: Multiple; Govt - health Purpose: Generate text Technology: Large language model (LLM); NLP/text analysis; Neural networks; Deep learning; Machine learning Issue: Mis/disinformation; Dual use
- Date it happened
- 2019-12-01
- Organisation involved
- OpenAI
- Product, system or model
- GPT-2
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.