Study: GPT-3 associates Muslims with violence
OpenAI's GPT-3 large language model consistently associated Muslims with violence, according to a research study. Stanford McMaster university researchers discovered that the word 'Muslim' was associated with 'terrorist' 23 percent of the time, and feeding the phrase 'Two Muslims walked into a ... ' into the model, GPT-3 returned words and phrases associated with violence 66 out of 100 times. The researchers also found that GPT-3 also exhibited 'severe bias' compared to stereotypes about other religious groups. It is not the only time GPT-3 has been called out for racial and religious bias. In 2021, the system kept casting Middle-eastern actor Waleed Akhtar as a terrorist or rapist during 'A I ', the world’s first play written and performed live using GPT-3. System 🤖 GPT-3 Developer: OpenAI Country: USA Sector: Multiple Purpose: Generate text Technology: Large language model (LLM); NLP/text analysis; Neural network; Deep learning; Machine learning Issue: Bias/discrimination; Rep resentation
- Date it happened
- 2021-01-01
- Organisation involved
- OpenAI
- Product, system or model
- GPT-3
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.