WF-4CTZ7A
Research Prototype AI, Delphi, Reportedly Gave Racially Biased Answers on Ethics
A publicly accessible research model that was trained via Reddit threads showed racially biased advice on moral dilemmas, allegedly demonstrating limitations of language-based models trained on moral judgments.
- Date it happened
- 2021-10-22
- Organisation involved
- Allen Institute for AI
- Product, system or model
- Ask Delphi is a neural network (mathematical system loosely modeled on the web of neurons in the brain) that analyzed more than 1.7 million ethical judgments by human reviewers from Mechanical Turk fr
Where this came from
Attribution
This incident was imported from AI Incident Database and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.