WF-EEQHSJ
High-Toxicity Assessed on Text Involving Women and Minority Groups
Google's Perspective API, which assigns a toxicity score to online text, seems to award higher toxicity scores to content involving non-white, male, Christian, heterosexual phrases.
- Date it happened
- 2017-02-27
- Organisation involved
- Product, system or model
- Google's Perspective project, a machine learning-based system to identify toxic comments in online discussion forums
Where this came from
Attribution
This incident was imported from AI Incident Database and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.