Google hate speech detection system accused of racial bias
TikTok's hate speech detection system was accuse d of racial bias by Black creators and rights activists for appearing to block Black content. Per The Verge , the furore was sparked by Black influencer Ziggi Tyler finding that phrases including 'Black Lives Matter' and 'Black success' were flagged by TikTok as 'inappropriate' when he tried to update his creator profile. At the same time, TikTok's system allowed phrases such as 'white supremacy' and 'white success'. TikTok responded by blaming its content moderation technology and claimed it had fixed the error. The incident raised questions about TikTok's willingness and ability to detect and act upo System 🤖 TikTok hate speech detection system Operator: Byte D ance/TikTok Developer: Byte D ance/TikTok Country: USA; Global Sector: Media/entertainment/sports/arts Purpose: Detect hate speech Technology: Recommendation algorithm Issue: Bias/discrimination - race er nance
- Date it happened
- 2021-07-01
- Product, system or model
- Perspective
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.