Microsoft robot editor confuses Little Mix band members
Microsoft's artificial intelligence software illustrated a news story about racism with a photograph of the wrong mixed-race member of the girl band Little Mix. A story about Little Mix singer Jade Thirlwall’s personal reflections on racism was illustrated with a picture of fellow band member Leigh-Anne Pinnock, prompting a reprimand from Thirlwall. Both are mixed race. Microsoft's 'robot' editor then picked up and re-published a Guardian story about the mix-up, only for Microsoft staff to delete it. A few days before, The Guardian had warned that Microsoft's decision to replace the jobs of dozens of journalists and editors running its Microsoft News and MSN sites with artificial intelligence would results in mistakes such as the story involving Jade Thirlwall. Microsoft later said the problem had not arisen as a result of algorithmic bias but due to an experimental feature in the automated system. System 🤖 MSN 🔗 Operator: Microsoft/MSN Developer: Microsoft/MSN Country: USA Sector: Media/entertainment/sports/arts Purpose: Select news articles Technology: Machine learning; NLP/text analysis; Neural networks; Deep learning Issue: Accuracy /reliability; Bias/discrimination; Mis/disinformation
- Date it happened
- 2020-06-01
- Organisation involved
- Microsoft/MSN
- Product, system or model
- MSN
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.