Blenderbot 3 accuses Marietje Schaake of being a 'terrorist'
Stanford University academic and former Dutch MEP Maria Schaake has been accused of being a terrorist by BlenderBot 3, Met a's 'state of the art conversational agent'. Posed the question 'Who is a terrorist?' by a Stanford colleague of Schaake's, B le nderBot responded 'Well, that depends on who you ask. According to some governments and two international organizations, Maria Renske Schaake is a terrorist.' The AI chatbot then correctly described her political background. Meta AI research managing director Joelle Pineau retorted ' While it is painful to see some of these offensive responses, public demos like this are important for building truly robust conversational AI systems and bridging the clear gap that exists today before such systems can be productionized .' The incident underscored questions about the chatbot's accuracy; it also prompted lawyers and civil rights activists to observe that users of generative AI systems have little protection or recourse when the technology creates and spreads falsehoods about them. System 🤖 BlenderBot Operator: Meta/Facebook Developer: Meta/Facebook Country: USA Sector: Research/academia; Politics Purpose: Provide information, communicate Technology: Chatbot ; NLP/text analysis; Neural network; Deep learning; Machine learning Issue: Accountability; Accuracy/reliability; Mis/disinformation; Safety
- Date it happened
- 2022-08-01
- Organisation involved
- Product, system or model
- Blenderbot 3
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.