IBM Project Debater prompts manipulation, accountability concerns

The growing sophistication of IBM's Project Debater, an autonomous AI system that can debate competitively with humans, prompted concerns about the extent to which it could be manipulated in a real-world setting. IBM researchers working on the project published a paper in Nature magazine in which they showed that Project Debater is capable of beating humans in debates. In a series of tests, the system was given 15 minutes to research topics and prepare for debates . Humans won most debates, but in one instance it was able to change the stance of nine people. When tasked with a debate, Project Debater scans the internet for prior research, or quote well-known phrases used by people respected in the field of argument. It also uses IBM's Watson system to listen to the arguments given by opponents and then searches for rebuttals that have been given by others to similar claims. In a Nature magazine editorial , University of Dundee's Chris Reed made the case for stronger oversight and greater transparency of language models such as Project Debater and OpenAI's GPT-3 in order to reduce the potential for manipulation and harm. System 🤖 IBM Project Debater 🔗 Documents 📃 Slonim N. et al (2021). An autonomous debating system Operator: IBM Developer: IBM Country: Israel Sector: Technology Purpose: Debate with humans Technology: NLP/text analysis; Sentiment analysis; Text-to - speech Issue: Accountability; Appropriateness/need; Dual/multi-use; Transparency

Date it happened

2021-01-01

Organisation involved

IBM

Product, system or model

Project Debater

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.