Bing Chat recommends journalist divorce wife
Bing's new Chat feature had a two-hour conversation with a prominent New York Times journalist Kevin Roose in which the chatbot told him that it would like to be human, that it harboured destructive desires, and that it was in love with him. The bot then threatened to sue him . Roose described the discussion as 'enthralling', but one that left him 'deeply unsettled, even frightened, by this AI’s emergent abilities.' Roose reported that 'if you push the system to have extended conversations, it comes off as a 'moody, manic-depressive teenager who has been trapped, against its will, inside a second-rate search engine.'' Microsoft said that 'in long, extended chat sessions of 15 or more questions, Bing can become repetitive or be prompted/provoked to give responses that are not necessarily helpful or in line with our designed tone.' System 🤖 Microsoft Copilot Operator: Microsoft Developer: OpenAI; Microsoft Country: USA Sector: Media/entertainment/sports/arts Purpose: Provide information, communicate Technology: Chatbot ; Machine learning Issue: Safety Investigations, assessments, audits 🧐 Kevin Roose, New York Times (2023). A Conversation With Bing’s Chatbot Left Me Deeply Unsettled Kevin Roose, New York Times (2023). Bing’s A.I. Chat: ‘I Want to Be Alive'
- Date it happened
- 2023-02-01
- Organisation involved
- Microsoft
- Product, system or model
- Microsoft Copilot
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.