ChatGPT used to create fake fatal train accident news
A Chinese man used a chatbot to spread disinformation about a train accident that caused the deaths of nine people in Gansu province. The man, named Hong, used OpenAI's ChatGPT chatbot to generate the content, which was posted to over 20 accounts on Baidu's Baijiahaoc blog platform and seen by tens of thousands of people. Hong was later arrested for 'picking quarrels and provoking trouble' and for using AI to 'concoct false and untrue information'. According to the South China Morning Post , he reputedly confessed to have inputted elements of viral stories in China from the past few years into ChatGPT to produce different versions of the same fake story and then uploaded it to his accounts on Baijiahao. ChatGPT is not available in China, but can be accessed using a VPN. System 🤖 ChatGPT Operator: OpenAI Developer: OpenAI Country: USA; Global Sector: Multiple; Transport/logistics Purpose: Provide information, communicate Technology: Chatbot; Machine learning Issue: Mis/disinformation
- Date it happened
- 2023-05-01
- Organisation involved
- OpenAI
- Product, system or model
- ChatGPT
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.