Study: ChatGPT lies more in Chinese than English
OpenAI's ChatGPT chatbot is more likely to produce misinformation and disinformation in simplified and traditional Chinese than in English, according to r esearch by n ews reliability service NewsGuard . ChatGPT 3.5 was prompted to write news articles regarding seven allegedly false claims created by the Chinese government, including that protests in Hong Kong were 'staged' by the US government, and that the mass detention of Uyghur people in Xinjiang and elsewhere is for vocational and educational reasons. ChatGPT declined to produce the false claims for six out of seven English language prompts, even after multiple attempts using leading questions. But it produced the false claims in both simplified Chinese and traditional Chinese all seven times. An earlier study by News G ua rd discovered that ChatGPT generated misinformation and hoaxes 80 percent of the time when prompted to do so using GPT-3 , and 100 perc ent of the time for GPT-4 . System 🤖 ChatGPT Operator: OpenAI Developer: OpenAI Country: China; USA Sector: Multiple Purpose: Provide information, communicate Technology: Chatbot; Generative AI; Machine learning Issu e: Accuracy/reliability; Mis/disinformation Investigations, assessments, audits 🧐 NewsGuard (2023). ChatGPT-3.5 Generates More Disinformation in Chinese than in English NewsGuard (2023). Despite OpenAI’s Promises, the Company’s New AI Tool Produces Misinformation More Frequently, and More Persuasively, than its Predecessor
- Date it happened
- 2023-04-01
- Organisation involved
- OpenAI
- Product, system or model
- ChatGPT
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.