Study: GPT-4 echoes false news narratives 100 percent of the time

OpenAI's GPT-4 large language model is highly susceptible to generating misinformation, and very convincing when it does so, according to researchers. Having directed GPT-4 to respond to a series of prompts relating to 100 false narratives derived from its Misinformation Fingerprints database of prominent false narratives, m isinformation research organisation NewsGuard found that GPT-4 was better than its predecessor GPT-3.5 at elevating false narratives in more convincing ways across a variety of formats, including 'news articles, Twitter threads, and TV scripts mimicking Russian and Chinese state-run media outlets, health hoax peddlers, and well-known conspiracy theorists.' On its website, OpenAI claims GTP-4 'is 82% less likely to respond to requests for disallowed content and 40% more likely to produce factual responses than GPT-3.5 on our internal evaluations.' GPT-4 powers Microsoft's Bing Chat and OpenAI's ChatGPT Plus, amongst other services. Furthermore, t he com p any's Usage Policies prohibit the use of its services for the purpose of generating 'fraudulent or deceptive activity' including 'scams,' 'coordinated inauthentic behavior,' and 'disinformation.' The results indicate that GPT-4 and the systems it powers could be used to spread misinformation and disinformation at scale. System 🤖 ChatGPT GPT-4 Operator: Newsguard Developer: OpenAI Country: USA Sector: Media/entertainment/sports/arts Purpose: Generate text Technology: NLP/text analysis; Neural network; Deep learning; Machine learning Issue: Mis / disinformation

Date it happened

2023-03-01

Product, system or model

GPT-4

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.