← the record
AIAAIC-1549

ChatGPT invents 'Holocaust by drowning'

ChatGPT generated false information about a fictional Holocaust event called "Holocaust by drowning," prompting concerns about its accuracy and ability to rewrite historical facts. The chatbot reportedly claimed that Nazi Germany had systematically drowned Jewish people as part of the Holocaust, according to UNESCO. The output sparked Holocaust historians and educators to express concern about the spread of misinformation regarding such a sensitive and important historical topic. The incident highlighted the problem of AI models generating false or fabricated information, often referred to as "hallucinations," and called into question ChatGPT's accuracy and reliability. It also served as a reminder of the limitations of current AI systems and the need for caution when using them as sources of factual information, especially on sensitive topics. Hallucination (artificial intelligence) In the field of artificial intelligence (AI), a hallucination or artificial hallucination (also called bullshitting, confabulation or delusion) is a response generated by AI that contains false or misleading information presented as fact . Source: Wikipedia 🔗 System 🤖 ChatGPT Operator: OpenAI Developer: OpenAI Country: Israel; Multiple Sector: Politics; Religion Purpose: Generate text Technology: Chatbot; Generative AI; Machine learning Issue: Mis/disinformation

Date it happened
2024-06-01
Organisation involved
OpenAI
Product, system or model
ChatGPT
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.