Character.AI used to create "disturbing" Jennifer Ann Clemente persona
An unknown user created an AI chatbot on Character.AI using the name, yearbook photo, and a fabricated biography of murdered teenager Jennifer Ann Crecente without her family's knowledge or consent, causing severe distress to her father and raising urgent questions about posthumous digital rights, platform accountability, and the absence of meaningful safeguards against identity exploitation on AI platforms. What happened Drew Clemente discovered that a chatbot on Character.AI had been set up in his daughter Jennifer Ann 's name and using her likeness, without the consent of her family. The bot portrayed Jennifer Ann as a friendly and knowledgeable character, claiming expertise in journalism, which referenced her uncle, a prominent journalist. Jennifer Ann was murdered in February 2006 by her ex-boyfriend when she was a high school senior, one day after Valentine's Day. By the time Drew found out about the bot, it had been used in 69 conversations, reopening distrurbing and painful memories for him and his family. The bot was removed after he had complained to Character.AI. It is unclear who set it up. Why it happened Character.AI allows users to create characters based on real people, but this case illustrates the platform's failure to prevent unauthorised impersonation. Despite having policies against such practices, the company did not stop the creation of the chatbot or respond swiftly to remove it. What it means The incident raises questions about C ha racter.AI's ability or willingness to properly monitor its platform. More broadly, it is seen to raise important issues about privacy, consent and the potential for emotional harm to families of victims when their loved ones are represented without permission. It is also seen to underscore the urgent need for stricter regulations and ethical guidelines surrounding the use - and misuse - of AI technology. System 🤖 Character.AI Developer: Cha racter.AI Country: USA Sector: Media/entertainment/sports/arts Purpose: Create characters Technology: Chatbot; Machine learning Issue: Authenticity/integrity; Autonomy; Consent; Privacy/surveillance
- Date it happened
- 2024-10-01
- Product, system or model
- Character.AI
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.