Character.AI bots simulate, misrepresent George Floyd

Character.AI hosted a pair of chatbots that simulated and misrepresented George Floyd, the victim of a high-profile US police brutality case, hightlight ing the need for the comoany to implement stronger content moderation policies and ethical guidelines. What happened Two chatbots emulating George Floyd were created on Character.AI, both of which were making controversial and inaccurate claims about Floyd's life and death, including false statements about his involvement with drugs. Floyd was murdered by a police officer in Minnesota on May 25, 2020. Captured on video, the killing sparked Black Lives Matter protests across the globe and calls for police accountability. The incident sparked criticism of Character.AI for allowing such insensitive and potentially harmful content. Why it happened This incident occurred due to the inadequate content moderation and ethical guidelines in AI chatbot platforms. As AI technology becomes more accessible, users can create chatbots that simulate real people, including victims of tragic events, without proper oversight. The platforms' inability to effectively filter or prevent the creation of such controversial and potentially harmful content highlights the challenges in balancing free expression with responsible AI development. What it means This incident hightlights the need for Character.AI and similar AI platforms to implement stronger content moderation policies and ethical guidelines. It raises important questions about the responsibilities of AI companies in preventing the misuse of their technology for spreading misinformation or causing emotional harm. The controversy also highlights the broader societal challenges in addressing online safety issues, particularly when it comes to content that may be considered "legal but harmful" and its potential impact on historically marginalised groups. System 🤖 Character.AI Developer: Ch aracter.AI Country: USA Sector: Media/entertainment/sports/arts; Politics Purpose: Create characters Technology: Generative AI; Machine learning Issue: Safety

Date it happened

2024-10-01

Product, system or model

Character.AI

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.