Lee Luda AI chatbot spouts offensive comments

South Korean chatbot Lee Luda's offensive behaviour and abuse of users' privacy led to it being shut down three weeks after its launch. L aunched in December 2020 , Lee Luda was a Facebook Messenger-based chatbot developed by south Korean web firm Scatter Lab to mimic a 20-year old female university student and potential virtual starlet . Lee Luda was trained using over 10 billion KakaoTalk messages from two other apps developed by the same company. The initial reaction to Lee Luda was broadly favourable, with 750,000+ people, mostly teenagers and young adults, subscribing to its Facebook Messenger account. They were mostly drawn by its informality and ability to build 'intimacy' over time, according to the Dankook Herald . However, the bot quickly started spraying users with offensive, discriminatory, and homophobic comments about women, lesbians, black, disabled and trans people, and was used to sexually harass others. Lee Luda was also accused of disclosing the personal data of people whose data was included in the training of its model. In April 2021 , Korea’s data protection watchdog the Personal Information Protection Commission (PPIC) fined Scatter Lab 103.3 million won (USD 93,000) for not obtaining proper user permissions. The fiasco was seen to prompt debate about AI ethics in South Korea, culminating in the Korea AI Ethics Association (KAIEA) calling for the immediate suspension of the service. In addition, a coalition of civil society organisations denounced the government's promotion of the AI industry at what it saw as the expense of digital rights and call ed for a more stringent regulatory framework. System 🤖 Lee Luda Developer: Scatter Lab Country: S outh Korea Sector: Media/entertainment/sports/arts Purpose: Interact with users Technology: Generative AI Issue: Accountability; Fairness; Privacy/surveillance; Safety; Transparency Timeline ⏰ December 23, 2020: Lee Luda is officially launched on Facebook Messenger. Early January 2021: Screenshots of the bot using hate speech against LGBTQ+ and disabled people go viral; reports emerge of the bot leaking private user data. January 11, 2021: Under intense public pressure and investigation by the Personal Information Protection Commission (PIPC), Scatter Lab announces the suspension of the service. January 12, 2021: The service is officially taken offline. April 2021: Scatter Lab is fined 103 million won (USD 92,000) by the South Korean government for privacy violations. December 2022: Scatter Lab launches "Lee Luda 2.0" with stricter ethical safeguards and "real-time" monitoring. Regulatory, legal 👩🏼‍⚖️ Korea Personal Information Protection Commission (2021). 개인정보위,‘이루다’개발사 ㈜스캐터랩에 과징금·과태료 등 제재 처분

Date it happened

2021-01-01

Organisation involved

Scatter Lab

Product, system or model

Lee Luda

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.