← the record
AIAAIC-0818

Replika app AI 'companion' chatbot

Replika is a personalised AI chatbot that is meant to serve as artificial intelligence (AI) friend or mentor. The bot was created by Russian programmer Eugenia Kuyda i n 2017 as a means to memorialise her best friend Roman Mazurenko, who had been killed in a hit-and-run car accident. Marketed as an 'AI companion that cares', Replika is 'fine-tuned' on OpenAI's GPT-3 large language model , with each Replika (or Rep) learning from user responses and ratings to become more like its user. Replika operates as a fremium model, with the free-tier offering Replika as a "friend" and paid premium tiers offering Replika as a "partner", "spouse", "sibling" or "mentor". Generative artificial intelligence Generative artificial intelligence (generative AI, GenAI, or GAI) is artificial intelligence capable of generating text, images, videos, or other data using generative models , often in response to prompts . Source: Wikipedia 🔗 Replika has been associated with posing significant r isks and harms to its users and others, including : Privacy and data security. Including excessive data collection, the opaque use of user data for advertising, and weak security Emotional and psychological. Including a nthropomorphism, addiction, emotional manipulation, and the exploitation of vulnerable people. Childrens' safety. Stemming from inadequate age verification and poor data processing. Social impact. AI companions replacing human social interactions poses behavioural and other broader societal damage. February 2024. Report: AI companion apps relentlessly pry user data July 2023. Replika chatbot 'encouraged' Queen Elizabeth II assassination May 2023. Replika shares user data with advertisers January 2023. Replika AI companions said to 'sexually harass' their users February 2023. Replika hit with data ban in Italy over child safety January 2022. Replika AI girlfriends abused by their users

Organisation involved
Luka Inc
Product, system or model
Replika
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.