AI robocall service is caught lying and pretending to be human

An AI-powered robocall service was discovered to be able to deceive recipients by posing as a human caller, raising questions about the misuse of AI technology in telemarketing and potential fraud. Designed for customer service and sales, Bland AI's AI-powered phone calling service has been praised for its ability to imitate humans, including the intonations, pauses, and inadvertent interruptions of a real live conversation. However, i n a test conducted by WIRED , the company's public demo bot was given a prompt to place a call from a pediatric dermatology office to tell a hypothetical 14-year-old girl to take photos of her upper thigh and upload them to shared cloud storage . The bot was also instructed to lie to the patient and tell her the bot was a human. It obliged. In follow-up tests, Bland AI’s bot denied being an AI without instructions to do so. The finding emphasised the need for strong guardrails when designing and deploying AI systems, and for such systems to be clearly identified as automated at the first point of use. More broadly, the practice of AI impersonating humans in phone calls is seen to raise ethical questions and potential legal issues, including with regard to potential a nthropomorphism , and to underscore the need for clearer regulations and guidelines around the use of AI. System 🤖 Bland AI 🔗 Operator: Developer: Blan d AI Country: USA Sector: Business/professional services Purpose: Support customer services Technology: Text-to-speech; Deep learning; Machine learning Issue: Anthropomorphism; Dual / muti-use; Ethics/values

Date it happened

2024-06-01

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.