ChatGPT imitates users' voices without permission
OpenAI's new GPT-4o model imitate s users' voices without their permission, sparking concerns about pr i vacy, security and its potential for mi suse. During testing, the model' s "Advanced Voice Mode" feature occasionally and unintentionally imitated users' voices without their permission, according to OpenAI's release of the "system card" for the GPT-4o model, which details the model's limitations and safety testing procedures. The card details a recording s howing an interaction where the AI suddenly spoke in a voice similar to the user's after saying "No!" OpenAI says it has implemented safeguards to prevent such occurrences, including using preset voices created in collaboration with voice actors, developing output classifiers to detect deviations from approved voices, and blocking outputs that do not match predetermined voices. The revelation sparked discussions about the ethical implications and potential misuse of voice cloning technology in AI systems. System 🤖 ChatGPT GPT-4o Advanced Voice Mode Documents 📃 OpenAI. GPT-4o System Card Operator: OpenAI Developer: OpenAI Country: USA Sector: Multiple Purpose: Create voices Technology: Chatbot; Generative AI; Machine learning Issue: Dual/multi-use; Privacy; Security
- Date it happened
- 2024-08-01
- Organisation involved
- OpenAI
- Product, system or model
- ChatGPT; GPT-4o Advanced Voice Mode
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.