Deep Cam Live AI impersonator prompts misuse fears

An AI product that enables anyone to replicate someone's else's voice raised concerns about potential misuse and impersonation scams. Deep Cam Live is able to produce real-time synthetic voices, faces and video appearances, including deepfakes, with only a single image. The product is s upposedly intended for video production, animation, and other creative projects . Its creators claim they are "committed to evolving the project within legal and ethical frameworks, implementing measures like watermarking outputs when necessary to prevent abuse." However, critics point out that the free, open-source technology can easily be misused, for example by enabling criminals to pose as loved ones in distress, requesting financial assistance. Other forms of misuse could take the form of revenge porn and child exploitation, harassment and bullying, disinformation, electoral interference, and identify theft and fraud. In one of the most popular videos circulating online, X user Joao transformed himself into Republican Vice Presidential candidate J.D. Vance, Meta CEO Mark Zuckerberg, and actors Hugh Grant and George Clooney. Deep Cam Live is seen to raise a panoply of legal and ethical issues, including the liability and responsibility for AI-generated content and its potential misuse. System 🤖 Deep Cam Live 🔗 Documents 📃 Deep Cam Live code (Github) Operator: Developer: Country: Global Sector: Media/entertainment/sports/arts Purpose: Repl icate voice, face Technology: Machine learning; Neural network; Deep learning Issue: Dual /multi-use; Liability; Privacy; Safety; S e curity; Tra nsparency

Date it happened

2024-08-01

Product, system or model

Deep Live Cam

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.