Dream Machine AI video generator makes porn
Users figured out how to trick Dream Machine into generating explicit videos and nudity, violating the terms of service of its creator and raising questions about its safety. Users found ways to "jailbreak" or bypass the content filters of AI video generator Dream Machine to generate videos containing nudity and sexually explicit material, even if the quality is crude compared to AI-generated images, according to 404 Media . The discovery raised questions about Luma Labs' governance and Dream Machine's safety, and about the safety of AI video generators in general. T ext-to-video model A text-to-video model is a machine learning model that uses a natural language description as input to produce a video relevant to the input text. Source: Wikipedia 🔗 System 🤖 Dream Machine Operator: Dream Machine users Developer: Luma Labs Country: USA Sector: Media/entertainment/sports/arts Purpose: Generate video Technology: Text-to-video Issue: Privacy; Safety Investigations, assessments, audits 🧐 https://www.404media.co/users-jailbreak-ai-video-generator-to-make-porn/
- Date it happened
- 2024-06-01
- Product, system or model
- Dream Machine
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.