Deepfake nudes target Winnipeg school female students

Deepfake nudes targeting young female students at Collège Béliveau in Winnipeg, Canada, caused serious distress and raised concerns about the misuse of AI. What happened Doctored photos created using publicly accessible social media images of the students were altered using AI to produce highly explicit images and shared online, prompting students to report the incident to school officials. Approximately 300 fake nude images were believed to have been created, affecting dozens of girls, many of whom were reported to have suffered serious emotional distress, feelings of violation, shame, fear of others, and anger. Winnipeg police investigated the incident but laid no charges. Why it happened The incident was made possible due to the increasing accessibility and advancement of AI image generation tools, which have made it possible to produce highly realistic deepfakes with minimal effort. Furthernore, some of these tools are expressly designed to facilitate this kind of behaviour, while others have few or no guardrails to limit how they can be used. The perpetrators may have used one of these tools without fully understanding the gravity of their actions or the legal implications. What it means The incident highlights the growing challenge of protecting individuals, especially young girls, from abuse by people using AI. It also underlines the need for fit-for-purpose legislation to address AI-generated explicit content, particularly involving minors, and improved digital literacy education in schools and amongst parents. System 🤖 Unknown Developer: Country: Canada Sector: Education Purpose: Harr ass/humiliate Technology: Deepfake Issue: Impersonation; Safety

Date it happened

2023-12-01

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.