New Mexico lawsuit accuses Snap of failing to act on sextortion reports
Snapchat was accused of failing to adequately respond to numerous reports of sextortion and child grooming on its platform , raising questions about its commitment to child safety. A lawsuit lodged by New Mexico's Attorney General, Raúl Torrez, accuses Snapchat of being aware of rampant sex-related issues on its platform but failing to inform users or parents about them. It also states that Snap reportedly received around 10,000 sextortion reports monthly, yet did not take sufficient action. One account remained active despite receiving 75 complaints related to explicit content and extortion. And it reveals that former Snapchat trust and safety team members expressed frustrations over resistance from management when proposing safety measures - indicating a culture that prioritises user engagement over safety. The lawsuit emphasises that Snap failed to alert the public about the severity of sextortion as a significant issue on their platform, which could have led to better protective measures for vulnerable users. In response, Snap claims it has implemented various safety measures, is continuously improving its protocols and that design decisions have been made to protect minors from being located by strangers. The accusations are seen to important questions about the responsibilities of Snap and other social media platforms in safeguarding younger users against exploitation, and about the effectiveness of their AI-powered content moderation systems. System 🤖 Snapchat content moderation system Developer: Snap Inc Country: U SA Sector: Media/entertainment/sports/arts Purpose: Moderate content Technology: Content mod eration system; Machine learning Issue: Accountability; Alignment; Safety; Transparency Documents 📄 Snap. Update: Statement on New Mexico Attorney General’s Complaint Legal, regulatory 👩🏼⚖️ State of New Mexico v Snap Inc New Mexico Department of Justice. Attorney General Raúl Torrez Files Unredacted Complaint Against Snapchat, Exposing Internal Messages that Snap Knowingly Contributed to Harm Amongst Children
- Date it happened
- 2024-10-01
- Organisation involved
- Snapchat
- Product, system or model
- Snapchat content moderation system
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.