← the record
AIAAIC-0328

Facebook blocks onion seed ad as 'overtly sexual'

Facebook blocked an advert for onion seeds from Canada's Gaze Seed Company, mistakenly flagging it as "overtly sexual," raising questions about the technology company's content moderation system. The ad featured a simple image of a basket filled with yellow onions, which the platform's algorithm appeared to misinterpret as inappropriate content. The Seed Company expressed confusion over the decision, noting that the ad was meant to promote their Walla Walla onion seeds and did not contain any sexual imagery. Jackson McLean, the company's manager, speculated that the rounded shapes of the onions could have been misconstrued as sexually suggestive, likening them to breasts. Following an appeal from the company, Facebook restored the ad and apologised for the error, emphasising that these kinds of mistakes can occur with their AI-driven content moderation tools. The incident was seen to highlight the limitations of Facebook's content moderation system. System 🤖 Facebook content management system Operator: Facebook users Developer: Face b ook Country: Canada Sector: Retail Purpose: Moderate con tent Technology: Machine learning Issue: Accountability; Accuracy/reliability; Transparency

Date it happened
2020-11-01
Organisation involved
Gaze Seed Company
Product, system or model
Facebook News Feed
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.