Twitter photo crop algorithm dropped due to age, weight bias

An algorithm used by Twitter to crop photos and other images on user timelines came under fire for perceived gender and racial bia s. The company's 'saliency' algorithm decided how images would be cropped in Twitter previews. However, researcher Bogdan Kulynyc discovered that the algorithm preferred to show faces that were slimmer, younger, and with lighter skin , and seemed to favour stereotypically feminine facial traits . Kulynyc also discovered that the “saliency” of a face in an image could be increased, making it less likely to be hidden by the cropping algorithm, by making the person’s skin lighter or warmer and smoother . Earlier, Twitter’s own research had found the algorithm had a bias towards cropping out black faces . When two faces were in the same image, the preview crop appeared to favour white faces, hiding the black faces until users clicked through . The company also said the algorithm produced an "objectification" bias that focused on a woman's chest or legs, described as "male gaze." Twitter’s own subsequent analysis showed a "4 percent difference f r om demographic parity, in favor of white individuals" . In response, Twitter decided to scrap the image-cropping system; Twitter’s then director of software engineering, Rumman Chowdhury, stated that "how to crop an image is a decision best made by people" . This controversy highlighted the challenges and potential pitfalls of using algorithms in social media platforms and the importance of continually testing and refining these systems to ensure they are fair and unbiased. System 🤖 Twitter saliency algorithm Operator: Twitter Developer: Twitter Country: USA Sector: Technology Purpose: Crop oversized images Technology: Saliency algorithm Issue: Automation bias; Fairness; Transparency Resources 📃 https://blog.twitter.com/engineering/en_us/topics/insights/2021/algorithmic-bias-bounty-challenge https://blog.twitter.com/engineering/en_us/topics/insights/2021/sharing-learnings-about-our-image-cropping-algorithm https://blog.twitter.com/en_us/topics/product/2020/transparency-image-cropping

Date it happened

2021-08-01

Organisation involved

xAI

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.