BDD100K dataset is worse at spotting people with darker skin
The BDD100K self-driving video dataset is less effective at detecting individuals with darker skin tones, according to researchers. The BDD100k dataset was discovered by Georgia Institute of Technology researchers to contain a higher percentage of "dark skin" labels, resulting in reduced accuracy and reliability in autonomous driving systems, particularly in scenarios involving individuals with darker skin tones. By hiring people to manually apply labels according to skin colour based on the Fitzpatrick scale, a scale commonly used to classify human skin colour, the researchers found that BDD100K is, on average, 4.8 percent more accurate at correctly spotting light-skinned pedestrians, and up to 12 per cent worse at spotting people with darker skin. The finding highlighted the need for more diverse and inclusive datasets. System 🤖 80 Million Tiny Images Operator: University of Toronto Developer: MIT Country: USA Sector: Technology; Research/academia Purpose: Identify & classify objects, people Technology: Database/dataset; Computer vision; Facial recognition; Object recognition Issue: Bias/discrimination - race, gender
- Date it happened
- 2019-03-01
- Product, system or model
- BDD100k
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.