Retorio talent personality assessments criticised as inaccurate, biased
A n algorithm owned by Munich-based start-up Retorio responds differently to the same candidate in different outfits, such as glasses and headscarves, prompting concerns about accuracy and bias. Retorio analyses video to determine personality attributes based on the 'Ocean' Big Five Model, which breaks down scores into 'openness, conscientiousness, extraversion, agreeableness, and neuroticism.' However, r eporters from Bayerischer Rundfunk (German Public Broadcasting) discovered that the company's personality assessment system produced significantly different scores when analysing a woman wearing spectacles and a headscarf, a darkened video of a Black woman, or when a bookshelf was added in the background. Retorio responded by saying the difference in results was due to the fact that the system had been trained based on how a chosen group of human recruiters perceived jobseekers and their personalities, leading the algorithm to reproduce the feelings and biases of those humans. On its website, Retorio describes its personality product as 'the world's most innovative video-based personality assessment.' System 🤖 Retorio 🔗 Operator: Lufthansa; BMW Group; ADAC Developer: Retorio Country: Germany Sector: Business/professional services Purpose: Identify personality traits Technology: Emotion recognition; Facial analysis; Computer vision Issue: Accuracy/reliability; Bias/discrimination - race Investigations, assessments, audits 🧐 BR24 (2021). Objective or Biased? BR24 (2021). FAIRNESS ODER VORURTEIL?
- Date it happened
- 2021-02-01
- Organisation involved
- Lufthansa; BMW Group; ADAC
- Product, system or model
- Retorio personality asssessment
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.