← the record
AIAAIC-1645

Report: Airbnb uses "secretive" algorithm to judge if users are trustworthy

Airbnb secretly collects and feeds users’ personal data into an algorithm that assesses whether they are trustworthy enough to make a booking . Australian consumer rights organisation CHOICE discovered that Airbnb employs an algorithm that evaluates users' trustworthiness based on a variety of personal data, including social media activity and online behavior. The assessment reportedly includes factors not connected with their rental history, such as language used in communications, past behaviours, and associations with certain topics deemed risky. The discovery prompted concerns that the algorithm could jeopardise user privacy, unfairly penalise individuals based on subjective or biased data, and could lead to discriminatory outcomes - something seen as particularly troubling for marginalised communities who might be disproportionately affected. Some commentators felt the system was similar to "social scoring" - when an automated system assesses a person's trustworthiness or likely future behaviour. CHOICE also took Airbnb to task for poor transparency on how the algorithm functions and the criteria it uses to judge users. Users in Australia complained about not being informed why they had been banned from the platform. System 🤖 Airbnb user trustworthiness scoring Operator : Airbnb Developer: Airbnb/Trooly Country: Australia; New Zealand Sector: Travel/hospitality Purpose: Assess trustworthiness Technology: Behavioural analysis; Personality analysis; Ranking algorithm Issue: Accountability; Accuracy/reliability; Bias/discrimination - profession/job; Tr ansparency

Date it happened
2022-03-01
Organisation involved
Airbnb
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.