← the record
AIAAIC-0180

Hangzhou No. 11 Middle School student surveillance

The installation of a 'smart classroom behaviour management system' which analyses students to make sure they are paying attention triggered a backlash from students, parents, and privacy advocates . Jointly developed by Hikvision and Hangzhou No. 11 Middle School, the system 's 'wisdom eyes' scan students’ faces every 30 seconds to identify seven types of emotions and six types of behaviour , with students receiving a real-time attentiveness score. Teacher display screens issue notifications about which students were inattentive t wenty minutes into each class. The Hangzhou school vice principal said that after a month-long trial, students had begun to accept the monitoring and had improved their behaviour. But t he action resulted in debate on the value and effectiveness on the system, and others like it . It also triggered a backlash from students, parents and privacy advocates, leading to programme being stalled. System 🤖 S mart classroom behaviour management system Operator: Hangzhou No. 11 Middle School Developer: China Electronics Technology Group/Hikvision Country: China Sector: Education Purpose: Assess student attentiveness Technology: Facial recognition; Emotion recognition; Deep learning; Neural network; Machine learning Issue: Accuracy/reliability; Bias/discrimination - gender, ethnicity; Surveillance; Privacy; Security

Date it happened
2018-05-01
Organisation involved
Hangzhou No. 11 Middle School
Product, system or model
Hikvision Smart Classroom Behaviour Management System
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.