Cruise self-driving cars struggle to recognise children
Cruise knew that its self-driving cars had been struggling to recognise children but kept its vehicles on the road anyway. According to internal safety assessment documents obtained by The Intercept , Cruise was concerned that its vehicles might drive too fast at crosswalks or near a child moving abruptly into the street. The materials also indicate Cruise lacks data around scenarios such as kids suddenly separating from their accompanying adult, falling down, riding bicycles or wearing costumes. The materials also revealed that Cruise lacked high-precision machine learning software that would automatically detect child-shaped objects around the car and manoeuvre accordingly, and was relying on human beings to manually identify children encountered by AVs where its software could not do so automatically. Cruise responded that its vehicles had had 'no on-road collisions with children'. System 🤖 Cruise Automated Driving System Operator: General Motors/Cruise LLC Developer: General Motors/Cruise LLC Country: USA Sector: Autom otive Purpose: Automate steering, acceleration, braking Technology: Self-driving system; Comp uter vision; Machine learning Issue: Safety Investigations, assessments, audits 🧐 The Intercept (2023). CRUISE KNEW ITS SELF-DRIVING CARS HAD PROBLEMS RECOGNIZING CHILDREN — AND KEPT THEM ON THE STREETS
- Date it happened
- 2023-11-01
- Organisation involved
- General Motors/Cruise LLC
- Product, system or model
- Cruise AV
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.