Baltimore student handcuffed after AI system mistakes bag of chips for weapon
A Baltimore County high school student was handcuffed after an AI surveillance system mistakenly identified his crumpled bag of chips as a gun, raising questions about the accuracy and reliability of the system. What happened Student Taki Allen was sitting outside Kenwood High School after football practice and was flagged by an AI-powered gun detection system that erroneously identified his Doritos bag of chips as a weapon. The false alarm triggered a heavy police response, with approximately eight police cars arriving, officers drawing their guns, detaining, handcuffing, and searching the student , before realising the error. The incident caused the student emotional distress, humiliation, and trauma due to false imprisonment and unnecessary physical restraint. Why it happened The alert was generated by AI weapons detection system Gun Detect, which flagged the bag of chips as dangerous and escalated the event for human review. Developed by Omnilert, Gun Detect is designed to detect weapons using advanced visual recognition, but it misinterpreted the shape and positioning of the chip bag in Allen's hands. The error highlights the lack of accuracy of the system and the lack of adequate human oversight in interpreting such critical alerts. What it means The incident reflects the dangers of overreliance on imperfect AI technology in sensitive environments like schools, and t he failure to immediately recognise the alert as a false positive . For the victim, it potentially means long-term psychological harm and loss of trust in school safety measures. More broadly, it stresses the need for enhanced safeguards, robust human review mechanisms to prevent harms caused directly or indirectly by AI. System 🤖 Gun Detect 🔗 Developer: Omnilert Country: USA Sector: Educa tion Purpose: Detect weapons Technology: Computer vision; Context recognition; Machine learning Issue: Accuracy/reliability; Autonomy; Human/civil rights
- Date it happened
- 2025-01-01
- Organisation involved
- Kenwood High School
- Product, system or model
- Gun Detect
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.