Key Takeaways
1. Kenwood High School implemented an AI security system called Omnilert to detect weapons using existing surveillance cameras.
2. The system mistakenly identified a bag of Doritos as a firearm, leading to a dangerous encounter for a student.
3. Police were not informed that the AI alert had been canceled, resulting in a delayed and aggressive response.
4. The incident sparked calls for accountability and changes in AI surveillance practices, with many attributing the issue to human error rather than AI failure.
5. There is a need to improve communication between security teams and law enforcement to minimize risks and reduce false alarms.
Kenwood High School in Maryland has implemented an AI-driven security system known as Omnilert, which utilizes current surveillance cameras to constantly look for possible weapons. However, this system is not infallible. On the night of October 20, it incorrectly identified a bag of Doritos—a very popular snack in the U.S.—as a firearm.
Scary Encounter
The chips belonged to Taki Allen, a 17-year-old student who was waiting for his ride after football practice at around 7 p.m. Suddenly, police sirens erupted, and eight patrol cars arrived on the scene. Officers rushed out with their guns drawn, aiming at him. “I thought I was going to die… they had guns on me,” Allen told CNN. He was made to kneel, handcuffed, and searched, only for the officers to discover nothing but an empty bag of chips lying on the ground.
Communication Issues
Principal Kate Smith stated that the AI alert had already been canceled before the police came. Unfortunately, the update did not reach the officers in time, as a school district spokesperson revealed to WBAL-TV 11. Superintendent Myriam Rogers described the incident as “unfortunate” and mentioned that a complete review would take place. Support services will be available for the students affected.
Call for Change
Following the event, Allen’s grandfather, Lamont Davis, demanded accountability and changes in how AI surveillance is used. This incident also ignited a heated discussion on social media. On Reddit, users expressed strong disapproval of the police, school administration, and the technology itself. Many people contended that the core problem was not the AI but rather the human response to the alert. “Human error, not AI failure,” was among the top comments.
A system intended to identify weapons early is logical, especially in the U.S., where school shootings pose a significant threat. However, it is essential to make sure these tools do not create additional risks. This involves reducing false alarms and ensuring effective communication between security teams and law enforcement.
Source:
Link