AI Gun Detection Mistakes Doritos for Weapon, Police Respond

An AI-driven gun detection system at Kenwood High School in Baltimore County mistakenly identified a bag of Doritos as a firearm, prompting police to respond to a 16-year-old student. Taki Allen was enjoying his snack outside the school after football practice when multiple police vehicles arrived, leading to a distressing encounter.

Allen recounted the incident, stating, “It was like eight cop cars that came pulling up for us.” The situation escalated as officers instructed him to get on the ground, handcuffed him, and conducted a search before realizing he posed no threat. “I was just holding a Doritos bag — it was two hands and one finger out, and they said it looked like a gun,” he explained.

Flaws in AI Detection Systems

This incident underscores significant issues with the current deployment of gun detection technology in schools across the United States. Critics highlight the potential privacy violations and the inability of such systems to prevent actual violence. The technology, which has been introduced to enhance security, faces scrutiny for its reliability and effectiveness.

The system employed at Kenwood High School is part of a broader initiative by the Baltimore County Public Schools, utilizing software from the Virginia-based startup Omnilert. According to the Baltimore Banner, the technology analyzes footage from approximately 7,000 surveillance cameras to detect potential weapons. Omnilert spokesperson Blake Mitchell confirmed that the system verified the image resembling a gun and forwarded it to the school’s safety team.

“Even as we look at it now, with full awareness that it’s not a gun, it still looks like to most people like one,” Mitchell acknowledged. The company later classified the incident as a “false positive” but insisted that it served its purpose of enhancing safety through rapid verification.

Impact on Students and Community Response

The repercussions of such a mistake extend beyond immediate fear. Allen expressed concern about returning to school, stating, “If I eat another bag of chips or drink something, I feel like they’re going to come again.” His experience raises alarms about the emotional toll on students subjected to aggressive law enforcement responses triggered by flawed technology.

Allen’s family has called for increased oversight of the technology. His grandfather, Lamont Davis, emphasized the severity of the situation, stating, “There was no threat for eight guns to be pointed at a 16-year-old.” The lack of communication and apology from the school left Allen feeling unsupported. “They just told me it was protocol,” he remarked.

This incident also reflects broader societal concerns regarding the role of AI in public safety, particularly within educational environments. The implementation of such systems has been met with criticism, not only for their inaccuracies but also for potential biases that could disproportionately affect minority students.

As schools continue to explore technological solutions to enhance security, the need for a balanced approach that prioritizes student safety without compromising their well-being becomes increasingly critical. The conversation surrounding AI in schools is far from over, as communities grapple with the implications of relying on technology to manage safety in educational settings.