The local school where I live completely disabled their AI weapon detection system for this same issue. Students kept getting targeted for having weapons they didn’t actually have.
School and police officials cancelled the alert, but armed police were dispatched anyway because school and police officials failed to have sufficient protocols in place to prevent cancelled alerts from triggering armed police responses.
This case is a policy issue, and not a technology issue.
It’s probably both. In particular, there’s a concern that if your training data is racist, your AI will be racist. And if your cops are racist, they will be selective about guarding against false positives.
Choosing a technology known for a significant rate of serious mistakes to work without proper supervision in situations were mistakes have nasty consequences, is itself a policy issue.
This applies just as much here as it does when the US Military used AI for target selection without proper veting and thus blew up schools full of children.
It always boils down to humans being in decision-making positions whilst either being incompetent, corrupt or not giving a shit about the consequences for others of their choices.
Blaming the tech is always the humans that chose to have that tech in that situation and used in that way trying to evade their responsability for that choice.
I hope those four sue the AI/Camera company, the school, the school board and the police to Kingdom Come for this show of utter stupidity.
Any system with false positives can work… but only if it has proper oversight. Clearly this one didn’t. I hope they win.
Eating Doritos while black.
Damned KKKai.
So the false alert was noticed by human personnel, but the cancel alert they issued didn’t cancel the alert.
We sure treat our school kids differently from Epstein associates.
The kids from Epstein file associates would likely never have this kind of system in their schools in the first place.
Good. They deserve compensation and the district needs to be made aware, financially, what a dumb idea these systems are. This so-called screw up could have very easily cost them their lives.
Yeah. Let’s say the person holding the bag of chips was wearing a very identifiable hoodie, and the cops show up just as they can see that the kid’s jogging into the school (because of the bell).
“I shot that kid because he was clearly running after some kids to shoot them, it was the only option and I had to think fast!” - some cop someday, probably
Don’t forget the part where they killed 3+ bystanders “on accident” after missing the first several shots.
And then try to pin it on. Him if he survives.
AI is the perfect excuse for systematic malicious abuse.
This shit vastly predates AI.
Blame the computer is so stereotypical that there’s an entire sketch in the British comedy series “Little Britain” were somebody keeps denying totally reasonable requests from people by checking her computer and saying “Computer says ‘No’”.
People blaming the software for what’s ultimatelly either a choice of inapropriate or flawed software by a person, something configured in the software by a person or a process involving software set up by a person which lacks appropriate human participation in vetting or as fallback for the software, is a tale as old as computers are old.
Ultimatelly you’ll always find one or more human making flawed decisions, even if that’s the decision of having a fuzzy logic piece of software directly connected to a system for calling armed police directly making or not the choice to activate that system without a user in the middle to vet it.
deleted by creator
Well, at least it’s not at this level (yet):







