Case focuses on alleged failures surrounding AI systems and impact on students BALTIMORE COUNTY, MD – Today, the Lawyers’ Committee for Civil Rights Under Law filed a lawsuit on behalf of four Black current and former students against Omnilert, LLC, Baltimore County Public Schools (BCPS) and personnel, the Baltimore County Police Department, and individual officers […]
School and police officials cancelled the alert, but armed police were dispatched anyway because school and police officials failed to have sufficient protocols in place to prevent cancelled alerts from triggering armed police responses.
This case is a policy issue, and not a technology issue.
It’s probably both. In particular, there’s a concern that if your training data is racist, your AI will be racist. And if your cops are racist, they will be selective about guarding against false positives.
Choosing a technology known for a significant rate of serious mistakes to work without proper supervision in situations were mistakes have nasty consequences, is itself a policy issue.
This applies just as much here as it does when the US Military used AI for target selection without proper veting and thus blew up schools full of children.
It always boils down to humans being in decision-making positions whilst either being incompetent, corrupt or not giving a shit about the consequences for others of their choices.
Blaming the tech is always the humans that chose to have that tech in that situation and used in that way trying to evade their responsability for that choice.
This case is a policy issue, and not a technology issue.
It’s probably both. In particular, there’s a concern that if your training data is racist, your AI will be racist. And if your cops are racist, they will be selective about guarding against false positives.
Choosing a technology known for a significant rate of serious mistakes to work without proper supervision in situations were mistakes have nasty consequences, is itself a policy issue.
This applies just as much here as it does when the US Military used AI for target selection without proper veting and thus blew up schools full of children.
It always boils down to humans being in decision-making positions whilst either being incompetent, corrupt or not giving a shit about the consequences for others of their choices.
Blaming the tech is always the humans that chose to have that tech in that situation and used in that way trying to evade their responsability for that choice.