“…an active student who claims the principal never apologized and instead made light of the incidents using cry-laughing emojis in texts with other school officials.”
I’m willing to believe the kid on face value here. This same principal is the one exclusively responsible for the cops arriving, she texted a resource officer asking them to call the cops. Clearly doesn’t give a shit about the responsibility of her position. Tech can certainly be built bad and cause problems, as is the case here, but there’s almost always a human in the loop making a bad decision as well. These models were created from our bad and good decisions; they can never be relied on any more than a human, and that’s absolute best case scenario. Like, moonshot best-case.
This event alone should shelve this “tech” for a long fucking time.
99% false positives isn’t even a system. Selecting people at random would probably turn up more weapons
Just think if in the work you did 99% failure rate. My boss would call me and be like, how did you make that 1% improvement?
A 99% false positive rate is not the same thing as a 99% failure rate though. You’d need to look at the false negative rate too. Since the goal is to find weapons and prevent school shootings, the false negative rate would be the actual failure rate. Like the TSA when they have undercovers try to bring weapons through, and 95% of them make it through.
A 99% false positive rate isn’t good, but it’s not a huge problem if you also have a false negative rate of 0%. It just means the model is too overzealous. The problem would be that eventually those responsible for reviewing and reporting the hits would start ignoring them.
If it were a 99% false positive rate and a high false negative rate, then yeah the whole thing is useless.
You ever heard of this story about a little boy who cried wolf?
The problem would be that eventually those responsible for reviewing and reporting the hits would start ignoring them.
I literally addressed that.
Which you prefaced with:
A 99% false positive rate isn’t good, but it’s not a huge problem if you also have a false negative rate of 0%
It is a huge problem when it’s a purpose built system to identify firearms in a school and it’s ineffective at its only job.
Again, that does NOT mean it’s ineffective. That would be the false negative rate.
If it makes 1,000 hits, falsely identifies 990 items as guns that are not, but correctly identifies 10 real guns, then it’s doing its job. It’s just overzealous on what it’s hitting on. It’s still finding all the actual guns, which is the only metric that is really going to matter in terms of public safety. The only real problem is that humans would start ignoring it when it hits.
If it makes 990 hits and all are false positives, and it misses 10 real guns entirely, then that’s an issue.
The only real problem is that humans would start ignoring it when it hits.
Unless it’s only job is to detect them and do nothing then this makes it an ineffective system and is a major issue.
I work in IT and we see this happen often. AI is exacerbating the issue considerably, particularly in cyber security .
An alert that’s wrong 990/1000 times gets ignored 1000/1000 times so those 10 where it’s right don’t matter. And apparently those 990 have a chance of generating a lawsuit.
From a statistical perspective you may be right but from a practical perspective it is an ineffective and broken tool.
The comment you are replying to is correct in regards to statistics and evaluation. There is more too it that “crying wolf”.
False positive AND false negatives is the true measure of failure. True negative and true positive are the opposite measures.
These four can be optimized for depending on the consequences of being incorrectly positive or negative. The consequences for negatively identifying an object incorrectly can outweigh the consequences of incorrectly identifying an object positively.
Depending on that breakdown, a model might be optimized to falsely identify a bag of chips as a gun “just to be safe”. The consequences of missing a weapon might have outweighed the consequences of being incorrect. Crying wolf might be the desired outcome that the school or company wanted because they deemed the risk acceptable.
That said, this is still stupid and police should not have come out after the alter was cancelled and CERTAINLY should not have behaved that way. 99% is way too high of a false positive rate
ACAB, but I like statistics and wanted to explain it.
Crying wolf might be the desired outcome that the school or company wanted because they deemed the risk acceptable.
A 99% false positive rate is a broken system. Mitigating a broken use of shoehorned “AI” by saying it’s not good but not that bad is ridiculous.
This is the real headline. 99% false positives is not a working system.
Over 99% of school system’s AI gun alerts were false positives.
Maybe AI will solve unemployment with all the extra work it causes. 🤡
Did jin yang develop this?
An AI mistakes a Doritos bag for a gun, humans cancel the alert, and somehow armed cops still end up handcuffing teenagers. Over 99% false positives, yet we’re calling this school safety?
Like all civilized nations, we, of course, regulate Doritos bags in this country for the health and safety of our youths.
If it wasn’t for
bad luckartificial intelligence
You knowIthey wouldn’t have noluckintelligence at all
Sure, but you’re missing the true point. Some corp got fabulously wealthy from the sale of the system to the government, so this is actually a heartwarming success story.
They should be able to drag doritos into court and make Pepsico fund their side of the lawsuit…
We demand a fighter jet!
the school’s AI gun detection system suddenly flagged one teen holding a bag of chips as a potential gunman.
No Robocop vibes at all here, no sirree
Can’t wait till the new AI in the FAA declares some Cessna to be some Chinese fighter jet or drone.
So I think it was Cool Ranch and then in the 90s it became Cooler Ranch, then I suppose they made that the new baseline for Cool and reverted back to the original name.
Meanwhile, in Denmark it’s been “Cool American” all the time.
Why? Because for some reason and to my unending regret, ranch dressing just isn’t a thing here.
When did they change it to gun flavor?
When the AI took over the QA department
Doritos… Flavor this good should be illegal.
Garbage journalism used to manipulate. 99% of what. I want to know how many false positives in what time span. 99% is a worthless metric designed to enrage you being dropped by a lawyer.







