Crossposted from HackerNews
I should be shocked that eight cops looked at a picture of a black kid holding a bag of doritos in his hand and agreed that it was a gun. why am I not shocked?
“The AI gave just us go-ahead, boys. Open fire!”
That’s unironically already been happening in Gaza for years now, and will now happen everywhere Palantir is used.
This is the premise of the video game Long Gone Days and the Netflix episode Black Mirror: Men Against Fire.
Gunshots By Computer, Saul Williams / NiN.
Welcome to Year Zero.
I hate every one of these replies.
Welcome to hyperreality, enjoy your stay!
Also, there is no way to leave.
Its cops. They just saw a black kid and figured they could plant a dime bag or a toy train after the fact.
You see to the untrained ear Choo Choo sounds like shoot! shoot!
I’m not convinced they looked at anything. The AI sounded the alert and they peeled rubber.
Minority report
Minority report had a specialist review the footage and present the case to
threetwo witnesses who teleconferenced in andapproved the arrestwitnessed the investigation before sending in the troops.So this is not that dystopian cautionary tale. It’s worse.
Edit: re-watched the intro. The witnesses watched, but the police arrested the perp on their own accord. One of the witnesses is a judge though. So I guess it’s a pretty well supervised process.
I was making a dumb joke. The ai reported a minority…
“Computer says” is enough confirmation for most people.
Yeah, that’s the sketch that always comes to my mind when it comes to people in positions of authority and computers.
They probably just trusted the AI. Like everyone else is doing for some reason.
It was in his pocket, the pocket bulge was picked up as a probable gun.
Notoriously gun shaped bags, Doritos, the shitty system definitely doesn’t just flag anything.
I am shocked that (thankfully) they didn’t shoot him.
Essentially this AI is a racist markov chain that can be simplified:
Skin colour = dark -> something in his hand = true -> result = A WEAPON A WEAPON!!!
It is doing good work replacing the police’s job of racially profiling minorities. Very efficient.
It wasn’t even in his hand.
The crumpled Doritos bag in his pocket had been mistaken for a gun.
This was a good kid who crumbled up the bag and stuck it in his pocket instead of littering, and he gets traumatized by a bunch of cops for it. Hell, he could have lost his life if an acorn had fallen at the wrong moment.
Ah okay.
In protest, everyone in that school should walk around with rulers, wrappers, bottles and other things sticking out of their pockets to trigger the system.
For fucks sake in 2002 I and all the other FFA kids went to school with knives and/or multitools clipped to our belts.
In the 80s, my Mom’s redneck ass school allowed all the dudes that hunted to keep their guns in their pickup truck gun racks. Which were very visible.
Yup. Late 80s/early 90s The only rule my high school had was that if you brought your guns to school, you had to park in the ‘smokers lot’ since it wasn’t technically on the same property as the school building.
It was just as it sounds, the lot across the street for the students to smoke during class breaks (the teachers were allowed to smoke in the teachers lounge).
My principal saw Schrade Switch-It clipped to my pants and thought it was a pager, and sternly admonished me not to bring my “pager” to school anymore.
Righty-o, man, no pager, I told him. No problem.
What a toolbox.
Omnilert later admitted the incident was a “false positive” but claimed the system “functioned as intended,” saying its purpose is to “prioritize safety and awareness through rapid human verification.”
What?? How is it prioritizing safety if it did exactly the opposite and created an unsafe environment (a bunch of US cops with guns pointed at teens)?
Black kids aren’t supposed to feel safe. Safety is for everyone else.
That was the quote I was about to paste, like what the actual fuck? Traumatizing innocent teens is functioning as intended eh? Wonder how many of our tax dollars is going towards this? Actually I probably don’t want to know…
In 2021, writer and game designer Alex Blechman inadvertently created a meme:
Sci-Fi Author: "In my book I invented the Torment Nexus as a cautionary tale."Tech Company: "At long last, we have created the Torment Nexus from classic sci-fi novel Don't Create The Torment Nexus!"
AI is a big component of the new and improved Torment Nexus which is coming along nicely.
Appreciate the source
Don’t worry guys, they’re only putting these AI cameras in literally every city and doing it in shady ways without anyone knowing. And false flags like this happen very frequently.
Look out! He’s got a whole bag full of ninja throwing triangles!
its the same thing light yagami used to hide a tv, so he can MURDER people with the notebook.
Doritos, This much flavor should be illegal.
You’re welcome lays, I’ll take $200k for the idea.
AI detection system detects black person.
WONTFIX: Working as intended.
I turned on the person detection on our Nest doorbell at work. Well-lit interior hallway.
It was useful because when the bell rang, it would tell you who was waiting.
White staff, 95%+ accuracy
If your skintone was even light mocha, you were all lumped together under one person. Male, Female, no difference.
We had some Korean people fly in for an event, they were all lumped together with one of our employees.
Shows the importance of having a human in the loop.
And since the police vetted the image properly they shouldn’t be afraid of publishing it, right?
Drop the weapon!
Now correctly identifies the dropped doritos bag.
Drop the weapon!That was just a minor glitch. Also who even liked Kenny anyway?
SIR, WE CAUGHT HIM RED HANDED
Red-handed, or orange-fingered?
Definitely orange.
Omnilert later admitted the incident was a “false positive” but claimed the system “functioned as intended,”
A black person gets harassed by police without reason. System is functioning as intended, indeed.
This could have been prevented if armed ‘protection’ drones had been installed at the school. The cops could have just stayed in the donut shop while the drones swarmed the student.
Cops not thinking and reliant on system to judge is how we get to psycho pass timeline
At least Sibyl System was not AI slop. I’ll take that over GPT-5 any day.
It was the most fair system made conceived by the human hive mind 😝
