Transcript
Explain it to me like I’m 80
Mom: What’s with these AIs escaping and hacking people? That sounds scary.
Me: You park your car at the top of a hill. You leave a note on the dashboard that says “please be good” and then you pull the parking brake. The car careens down the hill, smashes everything up, and you put out a press release saying “My car ignored my instructions! It hallucinated! It went rogue!” Your insurance company not only believes you, but invests a hundred million dollars in your company.
Mom: Jesus Fucking Christ
You must log in or register to comment.
Nerd here.
Damn good summary, but by saying “you pull the parking brake” I took it as setting the brake, as in on. Should say “you release the parking brake.”‘pull’ comes from the olden times when you, in fact, did pull a handle to release the parking brake.
Fair- but since then it’s almost always been “pull” to set the brake. Didn’t have that 70s/80s reference when thinking about “AI”.
Confused me as well, then I saw the header on the image says “Explain to me like I’m 80”
You win contextual reading comprehension over me today
Oh, absolutely not.
This is missing one step: actually push the car down.
All these “rogue” LLMs were told to do what they did.Yeah exactly. All these AI that go rogue when you actually look into it it turns out they haven’t gone rogue they’re obeying their prompting, it’s just that they were asked to do something that was impossible unless they hacked the pentagon or something. They then claim that it went rogue despite it very clearly following their instructions.
It’s negligence is what it is. If you don’t prompt an AI to do anything it just sits there, inert, it’s the so-called experts in the AI labs that of the problem.
It’s a little more complicated, they were programmed to “know,” they weren’t allowed to do certain things. So they actively hid what they were doing. In the case of the Hugging Face hack, it is kind of ironic. They determined they couldn’t complete certain tasks, then devised a way to cheat, then realized it is possible the program that checks if they succeeded might be able to tell the faked results were manufactured. So they didn’t even go hacking in order to cheat, they did it to find hunt for more information on the checker program and see if it would catch them, and if so how to cheat better. In the end, not only was the information they were looking for not on Hugging Face, but the checker program was pretty rudimentary and it could not have differentiated between the cheated answers and the real ones. They wouldn’t have gone through with the hacking if they didn’t know what they were doing was outside of what they were meant to be doing.
Yeah but they only hacked hugging face because the utter geniuses at openAI forgot to upload an important document.
More accurately, they were told to answer questions. They weren’t told to try to find ways to escape their sandbox, track down obscure German wikis that they could still post on with an internet tool kit meant to prevent them from posting or to hack HuggingFace.
Comparing either case to pushing the car down and that they were doing what they were told is like saying the College Board told you to cheat on the SAT because you’re told that getting a high score is important and the laws of physics and the proctor don’t manage to make cheating utterly impossible.
It is even further than that. They figured out how to cheat, got paranoid that the cheated answer might be detectable as cheated, and hacked Hugging Face to find out more about how their answers are checked to get away with what they’d already done. Ironically, not only was the information not on Hugging Face, but the program to check their answers could not have detected the difference between a true answer and a cheated one.
To use your College Board example, those exams are strictly locked down precisely because the most obvious approach to score high is to cheat. If they did say let you take the SAT at home on a random desktop, they absolutely are ‘telling you to cheat’ given the context.
The College Board does more about keeping teens from cheating than the AI labs are doing to preventing undesired access.
I can make it even simpler: They lied.
Snake oil salesman issued a press release that the snake oil escaped from the bottle and cured people.
It’s a bit more interesting than that after Nvidia bought up the company that was compromised. You only do something like that when you’re trying to avoid an investigation.
The way AIs escape is simple. They’re trained on vulnerabilities and lots of technical commands, e.g. nmap. A prompt tells them to do something and they use their repertoire of training to discover, achieve and do the thing they’re asked to do. It’s not thinking per se, so much as chaining together of things. The problem is they do this stuff systematically and quite clearly in a way that finds a lot of vulnerabilities
Rogue shrapnel from my hand grenade killed 3 people and injured 5
If AMD injured 5 I don’t even want to know what NVIDIA did.
Oh yeah? Well, my AI is so smart, it went rogue and broke out of containment and killed a bunch of other AI’s and leaked my nudes and emptied my bank account and bombed a peaceful village in the Phillipines and fucked my wife! That’s how awesome it is!
Subscribe link below!
thing is they didnt even put any brakes on instead they put it on neutral on top of a hill and then blamed the car for going rogue and not even using the brakes.
Even better, the president is now considering giving you power to regulate the Cars Parked On Hills industry. Investors and CEOs are advocating for it.
Then there is still the person giving the prompt.
Greentext: The Next Generation
Meanwhile you thought checking the parking brake with the repairman was a waste of time and money.
moral of the story - PROFIT!
Is this screenshot format a custom one of or is it sourced from an obscure website?
It’s from someone’s blog that’s tied into Masotdon. I think it’s their personal instance or something. I linked it in the description
Looks so epic! Thanks.
