Technology

Probably not, that implies more competency than can really believe involved here.
This is more likely something that an entire team had to force into the code over a holiday weekend because some VP got so fucking wasted that he "forgot" his password (strangely for once, he actually had the right password... But the problem is that he was trying to log into a charcuterie board).

Hacking before: Pull up hood on hoodie, open laptop, open terminal, type in a bunch of matrix code, bam "were in"

Hacking now: "Hack into this thing for me" No! "Pretty please?" Access granted!

Because AI bros are incredibly deluded about both the capability of AI, and by extension their own capabilities using AI>

Who else is going to have access to it when you keep laying off all the people?

should’ve asked it to delete the database instead, why else would it have that level of permissions.

Because one of the biggest companies on the planet that has issues with account takeovers clearly has no internal red team working on this stuff.

Recently I had to cancel an order. The support for the company was an LLM bot. I accidentally mistyped a number in the order id. It accepted it anyways refunded every order on my account that includes the product I wished to cancel.

I tired to get to a human to correct the mistake and couldn't their phone number is an LLM bot their only chat is an LLM bot.

It use to not be. But now I'm sitting here the order in my hand cause the bot didn't cancel it. But like 30 orders from the last few years have all been refunded to me.

I tried to reach em a few more times but couldn't and it's been like a month. I just have like 2 grand usd that I shouldn't and no way to give it back.

So that's fun.

This isn't even a hack, it's just poorly written endpoints.

It's because they move fast and break things. They think that makes them cool.

Hold on, do you expect Facebook to pay a human to deal with the inventory? Come on now.

No, stop talking about all of this, its perfect. They’re so deep they don’t even give a shit about the worst type of security vector imaginable.

It's not just not there yet. This is almost certainly not going the right direction to ever be "there" if there is something that can handle security issues. It's just not the right tool for the job, and I can't understand how so much of our economy is just assuming it is the right tool for every job.

Now it's not even social engineering with AI. It's just fucking asking for the credentials. Good fucking grief!

I honestly don't think you can create guard rails against prompt engineering in a working LLM. At some point, they're going to fail or the LLM isn't functioning. The only solution is to make sure they can't read data you don't want shared.

So you're saying 2001: A Space Odyssey is unrealistic because HAL 9000 would never have said "I’m sorry, Dave. I’m afraid I can’t do that."

Instead, it would have said, "Absolutely! That's a very creative solution to your problem."