this post was submitted on 29 Jan 2026
98 points (100.0% liked)

Cybersecurity

9128 readers
243 users here now

c/cybersecurity is a community centered on the cybersecurity and information security profession. You can come here to discuss news, post something interesting, or just chat with others.

THE RULES

Instance Rules

Community Rules

If you ask someone to hack your "friends" socials you're just going to get banned so don't do that.

Learn about hacking

Hack the Box

Try Hack Me

Pico Capture the flag

Other security-related communities !databreaches@lemmy.zip !netsec@lemmy.world !securitynews@infosec.pub !cybersecurity@infosec.pub !pulse_of_truth@infosec.pub

Notable mention to !cybersecuritymemes@lemmy.world

founded 2 years ago
MODERATORS
top 22 comments
sorted by: hot top controversial new old
[–] NickwithaC@lemmy.world 2 points 26 minutes ago

Signal phone OS when?

[–] umbrella@lemmy.ml 2 points 34 minutes ago

the amount of spying baked into the oses should already be doing the same, right?

[–] redsand@infosec.pub 37 points 6 hours ago (1 children)

Embedding AI in the operating system instead of as a normal program is something that should be punished.

Repeat irresponsible disclosure will not get you paid the same but will fix the architectural problem faster.

[–] Pika@sh.itjust.works 1 points 52 minutes ago

I expect that eventually windows will be anti-trusted again by established nations. we haven't seen it since explorer but, eventually it will happen again.

[–] ptz@dubvee.org 44 points 6 hours ago* (last edited 6 hours ago) (1 children)

I'm not a tin-foil hatter by any stretch of the imagination, but this has long been my assumption on why "AI" is being pushed down our throats so hard and from so many angles.

It's almost the perfect spyware, really.

[–] UnspecificGravity@piefed.social 28 points 5 hours ago (1 children)

There is a reason the FIRST google implementation of AI was to just read all your emails and give you shitty inaccurate summaries of the content.

[–] minorkeys@lemmy.world 6 points 3 hours ago

Like they're barely trying to give you a product justification for invasively spying on you while you use your own computer.

[–] homesweethomeMrL@lemmy.world 21 points 6 hours ago

Whittaker, a veteran researcher who spent more than a decade at Google, pointed to a fundamental shift in the threat model where AI agents integrated into core operating systems are being granted expansive access to user data, undermining the assumptions that secure messaging platforms like Signal are built on. To function as advertised, these agents must be able to read messages, access credentials, and interact across applications, collapsing the isolation that E2EE relies on.

This concern is not theoretical. A recent investigation by cybersecurity researcher Jamieson O’Reilly uncovered exposed deployments of Clawdbot, an open-source AI agent framework, that were directly linked to encrypted messaging platforms such as Signal. In one particularly serious case, an operator had configured Signal device-linking credentials inside a publicly accessible control panel. As a result, anyone who discovered the interface could pair a new device to the account and read private messages in plaintext, effectively nullifying Signal’s encryption.

[–] kbal@fedia.io 14 points 6 hours ago (1 children)

I suppose her attention is naturally focused on encryption, but the result of an untrustworthy operating system is not specific to it: Security in general becomes impossible.

[–] UnspecificGravity@piefed.social 11 points 5 hours ago

Her business is secure communication and communication isn't secure (and can't be secured) if you have someone reading everything over your shoulder.

[–] TribblesBestFriend@startrek.website 6 points 6 hours ago (5 children)
[–] French75@slrpnk.net 8 points 1 hour ago (1 children)

Encrypted apps like Signal work encrypt messages in a way that only you and the recipient can decrypt and read. Not even Signal can decrypt them. However it has always been the case that another person could look over your shoulder and read the messages you send, who you're sending them to, and so on. Pretty obvious, right?

What the author and Signal are calling out here is that all major commercial OSes are now building in features that "look over your shoulder." But it's worse than that because they also record every other device sensor's data.

Windows Recall is the easiest to understand. It is a tool build into windows (and enabled by default) that takes a screenshot a few times per second. This effectively capture a stream of everything you do while using windows; what you browse, who you chat with, the pron you watch, the games you play, where you travel, and who you travel with or near. If you use "private" message tools like Signal, they'll be able to see who you are messaging and read the conversations, just as if they were looking over your shoulder, permanently.

They claim that for an AI agent to serve you well, it needs to know everything it can about you. They also make dubious claims that they'll never use any of this against you, but they also acknowledge that they comply with court orders and government requests (to varying degrees). So... if you trust all of these companies and every government in the world, there's nothing to worry about.

[–] Voroxpete@sh.itjust.works 35 points 6 hours ago (3 children)

He's talking specifically about the idea of embedding AI agents in operating systems, and allowing them to interact with the OS on the user's behalf.

So if you think about something like Signal, the point is that as it leaves your device the message is encrypted, and only gets decrypted when it arrives on the device of the intended recipient. This should shut down most "Man in the middle" type of attacks. It's like writing your letters in code so that if the FBI opens them, they can't read any of it.

But when you add an AI agent in the OS, that's like dictating your letter to an FBI agent, and then encrypting it. Kind of makes the encryption part pointless.

[–] eleijeep@piefed.social 1 points 1 hour ago

He’s talking specifically

She*

[–] MeThisGuy@feddit.nl 4 points 5 hours ago

like using Gboard?

[–] UnspecificGravity@piefed.social 7 points 5 hours ago* (last edited 5 hours ago)

Your operating system and half the software you use has integrated spyware that can read anything you see on your computer or phone as free text and use that information to notify state actors or just whoever the fuck they want of the contents. It doesn't matter that the message was encrypted between you and the other person when they can spy directly on your device.

Its like passing a coded note to a friend in class and then they open it and just read it out loud to everyone sitting there. Didn't really matter that you encoded it.

[–] trevor@lemmy.blahaj.zone 11 points 6 hours ago (1 children)

"Agentic" LLMs are turning garbage operating systems, like Microslop Winblows, into hostile and untrusted environments where applications need to run. A primary example given is how Recall constantly captures your screen and turns the image data into text that can be processed by Microslop, thus making the fact that Signal is end-to-end encrypted largely irrelevant, since your OS is literally shoulder-surfing you at all times. This is made worse by the fact that the only workaround that application developers can use to defend against this surveillance is to implement OS DRM APIs, which are also controlled by the hostile entity.

[–] kingofras@lemmy.world 11 points 6 hours ago (1 children)

During the interview, she described how AI agents are marketed as helpful assistants but require sweeping permissions to work. As Whittaker explained, these systems are pitched as tools that can coordinate events or communicate on a user’s behalf, but to do so they must access calendars, browsers, payment methods, and private messaging apps like Signal, placing decrypted messages directly within reach of the operating system