Technology

42048 readers

293 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.

Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.

Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 6 years ago

MODERATORS

MinutePhrase@lemmy.ml

Anthropic Drops Flagship Safety Pledge (time.com)

submitted 2 days ago by geneva_convenience@lemmy.ml to c/technology@lemmy.ml

15 comments fedilink hide all child comments

Anthropic, the wildly successful AI company that has cast itself as the most safety-conscious of the top research labs, is dropping the central pledge of its flagship safety policy, company officials tell TIME.

In 2023, Anthropic committed to never train an AI system unless it could guarantee in advance that the company’s safety measures were adequate. For years, its leaders touted that promise—the central pillar of their Responsible Scaling Policy (RSP)—as evidence that they are a responsible company that would withstand market incentives to rush to develop a potentially dangerous technology.

But in recent months the company decided to radically overhaul the RSP. That decision included scrapping the promise to not release AI models if Anthropic can’t guarantee proper risk mitigations in advance.

you are viewing a single comment's thread
view the rest of the comments

[–] twinnie@feddit.uk 12 points 2 days ago (1 children)

They could probably never actually do this. It seems that a trained model is some big mysterious thing that nobody really understands. They take some maths that’s so complicated barely anyone can understand it, feed it all the data they can possibly lay their hands on, then pump insane amounts of computational power through it. It’s the modern day equivalent of Frankenstein’s monster.

[–] kautau@lemmy.world 4 points 2 days ago* (last edited 1 day ago)

Yeah Anthropic has a whole research department for this

https://www.anthropic.com/research/team/interpretability

https://www.anthropic.com/research/tracing-thoughts-language-model

And you’re exactly right. Models at this point are like a trillion floats in complex vectorized matrix math and we don’t really know how that works to produce the output we see