lurker

joined 6 months ago
[–] lurker@awful.systems 1 points 33 minutes ago* (last edited 33 minutes ago)

Telling people that the guy AI superintelligence guy also posted a Harry Potter self-insert fanfic to push his beliefs and recruit people to his ideology is a huge bombshell to drop on someone

[–] lurker@awful.systems 1 points 35 minutes ago

It’s always, always 2027

[–] lurker@awful.systems 3 points 2 days ago* (last edited 1 day ago)

I read their spreadsheet and their % progress numbers in terms of AI capabilities is MASSIVELY skewed by Claude Mythos. The rest of it is below the mark if you exclude that.

They also admitted that the “China wakes up” prediction hasn’t happened yet, and Kokotajlo still claims that the scenario is “roughly on track” even though the US/China race is important for the scenario, and if China hasn’t woken up, that derails things pretty hard imo. So does OpenAI’s slowing down announcement

[–] lurker@awful.systems 1 points 2 days ago* (last edited 2 days ago) (1 children)

I took a quick look over the article again, this spreadsheet contains how they measure their metrics. "Compute" seems to be based off number of chips, which is probably in part based off data centres anyways

And apparently they have ditched METR and are now using "coding uplift (i.e., how much of a speedup AIs are providing to software engineers at AGI companies) and revenue."

[–] lurker@awful.systems 8 points 2 days ago* (last edited 2 days ago)

I've never heard of abuse allegations against Altman, so I looked them up and holy shit wow.

[–] lurker@awful.systems 2 points 3 days ago (2 children)

Yeah that's what tripped me up, because if that was true then it'd make no sense why the percent of progress went up while the uplfit number went down.

[–] lurker@awful.systems 9 points 3 days ago* (last edited 3 days ago) (1 children)

The tech bros have no one to blame for this but themselves. They're the ones who pushed the 'it'll take your jobs/its super scary' narrative more than anyone else

[–] lurker@awful.systems 4 points 3 days ago* (last edited 3 days ago) (4 children)

According to one of the writers apparently 17% is supposed to be 'progress is 17% slower than expected', so the 34% figure here implies progress is 34% slower than expected, so that's actually worse

[–] lurker@awful.systems 1 points 4 days ago* (last edited 4 days ago)

It just occurred to me that this makes Anthropic look bad, actually

if OpenAI is slowing down because they concerned about ~~money~~ AI safety, then it makes Anthropic look like fools for publishing that blog where they waffle on about keeping up the race because of “bad actors”

If OpenAI is slowing down, an Anthropic that actually is concerned about safety would slow down too. But they won’t, because ~~money~~ ~~China~~ “bad actors”

[–] lurker@awful.systems 1 points 4 days ago* (last edited 4 days ago) (8 children)

Here's that side-by-side comparison

[–] lurker@awful.systems 2 points 4 days ago* (last edited 2 days ago) (11 children)

Well it took longer than I expected, but the AI 2027 guys finally posted a second update

their updated model website

This table is essentially the TLDR

They also finally explained the "2025 was 75% of AI 2027's progress" thing and it seems like that number was mostly skewed by revenue (edit: valuation) numbers (Edit 2: apparently this is wrong?? the 75% figure is supposed to represent 2026 progress. So 2025 was still 65%, I think. These people are confusing)

For some reason their website lists the date of ASI as 12/2028 even though their actual graph only had a 32% chance tops of ASI happening on that date

2
submitted 1 week ago* (last edited 1 week ago) by lurker@awful.systems to c/sneerclub@awful.systems
 

From the Old SneerClub

From the recent influencer camp, our friends have made a parody music video on AGI apocalypse. I wish I was joking

 

Originally posted in the Stubsack, but decided to make it its own post because why not

 

this was already posted on reddit sneerclub, but I decided to crosspost it here so you guys wouldn’t miss out on Yudkowsky calling himself a genre savy character, and him taking what appears to be a shot at the Zizzians

 

originally posted in the thread for sneers not worth a whole post, then I changed my mind and decided it is worth a whole post, cause it is pretty damn important

Posted on r/HPMOR roughly one day ago

full transcript:

Epstein asked to call during a fundraiser. My notes say that I tried to explain AI alignment principles and difficulty to him (presumably in the same way I always would) and that he did not seem to be getting it very much. Others at MIRI say (I do not remember myself / have not myself checked the records) that Epstein then offered MIRI $300K; which made it worth MIRI's while to figure out whether Epstein was an actual bad guy versus random witchhunted guy, and ask if there was a reasonable path to accepting his donations causing harm; and the upshot was that MIRI decided not to take donations from him. I think/recall that it did not seem worthwhile to do a whole diligence thing about this Epstein guy before we knew whether he was offering significant funding in the first place, and then he did, and then MIRI people looked further, and then (I am told) MIRI turned him down.

Epstein threw money at quite a lot of scientists and I expect a majority of them did not have a clue. It's not standard practice among nonprofits to run diligence on donors, and in fact I don't think it should be. Diligence is costly in executive attention, it is relatively rare that a major donor is using your acceptance of donations to get social cover for an island-based extortion operation, and this kind of scrutiny is more efficiently centralized by having professional law enforcement do it than by distributing it across thousands of nonprofits.

In 2009, MIRI (then SIAI) was a fiscal sponsor for an open-source project (that is, we extended our nonprofit status to the project, so they could accept donations on a tax-exempt basis, having determined ourselves that their purpose was a charitable one related to our mission) and they got $50K from Epstein. Nobody at SIAI noticed the name, and since it wasn't a donation aimed at SIAI itself, we did not run major-donor relations about it.

This reply has not been approved by MIRI / carefully fact-checked, it is just off the top of my own head.

 

I searched for “eugenics” on yud’s xcancel (i will never use twitter, fuck you elongated muskrat) because I was bored, got flashbanged by this gem. yud, genuinely what are you talking about

view more: next ›