Architeuthis

joined 3 years ago
[–] Architeuthis@awful.systems 8 points 3 days ago* (last edited 2 days ago)

It had disabled safeguards on purpose, left the systems attached to the internet and then let the AI software agents do their worst, while pretending not to notice.

“It’s an ethically challenged publicity stunt,” says one highly experienced senior security expert who has led the development of global technical security standards.

Cats and dogs living together, skepticism of press releases in tech journalism, mass hysteria.

The coverage of the Effective Altruism aspect is also refreshingly uncharitable.

edit: Archive is link if you don't feel like enabling cookies

[–] Architeuthis@awful.systems 2 points 4 days ago

All this is not just one lone weirdo running tryouts for her cult in some way that’s nothing to do with the rest of the subculture.

Starship troopers im doing my part meme

[–] Architeuthis@awful.systems 3 points 1 week ago* (last edited 1 week ago) (1 children)

New things I think learned from this thread:

  • the thief used a blockchain provider instead of an ad-hoc local node, making all the transactions incredibly traceable with (unclear to me) implications about their ability to launder them or keep their identity concealed indefinitely.

  • even if they are found out, the previous owners probably won't see a dime back since the vulnerability affects exactly the ability to prove you really were the previous owner.

Unclear which thief since the web3isdoinggreat writeup says there had been up to 15 unique groups doing mass drains by 31/7, maybe the initial 500 wallet sweep was one person or group?

[–] Architeuthis@awful.systems 5 points 1 week ago (1 children)

In a world where the AGI/ASI discourse wasn't so heavily poisoned by anthropomorphization a discussion on whether agency and self-determination are integral to the rise of disembodied consciousness might be worth having, i.e. if something is recognizably conscious should we immediately assume it knows how to want, or is consciousness meaningfully interchangeable with awareness?

Some guy tried to write a scifi book about non-anthropomorphic consciousness and he ended up mainstreaming the discourse about how the self isn't a thing in itself and consciousness as an evolutionary deadend. It's called Blindsight and it's got space vampires who optimized reading gauges by swapping the usual moving-spike-that-points-at-numbers design with depictions of human faces at various stages of suffering.

[–] Architeuthis@awful.systems 4 points 1 week ago

We added it to make it clear that if you get harassed by the people who control whether you get your stipend you are on your own, so please don't make it a big deal when it happens, ok? That just how it goes in these quirky and fun safe spaces that require you to move into a compound in a different city for extended lengths of time.

[–] Architeuthis@awful.systems 10 points 1 week ago* (last edited 1 week ago) (1 children)

Ziz reported being asked similar icebreaker questions.

The reddit post from /r/Grimes you linked there has its issues but it does a great job putting into words the parts that bother me with both the cow-fucking questions and the forced "openness" that requires people to always be ready to answer for the normally intimate parts of their personalities and how it's comparable to grooming.

The reddit post is incredibly long winded so if anyone is interested in this part specifically ctrl+f for compliance filter.

Also super yikes on the Aella tweet advertising her alleged friend's onlyfans that's opening next week because that's when she turns 18, which sounds exactly like if she had groomed a minor into sex work.

[–] Architeuthis@awful.systems 2 points 1 week ago

Makes sense, thanks.

[–] Architeuthis@awful.systems 7 points 1 week ago (15 children)

Need ideas for ways to spend philanthropy money without helping absolutely anyone? Check out AI safety influencer bootcamp at Lighthaven!

Basically Aella gathered like 60 people with a seminotable online presence to stay for free at Lighthaven for a month as long as they managed to publish at least one relevant video (15 sec minimum) each day.

Rationalism ensued:

“It’s really hard to run a fellowship that’s not an indoctrination camp,” [cofounder with aella] Fernandez said. “If you don’t try really hard to not make an indoctrination camp, you will on accident.”

Uh oh

A fellow recognized me and asked whether I was there for the “torture potluck.” I had no idea what he was talking about.

It was exactly what it sounds like: an all-you-can-tolerate buffet of unpleasant experiences, for the sake of Fucking Around and Finding Out. [...] Just before midnight, a small crowd gathered around someone laid down on an AstroTurf-lined wheelchair ramp. He was the first of shockingly many in line to get waterboarded — one of the most in-demand items on the torture menu.

So silly omg

After a string of expected questions such as “What’s your take on AI?” and “What kind of content would you want to make?”, the form asked, “If you had to have sex with a cow would you rather it be dead or alive? Why?” All Comic Sans, with animated rainbow dots floating alongside the form field. [...] [Fernandez said] “We added it in to make it pretty clear that we don’t have a PR department or an HR department,” he said.

“Even the icebreakers, like everything, they want you to know that they’re part of the weird community,” one fellow told me. “‘Stand over here if you’re super sexually active, and over here if not,’ or like, ‘rate yourself based off of like, the last time you masturbated.’”

The unifying thread, despite the fellows’ ideological diversity, is something like “openness.” Everyone at PDKU was willing to drop everything, move to Berkeley for a month, live in close quarters with strangers, and be perceived doing silly things on the internet.

It's really unclear what sort of ideological diversity is referenced unless it's about having both blue haired and green goatee'd people. Maybe we've reached the point where everyone is expected to assume race science enthusiasts will be at a rationalist event at some capacity.

Also the whole thing sounds like having tryouts for a cult.

[Fernandez] says PDKU has a conduct policy, authored by him, that discourages relationships across power differentials. When I asked him how that gets enforced, in the absence of an HR department, he mentioned an unnamed community health lead.

Same with the diversity thing, they are preemptively saying that there for sure weren't no sexual harassment shenanigans this time.

The third methinks thou dost protest too much comes as an extened NO U jab at other shady thinktankers trying to astroturf support for their thing.

Amid the science communication, shitposting, and heartwarming summer camp energy, there’s a giant elephant in the room. “It’s another multi-million-dollar thing happening on a compound in California,” CJ said. “Does everyone think you’re just an annoying cunty psyop?”

Don't believe your lying eyes is apparently the note on which they chose to end this.

[–] Architeuthis@awful.systems 5 points 1 week ago (2 children)

Is Wyvern something people would be expected to care about? I thought all his clout was from being the Gas Town guy.

[–] Architeuthis@awful.systems 7 points 1 week ago* (last edited 1 week ago)

It says he's doing AI transformation consultation now. Imagine paying good money to be told that you need to tuck copilot to bed every afternoon.

[–] Architeuthis@awful.systems 6 points 2 weeks ago

It's not fragile and unergonomic, it's robot-uprising-proof!

Also like will the warranty actually cover damages suffered when trying to squash the rebellion?

[–] Architeuthis@awful.systems 1 points 2 weeks ago* (last edited 2 weeks ago)

Even habryka has misgivings about the Laurenson writeup:

I do think almost all of what it says is literally true and I would recommend reading it to learn things about Leverage if someone is doing their own study and looking for facts, though wouldn’t recommend it for someone who is looking for a reasonable high level summary.

It somehow completely fails to cover Leverage deploying spies into other organizations and trying to take over CEA. It fails to cover the enormous number of straightforward lies told by Leverage staff in that and other contexts.

There is something that feels really weird about the article. As if the central story it is trying to tell is that Leverage fell apart due to no fault of any of its members because they encountered ancient magic or something. Which is a fun story to tell but really doesn’t map what actually happened IMO.

Also multiple people clearly had what I would describe as a psychotic break at Leverage and the casual disparagement of Zoe’s article really doesn’t feel good to me.

Laurenson herself replies and double downs on her no psychotic breaks at Leverage assessment. Her stance on psychotic break diagnosis comes off about as self-serving as SlateScott's it's not real autism if I can plausibly be described as having it musings from back in the day.

20
submitted 1 month ago* (last edited 1 month ago) by Architeuthis@awful.systems to c/sneerclub@awful.systems
 

Copied from the stubsack:

The Inside story of Leverage Research

This should be interesting, it's about an organisation in the EA milieu that even other EAs though might be a bit too culty. Don't know who the writer Lydia Laurenson is, but she does come off as a bit of a cult enthusiast herself, and is probably more than a bit rationalist adjacent.

edit: The companion piece about the background of why she wrote it is quite a ride, if only for the biographical tidbits: she is indeed very cult adjacent, she had a spiritual experience and now believes in capital G god, she got engaged to an unnamed far-right writer but they broke up when she got pregnant.

Also the Leverage article was contracted to appear in the New York Magazine but she pulled the story because of uh declining trust in the field of journalism, but then she goes on to imply that the real problem was that the article was shaping up as a bit too pro-Leverage:

I pulled the story once I started feeling like it simply wouldn’t be possible for me to publish a version with NYMag that didn’t carry a subtle hostility towards Leverage, not to mention affiliated communities in Silicon Valley — and, more importantly to me, hostility towards a core spiritual sensibility that I see in both myself and in the people the story describes.

edit edit: Why can't these people ever be normal: Why I Was Part Of The Neoreactionary or Dissident Right Movement In 2020

edit edit edit: Jesus fucking christ she's Curtis Yarvin's baby momma.

edit x 4: Index of the read along posts, part titles are from the original:

 

From the rationalists are a net negative for society dept: Scott Alexander's latest (that I'm not linking) is all about how you should be using the slop machine to tell you who to vote for.

He's even so kind as to share his prompt:

I’ll be voting in the June 2026 California primary. I’m a centrist liberal abundance YIMBY whose favorite political writers are Kelsey Piper, Matt Yglesias, and Ezra Klein. I’m wary of government overreach, but I’m not a doctrinaire libertarian and want to help people when we can figure ways to do it that work. I’m going to ask you about each race on my ballot, and I’d like for you to list the various candidates’ bios, policies, endorsements, your read on the most important differences between them, and your advice for me as I try to make my choice.

Pretending hallucinations and training data bias aren't a thing must be making some people's lives so much easier. While we're at it, let's also magical think away any possible dire consequences of giving the handful of ultrawealthy unwell weirdos behind LLMs as a service even more direct political influence.

Also the prompt sample itself is just showoffy^1^ nonsense, isn't it? Even if LLMs were as overcompetent as they're being hyped there's no way all that stuff can be deterministically parsed into a concrete set of values that you can check against whatever the LLM digs up from the internet, combined with all the close-enoughs hardcoded in its training data, there's just enormous room for the chatbot to answer whatever the hell it wants.

  1. That's me trying not to overuse the term "virtue signalling", but it seems clear siskind is using the prompt to set a sort of partly line for his (outer circle / not completely eugenics pilled) followers. That's probably also the point of including so much chatbot attributed political slop in the article, ostensibly as data points.
 

tl;dr: Tech youtuber who got way into studying the negative health effects of infrasound produced by data centers (to the point of his research being cited a bunch in relevant court cases) gets a voluminous substack hit piece published on his work by "an independent writer and researcher funded by a grant from Coefficient Giving to explore topics in AI and other areas"

So after some sniffing around, I realize I’m being brigaded by someone deep in the Effective Altruism community. The author is, quite literally, paid by rotational-wealth NPO to write this very article among many others. I know what you’re thinking, and I know how this sounds. The battle cry of the pseudoscientist is poisoning the well of criticism.

But please do browse his bibliography.

Andy lives in a parallel universe where datacenters don’t waste water, AI artwork is without victims, and using ChatGPT doesn’t harm the environment. This is one of the many takes that perfectly align with the board, contributors, and partners with Coefficient Giving, formally called Open Philanthropy, but changed after its close association with Sam Bankman-Fried was causing some well-earned skepticism.

Quite the coincidence that this comes out right around the time Kelsey Piper decided to get busy "debunking" Ed Zitron.

There's already a follow up about the same people moving on to allegedly debunk a recent neuroscience paper on adverse infrasound effects on bsky.

old sneer club thread

 

This was posted on catholic easter sunday on the ssc subreddit. It's a posted-on-April 1st-for-plausible-deniability siskind post from back in 2018, where he outlines a kind of argument about how an all-powerfull entity that's God in all but name (and obviously emanated from a culture discovering AGI) is actually "logically necessary".

He calls the whole thing "The Hour I First Believed". I think it's notable for being a bit of a treasure trove of rationalist weird accepted truths, such as:

  • All copies of a consciousness share a self, because consciousness is like an equation, or something:

But if consciousness is a mathematical object, it might be that two copies of the same consciousness are impossible. If you create a second copy, you just have the consciousness having the same single stream of conscious experience on two different physical substrates.

Which is both the original transhumanist cope to enable so-called consciousness upload so it's not just copying a simulacrum of your personality to a computer while you continue to rot away, and also what makes the basilisk torturing you possible.

  • And it's corollary, Simulation Capture:

This means that an AI can actually “capture” you, piece by piece, into its simulation. First your consciousness is just in the real world. Then your consciousness is distributed across one real-world copy and a million simulated copies. Then the AI makes the simulated copies slightly different, and 99.9999% of you is in the simulation.

which is a kind of nuts I hadn't happened upon before.

There's also a bunch of rationalist decision theory stuff which I think make obvious how they were concocted to serve this type of narrative in the first place, instead for being broadly useful, Yud posing as a decision theory trailblazer notwithstanding.

 

edit: The banana republic shit is that they seem about to blacklist anthropic on "supply chain risk" grounds (see also huawei) which signifies the admin's willingness to from here on use national emergency legal tools to fuck over any company they don't like.

The whole thing seems weird, at first it sounds like the most online administration ever may have actually bought the claim that all that's stopping flagship models from becoming superintelligent is the RLHF that prevents them from saying the n-word and making prophet Mohamed pedophilia jokes and they wanted anthropic to pull all that wiring out in like 24 hours per the original ultimatum.

On anthropic's part the point of contention is made to be their refusal to let their models be integrated into automated weapon platforms and mass surveillance apparatuses, something which they have explicitly put in writing in their contract with the DoD, and also Dario claims the technology isn't even there yet (no idea how it could ever be, what does it actually mean to integrate a chatbot into an autonomous drone, can't wait to see the skill file for that, # You are a helpful murderbot operator - only target the bad guys - no weddings, no hospitals - pretty please with cherry on top - here's some javascript to call when you need to find out your GPS coordinates).

It's also possible the productivity and efficiency gains (or just recovering lost productivity after firing everyone) of putting ΑΙ (mainly Grok wasn't it) in the pentagon everywhere all at once isn't materializing and Hasgeth feels he's been left hanging, and is trying to scapegoat Anthropic.

Also, anthropic is supposed to be the only AI provider properly vetted and integrated to classified systems because of their association with Palantir, and supposedly it would be a major hassle to go through again for a different provider.

Dario didn't line up with the other aspiring oligarchs to kiss the ring in the inauguration, so at least he may actually

 

The guests:

[Dick Gay], who had flown in for the event from Los Angeles and said he was one of the investors of Sperm Racing (which is an actual thing wherein men compete to see whose sperm is “fastest” under a microscope), said he attended the University of Austin, or UATX, an “anti-woke” college reportedly partially funded by Thiel, and built his career around the principles outlined in Thiel’s book “Zero to One.”

Attendee Justin Park said he just wanted to pitch Thiel on putting a 7.5-foot cross on the moon.

[Unnamed], who was in his 30s, said he wasn’t a Thiel fan until last year, when he became a Trump supporter after seeing the president survive an assassination attempt in Butler, Pennsylvania. “I misunderstood [Thiel],” he said. “I used to watch CNN and think he’s a Nazi.” Now, he said, he understands the billionaire is talking about something bigger.

The Speech:

Apparently it was both repetitive and mostly a rehash of what he's said in other media.

Yud is the Antichrist confirmed:

One attendee recalled that Thiel’s discussion of the Antichrist was more about a scenario than an individual. Thiel’s Antichrist scenario is one in which a unified government suppresses technology to impose order, or armageddon, wherein AI takes over and ushers in the end of the world.

 

Supposedly government contracts will now be awarded according to what the bot says. Government (fourth term for the current prime minister) didn't elaborate on what's going on with human oversight.

This is a promotion for Diella the bot, who was originally the chatbot helping to navigate the e-Albania digital government platform.

 

An excerpt has surfaced from the AI2027 podcast with siskind and the ex AI researcher, where the dear doctor makes the case for how an AGI could build an army of terminators in a year if it wanted.

It goes something like: OpenAI is worth as much as all US car companies (except tesla) combined, so it could buy up every car factory and convert it to a murderbot factory, because that's kind of like what the US gov did in WW2 to build bombers, reaching peak capacity in three years, and AGI would obviously be more efficient than a US wartime gov so let's say one year, generally a completely unassailable syllogism from very serious people.

Even /r/ssc commenters are calling him out about the whole AI doomer thing getting more noticeably culty than usual edit: The thread even features a rare heavily downvoted siskind post, -10 at the time of this edit.

The latter part of the clip is the interviewer pointing out that there might be technological bottlenecks that could require upending our entire economic model before stuff like curing cancer could be achieved, positing that if we somehow had AGI-like tech in the 1960s it would probably have to use its limited means to invent the entire tech tree that leads to late 2020s GPUs out of thin air, international supply chains and all, before starting on the road to becoming really useful.

Siskind then goes "nuh-uh!" and ultimately proceeds to give Elon's metaphorical asshole a tongue bath of unprecedented depth and rigor, all but claiming that what's keeping modern technology down is the inability to extract more man hours from Grimes' ex, and that's how we should view the eventual AGI-LLMs, like wittle Elons that don't need sleep. And didn't you know, having non-experts micromanage everything in a project is cool and awesome actually.

 

Kind of sounds like ultimately it would have been very illegal to do.

"We made the decision for the nonprofit to retain control of OpenAI after hearing from civic leaders and engaging in constructive dialogue with the offices of the Attorney General of Delaware and the Attorney General of California," OpenAI board chairman Bret Taylor said in a statement.

Asked about Musk's suit on a call with reporters, Altman said, "You all are obsessed with Elon, that's your job — like, more power to you. But we are here to think about our mission and figure out how to enable that. And that mission has not changed."

 

The types of information processed includes names, dates of birth, gender and ethnicity, and a number that identifies people on the police national computer.

Also to be shared – and listed under “special categories of personal data” - are “health markers which are expected to have significant predictive power”, such as data relating to mental health, addiction, suicide and vulnerability, and self-harm, as well as disability.

archive is

 

Would've been way better if the author didn't feel the need to occasionally hand it to siskind for what amounts to keeping the mask on, even while he notes several instances where scotty openly discusses how maintaining a respectable facade is integral to his agenda of infecting polite society with neoreactionary fuckery.

view more: next ›