Architeuthis

joined 2 years ago
[–] Architeuthis@awful.systems 7 points 13 hours ago

I the post he keeps referring to Ollama as an LLM (it's a desktop app that runs a local server that lets you download and interface with a local LLM via CLI or http API) so it's possible he's just that far behind in his technical understanding of LLMs that he's fallen to taking the wrong people's word for it.

The post certainly reads like he doesn't even know which local LLM he's using, let alone what it takes to make one.

[–] Architeuthis@awful.systems 7 points 13 hours ago

That he went from that all the way to it's mostly ok when sam altman steals all your data, misrepresents it and then steals all your traffic is... bad.

At any rate it's definitely good to know that that war crime forensics data project isn't quite the unintentional shambles corey makes it out to be.

[–] Architeuthis@awful.systems 12 points 19 hours ago* (last edited 19 hours ago) (4 children)

That was a good read.

Corey doc wrote:

It's not "unethical" to scrape the web in order to create and analyze data-sets. That's just "a search engine"

Equivocating what LLMs do and what goes into LLM web scraping with "a search engine" is messed up. His article that he links about scraping is mostly about how badly copyright works and how analysing trade-secret-walled data can be beneficial both to consumers and science but occasionally bad for citizen privacy, which you'll recognize as mostly irrelevant to the concerns people tend to have against LLM training data providers ddosing the fuck out of everything.

Corey also provides this anecdote:

As a group of human-rights defending forensic statisticians, HRDAG has always relied on cutting edge mathematics in its analysis. With its Colombia project, HRDAG used a large language model to assign probabilities for responsibility for each killing documented in the databases it analyzed.

That is, HRDAG was able to rigorously and legibly say, “This killing has an X% probability of having been carried out by a right-wing militia, a Y% probability of having been carried out by the FARC, and a Z% probability of being unrelated to the civil war.”

The use of large language models — produced from vast corpuses of scraped data — to produce accurate, thorough and comprehensible accounts of the hidden crimes that accompany war and conflict is still in its infancy. But already, these techniques are changing the way we hold criminals to account and bring justice to their victims.

Scraping to make large language models is good, actually.

what the actual shit

[–] Architeuthis@awful.systems 7 points 1 day ago* (last edited 1 day ago) (2 children)

Timnit briefly weighs in about being included in the doc, apparently she regrets it and says the filmmakers "sprinkle some [AI skeptics] in like chocolate chips to perform ethics".

She also calls Yud a eugenicist cult leader with nothing to show for.

[–] Architeuthis@awful.systems 4 points 2 days ago* (last edited 2 days ago)

Also code helper tools don't even work like that, there's an absurd amount of MCP and RAG based hand holding for the chatbot to even get a grip on what it's supposed to be doing at any given time.

Prompting an LLM with your entire code base isn't really a thing, even though the hype makes it feel like it would be.

[–] Architeuthis@awful.systems 5 points 3 days ago

I mean, they mostly don't have a problem with AI instances inheriting the earth as long as they're sufficiently rationalist.

[–] Architeuthis@awful.systems 6 points 3 days ago

Eh, one might say that going by the broad strokes version while letting the expert do their thing is basically what management is all about, especially if they ignore the part where he wants his version to be light and entertaining.

This isn't about managing subordinates though, this is about devising ways to be complacent about not double checking what the LLM generates in your name.

[–] Architeuthis@awful.systems 8 points 3 days ago

Goertzel discusses with Epstein future scenario for "an AGI economy":

"for the AGI parasite to overcome to regular-human-economy host (so it can grow to be more than a parasite and eventually gain its own superhuman autonomy) it first needs to suck off the resources of the host"

The Rationalists!

[–] Architeuthis@awful.systems 14 points 5 days ago (3 children)

OpenClaw guy got hired by OpenAI

My next mission is to build an agent that even my mum can use.

Maybe he'll get to stick it in whatever John Ives designs, eventually.

[–] Architeuthis@awful.systems 2 points 6 days ago

I mean the vibe is pretty spot on, I'll give them that, and the premise of someone making fashy noises in an anarchist squat and getting summarily thrown out on his ass is perfectly believable, but the protagonist seems like an obvious a parody character and I think his belief that everyone he meets should adhere to the NAP is meant as a running gag.

Also, I'd take issue with the unspoken premise that this would be an Exarcheia thing, getting your ass beat by anarchists who clocked you as a fascist (and vice versa) is a panhellenic phenomenon. Fascist here meaning less someone who likes Tucker Carlson and toothbrush mustaches, and more someone who is an organized member of a heavily nationalist sportball fan club and/or whatever is currently filling the void that Golden Dawn left but isn't making the news.

[–] Architeuthis@awful.systems 6 points 1 week ago* (last edited 1 week ago)

Never in the history of ever has a promptly finished ticket been something for a CEO to brag about, but here we are.

I guess since more down-to-earth stories like "chatgpclaudemini found the best value for money such and such for me" really aren't happening, trying to impress people who think coding is magic is as good a fallback as any.

[–] Architeuthis@awful.systems 11 points 1 week ago

Makes sense, given the embarrassing lengths he went to not hurt the bot's feelings in that thread.

 

The guests:

[Dick Gay], who had flown in for the event from Los Angeles and said he was one of the investors of Sperm Racing (which is an actual thing wherein men compete to see whose sperm is “fastest” under a microscope), said he attended the University of Austin, or UATX, an “anti-woke” college reportedly partially funded by Thiel, and built his career around the principles outlined in Thiel’s book “Zero to One.”

Attendee Justin Park said he just wanted to pitch Thiel on putting a 7.5-foot cross on the moon.

[Unnamed], who was in his 30s, said he wasn’t a Thiel fan until last year, when he became a Trump supporter after seeing the president survive an assassination attempt in Butler, Pennsylvania. “I misunderstood [Thiel],” he said. “I used to watch CNN and think he’s a Nazi.” Now, he said, he understands the billionaire is talking about something bigger.

The Speech:

Apparently it was both repetitive and mostly a rehash of what he's said in other media.

Yud is the Antichrist confirmed:

One attendee recalled that Thiel’s discussion of the Antichrist was more about a scenario than an individual. Thiel’s Antichrist scenario is one in which a unified government suppresses technology to impose order, or armageddon, wherein AI takes over and ushers in the end of the world.

 

Supposedly government contracts will now be awarded according to what the bot says. Government (fourth term for the current prime minister) didn't elaborate on what's going on with human oversight.

This is a promotion for Diella the bot, who was originally the chatbot helping to navigate the e-Albania digital government platform.

 

An excerpt has surfaced from the AI2027 podcast with siskind and the ex AI researcher, where the dear doctor makes the case for how an AGI could build an army of terminators in a year if it wanted.

It goes something like: OpenAI is worth as much as all US car companies (except tesla) combined, so it could buy up every car factory and convert it to a murderbot factory, because that's kind of like what the US gov did in WW2 to build bombers, reaching peak capacity in three years, and AGI would obviously be more efficient than a US wartime gov so let's say one year, generally a completely unassailable syllogism from very serious people.

Even /r/ssc commenters are calling him out about the whole AI doomer thing getting more noticeably culty than usual edit: The thread even features a rare heavily downvoted siskind post, -10 at the time of this edit.

The latter part of the clip is the interviewer pointing out that there might be technological bottlenecks that could require upending our entire economic model before stuff like curing cancer could be achieved, positing that if we somehow had AGI-like tech in the 1960s it would probably have to use its limited means to invent the entire tech tree that leads to late 2020s GPUs out of thin air, international supply chains and all, before starting on the road to becoming really useful.

Siskind then goes "nuh-uh!" and ultimately proceeds to give Elon's metaphorical asshole a tongue bath of unprecedented depth and rigor, all but claiming that what's keeping modern technology down is the inability to extract more man hours from Grimes' ex, and that's how we should view the eventual AGI-LLMs, like wittle Elons that don't need sleep. And didn't you know, having non-experts micromanage everything in a project is cool and awesome actually.

 

Kind of sounds like ultimately it would have been very illegal to do.

"We made the decision for the nonprofit to retain control of OpenAI after hearing from civic leaders and engaging in constructive dialogue with the offices of the Attorney General of Delaware and the Attorney General of California," OpenAI board chairman Bret Taylor said in a statement.

Asked about Musk's suit on a call with reporters, Altman said, "You all are obsessed with Elon, that's your job — like, more power to you. But we are here to think about our mission and figure out how to enable that. And that mission has not changed."

 

The types of information processed includes names, dates of birth, gender and ethnicity, and a number that identifies people on the police national computer.

Also to be shared – and listed under “special categories of personal data” - are “health markers which are expected to have significant predictive power”, such as data relating to mental health, addiction, suicide and vulnerability, and self-harm, as well as disability.

archive is

 

Would've been way better if the author didn't feel the need to occasionally hand it to siskind for what amounts to keeping the mask on, even while he notes several instances where scotty openly discusses how maintaining a respectable facade is integral to his agenda of infecting polite society with neoreactionary fuckery.

 

AI Work Assistants Need a Lot of Handholding

Getting full value out of AI workplace assistants is turning out to require a heavy lift from enterprises. ‘It has been more work than anticipated,’ says one CIO.

aka we are currently in the process of realizing we are paying for the privilege of being the first to test an incomplete product.

Mandell said if she asks a question related to 2024 data, the AI tool might deliver an answer based on 2023 data. At Cargill, an AI tool failed to correctly answer a straightforward question about who is on the company’s executive team, the agricultural giant said. At Eli Lilly, a tool gave incorrect answers to questions about expense policies, said Diogo Rau, the pharmaceutical firm’s chief information and digital officer.

I mean, imagine all the non-obvious stuff it must be getting wrong at the same time.

He said the company is regularly updating and refining its data to ensure accurate results from AI tools accessing it. That process includes the organization’s data engineers validating and cleaning up incoming data, and curating it into a “golden record,” with no contradictory or duplicate information.

Please stop feeding the thing too much information, you're making it confused.

Some of the challenges with Copilot are related to the complicated art of prompting, Spataro said. Users might not understand how much context they actually need to give Copilot to get the right answer, he said, but he added that Copilot itself could also get better at asking for more context when it needs it.

Yeah, exactly like all the tech demos showed -- wait a minute!

[Google Cloud Chief Evangelist Richard Seroter said] “If you don’t have your data house in order, AI is going to be less valuable than it would be if it was,” he said. “You can’t just buy six units of AI and then magically change your business.”

Nevermind that that's exactly how we've been marketing it.

Oh well, I guess you'll just have to wait for chatgpt-6.66 that will surely fix everything, while voiced by charlize theron's non-union equivalent.

 

An AI company has been generating porn with gamers' idle GPU time in exchange for Fortnite skins and Roblox gift cards

"some workloads may generate images, text or video of a mature nature", and that any adult content generated is wiped from a users system as soon as the workload is completed.

However, one of Salad's clients is CivitAi, a platform for sharing AI generated images which has previously been investigated by 404 media. It found that the service hosts image generating AI models of specific people, whose image can then be combined with pornographic AI models to generate non-consensual sexual images.

Investigation link: https://www.404media.co/inside-the-ai-porn-marketplace-where-everything-and-everyone-is-for-sale/

 

For thursday's sentencing the us government indicated they would be happy with a 40-50 prison sentence, and in the list of reasons they cite there's this gem:

  1. Bankman-Fried's effective altruism and own statements about risk suggest he would be likely to commit another fraud if he determined it had high enough "expected value". They point to Caroline Ellison's testimony in which she said that Bankman-Fried had expressed to her that he would "be happy to flip a coin, if it came up tails and the world was destroyed, as long as if it came up heads the world would be like more than twice as good". They also point to Bankman-Fried's "own 'calculations'" described in his sentencing memo, in which he says his life now has negative expected value. "Such a calculus will inevitably lead him to trying again," they write.

Turns out making it a point of pride that you have the morality of an anime villain does not endear you to prosecutors, who knew.

Bonus: SBF's lawyers' list of assertions for asking for a shorter sentence includes this hilarious bit reasoning:

They argue that Bankman-Fried would not reoffend, for reasons including that "he would sooner suffer than bring disrepute to any philanthropic movement."

 

rootclaim appears to be yet another group of people who, having stumbled upon the idea of the Bayes rule as a good enough alternative to critical thinking, decided to try their luck in becoming a Serious and Important Arbiter of Truth in a Post-Mainstream-Journalism World.

This includes a randiesque challenge that they'll take a $100K bet that you can't prove them wrong on a select group of topics they've done deep dives on, like if the 2020 election was stolen (91% nay) or if covid was man-made and leaked from a lab (89% yay).

Also their methodology yields results like 95% certainty on Usain Bolt never having used PEDs, so it's not entirely surprising that the first person to take their challenge appears to have wiped the floor with them.

Don't worry though, they have taken the results of the debate to heart and according to their postmortem blogpost they learned many important lessons, like how they need to (checks notes) gameplan against the rules of the debate better? What a way to spend 100K... Maybe once you've reached a conclusion using the Sacred Method changing your mind becomes difficult.

I've included the novel-length judges opinions in the links below, where a cursory look indicates they are notably less charitable towards rootclaim's views than their postmortem indicates, pointing at stuff like logical inconsistencies and the inclusion of data that on closer look appear basically irrelevant to the thing they are trying to model probabilities for.

There's also like 18 hours of video of the debate if anyone wants to really get into it, but I'll tap out here.

ssc reddit thread

quantian's short writeup on the birdsite, will post screens in comments

pdf of judge's opinion that isn't quite book length, 27 pages, judge is a microbiologist and immunologist PhD

pdf of other judge's opinion that's 87 pages, judge is an applied mathematician PhD with a background in mathematical virology -- despite the length this is better organized and generally way more readable, if you can spare the time.

rootclaim's post mortem blogpost, includes more links to debate material and judge's opinions.

edit: added additional details to the pdf descriptions.

 

Sam Altman, the recently fired (and rehired) chief executive of Open AI, was asked earlier this year by his fellow tech billionaire Patrick Collison what he thought of the risks of synthetic biology. ‘I would like to not have another synthetic pathogen cause a global pandemic. I think we can all agree that wasn’t a great experience,’ he replied. ‘Wasn’t that bad compared to what it could have been, but I’m surprised there has not been more global coordination and I think we should have more of that.’

view more: next ›