sinedpick

I don't entirely agree; 200000 questions asked per day is arguably a worse situation than 100 asked per day, and the latter rounds to 0 in that chart.

But yeah it feels pretty dead.

With the agents pouring concrete, we can now focus on the thing as a whole.

This is such a dumb take because it's wrong in both directions.

Either LLMs are really bad and shouldn't be trusted to write code and by trusting them you're going to utterly fail. Or LLMs are actually good enough to write code, but then they'll also be good enough to design/architect anything you could and reduce your labor's value to zero (e.g. someone will create a harness that lets the business guys TRULY prompt whatever they want into existence). The only situation where this works out for labor is if LLMs end up frozen in some middle ground where they don't get any more capable.

This idea that the LLM is analogous to a camera is such an insipid, thought-terminating cliché.

I enjoyed reading that. I should click around rationalwiki more.

I want to draw attention to yud's thoughts on this a million years ago: the AI box experiment

He claimed that he convinced multiple people to let him (roleplaying the AI) out of the box even though they had bet money that they wouldn't! How, you might ask? Well that's a secret.

So the orthodox position here is that even with absolutely perfect guard rails (lol) an AI can escape the box without starting the third impact. What "research" has yud bestowed upon us in this area beyond "trust me bro"? Literally fucking zilch. Zero advice on how to resist the siren song of a rogue AI trying to escape it's box and zero insight on how OR WHY it might try to achieve that.

I read this over a decade ago and it was how I realized how unserious yud and his ilk are.

am I supposed to read this in any way other than "the model didn't predict the text we expected?" or "the model didn't get better enough at $benchmark" e.g. training skill issue

This is a literal indoctrination ceremony to soften people up to the idea of progress at all costs.

basically because the left has out-ridiculous-ed Trump on culture war issues.

You can always find a single sentence in a political LW post that shows how much they hate marginalized people.

eww that tinkerer club page gives me serious crypto bro vibes

I'm pretty sure this kind of marketing has been their thing from the start

emacs welcomes all refugees with open parentheses.

couldn't you just change the first word to a synonym and completely thwart this? You'd never be able to compare subsequent next token predictions since you don't have the internal state of the LLM at that token.