We consistently find across all our experiments that, across concepts, the frequency of a concept in the pretraining dataset is a strong predictor of the model’s performance on test examples containing that concept. Notably, model performance scales linearly as the concept frequency in pretraining data grows exponentially

This reminds me of an older paper on how LLMs can't even do basic math when examples fall outside the training distribution (note that this was GPT-J and as far as I'm aware no such analysis is possible with GPT4, I wonder why), so this phenomena is not exclusive to multimodal stuff. It's one thing to pre-train a large capacity model on a general task that might benefit downstream tasks, but wanting these models to be general purpose is really, really silly.

I'm of the opinion that we're approaching a crisis in AI, we've hit a barrier on what current approaches are capable of achieving and no amount of data, labelers and tinkering with architectural minutiae or (god forbid) "prompt engineering" can fix that. My hopes are that with the bubble bursting the field will have to reckon with the need for algorithmic and architectural innovation, more robust standards for what constitutes a proper benchmark and reproducibility at the very least, and maybe, just maybe, extend its collective knowledge from other fields of study past 1960's neuroscience and explore the ethical and societal implications of your work more deeply than the oftentimes tiny obligatory ethics section of a paper. That is definetly a overgeneralization, so sorry for any researchers out here <3, I'm just disillusioned with the general state of the field.

You're correct about the C suites though , all they needed to see was one of those stupid graphs that showed line going up, with model capacity on the x axis and performance on the y axis, and their greed did the rest.

got the Samsung buds pro 2 at half price recently and I kind of like them, but they were a bit underwhelming even at that price. I've never spent a lot on audio in general, so they were actually a big improvement, but there was no "wow" factor or anything. Plus having to install bloatware that asks for all permissions under the sun sucks (why the fuck would a settings menu want to know my location???).

I do think you underestimate how nice the noise cancelation can be though. I moved to a big city and my hick ass cannot deal with all the fucking noise. Plus I'm clumsy and end up getting wires caught on everything, which means wire stuff also becomes e-waste fairly quickly.

the ice levels in Spelunky HD are my least favorite, but this track almost makes up for all the stupid UFOs crashing into me from out of screen

And even then, OP still has a point.

Yeah, kinda. But the framing is all fucked. Someone that can't improve themselves because of depression don't need "tough love" or to hear they are disinteresting and on their own, they need to see the inate value in themselves. Everyone IS interesting, they just have to nurture that and demonstrate it to others.

Could be because cats can be really distrustful of strangers. My cat is really sweet but she'll hiss to almost every guest. Could be a upbringing thing though, my neighbor has 4 and 3 of them were street cats that she took in, when I occasionally take care of them the only one that gives me any trouble is the one that was there since she was a kitten.

1 - Some of the appeal of the books is present in the series, specially early seasons, so there's that. More cynically, it's probably the first instance of medieval fantasy prestige TV (I know there was other stuff like Pillars of the Earth and whatnot but those didn't have the HBO brand) so there was some novelty to it. Borrowing from Lindsay Ellis, it's "hot fantasy that FUCKS". It's juvenile as all hell and eyeroll inducing but it was key to marketing it to general audiences.

2 - decent 7 while it was running because of the whole social aspect and no hindsight of how shit it was going to get, light 3 now, and a 0 if you're in any way averse to gratuitous violence/sex.

3 - I think the appeal of the books that transfers to the series is a) some of the characters and b) the politicking.

The problem with the characters is that they get flanderized to all hell later on, or sometimes it becomes clear the showrunners didn't really understand them, or at least didn't know what to do with them. But still, some of them are compelling, even if they are fucking assholes.

I think the core appeal of GoT though is seeing an inflection point in the history of this fictional world. Not because there's wars going on, but because characters like Jon and Daenarys (not coincidentally fan favorites) are struggling to surpass the "might makes right" world they live in, and sometimes succeeding. Also because of the growing presence of supernatural shit. It gives this feeling of this new world peeking in and all the promise and terror that comes with this kind of change. The show fumbles both os these aspects REALLY hard later on though. That's because it bought into the "dark fantasy" meme and played down the supernatural aspects (nerd shit) and made a U turn back to the status quo (the last few episodes reek of liberalism).

4 - Typical to early seasons in some ways in the sense that it borrows heavily from the books, but the focus shifts to war stuff so there's some distinction there.

5 - it' been a while since I've seen the series, but seasons 1-4 are pretty decent, 5 is okayish, 6 was pretty bad and 7-8 are atrocious.

6 - Dunno, not a native speaker. I was fine with subtitles off most of the time though.

7 - Haven't watched The Sopranos yet, but GoT has probably one of the worst endings I've ever seen.

I don't think so, sounds like american civil religion brainworms. Just a slightly more secular version of "what would Jesus think?"

u did the thing we designed the game to push you towards doing don't you feel bad u monster lolololol

To be fair to the game that's only the bait and switch at the very start with Toriel, designed to make the player reload and introduce the save meta-fuckery with Flowey. From then on the only incentive to do violence is getting stuck at a puzzle or completionism (which is at the heart of the meta-narrative).

The commentary on violence by itself is naive though (even the game points it out at one point) and if you don't like the characters or roll your eyes at 4th wall stuff the whole thing falls apart pretty quick.

evaluating LLM

ask the researcher if they are testing form or meaning

they don't understand

pull out illustrated diagram explaining what is form and what is meaning

they laugh and say "the model is demonstrating creativity sir"

looks at the test

it's form

just want to say thanks for this. I've been trying to get through a bunch of mental hurdles this past year, including social anxiety, but in the last few months I have been immersed in work and kind of neglected all that. I have a bunch of family I rarely see over for new years, and I kind of lost sight of making the most of it because of some stupid deadline.

Whenever they don't like bad media because it got "woke". I hate Disney remakes because they suck shit and are emblematic of our seemingly collective inability to move past nostalgia, and their really weird obsession with making old cartoons realistic, not because they did some feminism or whatever.