GamingChairModel

joined 3 years ago
[–] GamingChairModel@lemmy.world 3 points 1 day ago (1 children)

Wait can tokens just be directly compared like that? My impression is that token cost can vary by 2 orders of magnitude, depending on model, because the actual work of computation varies by that much between models.

She also did this while she was still a full time undergraduate university student. Normally you'd expect someone with more experience to be doing this kind of low level hardware hacking, but she did all this while still young, before even graduating from university.

Reportedly, the app uses an on-device machine learning model to classify the content.

Using your shiny new phone to train AI...

I would think the models are already trained, and then deployed to phones to do on-device inference. The models should be fixed and static by the time they end up on a phone (in large part because phone hardware is just not technically suitable for training, whether pre training or post training).

The federal Stored Communications Act is essentially one party consent. It primarily restricts the ability of a service provider (who isn't a party to those communications) to share things with law enforcement or with others, and governs the manner in which governments can compel disclosure of information about communications. None of it restricts an actual party to the communication, though.

[–] GamingChairModel@lemmy.world 1 points 3 days ago (1 children)

True, although that's kinda on the parents for naming their kid after a character whose arc isn't finished in popular culture.

[–] GamingChairModel@lemmy.world 2 points 3 days ago (2 children)

I'm not aware of any state that applies two party consent rules to written communications. As far as I can tell, state wiretap laws only apply to in-person or live voice conversations (like traditional phone calls).

Oregon, for example, is a two party consent state for phone calls but single party consent for electronic communications. Same with Illinois.

Connecticut and Montana don't apply two party rules when the non-recording parties are merely aware that recording is happening, and it seems like a pretty straightforward analysis that everyone knows that the other side keeps text messages on their phone, usually indefinitely.

The nature of email, text messaging, or any other kind of written communication basically makes it impossible to expect the other side not to save a record of the conversation, because that's just how the technology generally works.

[–] GamingChairModel@lemmy.world 5 points 4 days ago (3 children)

Imagine being named Alexa, born in 1998, minding your own damn business when Amazon just completely wrecks your name as you're entering high school.

aren’t just wrong — they’re a bridge too far

Haven't the PR flacks learned by now to sound less obvious about using LLM generated text?

[–] GamingChairModel@lemmy.world 13 points 5 days ago (1 children)

Yes, the rules of Conway's Game of Life is Turing Complete.

The glider shape (the thing moving diagonally out of the window in this meme) can be created non-destructively by a glider gun (another shape that creates gliders), which can be controlled using stored pixels in another configuration within the glider gun, including taking in input from other gliders, such that the whole thing can loop and do everything necessary to be a universal Turing machine. Not super efficiently, but it will still do the things that Turing machines can do, given enough cycles.

[–] GamingChairModel@lemmy.world 13 points 6 days ago (6 children)

The -cel suffix suggests that it's an insult (derived from incel).

Vibe coding is the name for creating computer code by telling an AI to generate the code for you, without necessarily even understanding anything about the code itself.

A thousand yard stare is a description for someone who looks like they're staring off into the distance, as if they're having some kind of PTSD flashback, or just at a loss for words.

This is a photograph of Sam Altman, the CEO of OpenAI, a major generative AI company.

Tokens are the unit of measure of how much computing power a particular generative AI query uses.

So basically, it's a meme that ironically takes the position of the vibe coder, mocking someone who is actually unwilling to use the AI code generation tools (calling them a codecel and criticizing them for saying something anti-vibe-coding or vibephobic), by giving the blank stare of Sam Altman's soulless eyes, and calling it a billion token stare, but basically doing it ironically to make fun of generative AI enthusiasts by lobbing a really stupid criticism and making the critic look bad.

[–] GamingChairModel@lemmy.world 10 points 1 week ago

The mechanism happens in the way LLMs generate text sequentially. So as the LLM generates text, each time the LLM encounters a choice between two or more equally probable words and has to pick one, it chooses from a known pseudorandom key instead of its previous practice of actually relying on a source of randomness.

If you run the text through a checker script that tries to predict the next word, and takes note of every choice made in any given fork in the probabilistic flowchart, you can see that whole sequence of choices and compare to whether it matches a known key.

You'd need to know the model itself well enough to know when the text reaches a particular fork, and what the choices are in that fork, and the key itself, so even OpenAI/Google/Anthropic may not be able to run this watermark detection on their competitors' models. But they'd be able to know it themselves, for their own models.

But it's not the company itself putting those assets up for sale. It's the court-approved or court-appointed bankruptcy trustee of that company, executing transactions approved by the court. That's why bankruptcy has to go through court, but it also provides a level of immunity (commonly called "exculpation" in bankruptcy cases) to the individuals actually doing the things ordered by the court.

If it's illegal to do, a court shouldn't be ordering it, so the affected people should have to fight the court order before it happens. But it's not illegal to sell anonymized user data like this, and not illegal to sell employee work-related data, either, in the U.S.

 

(Note: McSweeney's is a satirical publication)

 

I've read some of Ed Zitron's long posts on why the AI industry is a bubble that will never be profitable (and will bring down a lot of companies and investors), and one of the recurring themes is that the AI companies are trying to capture growing market share in an industry where their marginal profits are still negative, and that any increase in revenue necessarily increases their costs of providing their services.

But some of the comments in various HackerNews threads are dismissive, saying that each new generation of models makes the cost of inference lower, so that with sufficient customer volume, the companies running the models can make enough profit on inference to make up for the staggering up-front capital expenditures it took to build out the data centers, train their models, etc.

It's all pretty confusing to me. So for those of you who are familiar with the industry, I have several questions:

  1. Is the cost of running any given pretrained model going down, for specific models? Are there hardware and software improvements that make it cheaper to run those models, despite the model itself not changing?
  2. Is the cost of performing a particular task at a particular quality level going down, through releases of newer models of similar performance (i.e., a smaller model of the current generation performing similarly to a bigger model of the previous generation, such that the cost is now cheaper)?
  3. Is the cost of running the largest flagship frontier models going down for any given task? Or does running the cutting edge show-off tasks keep increasing in cost, but where the companies argue that the improvement in performance is worth the cost increase?

I suspect that the reason why the discussion around this is so muddled online is because the answers are different depending on which of the 3 questions is meant by "is running an AI model getting cheaper over time?" And the data isn't easy to synthesize because each model has different token prices and different number of tokens per query.

But I wanted to hear from people who are knowledgeable about these topics.

 

Curious what everyone else is doing with all the files that are generated by photography as a hobby/interest/profession. What's your working setup, how do you share with others, and how are you backing things up?

view more: next ›