Technology

500b of trust me Bros... To shake down US taxpayer for subsidies

Read between the lines folks

Here's someone doing 200 tokens/s (for context, OpenAI doesn't usually get above 100) on... A Raspberry Pi.

Yes, the "$75-$120 micro computer the size of a credit card" Raspberry Pi.

If all these AI models can be run directly on users devices, or on extremely low end hardware, who needs large quantities of top of the line GPUs?

The way I understood it, it's much more efficient so it should require less hardware.

Nvidia will sell that hardware, an obscene amount of it, and line will go up. But it will go up slower than nvidia expected because anything other than infinite and always accelerating growth means you're not good at business.

It requires only 5% of the same hardware that OpenAI needs to do the same thing. So that can mean less quantity of top end cards and it can also run on less powerful cards (not top of the line).

Should their models become standard or used more commonly, then nvidis sales will drop.

Hm even with DeepSeek being more efficient, wouldn’t that just mean the rich corps throw the same amount of hardware at it to achieve a better result?

Only up to the point where the AI models yield value (which is already heavily speculative). If nothing else, DeepSeek makes Altman's plan for $1T in new data-centers look like overkill.

The revelation that you can get 100x gains by optimizing your code rather than throwing endless compute at your model means the value of graphics cards goes down relative to the value of PhD-tier developers. Why burn through a hundred warehouses full of cards to do what a university mathematics department can deliver in half the time?