this post was submitted on 28 Mar 2026
102 points (90.5% liked)
Technology
83222 readers
5038 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Bullshit
I just added up how much it would cost (in theory—assuming everything is in-stock and ready to ship) to build out a data center capable of training something like qwen3.5:122b from scratch in a few months: $66M. That's how much it would cost for 128 Nvidia B200 nodes (they have 8 GPUs each), infiniband networking, all-flash storage (SSDs), and 20 racks (the hardware).
If OpenAI went bankrupt, that would result in a glut of such hardware which would flood the market, so the cost would probably drop by 40-60%.
Right now, hardware like that is all being bought up and monopolized by Big AI. This has resulted in prices going up for all these things. In a normal market, it would not cost this much! Furthermore, the reason why Big AI is spending sooooo much fucking money on data centers is because they're imagining demand. It's not for training. Not anymore. They're assuming they're going to reach AGI any day now and when they do, they'll need all that hardware to be the world's "virtual employee" provider.
BTW: Anthropic has a different problem than the others with AGI dreams... Claude (for coding) is in such high demand that their biggest cost is inference. They can't build out hardware fast enough to meet the demand (inference, specifically). For every dollar they make, they're spending a dollar to build out infrastructure. Presumably—some day—they'll actually be able to meet demand with what they've got and on that day they'll basically be printing money. Assuming they can outrun their debts, of course.