this post was submitted on 06 Apr 2026
28 points (100.0% liked)

technology

24318 readers
271 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] starkillerfish@hexbear.net 2 points 13 hours ago* (last edited 13 hours ago) (1 children)

so they will just build 100x more data centers

[–] yogthos@lemmygrad.ml 4 points 12 hours ago (1 children)

That's the neat part, once you drop the cost of running these things sufficiently, you don't need datacenters because people can just run the models locally. We're currently in the mainframe era of AI, but the pendulum is already swinging towards personal computing as local models continue to improve. These kinds of breakthroughs are going to accelerate the process.

[–] starkillerfish@hexbear.net 4 points 10 hours ago (2 children)

i am kind of pessimistic because i feel like the profit motive will impede the mass implementation of local models. it feel like all good web / tech things stay too niche to make a difference.

[–] yogthos@lemmygrad.ml 6 points 10 hours ago (1 children)

That's just the Silicon Valley model though. Look at China for contrast. Companies there treat models as foundational infrastructure, and they're not trying to monetize them directly. Hence why we see so much open source work coming out of there right now. It's a similar situation we see with Linux incidentally. A lot of companies contribute to its development, but they monetize things like AWS that are built on top of it. However, even without company engagement, people will continue to work on open source as they always have. It doesn't really matter if it goes mainstream or not.

[–] starkillerfish@hexbear.net 1 points 9 hours ago (1 children)

It doesn't really matter if it goes mainstream or not.

It does matter for it to be environmentally sustainable

[–] yogthos@lemmygrad.ml 5 points 9 hours ago

What's happening currently is a bubble that's not in any way sustainable. And energy prices going through the roof thanks to the war could even be the catalyst that pops it. But as I noted earlier, we've gone through this cycle many times in tech world. New tech often requires a ton of resources to run which creates the mainframe era, then it gets optimized overtime, and moves to edge devices. I don't see anything special about LLMs here. We're just in very early stages of new technology.

[–] gayspacemarxist@hexbear.net 3 points 10 hours ago

There's a competitive advantage to squeezing more compute out of the same GPU cluster with software optimizations that indirectly favors local models. It just depends on whether the optimization work can proceed fast enough to make the DC expansion approach obsolete (or at have a less profitable ROI).