Personally I can't wait until Nvidia releases a new generation and they start shedding gpus. Helloooo secondary market!
Ask Lemmy
A Fediverse community for open-ended, thought provoking questions
Rules: (interactive)
1) Be nice and; have fun
Doxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them
2) All posts must end with a '?'
This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?
3) No spam
Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.
4) NSFW is okay, within reason
Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com.
NSFW comments should be restricted to posts tagged [NSFW].
5) This is not a support community.
It is not a place for 'how do I?', type questions.
If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.
6) No US Politics.
Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !askusa@discuss.online
Reminder: The terms of service apply here too.
Partnered Communities:
Logo design credit goes to: tubbadu
Crypto mining. And Im sure they're being built with this dual purpose in mind.
Companies will never admit it. They’ll drive this shit right into the ground and keep digging
The last boom/bust cycle resulted in a lot of high tech gear getting sold off at bargain basement prices.
Good for new businesses but bad for companies like Cisco trying to sell new gear in a market flooded with cheap used gear.
Recording and analyzing all the real-time video and audio feeds of their surroundings that everyone is required to provide while using the Internet, to ensure that no children are present when they use social media.
Lol when the AI bubble pops it will be most likely destroyed to maintain artificially high hardware costs.
At least that's why China ending crypto mining didn't drastically reduce the price of graphics cards.
They'll all be fried and be sent straight to landfill.
Graphics cards haven't been used in any significant quantity for cryptocurrency mining for a long time now.
When an AI company goes bankrupt, their hardware will be sold to anyone interested in it. My guess is, MS and Amazon will be buying a bunch of vacant datacenters within the next 10 years.
That’s enterprise hardware, so it’s not really compatible with your consumer grade gaming PC. If you’re interested in self hosting your own cloud photos and local LLMs, you might want to look into those auctions.
This, but also I think the fallout of the AI bubble popping will be different than people are envisioning. After the dot com bubble collapsed a lot of the infrastructure was sold at surplus and repurposed, but some of the infrastructure was left unused and just sat around for a while.
It’s not completely equivalent, but imo a great example of this is fiber optic. Early on, companies and governments invested in fiber optic technology in their local area to get in on the bubble hype, but after the bubble burst most of it went unused or not fully utilized in the way it was intended until recently, when Google bought various fiber optic networks around the country for Google fiber. This is the reason why in the last 10 or so years you had certain states and cities getting access to fiber connections before others.
Obviously this isn’t exactly the same, but I’ll be curious what the “fiber” of the AI bubble will be (if anything). My guess would be changes and hopeful improvements to our energy infrastructure, but time will tell.
I listened to a YouTuber suggest that all these abandoned data centers would be great for the government to expand its mass surveillance programs so probably that
IDK, I think turning them into paintball arenas would be pretty sweet.
hard agree, I hope there's as much money in paintball as there is in mass surveillance
I think hardware as a service will be their next thing, raise the cost of parts so people buy a cheap sub then increase the aubscription year by year.
Agree. I think MS and Google selling more cheap "cloud laptops" could totally be a thing. The personal device would mostly be a screen and bare bones components
I feel like it could even be chromecast like devices which just plug into a screen and connect to server, cheap hardware sold at a loss to rope you into a sub.
Google execs like

ChatGPT alone has 800 million weekly users of which the vast majority are normal people - not companies. The demand is there despite it not being able to increase company profit margins the way people expected. I don't see this computing infrastructure needing to run idle anytime soon.
Chatgpt is constantly losing money, public surface-level interest won't matter much when the capital runs out and they're still accruing significant debt without any revenue.
They are about to put ads in the service. The money will be made eventually
A major problem faced by first-mover companies like OpenAI is that they spend an enormous amount of money on basic research and initial marketing and hardware purchases to set up in the first place. Those expenses become debts and have to be paid off by the business later. If they were to go bankrupt and sell off ChatGPT to some other company for pennies on the dollar that new owner would be in a much better position to be profitable.
There is clearly an enormous demand for AI services, despite all the "nobody wants this" griping you may hear in social media bubbles. That dermand's not going to disappear and the AIs themselves won't disappear. It's just a matter of finding the right price to balance things out.
I think OP is talking about all of the future data centers that are allegedly being build despite nobody even knowing where. Nvidia has agreed to pay OpenAI $10B per gigawatt of datacenter for 10 gigawatts of datacenter build up over the next few years.
Unlikely that will fully materialize, but that's the current outlook.
They're trying to build several right now near my home in Southeast Michigan. So now you know where.
That sucks. Sorry about your luck.
We're doing our best to shut down wherever they pop up but they REALLY want our electricity, land, and water.
The free plan of chatgtp is more than enough for most people. And when they decide to start charging for it, probably 30% of free users will switch to a different (mahbe even locally run) Ai.
They're probably just gonna trash it and move to the next thing.
I hope some of it hits the used market, so tinkerers can play with them.
But yeah, knowing them, they will probably just throw the hardware away :(
Auctioned off and used by startups and homelabs.
A write off.
How much RAM are they using? Would a RAMdisk VPS make any sense?
Its more VRAM heavy servers. They’d have to take the GPUs out, or even put the whole motherboard in a new case.
The demand for LLM inference will drop off when people finally realise it is not the road to AGI. However there is still plenty of things GPU compute can be applied to and maybe spot prices will come down again.
It's more likely that the demand for LLM inference will drop off only once AGI exists.
There are billions of active users already having it do everything from coming up with ideas for Christmas presents, to helping them write e-mails to clients.
That isn't going anywhere until there's a better option on the table. People would have already got bored and moved on if it wasn't doing anything useful for them.