cant wait for their debt calls and they have to sell their inventory to make payment.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
sigh I just wanna upgrade my video card, man
Intel must be kicking themselves for not using their own fabs for Arc, AND divesting from Micron, Optane, and HMC.
Apple and others must be too, for snubbing Intel and Samsung.
They would be making money hand over fist, and relieving the market at the same time.
y'all realize this is what a hostile takeover looks like, right?
Are you talking about a stocks takeover? Because I fail to see how buying up hardware has anything to do with it.
hostile takeovers are more than just stocks.
it can include supply chain attacks against over leveraged companies.
My new gaming PC that I bought about 18 months ago went up in value by 75% based on its RAM and GPU price and while I'm relieved I got it when I did, that's pure insanity that a PC would appreciate in value
I overbuilt built my NAS/container server for $1262 excluding the price of the rack chassis, PSU, cooler and two 1TB NVMe SSDs I cannot recall the price I paid for. B550 board, Ryzen 5, four 10TB Red Plus HDDs, Intel Arc A380, 64GB of DDR 5 ECC. Those listed components are now $3381. When or if you can even find them. The Arc is unobtanium as far as I can see. Of course the RAM and HDDs went up the most in cost, but it's still like $65 and $75 more for the mobo and chip.
Whoop, decided to check and I found the SSDs: I paid $60 a pop for Samsung 980 Pros and they're $240 now. So $1382 then vs $3861 now. Almost triple. The bubble can't pop soon enough.
Tell me about it, my rig went up by ~30% and to think I was worried it wasn't future proof enough
I'm convinced that OpenAI buisness model is to create AI bubble, to sell its "reserved memory wafers" and now Macs, at the top of ram extortion pricing moment.
That same thought just occurred to me: hype a McGuffin and get investors to lend you insane amounts of money which you then use to buy up a marker, causing artificial scarcity, then sell at massive profits.
Well, this may explain why my work computer has been on back order for the 4 months that I have had my job. Still have no idea when I’m actually going to get it.
Smells like 'Open’AI is digging another moat where there is none, like it did with the memory wafer deal that started RAMageddon. Heaven forbid people actually being able to run local models, can’t run local models if 'Open’AI has bought all the capable smaller machines, taps head. Fuck SamA and his market cornering with a rusty chainsaw. I guess they think all they have to do is keep that moat somehow until IPO and then it’s somebody else’s problem, they and their investors cash out. Dear Goddess I hope it blows up in their faces.
Ah, I see you’ve stumbled across the real reason for the “AI boom”.
Hint: it’s not because the models are SO incredible. It’s the fascists taking computers away from us so we can’t stifle them. So we can’t talk shit on billionaires anymore. So we can’t fundraise for a better world.
Just like our cars and our traffic lights watch our every move. Just like our phones have 100 sensors that profile us from the moment we wake up.
Demons took the wheel a long time ago.
Yeah, I've had the thought. 'What are we going to do with all that compute now that AI as worker replacement is a bust? Why not run panopticon and get rid of that pesky general compute in the hands of the masses?'
Centralizing compute has been tried again and again, initially mainframes, then the home PC, thin client / server, cloud compute, arguably phones (as apps processing in the cloud), Geforce Now, AI. So far it’s always gone back to the edge for most of the population, except for niche cases (or not in the case of phones, but they turned into general, if locked down, compute), good chance it won't stick this time either.
The niche case here is model training.
OpenAI buying tens of thousands of Macs for AI is the funniest possible plot twist: spend years convincing everyone the cloud is the future, then discover the hottest AI infrastructure is basically a warehouse full of Mac minis. Somewhere, an IT admin is whispering: »I told you so.«
What exactly do you think a cloud is? It's built exactly like that, computers connected and orchestrated to run a client's arbitrary services.
Now the interesting thing here is to choose many different types of smallscale hardware. Must be some fun to administrate.
Exactly. It’s super uncommon to use standard consumer hardware to build a data center.
I’d be interested in buying one as a headless server, but a lot of the FLOSS software I’d like to run seem to prefer x86 processors.
At this point it's pretty blatant that OpenAI are engaging in price fixing more than they are actually delivering AI datacentres.
Seems like Apple‘s little gambit to be immune to AI price fixing savagery didn’t work as well as they thought it would…
I guess Rosetta 2 was just too good…
Rosetta 2 has literally nothing to do with this.
Rosetta 2 is irrelevant here because they'd just compile their shit for ARM for better performance.
At least unlike B300s, these can one day be used if OpenAI dumps them on the used market. IF they do that instead of trashing them to make sure everything stays expensive.
Apple‘s little gambit to be immune to AI price fixing savagery
I don't think it was ever a strategy. If it was they would've stopped mac's from ever reaching OpenAI's datacenters. Or atleast they'd have prevented them from hoarding so much of the M5 production.
Local 27b models are good enough for most tasks.
Can’t wait to buy one of these from Ebay for 10% of the price next year.
Yeah no way they will allow any of this hardware to go back onto the market. Anything they dont use anymore will be destroyed.
Buy it, destroy it. Just like buying bunch of old books, train their LLM's and burn it. Humanity has gone a long way to be that stupid.
https://github.com/AtomicBot-ai/atomic-llama-cpp-turboquant
I'm running gwen 3.6 with 131k context window on a 3090, it's fast enough and about as good as pay to play Claude at work.
And that's really why they're hoarding them.
No, they’re hoarding them so you have to pay for cloud services they control from now on. With your little Fire tablet. No more pirating movies or political organizing for you, piggy
For what it's worth, piracy is the primary thing I use my older 10" fire tablet for.
Has the computers for local AI become that good?
Macs, in particular, are likely to be the best option at the moment, unless you absolutely need the largest Frontier models.
Madoff Altman is at it again.