Technology

It’s only the standard for people who self host their llms and don’t have $500k to throw at hardware for GLM-5.1 or similar models.

I have qwen3.6:27b on my local hardware and it’s way better than I expected. I’m excited for the rest of the 3.6 line as it comes out, if they can keep up that quality.

This story is also a nothing burger. Generally, yes, Nvidia will suffer once chinas stack catches up (soon). By then whatever bubble we are in will have normalized one way or the other.

In terms of actually deploying this model, it doesn’t matter what hardware you’re using. VLLM supports almost everything with SIMD-type hardware instructions.

More competition will make everyone happy except Nvidia shareholders.

I got Qwen 3.5 running on a Steam Deck.

It ain't exactly blazing fast, but it does actually work.

(Reasonably fast if you go down to the 2B param model, I can get the 9B param variant working, though this makes Steam Decky very hot and bothered.)

Yeah, you absolutely do not need Nvidia hardware to run an LLM, but we get blasted with their propoganda suggesting otherwise just all the time in the English speaking West.

Because if you don't need Nvidia, well, then, this whole AI bubble looks a lot more bubbly.

Qwen 3.6 is already out? Damn, I swear I switched to 3.5 not even a month ago.

I would prefer it wasn't like this, PAX Americana seemed to work quite well for several decades, of course USA served their own interests, but they they also provided a somewhat stable world order with a decent degree of freedom.
Now they have abandoned the ideals of freedom and democracy and international law, to serve their own interests exclusively at immense cost to others, without regard for either law or decency. and of course that is not sustainable to be an ally of.
I think USA will soon find that without allies, their power isn't so great after all.

It'll be good for consumers worldwide. America is not the whole world.

I, for example, am in Canada. We've established a bunch of very nice trade deals with China recently, we're going to end up with access to a bunch of Chinese products that Americans can't get due to their self-imposed trade war with China.

America decides to tariff anyone using Chinese technology

America already decides to tariff countries regardless of what they're doing

USA is already losing the tariff war as it undermines the American economy, and hasn't helped their trade deficits much.
When EU finally decides to put tariffs on American services, because USA continue with their shenanigans, then USA will have a trade deficit for real.
Because the trade deficit on goods is vastly outweighed by the surplus on services.
Even if they have a deficit, it is basically free, because they can pay for it with dollars they print themselves, because the USD is the global reserve currency.
But Trump is ruining that too, since "liberation day" where Trump introduced his tariffs, the use of the USD as a global reserve currency has dropped, some claim by up to 30%

All USA is doing is undermine the power they used to have. Everybody threatened by USA are in talks with each other to increase cooperation.

EU, Canada, Australia, UK, Japan, are making deals to cooperate around USA including on military.
The Gulf countries are now negotiating with China on economy, which will potentially be the end of the petro dollar. And they are looking to Europe especially Ukraine for defense equipment to replace American equipment.
South American countries have been working with China for years, and USA subsidizing Argentina will not change that.

USA is making themselves irrelevant, the Iran war has shown their military is a paper tiger, that cannot protect their allies, and they are pulling key defense equipment out of Japan and South Korea to aid in the Iran war. Making all allies unsure of the value of cooperating with USA. Japan participating in the EU SAFE program is an extremely clear indicator of that.

So whatever USA decides, will have very little bearing on the rest of the world. Because for USA, the train has already left the station, the ship has sailed. The world has lost patience with USA, and are now only idling in their relations with USA, while they all seek to strengthen other relations, for both financial stability and military safety.

US tariffs hold no power anymore these days.

Even with a bitnet, it’s almost definitely better to train on a high precision float then refine down to bits.

I would expect bitnet to require more layers for equivalent quality too.

Well I’ve got three 512gb Mac Studios in an EXO cluster I’m gonna see how it works.