this post was submitted on 18 Aug 2026
75 points (100.0% liked)

technology

24471 readers
127 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 6 years ago
MODERATORS
 

No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.

you are viewing a single comment's thread
view the rest of the comments
[–] ZWQbpkzl@hexbear.net 19 points 1 month ago (3 children)

Obviously if you can run frontier quality models on consumer hardware then the quality of models you can run in a data center will let you hit AGI. Unless there's any sort of diminishing returns in quality when increasing model size.

But in seriousness Qwen3.8 was trained in a data center. It takes way more VRAM and compute to train a model than to run one.

[–] marxisthayaca@hexbear.net 14 points 1 month ago (2 children)

Unless there's any sort of diminishing returns in quality when increasing model size.

There is actually.

[–] Acute_Engles@hexbear.net 11 points 1 month ago* (last edited 1 month ago) (1 children)

ZWQbpkzl is being sarcastic, the line after says "but in seriousness"

(edit pronouns sorry)

[–] ZWQbpkzl@hexbear.net 7 points 1 month ago

Thank you for your service. freedom-and-democracy

[–] Owl@hexbear.net 8 points 1 month ago

Nah, they redefined getting 20% better results for 10x the cost as "not diminishing returns actually" years ago.

[–] soybeanis@hexbear.net 5 points 1 month ago (1 children)

Obviously

why is this obvious?

[–] Acute_Engles@hexbear.net 8 points 1 month ago* (last edited 1 month ago) (1 children)

ZWQbpkzl is being sarcastic, the line after says "but in seriousness"

(edit pronouns sorry)

Obviously if you can run frontier quality models on consumer hardware then the quality of models you can run in a data center will let you hit AGI

sentient-ai