Technology

1469 readers

21 users here now

A tech news sub for communists

founded 4 years ago

MODERATORS

muad_dibber@lemmygrad.ml

burlemarx@lemmygrad.ml

egs81t@lemmygrad.ml

AI Companies Are Terrified. (youtu.be)

submitted 1 month ago by Makan@lemmygrad.ml to c/technology@lemmygrad.ml

32 comments fedilink hide all child comments

*Western AI companies are terrified

Anyway, what do you all think of the news?

Video is 8 minutes and 30 seconds long if you're interested.

Is it true that the DeepSeek models and that other AI model (I forgot the name already lol) can be run locally? How do they compete with Claude and OpenAI?

Also, what about that other AI thing, OpenClaw?

I am interested in AI but still very much skeptical.

I have only used Duck AI sometimes but try to avoid it.

you are viewing a single comment's thread
view the rest of the comments

[–] Faux@lemmygrad.ml 4 points 1 month ago* (last edited 1 month ago) (1 children)

If you mean using different models, yes. If you mean finetuning model weights... No, finetuning LLMs is hard in general and Strix Halo (device that I had in mind that costs 3K$ for 128GB of VRAM) is also kinda bad for it now due to having an AMD (and not really strong when it comes to compute power) GPU.

In practice, people who try finetuning on top of newest models usually cripple them. There are plenty of finetunes of Qwen 3.6 on huggingface trying to distill stronger models and they are just bad.

Heretic, the method for removing refusals I mentioned, also requires more VRAM to run it than it's required for inference.

[–] Makan@lemmygrad.ml 0 points 1 month ago

"AMD GPU"

oof