That is patently untrue. You can have useful ai on a esp32, a $10 chip. https://github.com/slvDev/esp32-ai It will not be as capable as kimi k3 in general generic tasks but you can fine tune models for certain workflows (literally how "distillation" works) and you can run them on affordable and available hardware. Just because you don't understand a tool or how to properly use it does not mean someone else doesn't.

[–] flamingos@feddit.uk 0 points 1 day ago (1 children)

Just because you don’t understand a tool or how to properly use it does not mean someone else doesn’t.

You brought up the Kimi model up in a conversation about local models being viable, something that requires 8 Nvidia GB300s as a prerequisite. And I'm sorry I don't follow you're little hobby close enough for you, I did try it and it sucked.

[–] Ptsf@lemmy.world 3 points 1 day ago* (last edited 1 day ago) (1 children)

Kimi k3 can be ran at a cost of $37,900 with Mac studios. It's not a hobby. Cool, glad for you. Tools are tools, I bet you don't own or like an absolute gob of them but it doesn't change their usefulness, and you don't need kimi k3 for everything, I mentioned it specifically because it's comparable to generalized frontier ai models and can be ran locally, but I also stated that you're better off tuning models for your workloads specifically. Jfc why even comment if you're gonna be so dumb and selective with your reading?

[–] flamingos@feddit.uk 0 points 1 day ago (1 children)

I bet you don’t own or like an absolute gob of them but it doesn’t change their usefulness

I was commenting based on my experience with this stuff, it was a lot of work to set up and the results I got were bad. I never even contended that it could be useful (but I'm reading selectively), I said you that you need decent hardware for it to be useable. I have an RX 6800 XT and 32GB of RAM and it was really slow, even with recommended models.

Jfc why even comment if you’re gonna be so dumb and selective with your reading?

I tried to engage in good faith, and you proceeded to call me an idiot, sorry I reacted poorly to you being rude. You get what you put in.

[–] Ptsf@lemmy.world 0 points 1 day ago (1 children)

Nah brother I'm not even going to continue giving you my time. You called my science and field a hobby, you questioned my reasoning when it was already presented, and you did not approach in good faith, you approached with preconceived notions, prejudice, and shit opinions based on your bad configs. I don't owe you shit.

[–] flamingos@feddit.uk -1 points 1 day ago

Lol, when did I disagree with your reasoning? At most we disagree on the meaning of 'local model'. Have a nice rest of your night, sister.