this post was submitted on 31 Oct 2025
87 points (98.9% liked)
askchapo
23164 readers
86 users here now
Ask Hexbear is the place to ask and answer ~~thought-provoking~~ questions.
Rules:
-
Posts must ask a question.
-
If the question asked is serious, answer seriously.
-
Questions where you want to learn more about socialism are allowed, but questions in bad faith are not.
-
Try !feedback@hexbear.net if you're having questions about regarding moderation, site policy, the site itself, development, volunteering or the mod team.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You and another commenter have good points about rhe bigger models ans how many prompts users hit them with. I think its dimishing returns after about 8 billion parameters and you can run those ones on old hardware. My home server is a 10 year old desktop. It cost $200 bucks to buy used last year and i didnt notice the energy costs. Me and my wife try to use it for any thing wed use an online one for instead. Probably only gets prompted about 10 times a week between the two of us.
๐ค I actually have a energy meter thing i could plug the the server into. I could do 100 prompts and tell you how much energy it ate for the day. Anybody interested?
yea do it
You got it dude. Feel free to ping me if i forget to respond. Im a very forgetful comrade ๐ซก
me catching up on my inbox
Oh yeah! ... somewhere in the many drawers of gadgets and gizmos there is a Kill-A-Watt meter in my house that I was wanting to use for a project...
You got drawers for your gadgets and gizmos? I'm jealous all I got our unsorted canvas bins lmao.
Too many mice and rats around to trust canvas bins.