this post was submitted on 03 Jun 2026
-3 points (42.1% liked)

Self-hosting

4566 readers
2 users here now

Hosting your own services. Preferably at home and on low-power or shared hardware.

Please don't share vibe coded projects here.

Also check out:

founded 4 years ago
MODERATORS
poVoq@slrpnk.net
sam_uk@slrpnk.net
-3
FitMyLLM — Independent benchmarks for self-hosted AI (www.fitmyllm.com)
submitted 2 months ago by anzo@programming.dev to c/selfhosting@slrpnk.net
1 comments fedilink hide all child comments
 

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

you are viewing a single comment's thread
view the rest of the comments