this post was submitted on 26 Jul 2026
213 points (98.6% liked)

Technology

86649 readers
2530 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 3 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
213
If open weight models are the future, U.S. AI companies are going to have a hard time (www.fastcompany.com)
submitted 1 day ago by sanitation@lemmy.today to c/technology@lemmy.world
84 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose@lemmy.world 1 points 1 day ago* (last edited 1 day ago) (1 children)

You want this one:

https://huggingface.co/turboderp/Qwen3.6-27B-exl3_3.30bpw/tree/main

Or maybe the 3.5bpw one if you don’t mind less context, or 3bpw if you need more:

https://huggingface.co/turboderp/Qwen3.6-27B-exl3

For faster inference at the cost of a little more VRAM usage:

https://huggingface.co/turboderp/Qwen3.6-27B-DFlash-exl3

And you run those in:

https://github.com/theroyallab/tabbyAPI

And FYI, if you have 64GB of RAM or more, you might consider hybrid inference instead.

[–] Asafum@lemmy.world 2 points 1 day ago

Thank you for all the links! Much appreciated :)