this post was submitted on 01 May 2026
10 points (100.0% liked)
Technology
1420 readers
20 users here now
A tech news sub for communists
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The 4-bit quantized GGUF for granite 4.1 is sub 5GB, so it's probably going to run on any modern machine even if it's not particularly built for Vram... 6 gigs is what I had on my old 1080 gpu.
https://huggingface.co/unsloth/granite-4.1-8b-GGUF/tree/main
๐