Home Assistant

This is an automated archive made by the Lemmit Bot.

The original was posted on /r/homeassistant by /u/TheOriginalOnee on 2026-07-13 17:11:28+00:00.

I’ve been using Gemma 4 12B directly for speech recognition on 16G VRAM and it’s surprisingly fast and accurate across multiple languages. That means you don’t necessarily need to keep a separate Whisper (or other STT) model in VRAM.

Bonus: Since it’s multimodal anyway, you can also use the same model for vision tasks like analyzing security camera snapshots.

So instead of running:

• LLM

• STT (Whisper)

• Vision model

…you can often get away with just Gemma 4 for all three. On limited GPUs, that’s a pretty nice VRAM and maintenance win.

Curious if anyone else has switched to this setup and how it’s working for you.