Linux
Welcome to c/linux!
Welcome to our thriving Linux community! Whether you're a seasoned Linux enthusiast or just starting your journey, we're excited to have you here. Explore, learn, and collaborate with like-minded individuals who share a passion for open-source software and the endless possibilities it offers. Together, let's dive into the world of Linux and embrace the power of freedom, customization, and innovation. Enjoy your stay and feel free to join the vibrant discussions that await you!
Rules:
-
Stay on topic: Posts and discussions should be related to Linux, open source software, and related technologies.
-
Be respectful: Treat fellow community members with respect and courtesy.
-
Quality over quantity: Share informative and thought-provoking content.
-
No spam or self-promotion: Avoid excessive self-promotion or spamming.
-
No NSFW adult content
-
Follow general lemmy guidelines.
view the rest of the comments
I have used Open-whisper and Fast-whisper to do subtitles.
Open whisper is easy to set up and install locally. I tried various models.
Recently I tried to do the French series En Therapie (In Therapy) which has 35 short episodes.
https://www.arte.tv/fr/videos/RC-020578/en-therapie/
Each episode is only 20 minutes long, so I thought that open whisper would be great to translate from French to English.
However. It failed dismally. Constant, regurgitation of repeated sentences. Throughout entire episodes open whisper used "him" instead of "her" and many other instances of misspelling. It would fail if there was music playing in the background.
I extracted the audio from the videos into small .wav format and .mp3 format but both failed.
I spent over a week trying to create suitable subtitles to no avail.
Check out Voxtral Mini or Small if you have the GPU for it. It works really well on English but it comes from French company so I would be surprised if French doesn't work well as well.
https://huggingface.co/mistralai/Voxtral-Mini-3B-2507
https://huggingface.co/mistralai/Voxtral-Small-24B-2507
Thank you Domi