this post was submitted on 02 May 2026
2 points (57.1% liked)

Free Open-Source Artificial Intelligence

4672 readers
10 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 2 years ago
MODERATORS
 

LLM’s are not the end all be all. What other AI tech are you all using? Something generative? Something else?

top 8 comments
sorted by: hot top controversial new old
[–] surewhynotlem@lemmy.world 3 points 1 week ago (1 children)

Agents. And finding sane ways to run them safely.

[–] venusaur@lemmy.world 1 points 1 week ago (1 children)

Yeah big move towards agents. They’re based on LLM’s, no?

[–] surewhynotlem@lemmy.world 1 points 1 week ago

Yeah. Basically there like giving an LLM a set of tools it can use on its own. It's a lot like having an intern at a company. You don't give them access to anything you don't want destroyed. But you can give them simple/safe buttons to push.

[–] iceberg314@slrpnk.net 3 points 1 week ago (1 children)

It's kinda fun to poke around with image and video generation using ComfyUI. There's all sorts of models, LORAs, and setting to tune and play with

[–] venusaur@lemmy.world 0 points 1 week ago (1 children)

I want to but I don’t think I have the hardware to support it. Need at least a decent GPU, right?

[–] N0tTr0xy@lemmy.dbzer0.com -1 points 1 day ago (1 children)

For playing around, no. My GPU is 9 years old and has 8GB VRAM. I generating my 384x512 profile picture with KoboldCPP (Vulkan) and Z-Image-Turbo model locally.

I just regenerated my profile picture with KoboldCPP a bit differently. I used some clearer LoRA configurations than I did initially. For Z-Image-Turbo it’s CFG 4 and for Flux2 Klein 4b CFG 1, both used Euler. For Anime V1 LoRA I started with anime illustrious, and for Koni Animestyle LoRA with anime_style, . :

384×512 & Z-Image-Turbo & Anime V1 & 8 steps (2min 42s):

384×512 & Z-Image-Turbo × Anime V1 & 25 steps (8min 16s):

384x512 × Flux2 Klein 4b × Koni Animestyle × 4 steps (22s):

384x512 × Flux2 Klein 4b × Koni Animestyle × 8 steps (35s):

384x512 × Flux2 Klein 4b × Koni Animestyle × 25 steps (1min 28s):

Upscaling it with RealESRGAN x4plus anime 6B upscaler only takes 10 seconds longer with this dimension.


KoboldCPP outputs how long generation takes like:

[11:09:15] Generating Image (8 steps)
  |==================================================| 480/480 - 0.00MB/s
  |==================================================| 480/480 - 0.00MB/s
  |==================================================| 480/480 - 810.94MB/s
  |==================================================| 480/480 - 0.00MB/s
  |==================================================| 8/8 - 19.64s/it
[11:11:57] Generating Media Complete
[–] venusaur@lemmy.world 0 points 20 hours ago (1 children)

Those are pretty good results! Unfortunately, I don’t have a GPU at all yet. Any recommendations on something capable yet affordable? What would you buy next?

[–] N0tTr0xy@lemmy.dbzer0.com 1 points 18 hours ago* (last edited 17 hours ago)

I stick to what I have as long as it continues to work for me, therefore I haven’t looked into GPUs the last years. New Radeon RX 580 is still at 200€, I paid 300€ 8 years ago. Looks like RX 580 2048SP 8GB is actually one of the cheapest one can get currently, but not entirely sure. (My GPU has 2304 shading units.) It’s so old that ROCm support was dropped and you really need software that can do AI via Vulkan

edit: looks like Intel Arc A750 is 5 years younger, has better performance and more memory bandwidth