I consolidated my setup a bit. This is my local LLM hosting server. I took a gamble on a Chinese NVLink SXM2 mezzanine board from ebay, it was surprisingly plug and play for my dual 16GB v100s ๐. I'm also running a Tesla P40 that I repasted with liquid metal that sits at 24C idle ๐ฅถ.
I had a similar goal with Hermes, but ended up splitting the context between separate profiles instead of teaching one agent everything. They share a Kanban board, while important decisions still come back to me.
It may be overkill for a homelab, but the profile isolation has worked better than I expected. I documented the setup here: https://github.com/nohuman-labs/agent-company
From the first photo I thought this was an earthquake simulator with models of skyscrapers
๐ I can see how it looks that way lol
Nice, dude. Love anyone who learns by doing.
It's been a fascinating experience so far and I feel like I'm only touching the surface. I'm exploring some of the various memory harnesses to hook into Hermes Agent and see how it learns with extended use.
Thatโs great! But Iโm even more curious about the green device in the background of the first pic ๐ Whatโs that?
It's an older version of a heatset insert fixture. I used it to put threaded brass inserts into my 3d prints instead of trying to capture a nut or screwing directly into plastic.
https://www.printables.com/model/609644-stealth-press-1-heat-set-insert-press-legacy
Thatโs interesting. Thanks!
What kind of model and space limitations are you under with v100s?
Some of the most interesting computer music Iโve heard in years was composed on them but idk if itโs worth getting into a whole new generation of hardware if it can only really do that.
This looks amazing. Did you make it with a CNC machine? Are you planning to add an enclosure? I think it would look even better with one.
Thank you! I actually 3D printed these. I couldn't get my qidi ifast to play nicely with my generic ABS filament, so I sliced them in half and printed them in PLA on my prusa mini. They're joined in the middle with a keyed lock on the top and bottom and 8x 12mm M3 bolts
