Selfhosted

58887 readers

783 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
No low-effort posts. This is subjective and will largely be determined by the community member reports.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago

MODERATORS

HybridSarcasm@lemmy.world

HybridSarcasm@lemmy.hybridsarcasm.xyz

Self-hosting Upgrade: planning my first 3-node cluster for deployment in a data center (discuss.livingcartoon.org)

submitted 1 day ago by kiol@discuss.online to c/selfhosted@lemmy.world

13 comments fedilink hide all child comments

cross-posted from: https://discuss.online/post/39090314

Full layout on my forum here. Basic idea is 3 thin clients that fit within:

1u space requirement

Possibly adding 2.5gb nic to the pci-e low profile slots of each hp t740 for Ceph shared storage.

Kubernetes and/or Proxmox experiments

Adding some sort of remote management via jetkvm or pikvm or similar.

Additional expansion no doubt needed for connecting to the three nodes.
+----------------------------------------------------------+
|                    CLUSTER TOTALS                        |
+----------------------+-----------------------------------+
| TOTAL CORES          | 12 physical / 24 threads          |
| TOTAL RAM            | 192 GB DDR4                       |
| TOTAL STORAGE        | 1.5 TB NVMe (local only)          |
| TOTAL NODES          | 3                                 |
| TOTAL NICs           | 3–7 (depending on 4-port NIC)     |
| GPU                  | None                              |
| KVM/IPMI             | None                              |
+----------------------------------------------------------+
All suggestions greatly appreciated! Never done this before, but hoping to save myself from the future hassle of having to drive to the data center... would much rather log in on Wireguard and address things by remotely rebooting, etc.

you are viewing a single comment's thread
view the rest of the comments

[–] frongt@lemmy.zip 4 points 1 day ago (7 children)

What's your plan for when you reboot and it doesn't come back up? I strongly recommend having some kind of IPMI and virtual console, whether that's pikvm or whatever. Far too many times I've had a server go down and it's saved me from having to drive down to the datacenter and stand in a loud, frigid room and troubleshoot the issue.

[–] kiol@discuss.online 1 points 1 day ago (2 children)

I thought I listed it in the description, but this is something I'm actively wondering about. A KVM over IP, such as PiKVM, Jetkvm, openkvm that allows access to all 3 nodes and saves future drives to the data center by using a wireguard connection instead. PiKVM + HDMI and USB switch is an option. Recommended option from PiKVM docs is https://www.easycoolav.com/products/ezcoo-hdmi-20-switch-4x1-with-usb-30-kvm-4-port-hdmi-switch-for-4k60hz-hdr-and-audio-breakout

[–] fruitycoder@sh.itjust.works 1 points 22 hours ago

The pikvm and pikvm switch are really fun tbh

[–] femtek@lemmy.blahaj.zone 2 points 1 day ago (2 children)

I really like my Jetkvm, has helped me out.

[–] vinnymac@lemmy.world 2 points 1 day ago (1 children)

Same, I use Jetkvm for this too, has worked great

[–] kiol@discuss.online 1 points 20 hours ago

Are you using it with an HDMI + USB switch or similar?

[–] kiol@discuss.online 1 points 1 day ago (1 children)

Cool, have you tried using it with multiple devices on an hdmi switch?

[–] femtek@lemmy.blahaj.zone 2 points 23 hours ago

I have not but may look into that as I'm thinking of getting 3 small computers to have a kubernetes cluster at home.

load more comments (4 replies)