22
homelab upgrade recommendations
(sh.itjust.works)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 13 Nov 2024
22 points (92.3% liked)
Selfhosted
40247 readers
673 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 1 year ago
MODERATORS
This is basically my homelab. Synology 1618 + 3x Lenovo M920Q systems with 1TB names. I upgraded to a 10gb fibre switch so they run Proxmox + Ceph, with the Synology offering additional fibre storage with the add on 10gb fibre card.
That's probably a few steps up from what the OP is asking for.
Splitting out storage and computer is definitely good first step to increase optimization and increase failure resiliency.
I’m interested in how you like Ceph.
My setup is similar, using a DS1522+ volume as shared block storage for an iSCSI SAN for three Proxmox nodes. Two nodes are micro PCs and the third is running on the 1522+. There’s a DS216j for backups.
Ceph is... fine. I feel like I don't know it enough to properly maintain it. I only went with 10gbe because I was basically told on a homelab reddit that Ceph will fail in unpredictable ways unless you give it crazy speeds for it's storage and network. And yet, it has perpetually complained about too many placement groups.
Aside from that and the occasional falling over of monitors it's been relatively quiet? I'm tempted to use use the Synology for all the storage and let the 10GbE network be carved up into VM traffic instead. Right now I'm using bonded USB 1GbE copper and it's kind of sketchy.
I maintained a CEPH cluster a few years back. I can verify that speeds under 10GbE will cause a lot of weird issues. Ideally, you'll even want a dedicated 10GbE purely for CEPH to do its automatic maintenance stuff and not impact storage clients.
The PGs is a separate issue. Each PG is like a disk partition. There's some funky math and guidelines to calculate the ideal number for each pool, based upon disks, OSDs, capacity, replicas, etc. Basically, more PGs means that there are more (but smaller) places for CEPH to store data. This means that balancing over a larger number of nodes and drives is easier. It also means that there's more metadata to track. So, really, it's a bit of a balancing act.
Exactly why I've been considering doing it this way for my new setup! I had to leave my last one on the other side of the planet and have felt positively cramped with just a couple TB worth of internal drives, can't wait to properly spread out again.
Any idea what your power consumption is for the 1618? I currently have a 720, but with only two drives it's kind of limiting for HDD upgrades.
Unfortunately, no - not specifically. I want to get a kilawatt monitor at one point. The best I can do is share my UPS's reported power output - currently at around 202-216W, but that includes both my DS1618 and the DS415+ along with my Ubiquiti NVR and two of my Lenovo M920Qs.
I should probably look at what adding the 5 bay external expansion would take power wise and maybe decommission the very aged 415
If you're running home assistant, you can put some inline power monitoring plugs in. I like the thirdreality ones, cause you can set them to "default on" or "default off" after power failure and run it as a zigbee local network without requiring internet access.
Oof, that's a lot of juice.
I'm running a UPS, Syno720+, old gaming laptop as a portainer host, my wifi, router, cable modem, and switches, and that's only using about 50w for everything. Pretty sure the Synology is using the bulk of that power, but I don't have data to back that up.
I'd like to upgrade a few things, but I'm really trying to keep it below 75w. Ideally below 50w if I can. I think my old laptop is good for now, just want more flexibility in my NAS if I can do it without bumping up the power budget.
To be fair - both synologies are running big spinny NAS drives - I could reduce my capacity and my power usage by going with SSDs, but shockingly, I can't seem to figure out what to cull in the 35TB combined storage.
I am debating moving my Vault cluster from a Clusterhat to pods on my fresh kubes deployment - and if I virtualize Pihole, that would also reduce some power consumption. Admittedly, I'm going overboard on my "homelab" - it's more of a full blown SMB at this point with Palo firewall and brocade 48p switch. I do infosec for a living though, and there's reason to most of my madness.