Ceph (rbd,s3) on 4 poweredges.
Nomad, Consul servers running in a 3 node raft on some ARM SBCs.
Nomad clients on 2 poweredges and 3 arm SBCs running:
- s3 CSI (media and large file storage is all on s3)
- rbd CSI (all the stateful jobs have rbd block devices)
- NATS cluster with Jetstream to enable MQTT support
- mosquito mqtt (had to run mosquito for mqtt v5)
- mosquito<->nats bridge (via benthos)
- nodered (just for easy Google home integration)
- zwavejs2mqtt
- zigbee2mqtt
- frigate (can only talk mqtt v5 so had to run mosquito just for this)
- grafana
- gotify
- gitea
- drone CI
- postgresql
- BitTorrent client
- ceph rgw s3 gateways
- NATS based home automation lambdas - I wrote these in go
- Adguard home
- traefik as main ingress
- Prometheus
- prom node exporter
- jellyfin
- jackett
- a program I wrote that manages torznab->acquisiton->s3 lifecycle
- a website
- wireguard servers
And that is just in the server room - I also have more like the 3d printer and CNC machine controllers etc.