this post was submitted on 04 Jul 2023
88 points (97.8% liked)

Selfhosted

60543 readers
528 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
ayyy@sh.itjust.works
curbstickle@anarchist.nexus
curbstickle_lw@lemmy.world
88
VMs or containers? (lemmy.world)
submitted 3 years ago by rpn@lemmy.world to c/selfhosted@lemmy.world
75 comments fedilink hide all child comments
 

I'm thinking about starting a self hosting setup, and my first thought was to install k8s (k3s probably) and containerise everything.

But I see most people on here seem to recommend virtualizing everything with proxmox.

What are the benefits of using VMs/proxmox over containers/k8s?

Or really I'm more interested in the reverse, are there reasons not to just run everything with k8s as the base layer? Since it's more relevant to my actual job, I'd lean towards ramping up on k8s unless there's a compelling reason not to.

you are viewing a single comment's thread
view the rest of the comments
[–] klangcola@reddthat.com 4 points 3 years ago (1 children)

Why not both?

Like many others here, I went with Proxmox as the base host. But most of my services are Docker containers , running in a "dockerVM" on top of Proxmox.

Having Proxmox as the base is just so flexible, which is very handy for a homelab.

  • For instance I set up a VM with Wireguard back when Wireguard had only just been merged in to the mainline kernel, without affecting the other
  • You can have separate VM for docker testing, and docker production
  • You can run multiple VMs for multiple Kubernetes hosts, to try it out and get your feet wet without affecting the "production" containers
  • If you get additional servers, you can just migrate those Kubernetes VMs
  • You can run Windows VM should you need, and BSD (and thus pfSense/opensense or TRUE AS)
  • You can run a full graphical environment if you want
  • Proxmox has easy setup for firewalls for each VM
  • I have a VM running a legacy bare metal system (from the same server now running proxmox) that I've been slowly de-commissioning piece by piece
[–] soldersmoker@reddthat.com 1 points 3 years ago (2 children)

What is your system backup solution like? Having it separated seems convenient for that since you can just back up the vm storage somewhere I'm guessing?

[–] mr47@kbin.social 2 points 3 years ago

Not OP, but similar setup (Proxmox with docker on a VM). The VM (plus a few LXCs) are backed up daily using the backup built into Proxmox, and those backups are mirrored to the cloud with rclone.

[–] klangcola@reddthat.com 1 points 3 years ago

Proxmox Backup Server: Incremental de-duplicateed image backups of the whole VM, with possibility of individual file restore. It's like magic

For the legacy bare metal system I have rsnapshots of the data folder (set it up ages ago, and never changed it)

An nginx LXC container has a single static backup of the container, with the nginx config file stored in a git repo