this post was submitted on 03 Oct 2025
541 points (97.2% liked)

Selfhosted

51995 readers
997 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

You might not even like rsync. Yeah it's old. Yeah it's slow. But if you're working with Linux you're going to need to know it.

In this video I walk through my favorite everyday flags for rsync.

Support the channel:
https://patreon.com/VeronicaExplains
https://ko-fi.com/VeronicaExplains
https://thestopbits.bandcamp.com/

Here's a companion blog post, where I cover a bit more detail: https://vkc.sh/everyday-rsync

Also, @BreadOnPenguins made an awesome rsync video and you should check it out: https://www.youtube.com/watch?v=eifQI5uD6VQ

Lastly, I left out all of the ssh setup stuff because I made a video about that and the blog post goes into a smidge more detail. If you want to see a video covering the basics of using SSH, I made one a few years ago and it's still pretty good: https://www.youtube.com/watch?v=3FKsdbjzBcc

Chapters:
1:18 Invoking rsync
4:05 The --delete flag for rsync
5:30 Compression flag: -z
6:02 Using tmux and rsync together
6:30 but Veronica... why not use (insert shiny object here)

top 50 comments
sorted by: hot top controversial new old
[–] MangoPenguin@lemmy.blahaj.zone 3 points 6 hours ago (2 children)

Surely restic or borg would be better for backups?

Rsync can send files and not delete stuff, but there's no versioning or retention settings.

[–] chronicledmonocle@lemmy.world 2 points 5 hours ago (1 children)

If you add --delete-before, it absolutely can delete stuff.

[–] MangoPenguin@lemmy.blahaj.zone 1 points 5 hours ago

Yeah but then it's not really a good backup!

[–] sugar_in_your_tea@sh.itjust.works 0 points 5 hours ago* (last edited 5 hours ago) (1 children)

For versioning/retention, just use snapshots in whatever filesystem you're using (you are using a proper filesystem like ZFS or BTRFS, right?).

[–] MangoPenguin@lemmy.blahaj.zone 1 points 2 hours ago (1 children)

How does that get sent over rsync though? Wouldn't you need snapshots on the remote destination server?

Why not just use a backup utility instead?

[–] sugar_in_your_tea@sh.itjust.works 1 points 1 hour ago (1 children)

Yes, async copies files to the remote server, the remote server takes regular snapshots.

Why not just use a backup utility instead?

What is that utility providing that snapshots + rsync doesn't. If rsync + snapshots is sufficient, why overcomplicate it with a backup utility?

[–] MangoPenguin@lemmy.blahaj.zone 1 points 52 minutes ago

The main things that come to mind are you have to test/monitor 2 seperate actions instead of 1, and restores of single files could be more difficult since you need to login to the backup server, restore the file from a snapshot, then also copy that file back to your PC.

[–] state_electrician@discuss.tchncs.de 29 points 14 hours ago (5 children)

Why videos? I feel like an old man yelling at clouds every time something that sounds interesting is presented in a fucking video. Videos are so damn awful. They take time, I need audio and I can't copy&paste. Why have they become the default for things that should've been a blog post?

[–] czardestructo@lemmy.world 10 points 10 hours ago

Thank you for putting into words what ive subconsciously been thinking for years. Every search result prioritizes videos at the top and I'm still annoyed every time. Or even worst I have to hunt through a 10 minute video for the 30 seconds of info I needed. Stoohhhhpppp internet of new! Make it good again!

[–] vga@sopuli.xyz 8 points 11 hours ago (1 children)

Blogs can have ads.

[–] Wawe@lemmy.world 9 points 13 hours ago* (last edited 13 hours ago)

They linked blog post with the video: https://vkc.sh/everyday-rsync/

[–] kchr@lemmy.sdf.org 4 points 11 hours ago

Hear hear. Knowledge should be communicated in an easily shareable way that can also be archived as easily, in contrast to a video requiring hundreds of MB:s.

[–] northernlights@lemmy.today 2 points 14 hours ago

Especially for a command line tool

[–] victorz@lemmy.world 0 points 5 hours ago (1 children)

But if you're working with Linux you're going to need to know it.

Nope. I never have needed to know it. I only ever used it because I was either curious to know how to use it or because it was more convenient than other solutions. But scp is basically just as convenient.

[–] sugar_in_your_tea@sh.itjust.works 1 points 5 hours ago (1 children)

It doesn't do diffs, so it's really bad if there's a lot of duplicate data.

[–] victorz@lemmy.world 1 points 1 hour ago* (last edited 1 hour ago) (1 children)

If you want to use it for backups, there are other solutions, so you still don't need to use it or know it. You can use something else. That's my only point. 🤷‍♂️

And "really bad" is all relative. If you are only backing up your home drive with documents or whatever, copying a few unnecessary gigabytes over a LAN connection isn't too bad at all. But scp isn't what you should be using for backups anyway. I only used rsync for file transfer...

I use rsync for all kinda of things:

  • deploying static files to a public webserver (blog or whatever)
  • backups - scheduled systems/cron task w/ SSH key
  • copying stuff from a USB drive

I only really use scp if the system doesn't already have rsync.

[–] vga@sopuli.xyz 4 points 11 hours ago* (last edited 11 hours ago) (2 children)

It's not bad if you don't need historical backups. I kinda think I do, so I use https://github.com/rustic-rs/rustic becase rust

Restic is probably a better choice if you're not a rust-freak like me.

[–] harambe69@lemmy.dbzer0.com 4 points 10 hours ago

Rustic scares me. I will 100% forget what tool I used to backup after 5 years and be unable to recover my files.

[–] WolfLink@sh.itjust.works 3 points 10 hours ago (1 children)

I use rsync + ZFS for backups which includes historical backups

Yup, just configure a snapshot policy and you can recover deleted and modified files going back as long as you choose. And it is probably more space efficient than both/restic too.

[–] 1984@lemmy.today 7 points 14 hours ago* (last edited 14 hours ago) (1 children)

I never thought of it as slow. More like very reliable. I dont need my data to move fast, I need it to be copied with 100% reliability.

And not waste time copying duplicate data. And for the typical home user, it's probably mo slower than other options.

[–] Wispy2891@lemmy.world 1 points 10 hours ago (1 children)

I tried to use it via tailscale but it disconnects very easily - is to be expected?

[–] offspec@lemmy.world 3 points 5 hours ago (1 children)

I would not expect rsync to have frequent disconnects, no.

[–] Wispy2891@lemmy.world 1 points 3 hours ago

If I connect to the same server via my own VPN I don't have the disconnections, so I'm thinking it's tailscale cutting connections after too much traffic. But connecting via tailscale is so much more convenient 😢

[–] clif@lemmy.world 15 points 1 day ago

I'll never not upvote Veronica Explains. Excellent creator and excellent info on everything I've seen.

[–] atk007@lemmy.world 23 points 1 day ago (2 children)

Rsnapshot. It uses rsync, but provides snapshot management and multiple backup versioning.

[–] Tja@programming.dev 13 points 1 day ago (3 children)

Yes, but a few hours writing my own scripts will save me from several minutes of reading its documentation...

load more comments (3 replies)
load more comments (1 replies)
[–] TheWilliamist@lemmy.world 5 points 1 day ago* (last edited 1 day ago) (1 children)

I still prefer tar for quick and dirty same box copies.

tar cf - * | (cd /target; tar xfp -)

Why not just cp?

[–] Appoxo@lemmy.dbzer0.com 5 points 1 day ago

Veeam for image/block based backups of Windows, Linux and VMs.
syncthing for syncing smaller files across devices.

Thank you very much.

load more comments
view more: next ›