1182
you are viewing a single comment's thread
view the rest of the comments
[-] bdonvr@thelemmy.club 7 points 1 year ago

I was starting to run into that until I moved pict-rs to object storage a few days back.

I gzip the backups, keep one local, upload the rest to Backblaze. The local one gets deleted before the next backup starts.

[-] howdy@thesimplecorner.org 2 points 1 year ago

Oh that's genius, you got any good docs on doing that?

[-] bdonvr@thelemmy.club 2 points 1 year ago

On the backups or the object storage?

[-] bdonvr@thelemmy.club 1 points 1 year ago* (last edited 1 year ago)

For the backups I have these bash scripts (the pict-rs one takes much less time now that I use object storage so the images aren't on the server): https://gist.github.com/bdonvr/5d4e56dadcb29de656368a1cb78cc00e

You can look at rclone's docs on how to hook that into B2 (or wherever you'd like to dump your backups, B2 is jusut cheap). I also set up a crypt in rclone so it encrypts it as it uploads (optional).

Then just put those on cron jobs at different times, I do them every 6 hours. One at :15 and one at :45

Then in B2 I set the bucket to keep files for 10 days.

To migrate to object storage check pict-rs docs here: https://git.asonix.dog/asonix/pict-rs.git#user-content-filesystem-to-object-storage-migration

Took about 20 minutes for me with 30gb of files, but your instance has to be down for it. I use Cloudflare R2 for pict-rs.

[-] howdy@thesimplecorner.org 1 points 1 year ago

Thank you very much. Seriously, that lays it all out perfectly. I was looking at the pict-rs docs for how to switch but then work called... so I really appreciate you taking the time to do this. ๐Ÿ™Œ ๐Ÿพ ๐ŸŽ‰ ๐Ÿฅ‚

[-] bdonvr@thelemmy.club 1 points 1 year ago

No problem

Oh and for those scripts the user needs paswordless sudo and needs to be part of the docker group, or you could add it to root's cron tab. Or maybe a systemd task. (Since the default ansible deploy of lemmy makes the pict-rs volume not readable by a normal system user)

[-] howdy@thesimplecorner.org 1 points 1 year ago* (last edited 1 year ago)

Finally got my stuff moved over to object storage. I really appreciate it. It wasn't hard at all! THANK YOU

this post was submitted on 19 Jul 2023
1182 points (98.9% liked)

Lemmy Shitpost

27164 readers
3168 users here now

Welcome to Lemmy Shitpost. Here you can shitpost to your hearts content.

Anything and everything goes. Memes, Jokes, Vents and Banter. Though we still have to comply with lemmy.world instance rules. So behave!


Rules:

1. Be Respectful


Refrain from using harmful language pertaining to a protected characteristic: e.g. race, gender, sexuality, disability or religion.

Refrain from being argumentative when responding or commenting to posts/replies. Personal attacks are not welcome here.

...


2. No Illegal Content


Content that violates the law. Any post/comment found to be in breach of common law will be removed and given to the authorities if required.

That means:

-No promoting violence/threats against any individuals

-No CSA content or Revenge Porn

-No sharing private/personal information (Doxxing)

...


3. No Spam


Posting the same post, no matter the intent is against the rules.

-If you have posted content, please refrain from re-posting said content within this community.

-Do not spam posts with intent to harass, annoy, bully, advertise, scam or harm this community.

-No posting Scams/Advertisements/Phishing Links/IP Grabbers

-No Bots, Bots will be banned from the community.

...


4. No Porn/ExplicitContent


-Do not post explicit content. Lemmy.World is not the instance for NSFW content.

-Do not post Gore or Shock Content.

...


5. No Enciting Harassment,Brigading, Doxxing or Witch Hunts


-Do not Brigade other Communities

-No calls to action against other communities/users within Lemmy or outside of Lemmy.

-No Witch Hunts against users/communities.

-No content that harasses members within or outside of the community.

...


6. NSFW should be behind NSFW tags.


-Content that is NSFW should be behind NSFW tags.

-Content that might be distressing should be kept behind NSFW tags.

...

If you see content that is a breach of the rules, please flag and report the comment and a moderator will take action where they can.


Also check out:

Partnered Communities:

1.Memes

2.Lemmy Review

3.Mildly Infuriating

4.Lemmy Be Wholesome

5.No Stupid Questions

6.You Should Know

7.Comedy Heaven

8.Credible Defense

9.Ten Forward

10.LinuxMemes (Linux themed memes)


Reach out to

All communities included on the sidebar are to be made in compliance with the instance rules. Striker

founded 2 years ago
MODERATORS