datahoarder

10406 readers

2 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 6 years ago

MODERATORS

archivist@lemmy.ml

Suggest Backup software configed per directory with .ignore file like Kopia ? Save exclude's metadata. Use as FileChangeTracker / File History. (lemmy.ml)

submitted 2 weeks ago* (last edited 2 weeks ago) by tdTrX@lemmy.ml to c/datahoarder@lemmy.ml

1 comments fedilink hide all child comments

These software have option to config directory using .ignore file

Kopia - .kopiaignore
Restic (hard to use)

--exclude-file
Ignore File: create a custom text file e.g., excludes.txt
.exclude_me supports --exclude-if-present, which lets you skip any directory containing a specific file, such as .exclude_me.
Uses gitignore-style syntax
wrapper like Restatic - crawls directories before Restic starts and looks for .restaticignore files. It merges all those local files into one big exclude list and passes it to Restic automatically.

Duplicacy .duplicacy

https://github.com/gilbertchen/duplicacy/wiki/set

~While the official binary uses .duplicacy/filters, many users use scripts to generate that filter file by scanning for .cvsignore or custom ignore files in subdirectories.~
~https://forum.duplicacy.com/t/filters-include-exclude-patterns/1089/23~
~https://github.com/TheBestPessimist/duplicacy-utils~
~https://github.com/markfeit/duplicacy-scripts~
~https://github.com/gilbertchen/duplicacy/issues/337~
~https://forum.duplicacy.com/tag/filters~

~~Rclone~~ ~~(Only ignores no option to config)~~

--exclude-if-present .rcloneignore (any name)
Global --exclude-from list.txt

Why is it only recommended for "Large-scale cloud copies" and "Google Drive/Dropbox/S3"?

~~Borg~~ ~~(Only ignores no option to config) .borgignore~~

~~FreeFileSync~~ ~~(Maybe global only).ffs_gui or .ffs_batch~~

How to set up like this with features -

Forever full backups/DeDuplication - Option Delete changes older than x. Where full-backup is taken once then incremental-s are merged. I have heard terms like, snapshot and CBT but don't understand it.
Save a "Ghost" for excluded data ie only Filename, Metadata and Folder-Structure.
"File Change Tracker" to see summary of what files are moved/deleted/renamed between 2 backups. Like Kopia's https://kopia.io/docs/reference/command-line/common/diff/
"File History" where I see previous version of files on the main disk. Like Kopia's kopia snapshot list <filename>

To Backup

External and Internal Disk (files) to backup,
all separately backup-ed to the same backup disk, .

~~Old Post:~~ ~~https://www.reddit.com/r/DataHoarder/comments/1rzmg67/discussion/_backup/_solution/_comparison/~~

Duplicacy has a -nobackup-file

top 1 comments

sorted by: hot top controversial new old

[–] droolio@feddit.uk 1 points 2 weeks ago

Duplicacy has a -nobackup-file option, documented with the set cmd.

Some of your other info about Duplicacy is very obviously wrong or out-of-date. Stop relying on AI for research. :)