Linux Prepper podcast

91 readers

9 users here now

See rules. Enjoy this experimental place to share content related to Linux Prepper podcast, which is also selfhosted to follow on the fediverse through Castopod as @linuxprepper@podcast.james.network

You may also use our discussion forum directly or join our chat on Matrix for Linux Prepper & Living Cartoon Company.

founded 4 months ago

MODERATORS

kiol@discuss.online

What steps can be taken to prevent AI training and scraping of my public facing website? (discuss.online)

submitted 3 months ago by kiol@discuss.online to c/linuxprepperpodcast@discuss.online

2 comments fedilink hide all child comments

I realize my options are limited, but what about any robots.txt style steps? Thanks for any suggestions.

you are viewing a single comment's thread
view the rest of the comments

[–] ShellMonkey@piefed.socdojo.com 5 points 3 months ago

A robots txt with a bunch of scraper user agents is a start, but there's no guarantee they honor it. A firewall with some dynamic lists of known scanners and scrapers is a bit more forceful method.